-- Logs begin at Sat 2022-06-04 20:01:18 UTC, end at Sat 2022-06-04 22:16:48 UTC. -- Jun 04 20:41:29.589594 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 04 20:41:29.597193 ncdv-master-1 devstack@n-api.service[121593]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 20:41:29 2022] *** Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: nodename: ncdv-master-1 Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: machine: x86_64 Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: clock source: unix Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: pcre jit disabled Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: detected number of CPU cores: 4 Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: current working directory: / Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: detected binary path: /usr/bin/uwsgi-core Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: your processes number limit is 47680 Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: your memory page size is 4096 bytes Jun 04 20:41:29.599204 ncdv-master-1 devstack@n-api.service[121593]: detected max file descriptor number: 2048 Jun 04 20:41:29.600070 ncdv-master-1 devstack@n-api.service[121593]: lock engine: pthread robust mutexes Jun 04 20:41:29.600070 ncdv-master-1 devstack@n-api.service[121593]: thunder lock: enabled Jun 04 20:41:29.601106 ncdv-master-1 devstack@n-api.service[121593]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 04 20:41:29.601106 ncdv-master-1 devstack@n-api.service[121593]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 20:41:29.648815 ncdv-master-1 devstack@n-api.service[121593]: Python main interpreter initialized at 0x55bced8fa9c0 Jun 04 20:41:29.648815 ncdv-master-1 devstack@n-api.service[121593]: python threads support enabled Jun 04 20:41:29.648815 ncdv-master-1 devstack@n-api.service[121593]: your server socket listen backlog is limited to 100 connections Jun 04 20:41:29.648815 ncdv-master-1 devstack@n-api.service[121593]: your mercy for graceful operations on workers is 90 seconds Jun 04 20:41:29.649413 ncdv-master-1 devstack@n-api.service[121593]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 20:41:29.649413 ncdv-master-1 devstack@n-api.service[121593]: *** Operational MODE: preforking *** Jun 04 20:41:29.649413 ncdv-master-1 devstack@n-api.service[121593]: *** uWSGI is running in multiple interpreter mode *** Jun 04 20:41:29.649975 ncdv-master-1 devstack@n-api.service[121593]: spawned uWSGI master process (pid: 121593) Jun 04 20:41:29.649975 ncdv-master-1 devstack@n-api.service[121593]: spawned uWSGI worker 1 (pid: 121594, cores: 1) Jun 04 20:41:29.649975 ncdv-master-1 devstack@n-api.service[121593]: spawned uWSGI worker 2 (pid: 121595, cores: 1) Jun 04 20:41:29.649975 ncdv-master-1 devstack@n-api.service[121593]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 20:41:29.649690 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 04 20:41:30.948448 ncdv-master-1 devstack@n-api.service[121595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 20:41:30.949803 ncdv-master-1 devstack@n-api.service[121594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 20:41:31.672098 ncdv-master-1 devstack@n-api.service[121594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:41:31.672098 ncdv-master-1 devstack@n-api.service[121594]: from cryptography.utils import int_from_bytes Jun 04 20:41:31.672402 ncdv-master-1 devstack@n-api.service[121594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:41:31.672402 ncdv-master-1 devstack@n-api.service[121594]: from cryptography.utils import int_from_bytes Jun 04 20:41:31.716973 ncdv-master-1 devstack@n-api.service[121595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:41:31.716973 ncdv-master-1 devstack@n-api.service[121595]: from cryptography.utils import int_from_bytes Jun 04 20:41:31.717325 ncdv-master-1 devstack@n-api.service[121595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:41:31.717325 ncdv-master-1 devstack@n-api.service[121595]: from cryptography.utils import int_from_bytes Jun 04 20:41:34.231884 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:41:34.232501 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:41:34.232617 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:41:34.232999 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:41:34.233246 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:41:34.233626 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.233816 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:41:34.234220 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.234295 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:41:34.234384 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.234519 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.234621 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:41:34.234848 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.234950 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:41:34.235150 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.235258 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:41:34.235477 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.235617 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.235822 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.235914 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.236143 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.236247 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.236397 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.236598 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.236697 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.237007 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.237161 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.237423 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.237524 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.237833 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.237933 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.238304 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.238407 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.238486 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.238564 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.238724 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.238815 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.239037 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.239136 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.239359 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.239455 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.239700 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.239937 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.240090 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.240304 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.240437 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.240620 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.240736 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.240920 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.241049 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.241243 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.241367 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.241544 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.241660 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.241857 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.242042 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.242248 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.242435 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.242619 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.242808 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.242995 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.243186 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.243376 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.243570 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.243720 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.243941 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.244091 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.244300 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.244498 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.244647 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.244824 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.245042 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.245246 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.245427 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.245575 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.245789 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.245982 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.246174 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.246174 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.246509 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.246666 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.246821 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.246976 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.247106 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.247238 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.247472 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.247628 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.247752 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.247889 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248011 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248174 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248308 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248430 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248551 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248688 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248829 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.248963 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.249149 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.249300 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.249562 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.249703 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.249827 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.249960 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250095 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250224 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250383 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250557 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250693 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250850 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.250980 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251104 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251238 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251373 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251534 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251677 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251801 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.251935 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252121 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252248 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252407 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252533 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252666 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252792 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.252913 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253043 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253186 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253310 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253437 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253561 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253715 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.253889 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254017 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254146 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254270 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254401 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254553 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254680 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254816 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.254951 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255073 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255196 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255329 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255466 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255649 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255790 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.255916 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.256043 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.256180 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.256308 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.256522 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.256785 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.256931 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257059 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257200 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257335 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257466 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257588 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257713 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.257853 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258015 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258157 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258315 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258446 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258646 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258841 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.258978 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259103 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259226 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259359 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259483 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259736 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259867 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.259999 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.260133 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.260264 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.260387 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.260525 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.260647 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.260841 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.261025 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.261155 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.261506 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.261694 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.261842 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.261972 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262096 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262233 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262367 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262490 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262612 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262742 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.262903 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263038 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263206 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263346 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263477 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263664 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263822 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.263968 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.264109 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.264245 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.264403 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.264536 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.264727 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.264908 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265064 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265194 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265318 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265453 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265576 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265708 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265856 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.265997 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.266200 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.266381 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.266529 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.266668 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.266801 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.266926 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.267056 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.267181 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.267319 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.267455 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.267696 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.267877 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268011 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268148 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268285 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268425 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268557 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268681 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268818 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.268942 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.269139 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.269332 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.269470 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.269604 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.269746 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.269953 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270083 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270217 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270343 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270472 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270603 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270733 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270864 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.270996 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.271128 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.271259 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.271428 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.271609 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.271735 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.271868 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272061 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272241 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272375 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272500 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272719 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272855 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.272979 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273104 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273226 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273348 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273487 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273618 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273749 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.273873 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274019 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274150 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274360 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274543 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274676 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274800 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.274924 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.275060 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.275202 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.275326 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.275486 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.275669 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.275831 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.276328 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.276596 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.277015 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.277258 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.277395 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.277748 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.277899 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:41:34.278073 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.278201 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.278407 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.278545 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.278741 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.278878 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.279059 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.279185 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.279368 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.279496 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.279701 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.279829 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280051 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280186 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280310 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280442 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280607 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280740 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.280913 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.281049 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.281224 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.281349 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.281535 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.281660 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.281893 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282029 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282175 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282313 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282450 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282581 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282749 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.282878 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.283053 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.283187 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.283363 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.283491 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.283701 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.283839 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284012 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284147 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284322 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284448 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284645 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284776 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.284972 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.285106 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.285277 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.285402 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.285596 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.285723 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.285917 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286054 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286222 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286349 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286527 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286654 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286830 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.286965 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.287145 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.287270 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.287456 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.287606 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.287789 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.287929 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.288102 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.288228 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.288408 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.288535 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.288713 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.288858 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289017 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289154 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289321 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289454 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289623 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289749 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.289926 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290050 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290264 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290396 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290520 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290643 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290833 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.290958 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.291141 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.291267 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.291444 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.291650 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.291775 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.291898 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.292127 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.292262 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.292441 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.292567 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.292750 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293033 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293160 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293339 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293476 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293643 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293770 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.293943 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294069 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294250 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294376 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294554 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294690 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294863 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.294989 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.295191 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.295318 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.295490 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.295653 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.295823 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.295951 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.296165 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.296299 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.296423 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.296547 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.296706 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.296843 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297010 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297136 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297311 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297446 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297618 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297752 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.297924 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298051 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298227 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298354 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298551 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298692 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298859 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.298993 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.299159 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.299286 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.299478 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.299707 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.299916 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.300108 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.300330 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.300649 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.300867 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.301064 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.301269 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.301464 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.301662 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.301859 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.302063 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.302271 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.302467 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.302667 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.302864 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.303059 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.303263 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.303459 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.303770 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.303969 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.304182 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.304374 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.304584 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.304778 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.304968 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.305154 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.305352 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.305576 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.305768 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.305973 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.306165 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.306355 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.306537 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.306839 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307012 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307153 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307287 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307410 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307555 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307704 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.307887 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308049 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308202 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308326 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308449 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308586 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308711 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308852 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.308980 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309104 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309236 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309368 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309492 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309615 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309738 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309738 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.309978 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.310110 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.310243 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.310367 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.310488 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.310764 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.310903 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311043 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311171 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311306 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311430 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311669 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311810 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.311935 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312069 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312193 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312318 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312455 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312587 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312711 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312833 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.312956 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313078 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313210 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313343 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313467 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313574 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313704 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.313885 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314014 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314140 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314301 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314485 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314624 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314747 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.314880 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315015 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315148 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315272 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315396 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315547 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315695 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315819 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.315942 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316073 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316196 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316327 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316452 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316575 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316698 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316820 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.316942 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317072 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317196 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317318 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317441 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317564 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317686 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317817 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.317941 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318063 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318194 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318317 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318447 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318564 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318688 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318795 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.318900 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319030 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319153 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319284 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319408 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319547 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319685 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319809 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.319942 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320066 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320188 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320319 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320443 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320578 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320713 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.320917 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321044 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321170 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321294 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321416 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321549 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321701 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.321831 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322006 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322133 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322311 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322448 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322628 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322766 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.322939 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.323066 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.323242 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.323401 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.323732 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.323860 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324043 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324187 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324395 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324521 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324652 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324783 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.324954 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.325082 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.325264 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.325378 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.325574 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.325688 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.325879 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326007 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326193 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326329 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326501 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326626 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326804 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.326941 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.327098 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.327231 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.327405 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.327566 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.327748 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.328009 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.328437 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.328552 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.328661 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.328768 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.328891 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329026 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329151 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329285 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329417 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329526 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329647 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.329779 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330111 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330239 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330362 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330485 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330617 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330742 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.330849 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.331064 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.331389 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.331538 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.331669 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.331822 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332019 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332145 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332318 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332443 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332582 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332728 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332853 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.332975 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333096 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333221 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333354 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333486 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333626 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333751 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.333873 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.334033 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.334234 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.334427 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.334640 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.334840 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.335043 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.335262 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.335465 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.335691 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.335890 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336093 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336224 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336359 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336484 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336616 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336741 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336864 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.336986 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337118 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337242 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337372 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337498 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337611 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337747 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337872 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.337995 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.338117 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.338240 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.338371 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.338505 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.338675 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.338803 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.339033 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.339166 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.339354 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.339675 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.339822 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.340051 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.340186 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.340500 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.340626 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.340827 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.340954 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.341190 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.341408 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.341550 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.341720 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.341857 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.342031 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.342166 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.342339 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.342645 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.342778 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.342955 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.343199 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.343340 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.343572 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.343771 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.343910 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.344105 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.344231 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.344461 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.344602 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.344768 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345001 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345129 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345311 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345440 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345619 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345745 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.345922 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.346072 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.346239 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.346402 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.346539 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.346846 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.346986 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.347179 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.347348 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.347459 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.347597 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.347758 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.347875 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.348059 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.348183 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.348379 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.348506 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.348681 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.348816 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349028 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349156 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349280 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349410 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349592 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349719 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.349892 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350022 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350228 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350365 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350549 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350674 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350851 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.350979 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.351151 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.351381 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.351565 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.351692 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.351830 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.351955 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352080 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352202 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352346 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352482 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352648 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352769 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.352949 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353087 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353250 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353388 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353545 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353672 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353839 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.353971 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.354142 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.354309 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.354460 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.354684 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.354885 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355015 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355130 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355289 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355492 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355721 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355857 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.355983 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.356121 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.356247 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.356383 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.356507 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.356629 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357256 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357400 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357512 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357629 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357629 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357837 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.357943 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.358196 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.358311 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.358500 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.358802 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.358914 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.359111 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.359382 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.359498 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.359729 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.359992 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.360108 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.360360 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.360545 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.360660 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.360950 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.361098 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.361257 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.361562 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.361688 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.361863 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.362168 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.362281 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.362490 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.362621 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.362806 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.362937 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.363110 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.363275 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.363402 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.363729 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.363857 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.364035 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.364336 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.364462 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.364642 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.364900 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.365027 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.365234 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.365471 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.365603 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.365818 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.366041 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.366198 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.366438 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.366613 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.366803 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.367017 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.367212 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.367400 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.367662 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.367778 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.367907 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368047 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368174 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368306 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368422 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368536 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368661 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368797 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.368912 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.369104 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.369219 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.369412 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.369554 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.369713 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.369840 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370019 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370239 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370365 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370483 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370634 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370748 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.370935 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.371052 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.371264 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.371387 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.371657 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.371798 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.371908 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372016 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372186 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372303 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372545 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372668 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372829 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.372959 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.373137 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.373260 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.373494 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.373608 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.373797 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.373912 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.374108 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.374223 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.374412 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.374561 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.374738 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.374900 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.375121 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.375237 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.375566 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.376286 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.376414 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.376414 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.376659 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.376789 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.376789 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377005 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377120 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377229 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377334 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377550 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377671 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.377915 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.378020 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.378225 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.378525 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.378652 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.378827 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.379126 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.379262 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.379452 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.379754 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.379893 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.380076 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.380352 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.380571 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.380710 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.380968 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.381096 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.381423 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.381567 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.381850 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.382036 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.382170 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.382337 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.382686 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.382926 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.383063 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.383237 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.383402 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.383628 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.383790 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.384130 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.384295 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.384868 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.384997 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.385379 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.385521 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.386039 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.386177 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.386545 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.386681 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.386871 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.387090 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.387218 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.387486 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.387691 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.387852 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.388148 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.388283 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.388456 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.388765 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.388893 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.389091 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.389275 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.389412 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.389707 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.389835 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.390151 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.390387 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.390513 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.390757 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.390972 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.391172 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.391482 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.391843 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.392146 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.392275 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.392399 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.392534 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.392665 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.392837 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.393030 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.393157 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.393344 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.393596 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.393722 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.393956 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.394136 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.394265 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.394577 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.394891 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.395018 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.395191 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.395475 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.395631 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.395847 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.396013 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.396159 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.396466 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.396593 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.396894 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.397084 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.397221 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.397514 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.397650 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.397835 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.398164 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.398291 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.398465 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.398734 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.398870 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.399065 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.399252 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.399379 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.399680 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.400004 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.400144 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.400372 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.400601 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.400736 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.401261 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.401618 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.401761 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.402227 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.402628 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.402760 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.402884 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.402998 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.403120 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.403259 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.403383 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.403583 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.403710 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.404036 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.404358 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.404715 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.404844 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.405039 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.405347 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.405496 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.405655 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.405851 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406046 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406176 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406300 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406408 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406575 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406706 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.406876 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.407001 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.407196 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.407448 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.407617 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.407807 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.407906 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.408113 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.408211 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.408495 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.408594 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.408821 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.408909 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.409127 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.409214 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.409441 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.409551 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.409757 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.409845 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410057 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410144 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410359 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410467 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410668 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410761 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.410958 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411050 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411259 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411349 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411589 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411682 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411901 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.411989 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.412201 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.412305 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.412518 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.412626 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.412792 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.412880 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.413122 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.413271 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.413428 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.413597 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.413922 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.414018 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.414233 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.414536 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.414623 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.414847 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.415150 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.415247 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.415497 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.415747 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.415922 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.416147 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.416302 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.416471 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.416795 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.416929 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.417243 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.417480 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.417753 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.417890 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.418014 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.418204 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.418519 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.418653 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.418835 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.419073 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.419203 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.419450 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.419671 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.419797 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.420094 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.420229 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.420404 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.420718 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.420843 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.421031 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.421293 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.421421 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.421878 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.422017 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.422229 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.422472 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.422624 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.422883 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.423060 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.423188 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.423425 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.423679 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.423822 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424133 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424276 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424409 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424534 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424667 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424792 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.424938 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.425255 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.425383 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.425507 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.425645 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.425779 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.425905 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.426029 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.426211 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.426346 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.426533 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.426693 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.426827 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.427073 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.427201 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.427335 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.427460 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.427737 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.427866 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.428175 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.428374 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.428524 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.428823 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.428948 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.429157 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.429283 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.429470 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.429692 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.429829 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.429952 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.430119 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.430253 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.430743 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.431062 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.431191 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.431388 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.431653 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.431783 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.431979 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.432117 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.432297 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.432424 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.432601 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.432755 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433041 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433174 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433299 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433428 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433544 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433678 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.433902 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434036 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434204 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434331 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434503 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434639 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434830 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.434958 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.435133 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.435259 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.435454 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.435643 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.435803 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.436089 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.436243 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.436398 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.436532 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.436697 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.437159 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.437295 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.437420 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.437646 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.437783 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.437966 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.438150 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.438277 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.438477 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.438743 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.438883 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.439053 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.439181 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.439378 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.439549 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.439725 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.439934 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.440103 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.440339 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.440513 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.440640 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.440949 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.441084 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.441261 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.441398 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.441572 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.441699 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.441878 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.442006 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.442188 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.442317 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.442498 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.442634 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.442955 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.443110 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.443397 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.443561 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.443763 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.443892 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.444082 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.444209 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.444392 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.444528 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.444700 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.444836 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445009 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445145 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445316 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445445 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445616 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445772 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.445908 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446032 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446209 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446338 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446516 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446653 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446825 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.446950 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.447127 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.447369 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.447499 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.447704 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.447838 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.447970 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.448095 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.448227 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.448470 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.448587 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.448783 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.449093 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.449228 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.449569 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.449713 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.449884 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450077 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450211 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450385 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450523 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450692 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450819 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.450997 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.451132 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.451307 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.451442 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.451648 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.451786 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.451953 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452080 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452259 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452395 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452574 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452704 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452861 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.452988 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.453161 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.453300 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.453574 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.453701 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.453816 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.453922 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454056 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454181 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454339 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454514 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454646 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454813 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.454990 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.455158 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.455325 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.455490 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.455741 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.456087 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.456242 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.456544 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.456818 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.456818 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.457136 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.457306 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.457758 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.457936 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458125 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458254 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458377 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458510 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458635 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458757 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.458880 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459002 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459002 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459245 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459369 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459500 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459669 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.459859 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.460055 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.460269 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.460468 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.460671 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.460885 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.461091 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.461298 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.461639 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.461858 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.462062 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.462267 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.462465 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.462465 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.462876 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.463087 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.463300 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.463710 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.463956 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.464181 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.464386 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.464573 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.464760 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.464970 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465173 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465380 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465578 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465746 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465872 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465995 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.465995 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.466239 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.466363 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.466497 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.466621 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.466742 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.466873 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467005 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467129 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467252 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467384 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467528 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467783 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.467914 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468038 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468169 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468300 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468433 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468568 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468693 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468817 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.468939 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469062 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469197 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469197 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469430 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469554 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469554 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469775 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.469906 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470029 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470151 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470272 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470396 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470518 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470650 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470650 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.470882 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471004 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471004 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471244 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471368 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471368 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471652 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471775 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.471925 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.472066 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.472251 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.472378 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.472567 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.472705 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.472907 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.473080 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.473207 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.473492 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.473684 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.473816 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.474093 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.474223 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.474404 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.474537 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.474710 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.474847 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.475013 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.475140 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.475357 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.475496 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.475696 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.475825 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.476034 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.476285 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.476479 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.476623 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.476748 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.476919 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.477063 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.477226 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.477352 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.477545 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.477680 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.477922 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478065 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478190 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478315 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478438 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478561 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478720 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.478847 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.479020 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.479146 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.479322 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.479447 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.479731 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.479863 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.480038 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.480267 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.480406 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.480652 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.480786 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.481061 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.481187 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.481373 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.481500 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.481683 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.481810 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482042 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482179 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482303 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482427 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482588 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482723 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.482893 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.483020 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.483196 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.483333 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.483535 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.483666 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.483890 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.484116 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.484256 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.484508 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.484669 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.484821 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.485135 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.485261 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.485441 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.485581 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.485746 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.485872 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486054 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486181 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486360 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486496 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486669 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486796 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.486999 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.487133 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.487307 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.487444 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.487642 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.487770 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488019 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488152 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488302 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488430 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488593 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488720 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.488903 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.489031 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.489216 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.489343 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.489525 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.489652 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.489841 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.490033 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.490174 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.490326 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.490463 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.490642 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.490924 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.491213 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.491347 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.491479 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.491680 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.491923 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.492050 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.492247 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.492570 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.492701 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.492887 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493002 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493198 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493336 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493528 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493664 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493832 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.493966 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.494139 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.494266 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.494453 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.494574 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.494767 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.494894 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.495079 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.495268 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.495547 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.495679 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.495961 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.496098 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.496265 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.496424 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.496572 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.496839 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.496966 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.497154 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.497291 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.497458 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.497589 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.497756 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.497935 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.498158 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.498517 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.498737 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.498942 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.499148 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.499352 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.499599 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.499599 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.499990 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.500181 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.500371 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.500566 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.500778 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.500978 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.501184 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.501388 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.501593 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:41:34.501796 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.501796 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.501796 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.501796 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.502578 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.502578 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.502578 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.503118 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.503118 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.503482 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.503783 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.504021 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.504328 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.504657 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.504962 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.505268 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.505570 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.505875 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.506178 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.506483 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.506809 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.507128 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.507430 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.507796 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.508093 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.508416 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.508729 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.509035 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.509361 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.509665 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.509968 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.510278 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.510580 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.511054 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.511361 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.511819 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.512320 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.512740 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.513184 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.513579 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.513967 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.514380 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.514825 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.515228 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.516257 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.516634 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.517006 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.517369 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:41:34.517663 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:41:34.572942 ncdv-master-1 devstack@n-api.service[121595]: INFO dbcounter [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Registered counter for database nova_api Jun 04 20:41:34.591680 ncdv-master-1 devstack@n-api.service[121594]: INFO dbcounter [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Registered counter for database nova_api Jun 04 20:41:34.601738 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_db.sqlalchemy.engines [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.611591 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writer thread running {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.614917 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_db.sqlalchemy.engines [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.623125 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writer thread running {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.670521 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.context [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=121595) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 20:41:34.675008 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:41:34.676663 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:41:34.677496 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:41:34.679553 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:41:34.682554 ncdv-master-1 devstack@n-api.service[121595]: INFO dbcounter [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Registered counter for database nova_cell0 Jun 04 20:41:34.688392 ncdv-master-1 devstack@n-api.service[121595]: INFO dbcounter [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Registered counter for database nova_cell1 Jun 04 20:41:34.693989 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.context [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=121594) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 20:41:34.697027 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_db.sqlalchemy.engines [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.701894 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_concurrency.lockutils [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:41:34.704205 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_concurrency.lockutils [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:41:34.705113 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_db.sqlalchemy.engines [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.705272 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_concurrency.lockutils [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:41:34.707249 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_concurrency.lockutils [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:41:34.709442 ncdv-master-1 devstack@n-api.service[121594]: INFO dbcounter [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Registered counter for database nova_cell0 Jun 04 20:41:34.712687 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writer thread running {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.714112 ncdv-master-1 devstack@n-api.service[121594]: INFO dbcounter [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Registered counter for database nova_cell1 Jun 04 20:41:34.715659 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writer thread running {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.726201 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_db.sqlalchemy.engines [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.728050 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_db.sqlalchemy.engines [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.737703 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writer thread running {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.746102 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writer thread running {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.874250 ncdv-master-1 devstack@n-api.service[121595]: INFO dbcounter [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Registered counter for database nova_cell0 Jun 04 20:41:34.884575 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_db.sqlalchemy.engines [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.892540 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writer thread running {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:34.903164 ncdv-master-1 devstack@n-api.service[121594]: INFO dbcounter [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Registered counter for database nova_cell0 Jun 04 20:41:34.912337 ncdv-master-1 devstack@n-api.service[121594]: DEBUG oslo_db.sqlalchemy.engines [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:41:34.917513 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writer thread running {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:41:35.407147 ncdv-master-1 devstack@n-api.service[121595]: WARNING keystonemiddleware.auth_token [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:41:35.415074 ncdv-master-1 devstack@n-api.service[121595]: WARNING keystonemiddleware.auth_token [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:41:35.461649 ncdv-master-1 devstack@n-api.service[121594]: WARNING keystonemiddleware.auth_token [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:41:35.475551 ncdv-master-1 devstack@n-api.service[121594]: WARNING keystonemiddleware.auth_token [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:41:35.638075 ncdv-master-1 devstack@n-api.service[121595]: WARNING keystonemiddleware.auth_token [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:41:35.644088 ncdv-master-1 devstack@n-api.service[121595]: WARNING keystonemiddleware.auth_token [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:41:35.649244 ncdv-master-1 devstack@n-api.service[121595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bced8fa9c0 pid: 121595 (default app) Jun 04 20:41:35.652162 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:41:35.653343 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002524 Jun 04 20:41:35.653793 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Sat Jun 4 20:41:35 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:41:35.914634 ncdv-master-1 devstack@n-api.service[121594]: WARNING keystonemiddleware.auth_token [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:41:35.927263 ncdv-master-1 devstack@n-api.service[121594]: WARNING keystonemiddleware.auth_token [None req-d9173f7f-1282-457c-95be-6c96f6aa65cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:41:35.937947 ncdv-master-1 devstack@n-api.service[121594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bced8fa9c0 pid: 121594 (default app) Jun 04 20:42:58.832095 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:42:58.834089 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002574 Jun 04 20:42:58.834677 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:42:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:42:58.848484 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_api:SELECT=3 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:58.849218 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_cell1:SELECT=3 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:58.850087 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_cell0:SELECT=3 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:58.851359 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_cell0:SELECT=3 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:59.288064 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-59419f04-a77e-47f9-a1bf-5191b943513b admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:42:59.318294 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-59419f04-a77e-47f9-a1bf-5191b943513b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475950 Jun 04 20:42:59.327353 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 20:42:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:43:01.808788 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:01.809791 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-c992e3b4-bae6-445f-8056-b3b4c88c0410 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 04 20:43:01.810463 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:01.873664 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-0cb7dcfa-72c4-46a2-9c16-2c281971b573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:01.892860 ncdv-master-1 devstack@n-api.service[121594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:43:01.892860 ncdv-master-1 devstack@n-api.service[121594]: warnings.warn(msg) Jun 04 20:43:01.924527 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-0cb7dcfa-72c4-46a2-9c16-2c281971b573 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107702 Jun 04 20:43:01.925084 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:43:01.939482 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_api:SELECT=3 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:01.940624 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_cell0:SELECT=3 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:01.941710 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_cell1:SELECT=3 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:01.942579 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:02.152653 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-70767b4b-d193-4c27-8474-63b6654e59a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:02.155374 ncdv-master-1 devstack@n-api.service[121595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:43:02.155374 ncdv-master-1 devstack@n-api.service[121595]: warnings.warn(msg) Jun 04 20:43:02.221843 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-70767b4b-d193-4c27-8474-63b6654e59a0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287874 Jun 04 20:43:02.231250 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Jun 4 20:43:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:04.695463 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-0cb7dcfa-72c4-46a2-9c16-2c281971b573 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:04.697117 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-0cb7dcfa-72c4-46a2-9c16-2c281971b573 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Jun 04 20:43:04.698021 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:04.843742 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-b4fddf38-ba5a-4096-96cc-b59b923cd6bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "id": "d1"}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:04.863837 ncdv-master-1 devstack@n-api.service[121595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:43:04.863837 ncdv-master-1 devstack@n-api.service[121595]: warnings.warn(msg) Jun 04 20:43:04.887256 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-b4fddf38-ba5a-4096-96cc-b59b923cd6bd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.183059 Jun 04 20:43:04.888114 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:43:04.902665 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-cfffd9b0-ba19-4e0a-965a-15aaf82e9642 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:04.904553 ncdv-master-1 devstack@n-api.service[121594]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:43:04.904553 ncdv-master-1 devstack@n-api.service[121594]: warnings.warn(msg) Jun 04 20:43:04.947143 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-cfffd9b0-ba19-4e0a-965a-15aaf82e9642 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049021 Jun 04 20:43:04.947876 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Jun 4 20:43:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:07.481323 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-b4fddf38-ba5a-4096-96cc-b59b923cd6bd admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:07.482387 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-b4fddf38-ba5a-4096-96cc-b59b923cd6bd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 04 20:43:07.488634 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:07.560318 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-9e756234-ef32-492b-8708-ed6c032822a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:07.583174 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-9e756234-ef32-492b-8708-ed6c032822a3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093240 Jun 04 20:43:07.584618 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:43:07.597720 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-d05c517c-f190-4b93-9d89-2f8371331890 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:07.631709 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-d05c517c-f190-4b93-9d89-2f8371331890 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037585 Jun 04 20:43:07.635853 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Jun 4 20:43:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:10.300770 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-9e756234-ef32-492b-8708-ed6c032822a3 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:10.302813 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-9e756234-ef32-492b-8708-ed6c032822a3 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002435 Jun 04 20:43:10.309976 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:10.380946 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-4836aad0-9632-4e2b-ba49-e36dbe0a2419 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:10.409029 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-4836aad0-9632-4e2b-ba49-e36dbe0a2419 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097025 Jun 04 20:43:10.423739 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:43:10.425006 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-0cfd7f26-16c8-4bf6-82d2-e7f3123219f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:10.454845 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-0cfd7f26-16c8-4bf6-82d2-e7f3123219f2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034845 Jun 04 20:43:10.455812 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Jun 4 20:43:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:43:13.208813 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-4836aad0-9632-4e2b-ba49-e36dbe0a2419 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:13.209827 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-4836aad0-9632-4e2b-ba49-e36dbe0a2419 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 04 20:43:13.210400 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:13.278092 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-af146a98-8263-4e41-874b-0843c4297513 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "swap": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:13.301290 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-af146a98-8263-4e41-874b-0843c4297513 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083965 Jun 04 20:43:13.302133 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:43:13.314302 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-89d79324-ed02-4a71-89f0-6d482919721f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:13.344034 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-89d79324-ed02-4a71-89f0-6d482919721f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033267 Jun 04 20:43:13.350438 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Sat Jun 4 20:43:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:43:15.839706 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-af146a98-8263-4e41-874b-0843c4297513 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:15.840757 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-af146a98-8263-4e41-874b-0843c4297513 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 04 20:43:15.841157 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:15.901284 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-de8b8e8a-69ba-4ef5-94e0-cc74ffff9c21 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:15.924196 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-de8b8e8a-69ba-4ef5-94e0-cc74ffff9c21 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076666 Jun 04 20:43:15.924723 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 20:43:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:43:18.386400 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-af146a98-8263-4e41-874b-0843c4297513 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:18.387393 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-af146a98-8263-4e41-874b-0843c4297513 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 04 20:43:18.388345 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:18.455165 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-508b48b3-1f90-4345-af8a-26f566f9d36c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:18.476550 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-508b48b3-1f90-4345-af8a-26f566f9d36c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082165 Jun 04 20:43:18.477774 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:43:18.489981 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-11564c5a-a8d1-4634-8bb8-53fcacd8268e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:18.515940 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-11564c5a-a8d1-4634-8bb8-53fcacd8268e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029550 Jun 04 20:43:18.516529 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Jun 4 20:43:18 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:21.018102 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-508b48b3-1f90-4345-af8a-26f566f9d36c admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:21.019119 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-508b48b3-1f90-4345-af8a-26f566f9d36c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 04 20:43:21.019501 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:21.084344 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-0340a439-33d3-4d11-9c36-2ffa3ef35125 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "ram": 2048}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:21.104985 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-0340a439-33d3-4d11-9c36-2ffa3ef35125 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078192 Jun 04 20:43:21.105967 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:43:21.118651 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-b7b19699-165b-437f-9c95-e1eb88ab43a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:21.149220 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-b7b19699-165b-437f-9c95-e1eb88ab43a0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033583 Jun 04 20:43:21.151233 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Jun 4 20:43:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:23.696027 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-0340a439-33d3-4d11-9c36-2ffa3ef35125 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:23.697184 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-0340a439-33d3-4d11-9c36-2ffa3ef35125 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001659 Jun 04 20:43:23.697411 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:23.766336 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-e65735c6-fcaa-4e24-a5ca-43696998eae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "disk": 40}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:23.787715 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-e65735c6-fcaa-4e24-a5ca-43696998eae1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083647 Jun 04 20:43:23.788483 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:43:23.801105 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-b93da125-cee0-457f-b81f-20c2807c4180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:23.826528 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-b93da125-cee0-457f-b81f-20c2807c4180 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029229 Jun 04 20:43:23.827141 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Jun 4 20:43:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:26.458826 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-e65735c6-fcaa-4e24-a5ca-43696998eae1 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:26.459937 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-e65735c6-fcaa-4e24-a5ca-43696998eae1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Jun 04 20:43:26.460587 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:26.528382 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-21f6bb7c-9af1-4ff8-bec4-806cf1e87fd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "name": "m1.large"}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:26.550609 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-21f6bb7c-9af1-4ff8-bec4-806cf1e87fd0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083554 Jun 04 20:43:26.551616 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:43:26.564294 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-41deedbd-c032-4f46-a6e6-eeeab1c66f9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:26.605105 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-41deedbd-c032-4f46-a6e6-eeeab1c66f9e admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044693 Jun 04 20:43:26.605724 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Jun 4 20:43:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:29.087659 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-21f6bb7c-9af1-4ff8-bec4-806cf1e87fd0 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:29.088695 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-21f6bb7c-9af1-4ff8-bec4-806cf1e87fd0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jun 04 20:43:29.089097 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:29.161747 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-8fafd4d6-ad39-4879-ad47-09d4800f0029 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "ram": 16384}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:29.184599 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-8fafd4d6-ad39-4879-ad47-09d4800f0029 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089002 Jun 04 20:43:29.185267 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Sat Jun 4 20:43:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:43:29.198602 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-bc489ecd-870d-4281-ac4a-e6c48699a7ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:43:29.202437 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:29.229552 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-bc489ecd-870d-4281-ac4a-e6c48699a7ce admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035763 Jun 04 20:43:29.230151 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Sat Jun 4 20:43:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:43:57.064314 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-8fafd4d6-ad39-4879-ad47-09d4800f0029 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:57.065317 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-8fafd4d6-ad39-4879-ad47-09d4800f0029 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jun 04 20:43:57.065732 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:57.080011 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:57.138851 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-7b363ae4-2d0d-4bb2-90a3-c6dc76d73c72 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:57.158026 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-7b363ae4-2d0d-4bb2-90a3-c6dc76d73c72 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.085546 Jun 04 20:43:57.158569 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 20:43:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:43:58.206691 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-8fafd4d6-ad39-4879-ad47-09d4800f0029 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:58.207740 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-8fafd4d6-ad39-4879-ad47-09d4800f0029 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 04 20:43:58.208168 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:43:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:58.439539 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-25346963-5d5c-4e75-a77c-eac926b028fb admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:58.446116 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.wsgi [None req-25346963-5d5c-4e75-a77c-eac926b028fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-25346963-5d5c-4e75-a77c-eac926b028fb admin admin] Request method failure captured: Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Accept: application/json Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Accept-Encoding: gzip, deflate Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Connection: keep-alive Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Content-Length: 0 Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Host: 10.222.0.18 Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Openstack-Api-Version: compute 2.90 Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: Openstack-System-Scope: None Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: User-Agent: python-novaclient Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Auth-Token: gAAAAABim8QOXbCNi8e_RTarfQu2wlRB6LJW2tBMcJiDFl4yXRffUrtt7Mx0HqHzDdPj4RzR5DeMMaYpbIsA7O3m5YIN4cSSzbrfvFR0Ki9Iu-zptjETqJdnVXrBYlvPtfElLqVRmzwl9pNfrhEIiMIE8JA1vd0zm7NdZM4QvLeV55nsgWJbWzc Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Domain-Id: None Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Domain-Name: None Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Identity-Status: Confirmed Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Is-Admin-Project: True Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Domain-Id: default Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Domain-Name: Default Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Name: admin Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Role: member,admin,reader Jun 04 20:43:58.456007 ncdv-master-1 devstack@n-api.service[121594]: X-Roles: member,admin,reader Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598115c278dc4440816e2bfd4030f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598115c278dc4440816e2bfd4030f050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant: admin Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant-Name: admin Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-User: admin Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-User-Domain-Id: default Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-User-Domain-Name: Default Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-User-Id: 6a435d18d74943c3a8e7cee442315d79 Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: X-User-Name: admin Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: method: > Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: exception: Flavor 42 could not be found. Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: action_args: {'id': '42'} Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:43:58.457684 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:58.458814 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.460382 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-25346963-5d5c-4e75-a77c-eac926b028fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:43:58.461639 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-25346963-5d5c-4e75-a77c-eac926b028fb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.075083 Jun 04 20:43:58.461639 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:43:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:58.467823 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-f2867202-e16b-468e-ab0d-aaa3b2d05675 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:58.470916 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:58.492726 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-f2867202-e16b-468e-ab0d-aaa3b2d05675 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028504 Jun 04 20:43:58.493313 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:43:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:43:58.505743 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-df68772d-422b-4bd1-8793-fd91549ede80 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:58.528490 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-df68772d-422b-4bd1-8793-fd91549ede80 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026424 Jun 04 20:43:58.529040 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:43:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:43:58.540214 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-7686209a-b552-47ec-b953-ff8095034aae admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:58.547632 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.wsgi [None req-7686209a-b552-47ec-b953-ff8095034aae admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-7686209a-b552-47ec-b953-ff8095034aae admin admin] Request method failure captured: Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Accept: application/json Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Accept-Encoding: gzip, deflate Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Connection: keep-alive Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Content-Length: 0 Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Host: 10.222.0.18 Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Openstack-Api-Version: compute 2.90 Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: Openstack-System-Scope: None Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: User-Agent: python-novaclient Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Auth-Token: gAAAAABim8QOXbCNi8e_RTarfQu2wlRB6LJW2tBMcJiDFl4yXRffUrtt7Mx0HqHzDdPj4RzR5DeMMaYpbIsA7O3m5YIN4cSSzbrfvFR0Ki9Iu-zptjETqJdnVXrBYlvPtfElLqVRmzwl9pNfrhEIiMIE8JA1vd0zm7NdZM4QvLeV55nsgWJbWzc Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Domain-Id: None Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Domain-Name: None Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Identity-Status: Confirmed Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Is-Admin-Project: True Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Domain-Id: default Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Domain-Name: Default Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Name: admin Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Role: member,admin,reader Jun 04 20:43:58.550945 ncdv-master-1 devstack@n-api.service[121595]: X-Roles: member,admin,reader Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598115c278dc4440816e2bfd4030f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598115c278dc4440816e2bfd4030f050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant: admin Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant-Name: admin Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-User: admin Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-User-Domain-Id: default Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-User-Domain-Name: Default Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-User-Id: 6a435d18d74943c3a8e7cee442315d79 Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: X-User-Name: admin Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: method: > Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: exception: Flavor 42 could not be found. Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: action_args: {'id': '42'} Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:43:58.552437 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:58.553546 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:58.554895 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-7686209a-b552-47ec-b953-ff8095034aae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:43:58.556320 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-7686209a-b552-47ec-b953-ff8095034aae admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016185 Jun 04 20:43:58.556320 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:43:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:59.431358 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-df68772d-422b-4bd1-8793-fd91549ede80 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:59.432441 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-df68772d-422b-4bd1-8793-fd91549ede80 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jun 04 20:43:59.432848 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:43:59.628224 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-e99f7ee1-49f5-4449-99dc-ef99eb6ef1a0 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:59.634450 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.wsgi [None req-e99f7ee1-49f5-4449-99dc-ef99eb6ef1a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-e99f7ee1-49f5-4449-99dc-ef99eb6ef1a0 admin admin] Request method failure captured: Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Accept: application/json Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Accept-Encoding: gzip, deflate Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Connection: keep-alive Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Content-Length: 0 Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Host: 10.222.0.18 Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Openstack-Api-Version: compute 2.90 Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: Openstack-System-Scope: None Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: User-Agent: python-novaclient Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Auth-Token: gAAAAABim8QPOXIRzbklzgWYmmz1Gi0xs6MjIuIfLo4jdYla0VGwjh75YcJXoBQy7IHncVkeCCSAl1OWq7-CKsVQ2TdAdlflW2zwMcrKRDsorYUNcunTBMZWsQUmu7ZBj19wHY5eaku3XHBEDcTmC1ILrDvMwZncLBUTMzb20Ct2SgLfkxaxPgg Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Domain-Id: None Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Domain-Name: None Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Identity-Status: Confirmed Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Is-Admin-Project: True Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Domain-Id: default Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Domain-Name: Default Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Name: admin Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Role: member,admin,reader Jun 04 20:43:59.636030 ncdv-master-1 devstack@n-api.service[121595]: X-Roles: member,admin,reader Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598115c278dc4440816e2bfd4030f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598115c278dc4440816e2bfd4030f050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant: admin Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant-Name: admin Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-User: admin Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-User-Domain-Id: default Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-User-Domain-Name: Default Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-User-Id: 6a435d18d74943c3a8e7cee442315d79 Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: X-User-Name: admin Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: method: > Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: exception: Flavor 84 could not be found. Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: action_args: {'id': '84'} Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:43:59.637591 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:59.638557 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.639668 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-e99f7ee1-49f5-4449-99dc-ef99eb6ef1a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:43:59.640725 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-e99f7ee1-49f5-4449-99dc-ef99eb6ef1a0 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063686 Jun 04 20:43:59.640725 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:43:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:43:59.647344 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-4768a223-b5e9-41ed-b111-ab08fb854b84 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:59.661908 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-4768a223-b5e9-41ed-b111-ab08fb854b84 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018217 Jun 04 20:43:59.662461 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:43:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:43:59.672379 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-47427485-718f-4cda-b9f7-16529b2d5838 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:59.686922 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-47427485-718f-4cda-b9f7-16529b2d5838 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018069 Jun 04 20:43:59.687455 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:43:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:43:59.697444 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-27be1349-a763-4706-b0d1-9307c5c35eec admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:43:59.703074 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.wsgi [None req-27be1349-a763-4706-b0d1-9307c5c35eec admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-27be1349-a763-4706-b0d1-9307c5c35eec admin admin] Request method failure captured: Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Accept: application/json Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Accept-Encoding: gzip, deflate Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Connection: keep-alive Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Content-Length: 0 Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Host: 10.222.0.18 Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Openstack-Api-Version: compute 2.90 Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: Openstack-System-Scope: None Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: User-Agent: python-novaclient Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Auth-Token: gAAAAABim8QPOXIRzbklzgWYmmz1Gi0xs6MjIuIfLo4jdYla0VGwjh75YcJXoBQy7IHncVkeCCSAl1OWq7-CKsVQ2TdAdlflW2zwMcrKRDsorYUNcunTBMZWsQUmu7ZBj19wHY5eaku3XHBEDcTmC1ILrDvMwZncLBUTMzb20Ct2SgLfkxaxPgg Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Domain-Id: None Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Domain-Name: None Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Identity-Status: Confirmed Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Is-Admin-Project: True Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Domain-Id: default Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Domain-Name: Default Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Name: admin Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Role: member,admin,reader Jun 04 20:43:59.704602 ncdv-master-1 devstack@n-api.service[121594]: X-Roles: member,admin,reader Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598115c278dc4440816e2bfd4030f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598115c278dc4440816e2bfd4030f050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant: admin Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant-Name: admin Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-User: admin Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-User-Domain-Id: default Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-User-Domain-Name: Default Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-User-Id: 6a435d18d74943c3a8e7cee442315d79 Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: X-User-Name: admin Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: method: > Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: exception: Flavor 84 could not be found. Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: action_args: {'id': '84'} Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:43:59.706060 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:59.706923 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:43:59.708371 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-27be1349-a763-4706-b0d1-9307c5c35eec admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:43:59.709403 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-27be1349-a763-4706-b0d1-9307c5c35eec admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012419 Jun 04 20:43:59.709403 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:43:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:00.610515 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-47427485-718f-4cda-b9f7-16529b2d5838 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:00.611604 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-47427485-718f-4cda-b9f7-16529b2d5838 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 04 20:44:00.612004 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:44:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:44:00.809720 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-3d451e9e-43b0-47fd-aed5-c4cfd7b015f9 admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:00.815675 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.wsgi [None req-3d451e9e-43b0-47fd-aed5-c4cfd7b015f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-3d451e9e-43b0-47fd-aed5-c4cfd7b015f9 admin admin] Request method failure captured: Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Accept: application/json Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Accept-Encoding: gzip, deflate Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Connection: keep-alive Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Content-Length: 0 Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Host: 10.222.0.18 Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Openstack-Api-Version: compute 2.90 Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: Openstack-System-Scope: None Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: User-Agent: python-novaclient Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Auth-Token: gAAAAABim8QQd0dOJHgx1Tjj_i2I5hPtR2hbZz4T3QKEkxl6nu43DYpxSAiDE-V5JoudomBMTrctDw1AeGcdKncCtKAE_B48IRjM-U1ZjcUFWV4r0wWNVHI6D71e7UsrAtjw4xzTxmwLFUsv92x1oMiNh8EJ6vsGf6o7VL7qr_RX1PI1F9dlwdg Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Domain-Id: None Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Domain-Name: None Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Identity-Status: Confirmed Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Is-Admin-Project: True Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Domain-Id: default Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Domain-Name: Default Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Project-Name: admin Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Role: member,admin,reader Jun 04 20:44:00.817192 ncdv-master-1 devstack@n-api.service[121594]: X-Roles: member,admin,reader Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598115c278dc4440816e2bfd4030f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598115c278dc4440816e2bfd4030f050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant: admin Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-Tenant-Name: admin Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-User: admin Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-User-Domain-Id: default Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-User-Domain-Name: Default Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-User-Id: 6a435d18d74943c3a8e7cee442315d79 Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: X-User-Name: admin Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: method: > Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: exception: Flavor 451 could not be found. Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: action_args: {'id': '451'} Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:44:00.818712 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:44:00.819605 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.821345 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-3d451e9e-43b0-47fd-aed5-c4cfd7b015f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:44:00.822379 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-3d451e9e-43b0-47fd-aed5-c4cfd7b015f9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066018 Jun 04 20:44:00.822379 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:44:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:00.828738 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-d65c01e6-a40d-4e7d-a366-55493ebe3aa2 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:00.843257 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-d65c01e6-a40d-4e7d-a366-55493ebe3aa2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018148 Jun 04 20:44:00.843850 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:44:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:44:00.853812 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:00.867703 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017654 Jun 04 20:44:00.868244 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:44:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:44:00.878345 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-93701027-764e-4e9c-94d4-6ff2c7b1b081 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:00.883968 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.wsgi [None req-93701027-764e-4e9c-94d4-6ff2c7b1b081 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-93701027-764e-4e9c-94d4-6ff2c7b1b081 admin admin] Request method failure captured: Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Accept: application/json Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Accept-Encoding: gzip, deflate Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Connection: keep-alive Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Content-Length: 0 Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Host: 10.222.0.18 Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Openstack-Api-Version: compute 2.90 Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: Openstack-System-Scope: None Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: User-Agent: python-novaclient Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Auth-Token: gAAAAABim8QQd0dOJHgx1Tjj_i2I5hPtR2hbZz4T3QKEkxl6nu43DYpxSAiDE-V5JoudomBMTrctDw1AeGcdKncCtKAE_B48IRjM-U1ZjcUFWV4r0wWNVHI6D71e7UsrAtjw4xzTxmwLFUsv92x1oMiNh8EJ6vsGf6o7VL7qr_RX1PI1F9dlwdg Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Domain-Id: None Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Domain-Name: None Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Identity-Status: Confirmed Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Is-Admin-Project: True Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Openstack-Nova-Api-Version: 2.90 Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Domain-Id: default Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Domain-Name: Default Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Project-Name: admin Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Role: member,admin,reader Jun 04 20:44:00.885456 ncdv-master-1 devstack@n-api.service[121595]: X-Roles: member,admin,reader Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_598115c278dc4440816e2bfd4030f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/598115c278dc4440816e2bfd4030f050"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/598115c278dc4440816e2bfd4030f050"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant: admin Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant-Id: 598115c278dc4440816e2bfd4030f050 Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-Tenant-Name: admin Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-User: admin Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-User-Domain-Id: default Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-User-Domain-Name: Default Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-User-Id: 6a435d18d74943c3a8e7cee442315d79 Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: X-User-Name: admin Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: method: > Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: exception: Flavor 451 could not be found. Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: action_args: {'id': '451'} Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:44:00.886909 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:44:00.887776 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: ERROR nova.api.openstack.wsgi Jun 04 20:44:00.889077 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-93701027-764e-4e9c-94d4-6ff2c7b1b081 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:44:00.890237 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-93701027-764e-4e9c-94d4-6ff2c7b1b081 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012405 Jun 04 20:44:00.890237 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:44:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:01.781259 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:01.782275 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 04 20:44:01.782675 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:44:01.994527 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-dfaabfa8-ed64-4e77-a862-4d84d56bb1ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:44:02.014441 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-dfaabfa8-ed64-4e77-a862-4d84d56bb1ee admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080921 Jun 04 20:44:02.015536 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Jun 4 20:44:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:44:02.895937 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:02.896957 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 04 20:44:02.897349 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:44:03.098499 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-7bfc87de-29fd-40a0-84cf-ee378a7610f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:44:03.118625 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-7bfc87de-29fd-40a0-84cf-ee378a7610f2 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073808 Jun 04 20:44:03.119086 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Jun 4 20:44:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:44:04.029769 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:04.030808 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 04 20:44:04.031197 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:44:04.230523 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-4425c3fc-d028-4cf8-bb93-3145f8f9c990 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:44:04.250082 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-4425c3fc-d028-4cf8-bb93-3145f8f9c990 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074661 Jun 04 20:44:04.250637 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Jun 4 20:44:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:44:05.128611 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:05.129639 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 04 20:44:05.130012 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:44:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:44:05.334010 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-46899694-7fc6-4026-a346-01384e43435b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:44:05.356596 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-46899694-7fc6-4026-a346-01384e43435b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.084013 Jun 04 20:44:05.357063 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Sat Jun 4 20:44:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:44:06.266925 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:06.267976 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 04 20:44:06.268377 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:44:06.485851 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-2433737c-ae3f-4c85-9b61-6ed0e24dd4f2 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:44:06.511828 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-2433737c-ae3f-4c85-9b61-6ed0e24dd4f2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.093968 Jun 04 20:44:06.512361 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Sat Jun 4 20:44:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:45:10.891899 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:45:10.892908 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-efb31d76-2ffb-4ac4-8b59-f3109582a48e admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 04 20:45:10.893302 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Sat Jun 4 20:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:45:10.907364 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:10.962103 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-1e6d3a4e-6a2b-4867-b267-375eefd53255 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:45:10.986713 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-1e6d3a4e-6a2b-4867-b267-375eefd53255 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.085289 Jun 04 20:45:10.987196 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 20:45:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:45:11.016626 ncdv-master-1 devstack@n-api.service[121594]: DEBUG dbcounter [-] [121594] Writing DB stats nova_api:SELECT=14 {{(pid=121594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:11.021977 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-31f4e5a0-7338-4167-9262-e0ae896b5d4d admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:45:11.033069 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-31f4e5a0-7338-4167-9262-e0ae896b5d4d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019257 Jun 04 20:45:11.033793 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Sat Jun 4 20:45:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:45:11.047876 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-af12dfba-41ae-40ad-978c-fd9e3eb59a66 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:45:11.055986 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-af12dfba-41ae-40ad-978c-fd9e3eb59a66 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012802 Jun 04 20:45:11.056489 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Sat Jun 4 20:45:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:45:11.070441 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-35001ad8-e23b-439b-a95d-696706d9d21a admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:45:11.078502 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-35001ad8-e23b-439b-a95d-696706d9d21a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013349 Jun 04 20:45:11.079036 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Sat Jun 4 20:45:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:45:11.091416 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-ec7f6097-0940-40fe-baaf-e0ad2dc3a8a1 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:45:11.100086 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-ec7f6097-0940-40fe-baaf-e0ad2dc3a8a1 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011967 Jun 04 20:45:11.100689 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Sat Jun 4 20:45:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:50:43.447726 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-35001ad8-e23b-439b-a95d-696706d9d21a admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:50:43.449028 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-35001ad8-e23b-439b-a95d-696706d9d21a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 04 20:50:43.449236 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:50:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:50:43.613436 ncdv-master-1 devstack@n-api.service[121595]: DEBUG dbcounter [-] [121595] Writing DB stats nova_api:SELECT=6 {{(pid=121595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:43.734684 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-40843281-0c1f-497d-89d1-414b791f814a admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:50:43.735896 ncdv-master-1 devstack@n-api.service[121595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:50:43.735896 ncdv-master-1 devstack@n-api.service[121595]: warnings.warn(msg) Jun 04 20:50:43.737100 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-40843281-0c1f-497d-89d1-414b791f814a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:50:43.737537 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-40843281-0c1f-497d-89d1-414b791f814a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:50:43.738416 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-40843281-0c1f-497d-89d1-414b791f814a admin admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:50:43.738843 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-40843281-0c1f-497d-89d1-414b791f814a admin admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:50:43.780406 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-40843281-0c1f-497d-89d1-414b791f814a admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.168593 Jun 04 20:50:43.780976 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:50:43 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:50:44.687887 ncdv-master-1 devstack@n-api.service[121594]: DEBUG nova.api.openstack.wsgi [None req-35001ad8-e23b-439b-a95d-696706d9d21a admin admin] Calling method '>' {{(pid=121594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:50:44.688984 ncdv-master-1 devstack@n-api.service[121594]: INFO nova.api.openstack.requestlog [None req-35001ad8-e23b-439b-a95d-696706d9d21a admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jun 04 20:50:44.689404 ncdv-master-1 devstack@n-api.service[121594]: [pid: 121594|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Sat Jun 4 20:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:50:44.901599 ncdv-master-1 devstack@n-api.service[121595]: DEBUG nova.api.openstack.wsgi [None req-5f7f2ce2-f567-4a61-a4b5-2aa043550cd9 admin admin] Calling method '>' {{(pid=121595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:50:44.902816 ncdv-master-1 devstack@n-api.service[121595]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:50:44.902816 ncdv-master-1 devstack@n-api.service[121595]: warnings.warn(msg) Jun 04 20:50:44.904136 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-5f7f2ce2-f567-4a61-a4b5-2aa043550cd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:50:44.904582 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-5f7f2ce2-f567-4a61-a4b5-2aa043550cd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:50:44.905372 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-5f7f2ce2-f567-4a61-a4b5-2aa043550cd9 admin admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:50:44.905806 ncdv-master-1 devstack@n-api.service[121595]: DEBUG oslo_concurrency.lockutils [None req-5f7f2ce2-f567-4a61-a4b5-2aa043550cd9 admin admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121595) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:50:44.929750 ncdv-master-1 devstack@n-api.service[121595]: INFO nova.api.openstack.requestlog [None req-5f7f2ce2-f567-4a61-a4b5-2aa043550cd9 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.086167 Jun 04 20:50:44.930348 ncdv-master-1 devstack@n-api.service[121595]: [pid: 121595|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:50:44 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:51:33.401449 ncdv-master-1 devstack@n-api.service[121593]: Sat Jun 4 20:51:33 2022 - graceful shutdown triggered... Jun 04 20:51:33.401550 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 04 20:51:33.402685 ncdv-master-1 devstack@n-api.service[121595]: Gracefully killing worker 2 (pid: 121595)... Jun 04 20:51:33.403099 ncdv-master-1 devstack@n-api.service[121594]: Gracefully killing worker 1 (pid: 121594)... Jun 04 20:51:34.403676 ncdv-master-1 devstack@n-api.service[121593]: worker 1 buried after 1 seconds Jun 04 20:51:34.403676 ncdv-master-1 devstack@n-api.service[121593]: worker 2 buried after 1 seconds Jun 04 20:51:34.403676 ncdv-master-1 devstack@n-api.service[121593]: goodbye to uWSGI. Jun 04 20:51:34.405512 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jun 04 20:51:34.406119 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 04 20:51:34.409932 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 04 20:51:34.461661 ncdv-master-1 devstack@n-api.service[137219]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 20:51:34 2022] *** Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: nodename: ncdv-master-1 Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: machine: x86_64 Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: clock source: unix Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: pcre jit disabled Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: detected number of CPU cores: 4 Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: current working directory: / Jun 04 20:51:34.463720 ncdv-master-1 devstack@n-api.service[137219]: detected binary path: /usr/bin/uwsgi-core Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: your processes number limit is 47680 Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: your memory page size is 4096 bytes Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: detected max file descriptor number: 2048 Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: lock engine: pthread robust mutexes Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: thunder lock: enabled Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 04 20:51:34.464401 ncdv-master-1 devstack@n-api.service[137219]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 20:51:34.518047 ncdv-master-1 devstack@n-api.service[137219]: Python main interpreter initialized at 0x559150a949c0 Jun 04 20:51:34.518047 ncdv-master-1 devstack@n-api.service[137219]: python threads support enabled Jun 04 20:51:34.518047 ncdv-master-1 devstack@n-api.service[137219]: your server socket listen backlog is limited to 100 connections Jun 04 20:51:34.518047 ncdv-master-1 devstack@n-api.service[137219]: your mercy for graceful operations on workers is 90 seconds Jun 04 20:51:34.518617 ncdv-master-1 devstack@n-api.service[137219]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 20:51:34.518617 ncdv-master-1 devstack@n-api.service[137219]: *** Operational MODE: preforking *** Jun 04 20:51:34.518832 ncdv-master-1 devstack@n-api.service[137219]: *** uWSGI is running in multiple interpreter mode *** Jun 04 20:51:34.518832 ncdv-master-1 devstack@n-api.service[137219]: spawned uWSGI master process (pid: 137219) Jun 04 20:51:34.518976 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 04 20:51:34.519663 ncdv-master-1 devstack@n-api.service[137219]: spawned uWSGI worker 1 (pid: 137228, cores: 1) Jun 04 20:51:34.520024 ncdv-master-1 devstack@n-api.service[137219]: spawned uWSGI worker 2 (pid: 137229, cores: 1) Jun 04 20:51:34.520190 ncdv-master-1 devstack@n-api.service[137219]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 20:51:35.862507 ncdv-master-1 devstack@n-api.service[137229]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 20:51:35.890800 ncdv-master-1 devstack@n-api.service[137228]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 04 20:51:36.741565 ncdv-master-1 devstack@n-api.service[137229]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:51:36.741565 ncdv-master-1 devstack@n-api.service[137229]: from cryptography.utils import int_from_bytes Jun 04 20:51:36.742395 ncdv-master-1 devstack@n-api.service[137229]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:51:36.742395 ncdv-master-1 devstack@n-api.service[137229]: from cryptography.utils import int_from_bytes Jun 04 20:51:36.757225 ncdv-master-1 devstack@n-api.service[137228]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:51:36.757225 ncdv-master-1 devstack@n-api.service[137228]: from cryptography.utils import int_from_bytes Jun 04 20:51:36.757710 ncdv-master-1 devstack@n-api.service[137228]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:51:36.757710 ncdv-master-1 devstack@n-api.service[137228]: from cryptography.utils import int_from_bytes Jun 04 20:51:39.209631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:51:39.210329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:51:39.210428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:51:39.210798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:51:39.211050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:51:39.211436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.211793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.212116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.212433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.212778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.213299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.213722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.214357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.214462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.214699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.215059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.215374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.215709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.216028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.216335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.216803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.217164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.217564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.218078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.218479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.219693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.219693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.219914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.220757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.220757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.220757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.221044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.221318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.221650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.221952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.222366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.222813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.223380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.223730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.224157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.224474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.224789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.225147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.225474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.225784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.226131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.226407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.226758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.227057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.227392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.227720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.228127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.228510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.228810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.229132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.229350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.229664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.230034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.230314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.230633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.230893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.231153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.231454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.231804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.232118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.232450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.232608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:51:39.233164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.233321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:51:39.233465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.233465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.233767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:51:39.233921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.234071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:51:39.234222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.234372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:51:39.234816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.235995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.236146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.236288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.236616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.236795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.236940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.237089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.237244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.237393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.237648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.237823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.237977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.238126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.238274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.238424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.238577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.238735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.238877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.239027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.239174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.239316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.239551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.239720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.239862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.240902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.241043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.241190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.241346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.241494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.241674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.241816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.242094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.242284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.242464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.242766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.242945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.243131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.243317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.243317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.243669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.243833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.243986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.244128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.244270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.244426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.244577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.244733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.245108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.245269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.245424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.245581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.245723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.245876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.246864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.247142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.247288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.247429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.247603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.247837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.247989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.248152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.248310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.248451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.248605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.248752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.248895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.249036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.249185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.249332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.249487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.249695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.249863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.250995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.251429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.251658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.251815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.251957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.252098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.252258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.252413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.252573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.252733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.252967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.253120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.253420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.253590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.253733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.253891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.254916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.255986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.256184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.256374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.256558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.256738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.256922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.256922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.257285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.257470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.257470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.257932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.258133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.258319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.258504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.258661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.258807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.258948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.258948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.259226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.259376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.259561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.259717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.259859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.260009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.260166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.260166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.260450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.260450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.260725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.260876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.261019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.261159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.261299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.261461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.261603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.261757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.261898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.262047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.262188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.262188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.262470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.262622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.262771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.262912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.263165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.263333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.263484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.263724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.263875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.264028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.264170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.264318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.264508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.264661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.264810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.264951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.265100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.266328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.266529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.266676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.266836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.266985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.267134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.267284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.267440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.267620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.267775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.267918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.268218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.268218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.268218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.268665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.268816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.269018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.269168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.269325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.269469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.269617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.269758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.269898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.270046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.270200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.270351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.270499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.270652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.270805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.270954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.271104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.271254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.271405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.271914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.272070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.272220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.272370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.272514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.272656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.272656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.272946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.273101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.273342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.273499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.273649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.273799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.273949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.274100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.274100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.274100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.274521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.274662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.274825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.274967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.275115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.275257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.275431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.275789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.275936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.276091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.276247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.276484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.276640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.276792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.276936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.277096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.277244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.277393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.277543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.277700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.277851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.278000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.278168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.278383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.278536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.278691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.278842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.279073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.279229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.279371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.279660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.279847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.280000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.280151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.280293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.280434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.280590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.280740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.280934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.281084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.281252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.281395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.281545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.281687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.283681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.283861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.284029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.284187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.284349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.284506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:51:39.284650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.284791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.284934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.285088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.285246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.285388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.285530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.285530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.285984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.286144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.286294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.286294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.286668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.286857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.287969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.288164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.288315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.288592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.288740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.288890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.289932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.290999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.291740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.291920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.292066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.292066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.292413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.292578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.292729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.292871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.293021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.293179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.293322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.293471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.293639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.293883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.294970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.295124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.295266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.295407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.295623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.295788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.296091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.296249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.296400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.296583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.296898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.297059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.297218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.297218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.297511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.297655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.297805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.298996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.299153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.299302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.299445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.299618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.299762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.299911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.300964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.301697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.302584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.302748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.302900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.303053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.303204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.303347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.303495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.303723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.303890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.304128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.304275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.304416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.304565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.304715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.304868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.305941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.306442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.306601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.306751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.306911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.307146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.307313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.307468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.307643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.307786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.307786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.308161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.308306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.308461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.308603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.308847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.308996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.309157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.309311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.309452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.309593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.309742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.309895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.310090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.310248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.310390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.310681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.310872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.311985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.312194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.312350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.312500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.312642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.312784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.312940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.313083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.313223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.313372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.313532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.313693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.313970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.314143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.314381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.314529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.314680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.314832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.314973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.315123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.315271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.315415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.315598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.315755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.315899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.316048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.316200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.316341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.316666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.316825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.316969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.317138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.317370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.317517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.317671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.317852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.318996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.319151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.319294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.319442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.319649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.319806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.319968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.320118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.320268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.320416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.320572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.320716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.320865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.321923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.322944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.323095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.323250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.323392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.323557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.323704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.323868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.324853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.325132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.325273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.325415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.325565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.325731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.325874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.326024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.326180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.326322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.326476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.326820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.326820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.327116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.327267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.327538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.327688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.327960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.328169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.328169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.328451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.328613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.328770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.328933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.329205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.329369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.329369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.329652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.329810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.329960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.330110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.330287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.331069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.331247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.331405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.331720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.331878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.332027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.332186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.332337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.332484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.332753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.332908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.333066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.333238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.333397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.333555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.333713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.333861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.334029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.334179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.334335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.334493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.334750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.334750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.335061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.335223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.335537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.335696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.335855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.336013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.336172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.336320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.336477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.336626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.336849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.337079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.337242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.337401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.337665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.337821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.337977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.338214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.338214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.338525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.338525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.338808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.338956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.339116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.339373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.339590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.339746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.339919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.340982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.341139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.341287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.341435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.341582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.341738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.341911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.342084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.342373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.342551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.342705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.342862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.343021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.343191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.343383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.343589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.343747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.343896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.344061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.344230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.344389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.344551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.344726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.344975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.345139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.345298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.345454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.345695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.345860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.346966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.347214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.347377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.347546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.347816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.347973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.348134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.348292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.348464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.348633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.348783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.348945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.349104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.349259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.349525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.349680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.349848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.350014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.350177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.350344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.351193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.351369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.351585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.351760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.351920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.352106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.352106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.352406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.352557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.352755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.352914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.353998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.354156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.354315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.354479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.354637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.354795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.354971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.355366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.355552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.355736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.355996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.356151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.356329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.356481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.356636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.356785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.356934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.357091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.364154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.364387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.364563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.364723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.364892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.365061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.365228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.365498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.365656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.365810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.365980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.366231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.366401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.366563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.366727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.366879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.367035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.367196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.367366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.367539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.367725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.367962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.368132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.368307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.368470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.368633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.368783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.368945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.369104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.369104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.369411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.369580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.369731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.369889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.370041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.370218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.377186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.378128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.378302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.378528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.378695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.378849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.379008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.379174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.379323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.379493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.379685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.379957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.380127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.380280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.380430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.380589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.380739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.380911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.381184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.381351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.381511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.381882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.382068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.382819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.382995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.383168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.383963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.384144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.384306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.384465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.384617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.384617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.384617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.385070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.385230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.385388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.385546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.385698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.385856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.386965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.387356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.387532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.387698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.387858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.388121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.388320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.388484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.388644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.388644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.389977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.390127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.390316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.390530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.390692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.390850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.391937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.392234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.392383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.392532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.392692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.392851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.393953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.394104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.394260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.394417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.394417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.394713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.394713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.395006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.395158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.395306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.395456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.395732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.395893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.396043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.396202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.396352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.396850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.397006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.397154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.397154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.397698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.397857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.398955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.399113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.399262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.399412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.399589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.399744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.399744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.400882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.401698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.401847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.401847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.402156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.402308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.402466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.402616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.402787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.402944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.403108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.403258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.403419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.403631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.403798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.403949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.404109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.404259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.404415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.404565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.404721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.404891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.405041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.405199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.405358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.405515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.405667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.405854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.406978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.407128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.407276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.407442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.407838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.408788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.409087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.409241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.409403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.409554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.409734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.410339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.410502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.410652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.410809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.411036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.411215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.411368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.411570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.411817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.412111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.412268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.412435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.412596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.412756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.412908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.413058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.413220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.413378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.413527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.413688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.413846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.414951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.415110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.415323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.415493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.415736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.415905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.416056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.416260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.416422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.416573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.416764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.416764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.417071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.417221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.417369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.417518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.417910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.418084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.418238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.418406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.418556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.418705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.418863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.419021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.419171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.419330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.419489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.419489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.419915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.420069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.420226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.420377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.420539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.420689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.420853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.421010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.421161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.421310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.421483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.421638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.421821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.422991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.423153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.423316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.423468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.423795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.423947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.424104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.424255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.424255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.424538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.425677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.425862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.426016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.426173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.426324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.426725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.426904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.427063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.427214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.427371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.427560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.427750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.428171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.428171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.429267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.429267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.429594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.429746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.429905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.430849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.431161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.431312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.431468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.431693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.431845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.431845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.432273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.432430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.432587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.432745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.432905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.433054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.433224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.433381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.433532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.433689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.433850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.434931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.435090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.435250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.435399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.435565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.435720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.435887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.436973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.437220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.437404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.437558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.437716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.437881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.438335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.438500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.438661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.438812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.438972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.439122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.439274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.439438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.439630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.439782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.439946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.440099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.440537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.440708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.440860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.441973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.442986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.443944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.444963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.445948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.446983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.447918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.448713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.449932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.450982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.451999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.452932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.453931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.454972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.455986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.456934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.457981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.458989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.459965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.460958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.461967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.462916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.463967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.464947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.465937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.466931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.467927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.468941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.469933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.470988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.471984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.472922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.473966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.474990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.475127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.475306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.475456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.475667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.475838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.475984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.476171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.476297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.476501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.476618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.476827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.476918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.477155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.477253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.477477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.477560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.477796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.477880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.478115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.478205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.478433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.478515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.478760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.478868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.479125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.479216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.479422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.479552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.479986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.480093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.480400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.480494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.480700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.480800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.481146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.481256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.481394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.481498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.481755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.481860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.482108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.482214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.482369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:51:39.482460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.482756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.483280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.483690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.484157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.485099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.485500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.485846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.486167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.486484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.486799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.487122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.487450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.487795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.488107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.488420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.488737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.489186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.489367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.489678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.489992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.490307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.490617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.490929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.491255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.491568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.491882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.492198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.492512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.492825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.493136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.493444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.493754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.494064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.494402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.494744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.495068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.495397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.495756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.496085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.496402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.496732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.497060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.497384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.497702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.498043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.498358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.498676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.498995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.499316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.499720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.500573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.500919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.501256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.501570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.501906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.502236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.502571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.502896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.503220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.503582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.503904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.504223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.504551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.504869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.505189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.505513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.505836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.506173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.506508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.506824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.507159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.507492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.507878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.508201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.508605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.508971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.509346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.510437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.510437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:51:39.510437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137228) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:51:39.549346 ncdv-master-1 devstack@n-api.service[137229]: INFO dbcounter [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Registered counter for database nova_api Jun 04 20:51:39.574413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.582057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writer thread running {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.582328 ncdv-master-1 devstack@n-api.service[137228]: INFO dbcounter [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Registered counter for database nova_api Jun 04 20:51:39.603480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_db.sqlalchemy.engines [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.611294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writer thread running {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.643573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.context [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=137229) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 20:51:39.648402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:51:39.650127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:51:39.650951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:51:39.653012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:51:39.655222 ncdv-master-1 devstack@n-api.service[137229]: INFO dbcounter [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Registered counter for database nova_cell0 Jun 04 20:51:39.660359 ncdv-master-1 devstack@n-api.service[137229]: INFO dbcounter [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Registered counter for database nova_cell1 Jun 04 20:51:39.667951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.672764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.675846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.context [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=137228) load_cells /opt/stack/nova/nova/context.py:464}} Jun 04 20:51:39.680091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:51:39.681769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:51:39.682182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writer thread running {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.682575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:51:39.683824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writer thread running {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.684638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:51:39.686761 ncdv-master-1 devstack@n-api.service[137228]: INFO dbcounter [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Registered counter for database nova_cell0 Jun 04 20:51:39.691777 ncdv-master-1 devstack@n-api.service[137228]: INFO dbcounter [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Registered counter for database nova_cell1 Jun 04 20:51:39.699978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_db.sqlalchemy.engines [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.702766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_db.sqlalchemy.engines [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.706988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writer thread running {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.838516 ncdv-master-1 devstack@n-api.service[137229]: INFO dbcounter [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Registered counter for database nova_cell0 Jun 04 20:51:39.846157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_db.sqlalchemy.engines [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.851570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writer thread running {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.855888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writer thread running {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:39.866555 ncdv-master-1 devstack@n-api.service[137228]: INFO dbcounter [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Registered counter for database nova_cell0 Jun 04 20:51:39.873895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_db.sqlalchemy.engines [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137228) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:51:39.880199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writer thread running {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:51:40.313559 ncdv-master-1 devstack@n-api.service[137229]: WARNING keystonemiddleware.auth_token [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:51:40.321915 ncdv-master-1 devstack@n-api.service[137229]: WARNING keystonemiddleware.auth_token [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:51:40.332526 ncdv-master-1 devstack@n-api.service[137228]: WARNING keystonemiddleware.auth_token [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:51:40.340482 ncdv-master-1 devstack@n-api.service[137228]: WARNING keystonemiddleware.auth_token [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:51:40.564287 ncdv-master-1 devstack@n-api.service[137229]: WARNING keystonemiddleware.auth_token [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:51:40.570796 ncdv-master-1 devstack@n-api.service[137229]: WARNING keystonemiddleware.auth_token [None req-bbc7b4cf-94b6-4c3b-9d87-0eeebb45df98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:51:40.576244 ncdv-master-1 devstack@n-api.service[137229]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559150a949c0 pid: 137229 (default app) Jun 04 20:51:40.576997 ncdv-master-1 devstack@n-api.service[137228]: WARNING keystonemiddleware.auth_token [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 04 20:51:40.584824 ncdv-master-1 devstack@n-api.service[137228]: WARNING keystonemiddleware.auth_token [None req-264e6eb7-3bd7-455a-9d0b-413375e6706d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 04 20:51:40.590357 ncdv-master-1 devstack@n-api.service[137228]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559150a949c0 pid: 137228 (default app) Jun 04 20:52:25.710450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.711847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.712786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:25.713747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.894722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '.version_select at 0x7f2d08ce3700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:26.896487 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:26.896487 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:26.902542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=137229) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 04 20:52:26.903362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:26.903826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:26.934775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:26.935220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:26.949179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:26.949623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:26.957523 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc5efafd-2e80-4ea2-b375-675bed6e3677 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.256698 Jun 04 20:52:26.958663 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1/1] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 20:52:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:26.977322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.978369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.979447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:26.980366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:27.209234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-91a7d6e2-0ef4-437b-a5dd-6c5f7ae37cb6 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-929304812", "name": "tempest-test_aggregate-80164857"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:27.244478 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:27.244478 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:27.245907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-91a7d6e2-0ef4-437b-a5dd-6c5f7ae37cb6 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 625e941c-8a8e-47ec-b045-72634b4b93cd for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:52:27.398383 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-91a7d6e2-0ef4-437b-a5dd-6c5f7ae37cb6 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.427219 Jun 04 20:52:27.404037 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1/2] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Jun 4 20:52:26 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:27.409758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eaaa8636-2fb7-4cbf-a9d6-3ea6b8cff406 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:27.410550 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:27.410550 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:27.442091 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eaaa8636-2fb7-4cbf-a9d6-3ea6b8cff406 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.036543 Jun 04 20:52:27.442998 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:52:27 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:27.453169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-368a0635-40c2-4c09-a913-1e66bfa4d504 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:27.456024 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:27.456024 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:27.474796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-368a0635-40c2-4c09-a913-1e66bfa4d504 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:27.475550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-368a0635-40c2-4c09-a913-1e66bfa4d504 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:28.813911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-46112645", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:29.388986 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-368a0635-40c2-4c09-a913-1e66bfa4d504 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 311 microversion: 2.1 time: 1.938992 Jun 04 20:52:29.400303 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2/4] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:52:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 311 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:29.990615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:52:30.308995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2770e4a-0fc4-481f-81cb-bec542ff9dfb tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1921044568", "id": 1644657472, "os-flavor-access:is_public": "True"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:30.312874 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:30.312874 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:30.408092 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2770e4a-0fc4-481f-81cb-bec542ff9dfb tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.006046 Jun 04 20:52:30.408681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3/5] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:52:29 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:30.528891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:52:30.529498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:52:30.530115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:52:30.530800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:52:30.531373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:52:30.560449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:30.569063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:30.571549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:30.572836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:30.648286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Getting quotas for project b2009577e16e48458dd3eebf04938841. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:52:30.657293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Getting quotas for user 71d0d753d0314e44b9cd7fba3ab1cd26 and project b2009577e16e48458dd3eebf04938841. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:52:30.671756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:52:30.675473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:52:30.740804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2203681d-47a1-4186-ae23-2d45816d57ae tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1126335597", "id": 740609587, "os-flavor-access:is_public": "True"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:30.766481 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2203681d-47a1-4186-ae23-2d45816d57ae tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.341786 Jun 04 20:52:30.767562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 4/6] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:52:30 2022] POST /compute/v2.1/flavors => generated 465 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:30.807041 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9fe6f55a-ab9b-46cf-816f-d1f78dc9f22f tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522870 Jun 04 20:52:30.808030 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3/7] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 20:52:30.983344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52366829-0957-463f-9a03-da391a1adf44 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:30.985309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52366829-0957-463f-9a03-da391a1adf44 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:30.985768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52366829-0957-463f-9a03-da391a1adf44 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:30.986739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52366829-0957-463f-9a03-da391a1adf44 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:30.987247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52366829-0957-463f-9a03-da391a1adf44 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:31.066618 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-52366829-0957-463f-9a03-da391a1adf44 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.294197 Jun 04 20:52:31.074633 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Jun 4 20:52:30 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:31.079599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d192bdef-c283-4fc8-b9f6-893bee3499f8 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2106536024", "id": 2119920043, "os-flavor-access:is_public": "False"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:31.082776 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:31.082776 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:31.153754 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d192bdef-c283-4fc8-b9f6-893bee3499f8 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.343112 Jun 04 20:52:31.163795 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 4/9] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:30 2022] POST /compute/v2.1/flavors => generated 431 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:31.180377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ff634d7-2ab4-400b-8537-2239dfdbe6b3 tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:31.182081 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:31.182081 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:31.261397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1803842688", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "availability_zone": "tempest-test_az-929304812"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:31.287283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:31.287782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:31.288589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:31.289025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:31.496114 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ff634d7-2ab4-400b-8537-2239dfdbe6b3 tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1644657472/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.327848 Jun 04 20:52:31.497747 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 5/10] 10.222.0.18 () {62 vars in 1264 bytes} [Sat Jun 4 20:52:31 2022] POST /compute/v2.1/flavors/1644657472/os-extra_specs => generated 62 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:31.631956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:52:31.689443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97ff3c61-f598-4088-a64b-717986d1e7e2 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-413379056", "id": 231483658, "os-flavor-access:is_public": "False"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:31.732771 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97ff3c61-f598-4088-a64b-717986d1e7e2 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.232986 Jun 04 20:52:31.733629 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 6/11] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:31 2022] POST /compute/v2.1/flavors => generated 435 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:31.983412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b36b95a-9730-440f-8590-4b52d9a90f0e tempest-FlavorsV261TestJSON-1479650512 tempest-FlavorsV261TestJSON-1479650512-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.003442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:52:32.003900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:52:32.004568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:52:32.005110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:52:32.005662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:52:32.007766 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b36b95a-9730-440f-8590-4b52d9a90f0e tempest-FlavorsV261TestJSON-1479650512 tempest-FlavorsV261TestJSON-1479650512-project] 10.222.0.18 "GET /compute/v2.1/flavors/740609587" status: 200 len: 465 microversion: 2.61 time: 0.272441 Jun 04 20:52:32.017614 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 7/12] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Jun 4 20:52:31 2022] GET /compute/v2.1/flavors/740609587 => generated 465 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:32.020343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-580ab215-86dd-4cdb-ad78-ef4feda16f1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.021469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-580ab215-86dd-4cdb-ad78-ef4feda16f1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:32.045917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:32.048747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:32.052460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:32.054332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:32.168812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Getting quotas for project 0d9e0c4a4f7b409bab8b012092f7d1f2. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:52:32.189726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Getting quotas for user 6c28978004214999bd5ff400f05fdc73 and project 0d9e0c4a4f7b409bab8b012092f7d1f2. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:52:32.193427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-580ab215-86dd-4cdb-ad78-ef4feda16f1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:32.209177 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-580ab215-86dd-4cdb-ad78-ef4feda16f1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1218 microversion: 2.1 time: 0.196079 Jun 04 20:52:32.210176 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:32 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1218 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:32.210886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:52:32.214072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:52:32.215250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dad04b69-1645-43a8-bcdf-e95d3c70e730 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.216163 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.216163 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:32.217496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad04b69-1645-43a8-bcdf-e95d3c70e730 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:32.218088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad04b69-1645-43a8-bcdf-e95d3c70e730 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:32.219002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad04b69-1645-43a8-bcdf-e95d3c70e730 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:32.219601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad04b69-1645-43a8-bcdf-e95d3c70e730 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:32.267882 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dad04b69-1645-43a8-bcdf-e95d3c70e730 tempest-AZAdminV2TestJSON-484351535 tempest-AZAdminV2TestJSON-484351535-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.056146 Jun 04 20:52:32.276902 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 9/14] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 20:52:32 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:32.282545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e089606-4582-484e-816a-383aa482c2b3 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3794e2ea301c4644aa5724a8ba8103e0"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:32.283910 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.283910 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:32.351945 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fde646de-a354-4d1b-a3b7-b80898cd26e7 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275956 Jun 04 20:52:32.353176 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 6/15] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:52:32.368772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-473ac5f3-a591-478a-b3d8-491d56730804 tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.369902 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.369902 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:32.431092 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-473ac5f3-a591-478a-b3d8-491d56730804 tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1644657472" status: 202 len: 0 microversion: 2.86 time: 0.076465 Jun 04 20:52:32.431731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 7/16] 10.222.0.18 () {60 vars in 1201 bytes} [Sat Jun 4 20:52:32 2022] DELETE /compute/v2.1/flavors/1644657472 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:52:32.443187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b2475e7a-8ade-4d5d-8fc7-ef02cd958869 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:32.444880 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.444880 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:32.449406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e089606-4582-484e-816a-383aa482c2b3 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/2119920043/action" status: 200 len: 97 microversion: 2.1 time: 0.171077 Jun 04 20:52:32.455530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 10/17] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Jun 4 20:52:32 2022] POST /compute/v2.1/flavors/2119920043/action => generated 97 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:32.460773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c993a07-b572-4d17-ae3e-3f3d685a5562 tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] Action: 'update', calling method: .version_select at 0x7f2d091441f0>, body: {"flavor": {"description": "new"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:32.481671 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.481671 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:32.528340 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c993a07-b572-4d17-ae3e-3f3d685a5562 tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/740609587" status: 200 len: 466 microversion: 2.61 time: 0.071247 Jun 04 20:52:32.532956 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 11/18] 10.222.0.18 () {62 vars in 1215 bytes} [Sat Jun 4 20:52:32 2022] PUT /compute/v2.1/flavors/740609587 => generated 466 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:32.539490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35153db2-7cff-4747-b0bd-8258c216eeb3 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.551808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-35153db2-7cff-4747-b0bd-8258c216eeb3 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:32.633374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b2475e7a-8ade-4d5d-8fc7-ef02cd958869 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/231483658/action" status: 200 len: 96 microversion: 2.1 time: 0.200364 Jun 04 20:52:32.634582 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 8/19] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Jun 4 20:52:32 2022] POST /compute/v2.1/flavors/231483658/action => generated 96 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:32.639722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a9e8bd9-e096-4dfe-8e50-a2b75c711a45 tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.685222 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a9e8bd9-e096-4dfe-8e50-a2b75c711a45 tempest-FlavorMetadataValidation-2051592850 tempest-FlavorMetadataValidation-2051592850-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.86 time: 0.049059 Jun 04 20:52:32.699759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-35153db2-7cff-4747-b0bd-8258c216eeb3 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:32.700573 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 9/20] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:52:32 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:32.731645 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-35153db2-7cff-4747-b0bd-8258c216eeb3 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1242 microversion: 2.1 time: 0.190191 Jun 04 20:52:32.734331 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 12/21] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:32 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:32.752684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-42a8f5d6-8026-4340-a338-b1d1493a2a5c tempest-FlavorsV261TestJSON-1479650512 tempest-FlavorsV261TestJSON-1479650512-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:32.842478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-42a8f5d6-8026-4340-a338-b1d1493a2a5c tempest-FlavorsV261TestJSON-1479650512 tempest-FlavorsV261TestJSON-1479650512-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.106769 Jun 04 20:52:32.843728 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 13/22] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:52:32 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:32.848596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35558fdb-2814-4140-a432-e9dafe3a5e18 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:32.850058 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:32.850058 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:33.404040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b5c708fb-43b5-4792-84a9-e121e7bec95f tempest-FlavorsAccessTestJSON-2002567916 tempest-FlavorsAccessTestJSON-2002567916-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:33.460079 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b5c708fb-43b5-4792-84a9-e121e7bec95f tempest-FlavorsAccessTestJSON-2002567916 tempest-FlavorsAccessTestJSON-2002567916-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5827 microversion: 2.1 time: 0.758026 Jun 04 20:52:33.472371 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 10/23] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:32 2022] GET /compute/v2.1/flavors/detail => generated 5827 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:33.485058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d01272f9-899e-43a0-97a5-ecafe608cd6c tempest-FlavorsV261TestJSON-1479650512 tempest-FlavorsV261TestJSON-1479650512-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:33.527948 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d01272f9-899e-43a0-97a5-ecafe608cd6c tempest-FlavorsV261TestJSON-1479650512 tempest-FlavorsV261TestJSON-1479650512-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.053297 Jun 04 20:52:33.529032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 11/24] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Jun 4 20:52:33 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:33.535150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:33.536071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:33.555444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:33.556115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:33.556961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:33.557716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:33.695562 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-35558fdb-2814-4140-a432-e9dafe3a5e18 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 7f37a307cd1843549d1e715ed0ee917c combination. Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35558fdb-2814-4140-a432-e9dafe3a5e18 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Request method failure captured: Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/flavors/231483658/action HTTP/1.1 Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 67 Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YN51ZcvolsYfDg4gEowaVZs9uSCsD-sfqphra_wn6I8OC091xHgoqV-HQAdscUj9oT06n1dKHpftr6N36V3haKLbLN1FXnp5EqzwQ8u0t5aRKtNaZjccNTiUkWN62g7NwMH6YyWDxPPF8cB68OaC5VyoDOqsj_dMHoeb1HO8bT-KI Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 69b33db63c5e424b94c673b74c1e9ddd Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:52:33.735482 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 69b33db63c5e424b94c673b74c1e9ddd Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c5ca7127b38940269836120b64656004 Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: {"addTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} Jun 04 20:52:33.737049 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: exception: Flavor access already exists for flavor 18 and project 7f37a307cd1843549d1e715ed0ee917c combination. Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '231483658', 'body': {'addTenantAccess': {'tenant': '7f37a307cd1843549d1e715ed0ee917c'}}} Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result.read() Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:52:33.737892 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-7f37a307cd1843549d1e715ed0ee917c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi session.flush() Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:52:33.739154 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:52:33.740362 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:52:33.741371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result.read() Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-7f37a307cd1843549d1e715ed0ee917c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 4, 20, 52, 33, 684747), 'updated_at': None, 'flavor_id': 18, 'project_id': '7f37a307cd1843549d1e715ed0ee917c'}] Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:33.742357 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 7f37a307cd1843549d1e715ed0ee917c combination. Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:33.743360 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 7f37a307cd1843549d1e715ed0ee917c combination. Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:52:33.746410 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:52:33.748522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 7f37a307cd1843549d1e715ed0ee917c combination. Jun 04 20:52:33.748522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:33.748522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35558fdb-2814-4140-a432-e9dafe3a5e18 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 7f37a307cd1843549d1e715ed0ee917c combination. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:52:33.752897 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-35558fdb-2814-4140-a432-e9dafe3a5e18 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/231483658/action" status: 409 len: 152 microversion: 2.1 time: 0.906943 Jun 04 20:52:33.758969 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 14/25] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Jun 4 20:52:32 2022] POST /compute/v2.1/flavors/231483658/action => generated 152 bytes in 914 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:52:33.791604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b2a2b0e-cb47-4015-a517-86e128256fcd tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3794e2ea301c4644aa5724a8ba8103e0"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:33.798684 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:33.798684 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:33.939748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:33.975943 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85660237-7c47-4e0a-a80f-58163e0b91b7 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1270 microversion: 2.1 time: 0.445486 Jun 04 20:52:33.976544 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 12/26] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:33 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1270 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:34.001080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae5efd07-9463-4f82-b116-43dac61da313 tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.001980 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:34.001980 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:34.069162 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae5efd07-9463-4f82-b116-43dac61da313 tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/740609587" status: 202 len: 0 microversion: 2.61 time: 0.083900 Jun 04 20:52:34.070385 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 13/27] 10.222.0.18 () {60 vars in 1198 bytes} [Sat Jun 4 20:52:33 2022] DELETE /compute/v2.1/flavors/740609587 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:52:34.083558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.084402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:34.114480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:34.114941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:34.121386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:34.132275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:34.232117 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b2a2b0e-cb47-4015-a517-86e128256fcd tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/2119920043/action" status: 200 len: 21 microversion: 2.1 time: 0.471283 Jun 04 20:52:34.232721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 15/28] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Jun 4 20:52:33 2022] POST /compute/v2.1/flavors/2119920043/action => generated 21 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:34.252052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e6d0480-db65-4ac3-a057-d02ec29f63fb tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:34.285773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:34.311635 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a55a99e4-5138-4da8-9b0a-0295db87106c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1242 microversion: 2.1 time: 0.234406 Jun 04 20:52:34.316173 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 14/29] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1242 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:34.328361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-489e06a6-bf0b-4bf9-8ce5-9e65e2a76f7c tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.400601 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-489e06a6-bf0b-4bf9-8ce5-9e65e2a76f7c tempest-FlavorsV261TestJSON-514537411 tempest-FlavorsV261TestJSON-514537411-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.082481 Jun 04 20:52:34.420886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 15/30] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:34.445341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55c42714-efa7-4da4-9d46-3d99671c8e16 tempest-FlavorsAccessTestJSON-2002567916 tempest-FlavorsAccessTestJSON-2002567916-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.495846 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55c42714-efa7-4da4-9d46-3d99671c8e16 tempest-FlavorsAccessTestJSON-2002567916 tempest-FlavorsAccessTestJSON-2002567916-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068467 Jun 04 20:52:34.497011 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 16/31] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:34.549679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c29661bd-7a53-4294-8a9c-90e9a690c499 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.551130 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:34.551130 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:34.603368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c29661bd-7a53-4294-8a9c-90e9a690c499 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2119920043" status: 202 len: 0 microversion: 2.1 time: 0.089483 Jun 04 20:52:34.604998 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 17/32] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:34 2022] DELETE /compute/v2.1/flavors/2119920043 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:34.614233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8af58243-520c-400b-81d3-1e9d3f0385c1 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.651396 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8af58243-520c-400b-81d3-1e9d3f0385c1 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041717 Jun 04 20:52:34.652965 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 18/33] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:34.676569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa4f1858-1a18-4821-9ae8-68633c3e4140 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1557699165", "id": 907946082, "os-flavor-access:is_public": "False"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:34.681342 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:34.681342 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:34.720445 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa4f1858-1a18-4821-9ae8-68633c3e4140 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.054236 Jun 04 20:52:34.722503 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 19/34] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:34 2022] POST /compute/v2.1/flavors => generated 428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:34.740196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e6756e11-2959-44bd-b422-0a3516aba1b3 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.742636 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:34.742636 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:34.787607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=9 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:34.802162 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e6756e11-2959-44bd-b422-0a3516aba1b3 tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/907946082/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.072962 Jun 04 20:52:34.803070 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 20/35] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/flavors/907946082/os-flavor-access => generated 21 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 20:52:34.813248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4026a789-0533-4332-859d-b148b02e333e tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.840322 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4026a789-0533-4332-859d-b148b02e333e tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/907946082" status: 202 len: 0 microversion: 2.1 time: 0.030752 Jun 04 20:52:34.844252 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 21/36] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:52:34 2022] DELETE /compute/v2.1/flavors/907946082 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:34.853425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7427baf6-f53d-4a76-918f-d20d89576a4b tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.883899 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7427baf6-f53d-4a76-918f-d20d89576a4b tempest-FlavorsAccessTestJSON-2093704686 tempest-FlavorsAccessTestJSON-2093704686-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036265 Jun 04 20:52:34.896593 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 22/37] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:34.896949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e6d0480-db65-4ac3-a057-d02ec29f63fb tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/231483658/action" status: 200 len: 21 microversion: 2.1 time: 0.653840 Jun 04 20:52:34.896949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 16/38] 10.222.0.18 () {60 vars in 1196 bytes} [Sat Jun 4 20:52:34 2022] POST /compute/v2.1/flavors/231483658/action => generated 21 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:34.908551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60babe01-8aeb-4cfc-a45b-d403da886b99 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.944145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60babe01-8aeb-4cfc-a45b-d403da886b99 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/231483658" status: 202 len: 0 microversion: 2.1 time: 0.037863 Jun 04 20:52:34.951986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 23/39] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:52:34 2022] DELETE /compute/v2.1/flavors/231483658 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:34.958189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c018dc2d-9ebd-4b94-a11e-6486a18e8cb2 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.998460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:34.999160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:35.014881 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c018dc2d-9ebd-4b94-a11e-6486a18e8cb2 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061453 Jun 04 20:52:35.015826 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 17/40] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:35.020030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:35.020489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:35.021645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:35.022085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:35.034464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d4841f95-e793-4c07-91c3-d59227c57169 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1302553835", "id": 1442604034, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:35.041008 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:35.041008 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:35.114576 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d4841f95-e793-4c07-91c3-d59227c57169 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.084894 Jun 04 20:52:35.115979 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 18/41] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:35.135879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8af01cb1-ec45-4651-8aa6-1b1920777cf8 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:35.136638 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:35.136638 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:35.156834 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8af01cb1-ec45-4651-8aa6-1b1920777cf8 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8af01cb1-ec45-4651-8aa6-1b1920777cf8 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Request method failure captured: Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/flavors/1442604034/os-flavor-access HTTP/1.1 Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YN51ZcvolsYfDg4gEowaVZs9uSCsD-sfqphra_wn6I8OC091xHgoqV-HQAdscUj9oT06n1dKHpftr6N36V3haKLbLN1FXnp5EqzwQ8u0t5aRKtNaZjccNTiUkWN62g7NwMH6YyWDxPPF8cB68OaC5VyoDOqsj_dMHoeb1HO8bT-KI Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 69b33db63c5e424b94c673b74c1e9ddd Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:52:35.159736 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 69b33db63c5e424b94c673b74c1e9ddd Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c5ca7127b38940269836120b64656004 Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: exception: Access list not available for public flavors. Jun 04 20:52:35.161019 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'flavor_id': '1442604034'} Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 04 20:52:35.161699 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:35.162963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8af01cb1-ec45-4651-8aa6-1b1920777cf8 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:52:35.162963 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8af01cb1-ec45-4651-8aa6-1b1920777cf8 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/1442604034/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.036996 Jun 04 20:52:35.169025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 19/42] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 20:52:35 2022] GET /compute/v2.1/flavors/1442604034/os-flavor-access => generated 91 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:52:35.197634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc2e07c0-b8d7-4875-9cb2-74bd8a733f09 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:35.202068 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:35.202068 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:35.227605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:35.260605 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc2e07c0-b8d7-4875-9cb2-74bd8a733f09 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1442604034" status: 202 len: 0 microversion: 2.1 time: 0.087808 Jun 04 20:52:35.265098 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:35 2022] DELETE /compute/v2.1/flavors/1442604034 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:35.279584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f489f59-11fc-4334-9d9c-4216688f3c2a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:35.335449 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f489f59-11fc-4334-9d9c-4216688f3c2a tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066618 Jun 04 20:52:35.337164 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 21/44] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:35.351646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:35.353238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:35.384586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:35.385307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:35.386256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:35.387884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:35.650293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:35.661981 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2d66e55-a837-4797-9962-ea553ba96791 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1276 microversion: 2.1 time: 0.670862 Jun 04 20:52:35.662594 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 24/45] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:34 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1276 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:35.675145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33542ad2-08b5-4569-b341-c8003d77febc tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-222660120", "id": 1575695716, "os-flavor-access:is_public": "False"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:35.678332 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:35.678332 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:35.718045 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33542ad2-08b5-4569-b341-c8003d77febc tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.054300 Jun 04 20:52:35.718673 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:36.162611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:36.194866 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f8bb95a-1df6-4040-89d9-7defc8593614 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1296 microversion: 2.1 time: 0.856303 Jun 04 20:52:36.211523 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 22/47] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:35 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1296 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:36.678879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:36.679531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:36.706025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:36.707723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:36.708581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:36.713390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:36.988790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e98430f1-e631-4778-8108-bafb1e255d99 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:36.990091 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:36.990091 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:36.990994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e98430f1-e631-4778-8108-bafb1e255d99 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9f701c69994f4445b32c5b500d687260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f37a307cd1843549d1e715ed0ee917c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e98430f1-e631-4778-8108-bafb1e255d99 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Request method failure captured: Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/flavors/1575695716/action HTTP/1.1 Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 67 Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YK04RiQlOUGX3ylGttYoiIFLkE43V8-1IZS9qGJqmjXgthbVPYl4jfFH4LHhRhDL2l6218Pyn1cTONYZIXj8OpU1IyyvNmk-nHCukAASptOwtfhsQFAGqv8lW6DJAWfXKinZpR3gd4LOoxXHEzIZfPUClF-9J3FBx5cRSojUrJtGk Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7f37a307cd1843549d1e715ed0ee917c Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-249906207 Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:52:36.994215 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-249906207 Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7f37a307cd1843549d1e715ed0ee917c Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-249906207 Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsAccessNegativeTestJSON-249906207-project Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9f701c69994f4445b32c5b500d687260 Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-249906207-project Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: {"addTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} Jun 04 20:52:36.995346 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1575695716', 'body': {'addTenantAccess': {'tenant': '7f37a307cd1843549d1e715ed0ee917c'}}} Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:52:36.996037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 04 20:52:36.996978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:36.997980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e98430f1-e631-4778-8108-bafb1e255d99 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:52:37.004542 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e98430f1-e631-4778-8108-bafb1e255d99 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] 10.222.0.18 "POST /compute/v2.1/flavors/1575695716/action" status: 403 len: 130 microversion: 2.1 time: 1.269086 Jun 04 20:52:37.009600 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 26/48] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Jun 4 20:52:35 2022] POST /compute/v2.1/flavors/1575695716/action => generated 130 bytes in 1284 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:52:37.031256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-075a9646-3e15-4f2c-ab0e-69f92de9bc4e tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:37.034833 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:37.034833 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:37.106862 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-075a9646-3e15-4f2c-ab0e-69f92de9bc4e tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1575695716" status: 202 len: 0 microversion: 2.1 time: 0.095764 Jun 04 20:52:37.107960 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 27/49] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:37 2022] DELETE /compute/v2.1/flavors/1575695716 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:37.129414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ec114c60-5c58-4fac-9b3b-029b05f81ba9 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:37.199825 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ec114c60-5c58-4fac-9b3b-029b05f81ba9 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076018 Jun 04 20:52:37.204226 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 28/50] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:37.222903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:37.223706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:37.240697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:37.241157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:37.243794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:37.249803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:38.145252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:38.161027 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45dc7dc6-ca7a-4e92-a163-da2f07dfd690 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1296 microversion: 2.1 time: 0.951489 Jun 04 20:52:38.162988 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 29/51] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:37 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1296 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:38.171042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fab0d795-d4ce-4728-b48a-a3402074f940 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-429730032", "id": 59017703, "os-flavor-access:is_public": "False"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:38.181693 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:38.181693 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:38.226043 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fab0d795-d4ce-4728-b48a-a3402074f940 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.061633 Jun 04 20:52:38.233419 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 30/52] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:38 2022] POST /compute/v2.1/flavors => generated 432 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:38.247324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c61a944d-8d26-4cfa-b303-ca3f062fe373 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:38.254159 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:38.254159 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:38.753059 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c61a944d-8d26-4cfa-b303-ca3f062fe373 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/59017703/action" status: 200 len: 95 microversion: 2.1 time: 0.518155 Jun 04 20:52:38.755898 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 31/53] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:52:38 2022] POST /compute/v2.1/flavors/59017703/action => generated 95 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:38.774807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fac3301e-aaec-4651-b680-17bcda902142 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:38.782482 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:38.782482 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:38.786771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fac3301e-aaec-4651-b680-17bcda902142 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9f701c69994f4445b32c5b500d687260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f37a307cd1843549d1e715ed0ee917c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fac3301e-aaec-4651-b680-17bcda902142 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Request method failure captured: Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/flavors/59017703/action HTTP/1.1 Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 70 Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YK04RiQlOUGX3ylGttYoiIFLkE43V8-1IZS9qGJqmjXgthbVPYl4jfFH4LHhRhDL2l6218Pyn1cTONYZIXj8OpU1IyyvNmk-nHCukAASptOwtfhsQFAGqv8lW6DJAWfXKinZpR3gd4LOoxXHEzIZfPUClF-9J3FBx5cRSojUrJtGk Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7f37a307cd1843549d1e715ed0ee917c Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-249906207 Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:52:38.795090 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7f37a307cd1843549d1e715ed0ee917c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-249906207 Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7f37a307cd1843549d1e715ed0ee917c Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-249906207 Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsAccessNegativeTestJSON-249906207-project Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9f701c69994f4445b32c5b500d687260 Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-249906207-project Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: {"removeTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} Jun 04 20:52:38.796668 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '59017703', 'body': {'removeTenantAccess': {'tenant': '7f37a307cd1843549d1e715ed0ee917c'}}} Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can( Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:52:38.797446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 04 20:52:38.799488 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:38.805226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fac3301e-aaec-4651-b680-17bcda902142 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:52:38.807915 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fac3301e-aaec-4651-b680-17bcda902142 tempest-FlavorsAccessNegativeTestJSON-249906207 tempest-FlavorsAccessNegativeTestJSON-249906207-project] 10.222.0.18 "POST /compute/v2.1/flavors/59017703/action" status: 403 len: 133 microversion: 2.1 time: 0.044653 Jun 04 20:52:38.815769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 32/54] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:52:38 2022] POST /compute/v2.1/flavors/59017703/action => generated 133 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:52:38.837925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24f6605e-01f7-4039-ab45-0ea003218ce1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7f37a307cd1843549d1e715ed0ee917c"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:39.210344 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-24f6605e-01f7-4039-ab45-0ea003218ce1 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/59017703/action" status: 200 len: 21 microversion: 2.1 time: 0.383688 Jun 04 20:52:39.214797 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 33/55] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:52:38 2022] POST /compute/v2.1/flavors/59017703/action => generated 21 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:39.232182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:39.232460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:39.235406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:39.249429 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6533e605-59f7-49cf-b706-ec29a6c6ffc1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 2.574717 Jun 04 20:52:39.262092 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 23/56] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:36 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:52:39.270650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:39.280228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:39.282810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:39.286271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76e6021e-e524-49ed-b181-f739658811f4 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:39.286767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:39.287498 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:39.287498 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:39.356684 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76e6021e-e524-49ed-b181-f739658811f4 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/59017703" status: 202 len: 0 microversion: 2.1 time: 0.090492 Jun 04 20:52:39.357967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 24/57] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:52:39 2022] DELETE /compute/v2.1/flavors/59017703 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:39.385767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a660623b-697f-441f-af05-d66db7c41b99 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:39.464055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a660623b-697f-441f-af05-d66db7c41b99 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092510 Jun 04 20:52:39.467260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 25/58] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:39.486753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17e3c28b-fc1b-4e2f-be97-a2d404e3f995 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1948545153", "id": 1358967859, "os-flavor-access:is_public": "False"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:39.498321 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:39.498321 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:39.578810 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-17e3c28b-fc1b-4e2f-be97-a2d404e3f995 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.082146 Jun 04 20:52:39.586640 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 26/59] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:39 2022] POST /compute/v2.1/flavors => generated 439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:39.601101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a3eacd4-fe08-4318-8863-953e5ecc025b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5dfebfcbd66a448ab244276f70531d0d"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:39.615443 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:39.615443 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:39.666740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:39.689305 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04ed5ebb-fd01-4990-92b0-5ba4c9deb3c4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1296 microversion: 2.1 time: 0.461987 Jun 04 20:52:39.690081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 34/60] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:39 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1296 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:40.269538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:40.270403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:40.289308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:40.289783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:40.297188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:40.302469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:40.445729 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-6a3eacd4-fe08-4318-8863-953e5ecc025b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] HTTP exception thrown: Flavor access not found for 23 / 5dfebfcbd66a448ab244276f70531d0d combination. Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a3eacd4-fe08-4318-8863-953e5ecc025b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Request method failure captured: Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/flavors/1358967859/action HTTP/1.1 Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 70 Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YN51ZcvolsYfDg4gEowaVZs9uSCsD-sfqphra_wn6I8OC091xHgoqV-HQAdscUj9oT06n1dKHpftr6N36V3haKLbLN1FXnp5EqzwQ8u0t5aRKtNaZjccNTiUkWN62g7NwMH6YyWDxPPF8cB68OaC5VyoDOqsj_dMHoeb1HO8bT-KI Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 69b33db63c5e424b94c673b74c1e9ddd Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:52:40.451115 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/69b33db63c5e424b94c673b74c1e9ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 69b33db63c5e424b94c673b74c1e9ddd Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899 Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c5ca7127b38940269836120b64656004 Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: {"removeTenantAccess": {"tenant": "5dfebfcbd66a448ab244276f70531d0d"}} Jun 04 20:52:40.452334 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: exception: Flavor access not found for 23 / 5dfebfcbd66a448ab244276f70531d0d combination. Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '1358967859', 'body': {'removeTenantAccess': {'tenant': '5dfebfcbd66a448ab244276f70531d0d'}}} Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 04 20:52:40.453178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / 5dfebfcbd66a448ab244276f70531d0d combination. Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / 5dfebfcbd66a448ab244276f70531d0d combination. Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:40.454577 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / 5dfebfcbd66a448ab244276f70531d0d combination. Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a3eacd4-fe08-4318-8863-953e5ecc025b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Returning 404 to user: Flavor access not found for 23 / 5dfebfcbd66a448ab244276f70531d0d combination. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:52:40.455822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a3eacd4-fe08-4318-8863-953e5ecc025b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/1358967859/action" status: 404 len: 124 microversion: 2.1 time: 0.858032 Jun 04 20:52:40.459595 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 27/61] 10.222.0.18 () {60 vars in 1199 bytes} [Sat Jun 4 20:52:39 2022] POST /compute/v2.1/flavors/1358967859/action => generated 124 bytes in 867 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:52:40.472834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b512f5d7-ca7f-4015-880c-ab9c3cf15805 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:40.519491 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b512f5d7-ca7f-4015-880c-ab9c3cf15805 tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1358967859" status: 202 len: 0 microversion: 2.1 time: 0.057489 Jun 04 20:52:40.524292 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 28/62] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:40 2022] DELETE /compute/v2.1/flavors/1358967859 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:40.531688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00b1007f-1552-4ec9-837c-e3036f95ee0b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:40.593662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00b1007f-1552-4ec9-837c-e3036f95ee0b tempest-FlavorsAccessNegativeTestJSON-1482730899 tempest-FlavorsAccessNegativeTestJSON-1482730899-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066828 Jun 04 20:52:40.597073 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 29/63] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:40.707701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:40.708320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:40.724227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:40.726521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:40.728788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:40.731683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:41.592807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:41.606904 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9c78218d-142b-42ed-9a80-a5ea37ec72d2 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 1.341939 Jun 04 20:52:41.609584 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 35/64] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:40 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:42.013301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:42.029474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-29a0efcf-891b-4362-8bc1-ecc41a781154 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 1.326043 Jun 04 20:52:42.057035 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 30/65] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:40 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:42.627886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:42.628848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:42.641728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:42.642638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:42.644490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:42.644977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:42.662852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:42.663465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:43.058343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:43.059544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:43.066506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:43.072000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:43.104948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:43.105365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:43.112244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:43.114183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:43.218605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:43.241858 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-42568040-74c3-495c-ae37-b8dc0f6c6a73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.619658 Jun 04 20:52:43.249219 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 36/66] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:42 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:44.272545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:44.273231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:44.312929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:44.321809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:44.322789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:44.323247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:44.834967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:44.855812 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f803cad4-88a6-4698-8261-1ebf8c689bc0 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 1.793884 Jun 04 20:52:44.856512 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 31/67] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:43 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:45.816968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:45.837263 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2bbea51a-47a0-426a-9d5a-64dc4dcd7f73 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 1.564807 Jun 04 20:52:45.838105 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 37/68] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:44 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:45.874134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:45.874758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:45.882075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:45.882530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:45.883322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:45.901070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:46.072566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36595530-c364-48b9-a256-44400abb5bb0 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-400512477", "id": 982190251, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:46.075011 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:46.075011 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:46.121518 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36595530-c364-48b9-a256-44400abb5bb0 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.217965 Jun 04 20:52:46.130738 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 32/69] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:44 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:46.143146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9897d067-f3f9-4bc8-b1f6-ea53625f3895 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.143952 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:46.143952 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:46.202535 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9897d067-f3f9-4bc8-b1f6-ea53625f3895 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/982190251" status: 202 len: 0 microversion: 2.1 time: 0.070412 Jun 04 20:52:46.203343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 33/70] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:52:46 2022] DELETE /compute/v2.1/flavors/982190251 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:46.219383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b25b771c-d98b-42b7-85a6-6ec0625ea095 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.258471 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b25b771c-d98b-42b7-85a6-6ec0625ea095 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050023 Jun 04 20:52:46.273115 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 34/71] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:46.295675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a6a029e1-5fbb-42a7-be34-c4d706280f2a tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-910573570", "id": 1300301608, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:46.365929 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a6a029e1-5fbb-42a7-be34-c4d706280f2a tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.056375 Jun 04 20:52:46.369813 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 35/72] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:46 2022] POST /compute/v2.1/flavors => generated 416 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:46.410640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f4d3602-41d2-4b50-b21f-00b2a5383705 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.465054 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f4d3602-41d2-4b50-b21f-00b2a5383705 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.084256 Jun 04 20:52:46.474246 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 36/73] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:46 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:46.505495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f15ef29-a676-45dc-b0d1-77de2a66da9d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.589178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f15ef29-a676-45dc-b0d1-77de2a66da9d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1300301608" status: 202 len: 0 microversion: 2.1 time: 0.102826 Jun 04 20:52:46.594476 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 37/74] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:46 2022] DELETE /compute/v2.1/flavors/1300301608 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:46.618029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5ceba7ab-76ad-42dc-924b-2947246c25e8 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.694603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:46.697410 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5ceba7ab-76ad-42dc-924b-2947246c25e8 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097537 Jun 04 20:52:46.702405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:46.718499 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b1f7d9c-72e2-4be1-8451-1eca3692878d tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.847294 Jun 04 20:52:46.719738 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:45 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:46.720684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66a40c4f-de3d-4181-b556-3408b54963fa tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1402749260", "id": 1876963072, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:46.765951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66a40c4f-de3d-4181-b556-3408b54963fa tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.049298 Jun 04 20:52:46.781538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f14074bb-e327-43c6-823e-c1021be13d2e tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.782378 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:46.782378 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:46.787821 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 39/77] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:46 2022] POST /compute/v2.1/flavors => generated 429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:46.830925 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f14074bb-e327-43c6-823e-c1021be13d2e tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1876963072" status: 202 len: 0 microversion: 2.1 time: 0.055475 Jun 04 20:52:46.835723 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:46 2022] DELETE /compute/v2.1/flavors/1876963072 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:46.842681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a42d63c1-1d35-4793-a6b8-768994d8d5aa tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.870884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.871853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:46.880301 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a42d63c1-1d35-4793-a6b8-768994d8d5aa tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042934 Jun 04 20:52:46.891576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:46.893476 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:46.897672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:46.899887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:46.900274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:46.900644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e4d2b491-1699-4203-a738-7f6acc93e27d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2104767559", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:46.925074 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e4d2b491-1699-4203-a738-7f6acc93e27d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.030054 Jun 04 20:52:46.932465 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 41/80] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:46 2022] POST /compute/v2.1/flavors => generated 507 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:46.938560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-defc295a-69f2-4055-869c-f142f17ab928 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:46.967468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-defc295a-69f2-4055-869c-f142f17ab928 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/e33bb6ff-71d0-4c08-92e9-46a67bc1d4e1" status: 202 len: 0 microversion: 2.1 time: 0.033199 Jun 04 20:52:46.973583 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 42/81] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:52:46 2022] DELETE /compute/v2.1/flavors/e33bb6ff-71d0-4c08-92e9-46a67bc1d4e1 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:46.986293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e86ca75-095d-4079-a978-043854638bb2 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:47.041714 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e86ca75-095d-4079-a978-043854638bb2 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064728 Jun 04 20:52:47.044470 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 43/82] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:47.067209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-39d2c18a-62a7-4a4f-aaa8-632be3ff59d7 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1519228985", "id": "1ad11560-8a0a-4fbd-94fe-bac96b65336b", "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:47.140530 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-39d2c18a-62a7-4a4f-aaa8-632be3ff59d7 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.076877 Jun 04 20:52:47.148638 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 44/83] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:47 2022] POST /compute/v2.1/flavors => generated 507 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:47.169384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e5f7e3d-eadd-4fb8-b5d5-d5c640de6aca tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:47.237833 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e5f7e3d-eadd-4fb8-b5d5-d5c640de6aca tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1ad11560-8a0a-4fbd-94fe-bac96b65336b" status: 202 len: 0 microversion: 2.1 time: 0.076895 Jun 04 20:52:47.240934 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 45/84] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:52:47 2022] DELETE /compute/v2.1/flavors/1ad11560-8a0a-4fbd-94fe-bac96b65336b => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:47.254291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d41b74d-0808-41ad-b965-2be1d45e9620 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:47.305027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:DELETE=21,nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:47.324837 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d41b74d-0808-41ad-b965-2be1d45e9620 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080099 Jun 04 20:52:47.330530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 46/85] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:47.350048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a3662e5-2b92-4c97-b70e-1e608e541829 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-698637769", "id": 52241568, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:47.430335 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a3662e5-2b92-4c97-b70e-1e608e541829 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.084135 Jun 04 20:52:47.434671 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 47/86] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:47.456807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50f79b1e-a959-4f67-bfb0-061480cb2318 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:47.501164 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50f79b1e-a959-4f67-bfb0-061480cb2318 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/52241568" status: 200 len: 407 microversion: 2.1 time: 0.062481 Jun 04 20:52:47.501998 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 48/87] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:52:47 2022] GET /compute/v2.1/flavors/52241568 => generated 407 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:48.066362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:48.075424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6c66617-1046-4008-8300-1e680d523821 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 1.222961 Jun 04 20:52:48.090346 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 40/88] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:46 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:48.098758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:48.124379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:48.146559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:48.147367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:48.149223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:48.152061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:48.200708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-069a1604-2f57-48fe-a062-fe4098a48afc tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:48.286886 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-069a1604-2f57-48fe-a062-fe4098a48afc tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5388 microversion: 2.1 time: 0.765494 Jun 04 20:52:48.312737 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 49/89] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:47 2022] GET /compute/v2.1/flavors/detail => generated 5388 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:48.704624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:48.713161 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b8d0eb5-c18a-414f-bd4f-d509c59f6e22 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.618888 Jun 04 20:52:48.718613 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 41/90] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:48 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:48.726387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a9417116-e971-429c-9884-fca55b854dd8 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:48.731459 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:48.731459 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:48.775156 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a9417116-e971-429c-9884-fca55b854dd8 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/52241568" status: 202 len: 0 microversion: 2.1 time: 0.054980 Jun 04 20:52:48.776188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 42/91] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:52:48 2022] DELETE /compute/v2.1/flavors/52241568 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:48.797382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-041f3dd7-fdf6-4f5c-82e4-f34409080537 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:48.875441 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-041f3dd7-fdf6-4f5c-82e4-f34409080537 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091248 Jun 04 20:52:48.891458 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 43/92] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:48.902999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-27ac823c-1033-4b00-8b88-275b32edf4be tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1690815400", "id": 768652941, "os-flavor-access:is_public": "False"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:48.906624 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:48.906624 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:48.933479 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-27ac823c-1033-4b00-8b88-275b32edf4be tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.039417 Jun 04 20:52:48.934995 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 44/93] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:48 2022] POST /compute/v2.1/flavors => generated 427 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:48.953629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4635f2e3-28aa-4d45-acae-268bb33d89d0 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "768652941"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:48.973052 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4635f2e3-28aa-4d45-acae-268bb33d89d0 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] HTTP exception thrown: Flavor 768652941 could not be found. Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4635f2e3-28aa-4d45-acae-268bb33d89d0 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] Request method failure captured: Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 106 Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YZbAebWyTm6gGQbNAtKwEkB3Sa7BuAkEm67cywxUykfAJc-cVpyWdGToxs2z_zUJOvi0p9BQ8HicarKNNyARczQHn4nsY1aOfdmcCG05sVWQHAaenQv_MQ6c8btUWXxLlYBYxwRmSAuzxQBro0graZxjYUQrR0EBqirTNQcpGS_1k Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a3b98c9704a043ea8089ae0910ca9053 Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsAdminTestJSON-1121632038 Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:52:48.978956 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3b98c9704a043ea8089ae0910ca9053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3b98c9704a043ea8089ae0910ca9053"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3b98c9704a043ea8089ae0910ca9053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3b98c9704a043ea8089ae0910ca9053"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsAdminTestJSON-1121632038 Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a3b98c9704a043ea8089ae0910ca9053 Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1121632038 Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsAdminTestJSON-1121632038-project Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: a4a4d09ab8484e458a96593fcbfdcbbd Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsAdminTestJSON-1121632038-project Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "test", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "768652941"}} Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:52:48.980594 ncdv-master-1 devstack@n-api.service[137228]: exception: Flavor 768652941 could not be found. Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '768652941'}}} Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 768652941 could not be found. Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:48.981551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 768652941 could not be found. Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:52:48.982793 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:52:48.988049 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:52:48.988049 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:52:48.988049 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:52:48.988049 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 768652941 could not be found. Jun 04 20:52:48.988049 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:52:48.993429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4635f2e3-28aa-4d45-acae-268bb33d89d0 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] Returning 400 to user: Flavor 768652941 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:52:48.994822 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4635f2e3-28aa-4d45-acae-268bb33d89d0 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.051757 Jun 04 20:52:48.996438 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 45/94] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:48 2022] POST /compute/v2.1/servers => generated 80 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:49.080941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-59724c02-4dcb-4e6d-b683-507dd219510c req-b58cb29b-ddf8-4802-b54f-4a90d0d21ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "254eb6e8-3c1f-4065-835c-fc095e96a562", "tag": "eeca4c3c-b026-4be8-9764-28b53e277e59"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:49.136052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-59724c02-4dcb-4e6d-b683-507dd219510c req-b58cb29b-ddf8-4802-b54f-4a90d0d21ca9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.140144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-59724c02-4dcb-4e6d-b683-507dd219510c req-b58cb29b-ddf8-4802-b54f-4a90d0d21ca9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:49.234682 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-59724c02-4dcb-4e6d-b683-507dd219510c req-b58cb29b-ddf8-4802-b54f-4a90d0d21ca9 service nova] Creating event network-changed:eeca4c3c-b026-4be8-9764-28b53e277e59 for instance 254eb6e8-3c1f-4065-835c-fc095e96a562 on nch1-master-1 Jun 04 20:52:49.235684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-59724c02-4dcb-4e6d-b683-507dd219510c req-b58cb29b-ddf8-4802-b54f-4a90d0d21ca9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:52:49.242146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.242860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:49.244022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.244712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:49.295777 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.rpcapi [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 04 20:52:49.297350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] Releasing lock "compute-rpcapi-router" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:52:49.361610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec1293a6-612e-4d54-b051-397da56ac44a None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047113 Jun 04 20:52:49.362751 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 50/95] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:49.370974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aff9a68a-f619-4318-b5f8-aab44fec0bff tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:49.373210 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:49.373210 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:49.441719 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aff9a68a-f619-4318-b5f8-aab44fec0bff tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/768652941" status: 202 len: 0 microversion: 2.1 time: 0.075094 Jun 04 20:52:49.446476 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 51/96] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:52:49 2022] DELETE /compute/v2.1/flavors/768652941 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:49.468106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:49.471218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:49.483106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.484491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:49.487186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.488409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:49.761686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:49.780497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a726128-59cb-4e96-bfcb-d15683a88964 tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] Calling method '.version_select at 0x7f2d080f2ca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:49.781943 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04254e2f-3544-4344-93e8-e01a4c95d30c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.329387 Jun 04 20:52:49.782297 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:49.782297 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:49.784825 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 52/97] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:49 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:49.812750 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a726128-59cb-4e96-bfcb-d15683a88964 tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.814790 Jun 04 20:52:49.813821 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 46/98] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 20:52:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:49.831416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83ee755a-e43b-4854-86a6-28ecb2141d80 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:49.871744 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83ee755a-e43b-4854-86a6-28ecb2141d80 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050528 Jun 04 20:52:49.872777 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 47/99] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:49.885049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:49.888373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:49.903632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.904728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:49.905886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:49.906541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:50.359766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:50.382030 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e297246e-075f-4e09-95b6-2cbe2d96d4cc tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.501949 Jun 04 20:52:50.398011 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 48/100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:49 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:50.408511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d2eb07a9-863d-4be3-88b5-723a3cfca903 req-66fed4de-7006-4104-8b86-38c1f684ec52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7435eee0-6714-4225-9759-fff2ed40dcc5", "tag": "9f7970ad-a469-46b4-917a-773476de78ef"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:50.422070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-270b7ef4-3ced-42de-a39d-ec5016c1df9c tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] Action: 'update', calling method: .version_select at 0x7f2d0812d790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:50.425822 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:50.425822 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:50.436539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d2eb07a9-863d-4be3-88b5-723a3cfca903 req-66fed4de-7006-4104-8b86-38c1f684ec52 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:50.438240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d2eb07a9-863d-4be3-88b5-723a3cfca903 req-66fed4de-7006-4104-8b86-38c1f684ec52 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:50.477620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d2eb07a9-863d-4be3-88b5-723a3cfca903 req-66fed4de-7006-4104-8b86-38c1f684ec52 service nova] Creating event network-changed:9f7970ad-a469-46b4-917a-773476de78ef for instance 7435eee0-6714-4225-9759-fff2ed40dcc5 on nch2-master-1 Jun 04 20:52:50.496384 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d2eb07a9-863d-4be3-88b5-723a3cfca903 req-66fed4de-7006-4104-8b86-38c1f684ec52 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.694273 Jun 04 20:52:50.501411 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 53/101] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:50.521892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=16,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:50.522224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1424244a-4015-4445-a508-f95f55383302 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-987547488", "id": 2048256925, "os-flavor-access:is_public": "False"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:50.531094 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:50.531094 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:50.597291 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1424244a-4015-4445-a508-f95f55383302 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.090468 Jun 04 20:52:50.600503 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 54/102] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:50 2022] POST /compute/v2.1/flavors => generated 414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:50.617850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cf4082da-7685-4f0b-bba5-df76447e99c4 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1364376164", "id": 219085354, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:50.668719 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cf4082da-7685-4f0b-bba5-df76447e99c4 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.057954 Jun 04 20:52:50.672429 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 55/103] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:50 2022] POST /compute/v2.1/flavors => generated 411 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:50.684565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d6f4c25-b226-4c40-99a1-646bd042bb9b tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:50.727789 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d6f4c25-b226-4c40-99a1-646bd042bb9b tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.039423 Jun 04 20:52:50.737205 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 56/104] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Jun 4 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:50.742561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-efedf5d1-0cde-4fd9-9704-cc1baa5e2c1c tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:50.753296 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-efedf5d1-0cde-4fd9-9704-cc1baa5e2c1c tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.014802 Jun 04 20:52:50.761083 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 57/105] 10.222.0.18 () {58 vars in 1176 bytes} [Sat Jun 4 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:50.766360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-931ad683-c9c3-4c7e-a123-380d9684f7f1 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:50.782268 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-931ad683-c9c3-4c7e-a123-380d9684f7f1 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.019764 Jun 04 20:52:50.789540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 58/106] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Jun 4 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:50.799276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5155ca9a-3ccc-4a8f-9953-460a7cedfe6d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:50.826111 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5155ca9a-3ccc-4a8f-9953-460a7cedfe6d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.034712 Jun 04 20:52:50.827212 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 59/107] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Jun 4 20:52:50 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:50.850446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:50.854989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:50.880756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:50.881435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:50.885730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:50.886224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:51.229805 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-270b7ef4-3ced-42de-a39d-ec5016c1df9c tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.825204 Jun 04 20:52:51.237731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 49/108] 10.222.0.18 () {60 vars in 1205 bytes} [Sat Jun 4 20:52:50 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:51.242023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be473881-d654-4c8d-a849-8280b97cf60d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:51.295183 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be473881-d654-4c8d-a849-8280b97cf60d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.060228 Jun 04 20:52:51.301245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 50/109] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Jun 4 20:52:51 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:51.323790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e7c3a2a-475b-4aca-922e-90ef3a2c3670 tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] Calling method '.version_select at 0x7f2d08143dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:51.339126 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:51.339126 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:51.396337 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e7c3a2a-475b-4aca-922e-90ef3a2c3670 tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.092248 Jun 04 20:52:51.399606 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 51/110] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 20:52:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:51.431109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-74edb4ee-dfc1-4e5c-9aa3-1a361855c53e tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:51.510176 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-74edb4ee-dfc1-4e5c-9aa3-1a361855c53e tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.104791 Jun 04 20:52:51.514497 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 52/111] 10.222.0.18 () {58 vars in 1174 bytes} [Sat Jun 4 20:52:51 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:51.529250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:51.529930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:51.550725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:51.551629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:51.556027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:51.556850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:52.251826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:52.270519 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0f72e763-af99-41d8-b869-3f97d367ac48 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 1.433144 Jun 04 20:52:52.271658 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 60/112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:50 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:52.285706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97c4a3c5-fade-4d6e-ba0c-11324189adfa tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] Action: 'update', calling method: .version_select at 0x7f2d036fcb80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:52.291731 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:52.291731 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:52.557742 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97c4a3c5-fade-4d6e-ba0c-11324189adfa tempest-QuotaClassesAdminTestJSON-1204554853 tempest-QuotaClassesAdminTestJSON-1204554853-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.283454 Jun 04 20:52:52.558716 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 61/113] 10.222.0.18 () {60 vars in 1205 bytes} [Sat Jun 4 20:52:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:52.571070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c1983e59-11cd-45d2-8a9c-58d335becfcf tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:52.593669 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c1983e59-11cd-45d2-8a9c-58d335becfcf tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.026868 Jun 04 20:52:52.605226 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 62/114] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Jun 4 20:52:52 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:52.642252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:52.653471 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46e86c66-be60-4f94-85d1-e4677f4a5bd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 1.138497 Jun 04 20:52:52.654253 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 53/115] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:51 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:52.696874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd505ff7-a99f-4a45-a12a-9a001d92de76 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:52.795078 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd505ff7-a99f-4a45-a12a-9a001d92de76 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.139536 Jun 04 20:52:52.798273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 54/116] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Jun 4 20:52:52 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:52.828523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7733386d-4dc6-4f1d-b571-e1d1c6ff59bd tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:52.829684 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:52.829684 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:52.900524 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7733386d-4dc6-4f1d-b571-e1d1c6ff59bd tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/219085354" status: 202 len: 0 microversion: 2.1 time: 0.085826 Jun 04 20:52:52.910692 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 55/117] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:52:52 2022] DELETE /compute/v2.1/flavors/219085354 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:52.928222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8351c7da-ecbf-4064-bb7c-b5803af3a80d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.002412 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8351c7da-ecbf-4064-bb7c-b5803af3a80d tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089868 Jun 04 20:52:53.007720 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 56/118] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:53.029662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aeb48ec9-8e50-46ec-9577-4c9ad8fd0624 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.089019 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aeb48ec9-8e50-46ec-9577-4c9ad8fd0624 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2048256925" status: 202 len: 0 microversion: 2.1 time: 0.068600 Jun 04 20:52:53.096801 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 57/119] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:53 2022] DELETE /compute/v2.1/flavors/2048256925 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:52:53.110649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-048a4460-a63b-423a-8f91-9f88a3f77a0a tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.131181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ec91d826-a8e2-4693-84a7-6d1e874ffbc0 tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1842349809", "id": 2051129351, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:53.134539 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:53.134539 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:53.180719 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-048a4460-a63b-423a-8f91-9f88a3f77a0a tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080532 Jun 04 20:52:53.186731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 58/120] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:53.191011 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec91d826-a8e2-4693-84a7-6d1e874ffbc0 tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.579181 Jun 04 20:52:53.191874 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 63/121] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:52:52 2022] POST /compute/v2.1/flavors => generated 449 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:53.217572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cc6916fa-1748-4067-a7d8-96c109623036 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1041681586", "id": 829883407, "os-flavor-access:is_public": "False"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:53.222290 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:53.222290 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:53.261773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cc6916fa-1748-4067-a7d8-96c109623036 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.055242 Jun 04 20:52:53.266301 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 59/122] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:53 2022] POST /compute/v2.1/flavors => generated 412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:53.278148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f14680a1-0ce6-4cd8-a7db-93179c88a1bc tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.336399 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f14680a1-0ce6-4cd8-a7db-93179c88a1bc tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.063468 Jun 04 20:52:53.341076 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 60/123] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:53 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:52:53.358791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.360003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:53.376053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:53.377054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:53.378402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:53.379284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:53.778165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:53.804222 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-162b6ba5-1899-4f76-9395-2a82c7f45668 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.461623 Jun 04 20:52:53.805065 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 61/124] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:53 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:53.818023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6eea39c-8527-45f4-b84a-a152e7b5c118 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.905398 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6eea39c-8527-45f4-b84a-a152e7b5c118 tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.098929 Jun 04 20:52:53.915493 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 62/125] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:53 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:53.915493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:53.916015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:53.925589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:53.926139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:53.926942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:53.928262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.256309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83378903-17c7-401d-ac65-d49e45eb0941 tempest-FlavorsV255TestJSON-113731745 tempest-FlavorsV255TestJSON-113731745-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.281851 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83378903-17c7-401d-ac65-d49e45eb0941 tempest-FlavorsV255TestJSON-113731745 tempest-FlavorsV255TestJSON-113731745-project] 10.222.0.18 "GET /compute/v2.1/flavors/2051129351" status: 200 len: 449 microversion: 2.55 time: 1.074246 Jun 04 20:52:54.283186 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 64/126] 10.222.0.18 () {60 vars in 1198 bytes} [Sat Jun 4 20:52:53 2022] GET /compute/v2.1/flavors/2051129351 => generated 449 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:54.299117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:54.310439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c53166d-48a7-431c-acdf-0065a58d8e29 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.311426 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:54.311426 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:54.317298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:54.323271 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d0286f08-60b7-4d42-900c-90cf555b6ae5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.415259 Jun 04 20:52:54.329537 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 63/127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:53 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:54.389148 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c53166d-48a7-431c-acdf-0065a58d8e29 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/829883407" status: 202 len: 0 microversion: 2.1 time: 0.102705 Jun 04 20:52:54.391576 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 65/128] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:52:54 2022] DELETE /compute/v2.1/flavors/829883407 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:54.406477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-884a75f8-9e6f-40b6-83e8-f85ccb125cff tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:54.413430 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:54.413430 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:54.503981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-884a75f8-9e6f-40b6-83e8-f85ccb125cff tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/2051129351" status: 200 len: 450 microversion: 2.55 time: 0.096363 Jun 04 20:52:54.509196 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 66/129] 10.222.0.18 () {62 vars in 1218 bytes} [Sat Jun 4 20:52:54 2022] PUT /compute/v2.1/flavors/2051129351 => generated 450 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:52:54.531130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de64e89c-76b5-4910-9b3d-6ea208a1d26c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d08143dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.532663 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:54.532663 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:54.536793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de64e89c-76b5-4910-9b3d-6ea208a1d26c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.537949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de64e89c-76b5-4910-9b3d-6ea208a1d26c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.538587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5931138-78ab-4964-a20f-e7d6c6043c0c tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.539778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de64e89c-76b5-4910-9b3d-6ea208a1d26c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.542894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de64e89c-76b5-4910-9b3d-6ea208a1d26c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.605699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5931138-78ab-4964-a20f-e7d6c6043c0c tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.094843 Jun 04 20:52:54.608065 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 67/130] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:54.624808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1027c42a-436a-4ad3-aa78-0eac2ed14e24 tempest-FlavorsV255TestJSON-113731745 tempest-FlavorsV255TestJSON-113731745-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.643547 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de64e89c-76b5-4910-9b3d-6ea208a1d26c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.309858 Jun 04 20:52:54.647155 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 64/131] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:54.660868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-18c44010-ff7a-445e-ad02-37d1fe7858f6 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1542646589", "id": 2111212581, "os-flavor-access:is_public": "True"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:54.665982 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:54.665982 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:52:54.673334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=12,nova_api:UPDATE=10,nova_api:DELETE=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:54.685527 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1027c42a-436a-4ad3-aa78-0eac2ed14e24 tempest-FlavorsV255TestJSON-113731745 tempest-FlavorsV255TestJSON-113731745-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.073133 Jun 04 20:52:54.688359 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 68/132] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:54.704550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4ba214a-da73-412f-b466-f3a45fca340e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d03749700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.706489 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:54.706489 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:54.711845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-18c44010-ff7a-445e-ad02-37d1fe7858f6 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.060256 Jun 04 20:52:54.716153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4ba214a-da73-412f-b466-f3a45fca340e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.718536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4ba214a-da73-412f-b466-f3a45fca340e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.723584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4ba214a-da73-412f-b466-f3a45fca340e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.728048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 65/133] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:54 2022] POST /compute/v2.1/flavors => generated 414 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:54.733490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4ba214a-da73-412f-b466-f3a45fca340e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.742342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bf7019ca-f1da-476f-a329-008cb8c81159 tempest-FlavorsV255TestJSON-113731745 tempest-FlavorsV255TestJSON-113731745-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.812772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4ba214a-da73-412f-b466-f3a45fca340e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 400 microversion: 2.1 time: 0.116534 Jun 04 20:52:54.817823 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 69/134] 10.222.0.18 () {58 vars in 1138 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/os-hosts?zone= => generated 400 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:54.832383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-164777fb-33e9-4322-a3ea-f72f20ad061f tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.834466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bf7019ca-f1da-476f-a329-008cb8c81159 tempest-FlavorsV255TestJSON-113731745 tempest-FlavorsV255TestJSON-113731745-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3411 microversion: 2.55 time: 0.104660 Jun 04 20:52:54.835964 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 66/135] 10.222.0.18 () {60 vars in 1165 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/flavors => generated 3411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:54.851060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.852260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:54.871700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.872679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.872932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.873367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.888739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-164777fb-33e9-4322-a3ea-f72f20ad061f tempest-FlavorsAdminTestJSON-1121632038 tempest-FlavorsAdminTestJSON-1121632038-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5813 microversion: 2.1 time: 0.066262 Jun 04 20:52:54.893719 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 70/136] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/flavors/detail => generated 5813 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:54.900763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02e09688-d1f9-4b12-994d-ae3a25c54a2e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d0367c280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:54.908511 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:54.908511 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:54.914348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e09688-d1f9-4b12-994d-ae3a25c54a2e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.915187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e09688-d1f9-4b12-994d-ae3a25c54a2e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.917838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e09688-d1f9-4b12-994d-ae3a25c54a2e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:54.920241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e09688-d1f9-4b12-994d-ae3a25c54a2e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:54.986771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:DELETE=6,nova_api:UPDATE=13 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:55.009991 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02e09688-d1f9-4b12-994d-ae3a25c54a2e tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.114443 Jun 04 20:52:55.015893 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 71/137] 10.222.0.18 () {58 vars in 1144 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:55.024369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-109c41f3-6ad8-4f1d-9e4a-f6f1e3d99dd6 tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:55.028566 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:55.028566 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:55.081203 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-109c41f3-6ad8-4f1d-9e4a-f6f1e3d99dd6 tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2051129351" status: 202 len: 0 microversion: 2.55 time: 0.063432 Jun 04 20:52:55.088614 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 72/138] 10.222.0.18 () {60 vars in 1201 bytes} [Sat Jun 4 20:52:55 2022] DELETE /compute/v2.1/flavors/2051129351 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:52:55.095902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66345ecc-f507-41fd-8538-1ff9c12a5efa tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:55.136918 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66345ecc-f507-41fd-8538-1ff9c12a5efa tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/2111212581" status: 202 len: 0 microversion: 2.1 time: 0.051059 Jun 04 20:52:55.138866 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 73/139] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:52:55 2022] DELETE /compute/v2.1/flavors/2111212581 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:52:55.149797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c2808fe-d763-4099-a769-6967597c2be0 tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:55.190635 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c2808fe-d763-4099-a769-6967597c2be0 tempest-FlavorsV255TestJSON-229493958 tempest-FlavorsV255TestJSON-229493958-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.050573 Jun 04 20:52:55.200016 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 74/140] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:52:55 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:52:55.213447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1ea65851-e6f4-4573-a00b-886126f7e067 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:55.263925 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1ea65851-e6f4-4573-a00b-886126f7e067 tempest-FlavorsAdminTestJSON-1263781889 tempest-FlavorsAdminTestJSON-1263781889-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062565 Jun 04 20:52:55.266722 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 75/141] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:52:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:55.353811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:55.354261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:55.407954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:55.408618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:55.410210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:55.418228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:55.428568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:55.460963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b5a30fa3-8250-4b17-87cf-e1ebb606aa9a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.616108 Jun 04 20:52:55.462748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 67/142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:54 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:55.974553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:55.990361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=61 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:55.993227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3b833ae3-cf2e-4599-94da-cfb079ed6fd4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.648699 Jun 04 20:52:55.993832 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 76/143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:55 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:56.484692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:56.485578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:56.509320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:56.530661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:56.534110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:56.540288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:57.010938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:57.012156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:57.030549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:57.032136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:57.034025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:57.036371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:57.234898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:57.249685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c5b25703-1605-4350-a7a8-1a5668ea317e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.767665 Jun 04 20:52:57.251019 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 68/144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:56 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:57.394234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:57.403932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2d89cc1b-4ce0-48c7-bd2b-687481936a32 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.397364 Jun 04 20:52:57.404517 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 77/145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:57 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:57.835104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd6ccd3a-7338-4eda-b7b0-63ffc39806fd tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:57.849371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd6ccd3a-7338-4eda-b7b0-63ffc39806fd tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.528855 Jun 04 20:52:57.849963 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 69/146] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:52:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:52:58.268265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:58.269019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:58.275967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:58.276530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:58.277470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:58.278040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:58.322508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-650a7d04-be1a-44f3-84c0-ce657649d5da tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2099425914", "id": 1090592326, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:58.327674 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:52:58.327674 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:52:58.361458 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-650a7d04-be1a-44f3-84c0-ce657649d5da tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.501553 Jun 04 20:52:58.363010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 78/147] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:57 2022] POST /compute/v2.1/flavors => generated 425 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:58.388315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9bd91e6-6d17-4973-a748-e7755cb4d9c6 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:58.406186 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9bd91e6-6d17-4973-a748-e7755cb4d9c6 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032337 Jun 04 20:52:58.407460 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 79/148] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Jun 4 20:52:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 20:52:58.419170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b0fe5eb-2c0d-4e22-8364-93e7b6a50355 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2004960374", "id": 630456234, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:58.445600 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b0fe5eb-2c0d-4e22-8364-93e7b6a50355 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.033159 Jun 04 20:52:58.446867 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 80/149] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:52:58 2022] POST /compute/v2.1/flavors => generated 422 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:58.452607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:58.453563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:58.462033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:58.463059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:58.464944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:58.465585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:58.481858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:58.493620 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4ae5d8e-7b9d-47d3-9ed8-292b9edb6cc0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.229546 Jun 04 20:52:58.497542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 70/150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:58 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:52:58.508265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0a2d91cc-a006-407a-b262-a6928a3f3a68 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:58.530247 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0a2d91cc-a006-407a-b262-a6928a3f3a68 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026098 Jun 04 20:52:58.532604 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 71/151] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Jun 4 20:52:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:52:58.553440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-06ec87a6-055f-4331-9235-7cdd3678f880 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Action: 'create', calling method: .version_select at 0x7f2d08076c10>, body: {"keypair": {"name": "tempest-keypair-559223619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxRFlyFOwKgA6RJg/ngZ40plD5j0gwlMv8bzLsO0VosZEORqAqqTHuhfkCcpW/fWVwZLF11Fw58p9Hc95lSflwVfwpgMq+POpJ8755W8ZFR5dkLvW1arSo453YQZdSZQA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:52:58.587143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-06ec87a6-055f-4331-9235-7cdd3678f880 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Getting quotas for project afaae81a01be4c73acb908aae5be8312. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:52:58.593132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-06ec87a6-055f-4331-9235-7cdd3678f880 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Getting quotas for user 90a9faf4a615437ca499c0ccbc1e7563 and project afaae81a01be4c73acb908aae5be8312. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:52:58.634764 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-06ec87a6-055f-4331-9235-7cdd3678f880 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093836 Jun 04 20:52:58.636389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 72/152] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:52:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:52:58.678575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:58.687396 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-911200a0-bbc2-4f94-962d-7abad7e32071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.239198 Jun 04 20:52:58.698405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 81/153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:58 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:52:59.515642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:59.516572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:59.526789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:59.527904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:59.529895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:59.530895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:59.705633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:52:59.706878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:52:59.717780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:59.718230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:59.719052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:52:59.719753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:52:59.895140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:52:59.909665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d9712200-4956-420d-82fe-55389a2d7640 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.398348 Jun 04 20:52:59.913314 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 73/154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:59 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:00.005732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:00.014615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8f6e751-4afa-4931-aa30-d941ce7a86f4 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.312997 Jun 04 20:53:00.015210 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 82/155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:52:59 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:00.745532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33596060-cd68-4281-bc6e-6a71277b0d06 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-245442904", "ram": 512, "vcpus": 1, "disk": 10, "id": 876311757, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:00.747451 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:00.747451 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:00.794758 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33596060-cd68-4281-bc6e-6a71277b0d06 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.403419 Jun 04 20:53:00.796475 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 74/156] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:00 2022] POST /compute/v2.1/flavors => generated 412 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:00.814737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4028e2c7-4a37-41df-9af9-ca9acbef9f45 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:00.816446 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:00.816446 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:00.882796 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4028e2c7-4a37-41df-9af9-ca9acbef9f45 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079814 Jun 04 20:53:00.883404 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 83/157] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Jun 4 20:53:00 2022] POST /compute/v2.1/flavors/876311757/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:00.929750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:00.930674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:00.945436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:00.946167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:00.947185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:00.948056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:01.154747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:01.164938 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2dead24d-f3ca-4e24-96a9-7dfd3c79e47d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.239453 Jun 04 20:53:01.165877 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 84/158] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:00 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:01.172004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.172614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:01.179663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:01.180337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:01.181288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:01.182492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:01.366925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:01.380989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dec32b73-60ac-4a2d-8565-8c1870c3c5e5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.213378 Jun 04 20:53:01.381394 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 85/159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:01 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:01.415438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01a7a3d8-4d5e-4ef1-b592-e9ee56d130ea tempest-FlavorsExtraSpecsTestJSON-1016188039 tempest-FlavorsExtraSpecsTestJSON-1016188039-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.428507 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01a7a3d8-4d5e-4ef1-b592-e9ee56d130ea tempest-FlavorsExtraSpecsTestJSON-1016188039 tempest-FlavorsExtraSpecsTestJSON-1016188039-project] 10.222.0.18 "GET /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.538556 Jun 04 20:53:01.434710 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 75/160] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Jun 4 20:53:00 2022] GET /compute/v2.1/flavors/876311757/os-extra_specs => generated 66 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.439405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f2b64f48-d5d9-4434-8115-eb665f5e0375 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:01.440985 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:01.440985 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:01.472779 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f2b64f48-d5d9-4434-8115-eb665f5e0375 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037423 Jun 04 20:53:01.476055 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 86/161] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Jun 4 20:53:01 2022] POST /compute/v2.1/flavors/876311757/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.484668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e1e18cc2-9b81-4ee5-94d0-99e0def99199 tempest-FlavorsExtraSpecsTestJSON-1016188039 tempest-FlavorsExtraSpecsTestJSON-1016188039-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.495268 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e1e18cc2-9b81-4ee5-94d0-99e0def99199 tempest-FlavorsExtraSpecsTestJSON-1016188039 tempest-FlavorsExtraSpecsTestJSON-1016188039-project] 10.222.0.18 "GET /compute/v2.1/flavors/876311757/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015413 Jun 04 20:53:01.501499 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 76/162] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 20:53:01 2022] GET /compute/v2.1/flavors/876311757/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.506936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4198d73f-b16c-44c1-a9be-bc5b1385e709 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:01.543726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1963574504", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "630456234", "adminPass": "***", "networks": [{"uuid": "15ccdbd5-bc68-4958-9cc4-67d6874ef26c"}], "security_groups": [{"name": "tempest-securitygroup--185279577"}], "key_name": "tempest-keypair-559223619", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:01.559754 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4198d73f-b16c-44c1-a9be-bc5b1385e709 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055065 Jun 04 20:53:01.569760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 87/163] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Jun 4 20:53:01 2022] POST /compute/v2.1/flavors/876311757/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 20:53:01.586142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14133e7b-564b-4c68-ad85-d5425f4a5792 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.612421 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14133e7b-564b-4c68-ad85-d5425f4a5792 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.038364 Jun 04 20:53:01.615730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 88/164] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Jun 4 20:53:01 2022] GET /compute/v2.1/flavors/876311757/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.630980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca61fcd6-ef1e-4d30-910f-fed0eeb2a4a2 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:01.633798 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:01.633798 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:01.698231 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca61fcd6-ef1e-4d30-910f-fed0eeb2a4a2 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/876311757/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.076397 Jun 04 20:53:01.700312 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 89/165] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:01 2022] PUT /compute/v2.1/flavors/876311757/os-extra_specs/hw:numa_nodes => generated 22 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.716963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f3c8449-aaff-40d7-a1b8-703af228a105 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.732795 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f3c8449-aaff-40d7-a1b8-703af228a105 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026437 Jun 04 20:53:01.734601 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 90/166] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Jun 4 20:53:01 2022] GET /compute/v2.1/flavors/876311757/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.743684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c9e2bb89-1aab-40ac-892c-a53a747913d3 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.744859 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:01.744859 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:01.799990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] validate_networks() for [('15ccdbd5-bc68-4958-9cc4-67d6874ef26c', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:01.828827 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c9e2bb89-1aab-40ac-892c-a53a747913d3 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/876311757/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.089257 Jun 04 20:53:01.840502 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 91/167] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 20:53:01 2022] DELETE /compute/v2.1/flavors/876311757/os-extra_specs/hw:numa_nodes => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:01.853352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e9f7cde-f930-45c7-a691-003a2869e461 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.862855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=7,nova_api:INSERT=4,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:01.907991 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e9f7cde-f930-45c7-a691-003a2869e461 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/876311757/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.063104 Jun 04 20:53:01.916906 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 92/168] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 20:53:01 2022] DELETE /compute/v2.1/flavors/876311757/os-extra_specs/hw:cpu_policy => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:01.934296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3cc22c7b-74d2-45fb-9a48-d082a8f449f4 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.962118 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3cc22c7b-74d2-45fb-9a48-d082a8f449f4 tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/876311757/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043867 Jun 04 20:53:01.962710 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 93/169] 10.222.0.18 () {58 vars in 1199 bytes} [Sat Jun 4 20:53:01 2022] GET /compute/v2.1/flavors/876311757/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:01.984424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecb18b60-16df-4170-abdf-86f40fad324a tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:01.986930 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:01.986930 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:02.036035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecb18b60-16df-4170-abdf-86f40fad324a tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/876311757" status: 202 len: 0 microversion: 2.1 time: 0.064245 Jun 04 20:53:02.036674 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 94/170] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:53:01 2022] DELETE /compute/v2.1/flavors/876311757 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:53:02.048555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6acf3848-6969-416f-8fea-175e0a7ad4bc tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:02.091984 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6acf3848-6969-416f-8fea-175e0a7ad4bc tempest-FlavorsExtraSpecsTestJSON-1028174781 tempest-FlavorsExtraSpecsTestJSON-1028174781-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.050616 Jun 04 20:53:02.093180 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 95/171] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:02 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:02.184958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:02.185759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:02.199908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:02.200390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:02.201193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:02.201627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:02.379214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:02.389257 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81304783-a120-4f7f-a445-5678202a0014 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.210088 Jun 04 20:53:02.390056 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 96/172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:02 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:02.405605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:02.406401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:02.413724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:02.414174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:02.414947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:02.415376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:02.556548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:02.848590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:02.859692 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50e22128-c8d5-43e1-a327-d0ac6190e6a6 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.458386 Jun 04 20:53:02.861664 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 97/173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:02 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:03.409160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Action: 'update', calling method: .version_select at 0x7f2d03608dc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:03.412857 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:03.412857 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:03.416675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.418101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.461141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.461607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.483949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] HTTP exception thrown: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Request method failure captured: Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554 HTTP/1.1 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 56 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YuOKSy2xMDmejHHsh17onUuGka25ewg8sfGK1a4x0WrOS3A0TGSS-j_Ho_ZiASfC-Z2fKL3dQlKctp4-YjyLODn2FxFv_o-kfLuLS_FInpmnyvS52-8KvTYbTF5LdIZadjnlvNr92F2twteiJZtAi1KWn8_28yk3GCRVcrkjkflcQ Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.53 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1f9661db443648e691406aba59772bd1 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:03.505403 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f9661db443648e691406aba59772bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f9661db443648e691406aba59772bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f9661db443648e691406aba59772bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f9661db443648e691406aba59772bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1f9661db443648e691406aba59772bd1 Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: bba28bc58a4a4650ab9100153ec72109 Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:03.506685 ncdv-master-1 devstack@n-api.service[137229]: exception: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '05a02cdf-20b1-4adc-a4b3-5a0330692554', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.507401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:03.509827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:03.510900 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:03.510900 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.510900 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.510900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Returning 404 to user: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:03.510900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-688d44e9-77b2-4060-9e89-c626d5868aab tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554" status: 404 len: 110 microversion: 2.53 time: 0.644160 Jun 04 20:53:03.513676 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 98/174] 10.222.0.18 () {62 vars in 1308 bytes} [Sat Jun 4 20:53:02 2022] PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554 => generated 110 bytes in 651 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:03.526934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:03.527767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:03.535180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.535702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.536499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.542206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.558777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:03.559841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:03.560585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:03.561182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:03.561775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:03.590160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.590902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.594426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.597249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.666725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Getting quotas for project afaae81a01be4c73acb908aae5be8312. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:03.681767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Getting quotas for user 90a9faf4a615437ca499c0ccbc1e7563 and project afaae81a01be4c73acb908aae5be8312. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:03.738803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:03.741640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:03.804721 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a91ba153-85d6-4e88-8387-54461a085857 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.266649 Jun 04 20:53:03.806049 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 77/175] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:53:03.815444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Action: 'update', calling method: .version_select at 0x7f2d0812dca0>, body: {"status": "disabled"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:03.817488 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:03.817488 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:03.825752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=137228) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 04 20:53:03.827163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.827811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.838749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:03.839375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:03.850173 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] HTTP exception thrown: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Request method failure captured: Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554 HTTP/1.1 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 22 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YuOKSy2xMDmejHHsh17onUuGka25ewg8sfGK1a4x0WrOS3A0TGSS-j_Ho_ZiASfC-Z2fKL3dQlKctp4-YjyLODn2FxFv_o-kfLuLS_FInpmnyvS52-8KvTYbTF5LdIZadjnlvNr92F2twteiJZtAi1KWn8_28yk3GCRVcrkjkflcQ Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.53 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1f9661db443648e691406aba59772bd1 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:03.855198 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f9661db443648e691406aba59772bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f9661db443648e691406aba59772bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f9661db443648e691406aba59772bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f9661db443648e691406aba59772bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1f9661db443648e691406aba59772bd1 Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: bba28bc58a4a4650ab9100153ec72109 Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: {"status": "disabled"} Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: exception: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.856445 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '05a02cdf-20b1-4adc-a4b3-5a0330692554', 'body': {'status': 'disabled'}} Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.857658 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:03.858731 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:03.860188 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:03.860188 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:03.862162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Returning 404 to user: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:03.863279 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0bf73836-075d-4e3e-b5af-3fb09c89ee23 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554" status: 404 len: 110 microversion: 2.53 time: 0.055874 Jun 04 20:53:03.864385 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 78/176] 10.222.0.18 () {62 vars in 1308 bytes} [Sat Jun 4 20:53:03 2022] PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554 => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:03.991250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:04.000094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-03fdff3e-2cb1-4c32-9061-f331562f1f9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.484767 Jun 04 20:53:04.011232 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 99/177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:03 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:04.016900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e81b736-fe7b-4e7f-9df3-b2d865c8bb37 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.018148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1e81b736-fe7b-4e7f-9df3-b2d865c8bb37 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:04.116621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1e81b736-fe7b-4e7f-9df3-b2d865c8bb37 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:04.134331 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e81b736-fe7b-4e7f-9df3-b2d865c8bb37 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1262 microversion: 2.1 time: 0.121568 Jun 04 20:53:04.134956 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 100/178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1262 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:04.140499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Action: 'update', calling method: .version_select at 0x7f2d036fcaf0>, body: {"status": "enabled"} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:04.142056 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.142056 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:04.144504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.144504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.150332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.150855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.157063 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] HTTP exception thrown: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Request method failure captured: Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554 HTTP/1.1 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 21 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YuOKSy2xMDmejHHsh17onUuGka25ewg8sfGK1a4x0WrOS3A0TGSS-j_Ho_ZiASfC-Z2fKL3dQlKctp4-YjyLODn2FxFv_o-kfLuLS_FInpmnyvS52-8KvTYbTF5LdIZadjnlvNr92F2twteiJZtAi1KWn8_28yk3GCRVcrkjkflcQ Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.53 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1f9661db443648e691406aba59772bd1 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:04.159390 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f9661db443648e691406aba59772bd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f9661db443648e691406aba59772bd1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f9661db443648e691406aba59772bd1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f9661db443648e691406aba59772bd1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1f9661db443648e691406aba59772bd1 Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419 Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: bba28bc58a4a4650ab9100153ec72109 Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: {"status": "enabled"} Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: exception: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:04.160665 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '05a02cdf-20b1-4adc-a4b3-5a0330692554', 'body': {'status': 'enabled'}} Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:04.161540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:04.162720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:04.165088 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. Jun 04 20:53:04.165088 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:04.168113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Returning 404 to user: Service 05a02cdf-20b1-4adc-a4b3-5a0330692554 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:04.169542 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8996193e-d4ce-45a2-9319-c9612af564b2 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554" status: 404 len: 110 microversion: 2.53 time: 0.033170 Jun 04 20:53:04.170369 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 101/179] 10.222.0.18 () {62 vars in 1308 bytes} [Sat Jun 4 20:53:04 2022] PUT /compute/v2.1/os-services/05a02cdf-20b1-4adc-a4b3-5a0330692554 => generated 110 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:04.176544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.177787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:04.183129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-daee3d4b-f7a4-4ab3-8dba-1d24446cf803 req-8e1bec0b-5dfa-4112-83d4-cc46210d2a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254eb6e8-3c1f-4065-835c-fc095e96a562", "name": "network-vif-plugged", "status": "completed", "tag": "eeca4c3c-b026-4be8-9764-28b53e277e59"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:04.185752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.186449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.187325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.187865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.200679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-daee3d4b-f7a4-4ab3-8dba-1d24446cf803 req-8e1bec0b-5dfa-4112-83d4-cc46210d2a13 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.201263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-daee3d4b-f7a4-4ab3-8dba-1d24446cf803 req-8e1bec0b-5dfa-4112-83d4-cc46210d2a13 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.222581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-daee3d4b-f7a4-4ab3-8dba-1d24446cf803 req-8e1bec0b-5dfa-4112-83d4-cc46210d2a13 service nova] Creating event network-vif-plugged:eeca4c3c-b026-4be8-9764-28b53e277e59 for instance 254eb6e8-3c1f-4065-835c-fc095e96a562 on nch1-master-1 Jun 04 20:53:04.223843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-daee3d4b-f7a4-4ab3-8dba-1d24446cf803 req-8e1bec0b-5dfa-4112-83d4-cc46210d2a13 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:53:04.225131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.225571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.226526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.227127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.237282 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.compute.rpcapi [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 04 20:53:04.238550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] Releasing lock "compute-rpcapi-router" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:53:04.267967 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-851a58df-d9c0-4184-af53-689f72b89804 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.401709 Jun 04 20:53:04.269345 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 79/180] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:04.411026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:04.420809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-93dcc1db-1a38-4d4b-81d5-1281f0152071 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.248111 Jun 04 20:53:04.422127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 102/181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:04.541616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Calling method '.version_select at 0x7f2d08007a60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.542493 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.542493 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.543758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.544187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.563636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.564404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.580342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.580796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.590435 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-859bf6b9-5e7c-42f2-88e0-2efd888a3f69 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.317556 Jun 04 20:53:04.596923 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 80/182] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:04.602063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55375cb0-3c60-40f4-99f1-69027755781b tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.603427 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.603427 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.604906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55375cb0-3c60-40f4-99f1-69027755781b tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.605759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55375cb0-3c60-40f4-99f1-69027755781b tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.606726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55375cb0-3c60-40f4-99f1-69027755781b tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.607245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55375cb0-3c60-40f4-99f1-69027755781b tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.636301 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55375cb0-3c60-40f4-99f1-69027755781b tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.038016 Jun 04 20:53:04.637736 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 81/183] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:53:04.642811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f13d4b67-161d-4fc9-b9f8-92976d1f7545 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Calling method '.version_select at 0x7f2d02eb1670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.644151 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.644151 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.646013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f13d4b67-161d-4fc9-b9f8-92976d1f7545 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.646679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f13d4b67-161d-4fc9-b9f8-92976d1f7545 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.668496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f13d4b67-161d-4fc9-b9f8-92976d1f7545 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.669268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f13d4b67-161d-4fc9-b9f8-92976d1f7545 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.677218 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f13d4b67-161d-4fc9-b9f8-92976d1f7545 tempest-HypervisorAdminV228Test-1538811537 tempest-HypervisorAdminV228Test-1538811537-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.038107 Jun 04 20:53:04.678050 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 82/184] 10.222.0.18 () {60 vars in 1192 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:04.684672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e310838-ddd2-43a3-864d-dd56cfd4c570 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.686313 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.686313 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.689092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e310838-ddd2-43a3-864d-dd56cfd4c570 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.689751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e310838-ddd2-43a3-864d-dd56cfd4c570 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.691108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e310838-ddd2-43a3-864d-dd56cfd4c570 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.691892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e310838-ddd2-43a3-864d-dd56cfd4c570 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.724982 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e310838-ddd2-43a3-864d-dd56cfd4c570 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.045472 Jun 04 20:53:04.726473 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 83/185] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1263 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:53:04.739714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de226b1c-7478-41d7-b2ec-6e12f03b68ac tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.742862 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.742862 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.744090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de226b1c-7478-41d7-b2ec-6e12f03b68ac tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.744591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de226b1c-7478-41d7-b2ec-6e12f03b68ac tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.747809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7d8f0ef0-bc7d-4401-b934-cfe7b80b7c3e tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Calling method '.version_select at 0x7f2d035d1af0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.749312 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.749312 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:04.750812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d8f0ef0-bc7d-4401-b934-cfe7b80b7c3e tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.751590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d8f0ef0-bc7d-4401-b934-cfe7b80b7c3e tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.756781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de226b1c-7478-41d7-b2ec-6e12f03b68ac tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.757412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d8f0ef0-bc7d-4401-b934-cfe7b80b7c3e tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.757530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de226b1c-7478-41d7-b2ec-6e12f03b68ac tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.758731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d8f0ef0-bc7d-4401-b934-cfe7b80b7c3e tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.798816 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de226b1c-7478-41d7-b2ec-6e12f03b68ac tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.064214 Jun 04 20:53:04.800426 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 84/186] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:53:04.816296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1182cce-39e3-4049-9621-b4569c9f7e7f tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.833854 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.833854 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.835293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1182cce-39e3-4049-9621-b4569c9f7e7f tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.835781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1182cce-39e3-4049-9621-b4569c9f7e7f tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.836745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1182cce-39e3-4049-9621-b4569c9f7e7f tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.837436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1182cce-39e3-4049-9621-b4569c9f7e7f tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.852739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7d8f0ef0-bc7d-4401-b934-cfe7b80b7c3e tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.429011 Jun 04 20:53:04.853951 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 103/187] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:04.869192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1182cce-39e3-4049-9621-b4569c9f7e7f tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.059558 Jun 04 20:53:04.870841 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 85/188] 10.222.0.18 () {60 vars in 1236 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:04.885013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5342a020-408b-4ff8-adf1-d18b7b0f30f9 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.886287 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.886287 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.888154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5342a020-408b-4ff8-adf1-d18b7b0f30f9 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.888601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5342a020-408b-4ff8-adf1-d18b7b0f30f9 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.889495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5342a020-408b-4ff8-adf1-d18b7b0f30f9 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.890111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5342a020-408b-4ff8-adf1-d18b7b0f30f9 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.928843 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5342a020-408b-4ff8-adf1-d18b7b0f30f9 tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1263 microversion: 2.53 time: 0.050875 Jun 04 20:53:04.935702 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 86/189] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-services => generated 1263 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:53:04.946188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d564ec12-a37c-4476-b732-2bd7b54f064a tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:04.949199 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:04.949199 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:04.955495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d564ec12-a37c-4476-b732-2bd7b54f064a tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.956511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d564ec12-a37c-4476-b732-2bd7b54f064a tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.957562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d564ec12-a37c-4476-b732-2bd7b54f064a tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:04.958562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d564ec12-a37c-4476-b732-2bd7b54f064a tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:04.993876 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d564ec12-a37c-4476-b732-2bd7b54f064a tempest-ServicesAdminNegativeV253TestJSON-247344419 tempest-ServicesAdminNegativeV253TestJSON-247344419-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.056739 Jun 04 20:53:04.994652 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 87/190] 10.222.0.18 () {60 vars in 1238 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:05.166720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afa7fd68-c49b-4ddb-b659-ac5b5e2368ff tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Calling method '.version_select at 0x7f2d036520d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.169025 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.169025 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:05.170672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-afa7fd68-c49b-4ddb-b659-ac5b5e2368ff tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7abca2e5d53a43149dea438193357042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bdd7db3ff04de98130d93249a59c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afa7fd68-c49b-4ddb-b659-ac5b5e2368ff tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Request method failure captured: Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YuZIpDVlGoExAYMu-lPkDtejOqim0JUJRXuyQ-RqhVvgvP_2oJj6uQ4eZ0eJ_lt-JqGhXT2ZkvQ8hZgYNBbKQm6fGo3JlEM5q0XUEGnB5v9RpB7iFzntj-TA9wl9M7NDS2UPHPUn5l6tJx_sBHPCXrbqqeMgf7cVbZVNhrDADu6tQ Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:05.184851 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 7abca2e5d53a43149dea438193357042 Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: action_args: {} Jun 04 20:53:05.186035 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.186832 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 04 20:53:05.187953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.189955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afa7fd68-c49b-4ddb-b659-ac5b5e2368ff tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.189955 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-afa7fd68-c49b-4ddb-b659-ac5b5e2368ff tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.325463 Jun 04 20:53:05.189955 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 104/191] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 20:53:04 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 327 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:05.195579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.196198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:05.204074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:05.204530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:05.205430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:05.206134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:05.333907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-866e7b49-9800-4897-a872-d2c0b05bf1ac tempest-ServicesAdminNegativeV253TestJSON-399670524 tempest-ServicesAdminNegativeV253TestJSON-399670524-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.336241 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.336241 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:05.338963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-866e7b49-9800-4897-a872-d2c0b05bf1ac tempest-ServicesAdminNegativeV253TestJSON-399670524 tempest-ServicesAdminNegativeV253TestJSON-399670524-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '68c0fa377ee24f049f034bb8ec13c5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966c29cbde7542f4b537730a6fa7f550', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-866e7b49-9800-4897-a872-d2c0b05bf1ac tempest-ServicesAdminNegativeV253TestJSON-399670524 tempest-ServicesAdminNegativeV253TestJSON-399670524-project] Request method failure captured: Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Ys8rxcoUHOiTbwqAGY8t-VuaU0iVZ3ouMhNA93cF7ngO0V3VsfmvVyfBYoqns4setHw5n5iaJQXAKdzILSm30zINKDXcInsm-8Jd6uOLhkELBzoiVtmG70XX_DePRF26EKDWrXuzRAHaKgpA-P7ARTiVHywVSGNQmkK6QpraSQBp0 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.53 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 966c29cbde7542f4b537730a6fa7f550 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-399670524 Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:05.341785 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_966c29cbde7542f4b537730a6fa7f550"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/966c29cbde7542f4b537730a6fa7f550"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/966c29cbde7542f4b537730a6fa7f550"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/966c29cbde7542f4b537730a6fa7f550"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-399670524 Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 966c29cbde7542f4b537730a6fa7f550 Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-399670524 Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServicesAdminNegativeV253TestJSON-399670524-project Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 68c0fa377ee24f049f034bb8ec13c5ed Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-399670524-project Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 04 20:53:05.344812 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.346081 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 04 20:53:05.352991 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.366018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-866e7b49-9800-4897-a872-d2c0b05bf1ac tempest-ServicesAdminNegativeV253TestJSON-399670524 tempest-ServicesAdminNegativeV253TestJSON-399670524-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.366018 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-866e7b49-9800-4897-a872-d2c0b05bf1ac tempest-ServicesAdminNegativeV253TestJSON-399670524 tempest-ServicesAdminNegativeV253TestJSON-399670524-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.341765 Jun 04 20:53:05.366018 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 88/192] 10.222.0.18 () {60 vars in 1177 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-services => generated 112 bytes in 344 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:05.366018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.366018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:05.376473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:05.377184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:05.381176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:05.381740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:05.394959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.404707 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ddb57a2-b607-4e62-97c7-072b9b986552 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.215116 Jun 04 20:53:05.405302 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 105/193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:05.410762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43de2d30-e8c7-48dd-ad96-8c11a020ed06 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Calling method '.version_select at 0x7f2d03694310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.415682 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.415682 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:05.418478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-43de2d30-e8c7-48dd-ad96-8c11a020ed06 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7abca2e5d53a43149dea438193357042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bdd7db3ff04de98130d93249a59c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43de2d30-e8c7-48dd-ad96-8c11a020ed06 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Request method failure captured: Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YuZIpDVlGoExAYMu-lPkDtejOqim0JUJRXuyQ-RqhVvgvP_2oJj6uQ4eZ0eJ_lt-JqGhXT2ZkvQ8hZgYNBbKQm6fGo3JlEM5q0XUEGnB5v9RpB7iFzntj-TA9wl9M7NDS2UPHPUn5l6tJx_sBHPCXrbqqeMgf7cVbZVNhrDADu6tQ Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:05.420239 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 7abca2e5d53a43149dea438193357042 Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ncdv-master-1'} Jun 04 20:53:05.421498 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.422247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 04 20:53:05.423719 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.424918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43de2d30-e8c7-48dd-ad96-8c11a020ed06 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.424918 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43de2d30-e8c7-48dd-ad96-8c11a020ed06 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015576 Jun 04 20:53:05.424918 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 106/194] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:05.435656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01b9dfc4-d815-4d06-8ab1-f33c933e27c1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Calling method '.version_select at 0x7f2d03527040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.475469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.481503 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-01b9dfc4-d815-4d06-8ab1-f33c933e27c1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01b9dfc4-d815-4d06-8ab1-f33c933e27c1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:05.483734 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'nonexistent_hostname'} Jun 04 20:53:05.486789 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:05.488649 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 04 20:53:05.491570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01b9dfc4-d815-4d06-8ab1-f33c933e27c1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01b9dfc4-d815-4d06-8ab1-f33c933e27c1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.053362 Jun 04 20:53:05.493975 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 107/195] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 20:53:05.497465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.497465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:05.497710 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fbd83811-d85f-43bc-a29c-367906be9c80 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1314 microversion: 2.1 time: 0.147850 Jun 04 20:53:05.497710 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 89/196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:05.509966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c4d97f0-5e98-48d0-99b8-81f9b340704a tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Calling method '.version_select at 0x7f2d02eb1c10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.510887 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.510887 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:05.511052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:05.511535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:05.512323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:05.512435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0c4d97f0-5e98-48d0-99b8-81f9b340704a tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7abca2e5d53a43149dea438193357042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bdd7db3ff04de98130d93249a59c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.512780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c4d97f0-5e98-48d0-99b8-81f9b340704a tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Request method failure captured: Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YuZIpDVlGoExAYMu-lPkDtejOqim0JUJRXuyQ-RqhVvgvP_2oJj6uQ4eZ0eJ_lt-JqGhXT2ZkvQ8hZgYNBbKQm6fGo3JlEM5q0XUEGnB5v9RpB7iFzntj-TA9wl9M7NDS2UPHPUn5l6tJx_sBHPCXrbqqeMgf7cVbZVNhrDADu6tQ Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:05.514164 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 7abca2e5d53a43149dea438193357042 Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1'} Jun 04 20:53:05.515305 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.516105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 04 20:53:05.517124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.518274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c4d97f0-5e98-48d0-99b8-81f9b340704a tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.519739 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c4d97f0-5e98-48d0-99b8-81f9b340704a tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.017936 Jun 04 20:53:05.524589 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 90/197] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:05.530020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-839deeb5-a3ba-49a9-8606-7b75c0ae2cac tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Calling method '.version_select at 0x7f2d02f94160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.538777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-839deeb5-a3ba-49a9-8606-7b75c0ae2cac tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-839deeb5-a3ba-49a9-8606-7b75c0ae2cac tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:05.541409 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'nonexistent_hostname'} Jun 04 20:53:05.542626 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.543330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.544336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.546975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-839deeb5-a3ba-49a9-8606-7b75c0ae2cac tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.548098 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-839deeb5-a3ba-49a9-8606-7b75c0ae2cac tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.022268 Jun 04 20:53:05.549466 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 91/198] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:05.571266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aea48b2e-a199-443a-97fa-2b1240b41107 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Calling method '.version_select at 0x7f2d02f94820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.573020 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.573020 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:05.574670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aea48b2e-a199-443a-97fa-2b1240b41107 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7abca2e5d53a43149dea438193357042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bdd7db3ff04de98130d93249a59c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aea48b2e-a199-443a-97fa-2b1240b41107 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Request method failure captured: Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YuZIpDVlGoExAYMu-lPkDtejOqim0JUJRXuyQ-RqhVvgvP_2oJj6uQ4eZ0eJ_lt-JqGhXT2ZkvQ8hZgYNBbKQm6fGo3JlEM5q0XUEGnB5v9RpB7iFzntj-TA9wl9M7NDS2UPHPUn5l6tJx_sBHPCXrbqqeMgf7cVbZVNhrDADu6tQ Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:05.576762 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 7abca2e5d53a43149dea438193357042 Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1'} Jun 04 20:53:05.578005 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.579072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 04 20:53:05.580314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.583030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aea48b2e-a199-443a-97fa-2b1240b41107 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.584184 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aea48b2e-a199-443a-97fa-2b1240b41107 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.028944 Jun 04 20:53:05.585271 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 92/199] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:05.597050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc103d12-d529-4b9f-91b4-947d50cf3997 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Calling method '.version_select at 0x7f2d02eb1160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.612195 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-bc103d12-d529-4b9f-91b4-947d50cf3997 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc103d12-d529-4b9f-91b4-947d50cf3997 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:05.614213 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'nonexistent_hostname'} Jun 04 20:53:05.615815 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:05.616597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 04 20:53:05.617598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc103d12-d529-4b9f-91b4-947d50cf3997 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.618598 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc103d12-d529-4b9f-91b4-947d50cf3997 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.023284 Jun 04 20:53:05.621642 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 93/200] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:05.626748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89a2a744-5d9b-4c99-bd10-435cd4e5b008 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Calling method '.version_select at 0x7f2d02e513a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.627728 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.627728 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:05.628991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-89a2a744-5d9b-4c99-bd10-435cd4e5b008 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7abca2e5d53a43149dea438193357042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bdd7db3ff04de98130d93249a59c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89a2a744-5d9b-4c99-bd10-435cd4e5b008 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Request method failure captured: Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YuZIpDVlGoExAYMu-lPkDtejOqim0JUJRXuyQ-RqhVvgvP_2oJj6uQ4eZ0eJ_lt-JqGhXT2ZkvQ8hZgYNBbKQm6fGo3JlEM5q0XUEGnB5v9RpB7iFzntj-TA9wl9M7NDS2UPHPUn5l6tJx_sBHPCXrbqqeMgf7cVbZVNhrDADu6tQ Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:05.631267 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 7abca2e5d53a43149dea438193357042 Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1'} Jun 04 20:53:05.632524 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.633686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 04 20:53:05.635892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.638204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89a2a744-5d9b-4c99-bd10-435cd4e5b008 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.638204 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89a2a744-5d9b-4c99-bd10-435cd4e5b008 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] 10.222.0.18 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010386 Jun 04 20:53:05.638204 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 94/201] 10.222.0.18 () {58 vars in 1193 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:05.643761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd764083-6d50-44c6-a96c-0ce3fd8af6a4 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Calling method '.version_select at 0x7f2d02eb1790>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:05.654296 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fd764083-6d50-44c6-a96c-0ce3fd8af6a4 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd764083-6d50-44c6-a96c-0ce3fd8af6a4 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:05.656491 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'nonexistent_hostname'} Jun 04 20:53:05.657948 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:05.659392 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 04 20:53:05.661306 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd764083-6d50-44c6-a96c-0ce3fd8af6a4 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd764083-6d50-44c6-a96c-0ce3fd8af6a4 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019305 Jun 04 20:53:05.662366 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 95/202] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:05.669811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-615454c5-1a7c-4555-9a31-9a0251bc1df0 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02f94820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-615454c5-1a7c-4555-9a31-9a0251bc1df0 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 51 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:05.676743 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: {"status": "enable", "maintenance_mode": "invalid"} Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.678053 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'disable', Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'Enable', Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'Disable', Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance: Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'invalid' Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.678882 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.680276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-615454c5-1a7c-4555-9a31-9a0251bc1df0 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.685985 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-615454c5-1a7c-4555-9a31-9a0251bc1df0 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.013304 Jun 04 20:53:05.689631 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 96/203] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Jun 4 20:53:05 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:05.696879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a52c8f52-9ab4-4ef3-9397-0da787608cf1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02f949d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a52c8f52-9ab4-4ef3-9397-0da787608cf1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 51 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:05.702239 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: {"status": "invalid", "maintenance_mode": "enable"} Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.703559 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'disable', Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'Enable', Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'Disable', Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance: Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'invalid' Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.704482 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.705881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a52c8f52-9ab4-4ef3-9397-0da787608cf1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a52c8f52-9ab4-4ef3-9397-0da787608cf1 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.013234 Jun 04 20:53:05.708854 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 97/204] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Jun 4 20:53:05 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:05.716595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6dbca16-0e67-42c1-9aa0-4e0550ac3285 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Action: 'update', calling method: .version_select at 0x7f2d02eb11f0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:05.718002 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.718002 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:05.719210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6dbca16-0e67-42c1-9aa0-4e0550ac3285 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7abca2e5d53a43149dea438193357042', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4bdd7db3ff04de98130d93249a59c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6dbca16-0e67-42c1-9aa0-4e0550ac3285 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Request method failure captured: Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 50 Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YuZIpDVlGoExAYMu-lPkDtejOqim0JUJRXuyQ-RqhVvgvP_2oJj6uQ4eZ0eJ_lt-JqGhXT2ZkvQ8hZgYNBbKQm6fGo3JlEM5q0XUEGnB5v9RpB7iFzntj-TA9wl9M7NDS2UPHPUn5l6tJx_sBHPCXrbqqeMgf7cVbZVNhrDADu6tQ Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:05.721323 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d4bdd7db3ff04de98130d93249a59c81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d4bdd7db3ff04de98130d93249a59c81 Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-348669645 Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 7abca2e5d53a43149dea438193357042 Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-348669645-project Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: {"status": "enable", "maintenance_mode": "enable"} Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 04 20:53:05.722556 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.723420 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 04 20:53:05.729530 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.730536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6dbca16-0e67-42c1-9aa0-4e0550ac3285 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.730536 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6dbca16-0e67-42c1-9aa0-4e0550ac3285 tempest-HostsAdminNegativeTestJSON-348669645 tempest-HostsAdminNegativeTestJSON-348669645-project] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.010432 Jun 04 20:53:05.730536 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 98/205] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Jun 4 20:53:05 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:05.730724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:05.734028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82f7fe7b-425a-4308-8683-7706016bb757 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02e26550>, body: {"status": null, "maintenance_mode": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82f7fe7b-425a-4308-8683-7706016bb757 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 42 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:05.737474 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: {"status": null, "maintenance_mode": null} Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 04 20:53:05.739154 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'disable', Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'Enable', Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'Disable', Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance: Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi None Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.743987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.745973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.747022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:53:05.747022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:53:05.747022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 04 20:53:05.747022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.747022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82f7fe7b-425a-4308-8683-7706016bb757 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.747320 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7ed12ae-c0c5-42b1-aab6-00f4bc275350 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.250633 Jun 04 20:53:05.747396 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82f7fe7b-425a-4308-8683-7706016bb757 tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.009589 Jun 04 20:53:05.747472 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 108/206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:05 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:05.747578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 99/207] 10.222.0.18 () {60 vars in 1189 bytes} [Sat Jun 4 20:53:05 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 20:53:05.752570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e20caa9-6491-4bb0-9c9a-75eaf24045bf tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Action: 'update', calling method: .version_select at 0x7f2d094e93a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:05.753879 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:05.753879 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:05.754668 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.hosts [None req-0e20caa9-6491-4bb0-9c9a-75eaf24045bf tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Enabling host nonexistent_hostname. Jun 04 20:53:05.766909 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0e20caa9-6491-4bb0-9c9a-75eaf24045bf tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e20caa9-6491-4bb0-9c9a-75eaf24045bf tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Request method failure captured: Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 50 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YvWeyjXnYMedCyvqzSvyAHofpzEai8dwYqYFsqUmo0iY5-hxC_rSyhD3jGzXgAYG_I_QqneynlhbouX_7sH_eCeh9mk4cM82ZTpn0wcXlSXUDxkQe5IdEp5d1icXxGcI6k5pRKC5XGbf-__5gMk6SCHwUJy_E0ilsoCyUmP1n4_g8 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:05.769212 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7cb222f108c64fb6a885733337e192d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7cb222f108c64fb6a885733337e192d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 7cb222f108c64fb6a885733337e192d0 Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1720007399 Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 9c4e30f31a06490fac7e63f31bfd7cc8 Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1720007399-project-admin Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: {"status": "enable", "maintenance_mode": "enable"} Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.770533 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:05.771933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:05.772854 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:05.774372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e20caa9-6491-4bb0-9c9a-75eaf24045bf tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:05.775344 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e20caa9-6491-4bb0-9c9a-75eaf24045bf tempest-HostsAdminNegativeTestJSON-1720007399 tempest-HostsAdminNegativeTestJSON-1720007399-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025838 Jun 04 20:53:05.775344 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 109/208] 10.222.0.18 () {60 vars in 1210 bytes} [Sat Jun 4 20:53:05 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:06.291126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0d0c518e-89e3-4acf-8500-299e6b2bb277 req-b5b0bcdf-6a56-4dcd-9de4-991f4d3c5c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7435eee0-6714-4225-9759-fff2ed40dcc5", "name": "network-vif-plugged", "status": "completed", "tag": "9f7970ad-a469-46b4-917a-773476de78ef"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:06.308114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:06.310893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0d0c518e-89e3-4acf-8500-299e6b2bb277 req-b5b0bcdf-6a56-4dcd-9de4-991f4d3c5c21 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.311869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0d0c518e-89e3-4acf-8500-299e6b2bb277 req-b5b0bcdf-6a56-4dcd-9de4-991f4d3c5c21 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.356994 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0d0c518e-89e3-4acf-8500-299e6b2bb277 req-b5b0bcdf-6a56-4dcd-9de4-991f4d3c5c21 service nova] Creating event network-vif-plugged:9f7970ad-a469-46b4-917a-773476de78ef for instance 7435eee0-6714-4225-9759-fff2ed40dcc5 on nch2-master-1 Jun 04 20:53:06.368991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0d0c518e-89e3-4acf-8500-299e6b2bb277 req-b5b0bcdf-6a56-4dcd-9de4-991f4d3c5c21 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083539 Jun 04 20:53:06.371053 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 100/209] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:06.424018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:06.425480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:06.439891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.440919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.446007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.446825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.518232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:06.519301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:06.557768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.560286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.582686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.587714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.765277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:06.781581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4d38084-7e16-4d43-beeb-be271a884a2e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1320 microversion: 2.1 time: 0.269737 Jun 04 20:53:06.782237 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 101/210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:06 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1320 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:06.798107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:06.798995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:06.812233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.813157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.816365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:06.817013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:06.838452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:06.850381 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-347c8a7b-b52a-4311-bca8-f6707de1e939 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1318 microversion: 2.1 time: 0.431253 Jun 04 20:53:06.851190 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 110/211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:06 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:07.264201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:07.276086 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a9b65949-7cf8-4caf-bd26-1cc362c25431 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.492143 Jun 04 20:53:07.286405 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 102/212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:06 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:07.804542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:07.806002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:07.832221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:07.833577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:07.834800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:07.835618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:07.869025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:07.871234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:07.887181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:07.894927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:07.899348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:07.905739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:08.244814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:08.258665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f0f8edb-bb89-4ccf-b813-c167780fcb85 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1468 microversion: 2.1 time: 0.394025 Jun 04 20:53:08.260970 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 103/213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:07 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1468 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:08.275341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:08.287884 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98a185da-9441-455d-9a36-7920fda0a458 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.490577 Jun 04 20:53:08.296954 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 111/214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:07 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:08.308206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:08.309585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:08.318423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:08.319335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:08.320756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:08.321528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:08.591791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:08.607319 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fcabb98a-be8d-4c5a-802b-24e3b875da6c tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1338 microversion: 2.1 time: 0.306282 Jun 04 20:53:08.618575 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 112/215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:08 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1338 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:09.049434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:09.052068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:09.068815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.070770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.072416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.073254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.162030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-131b2312-ac5d-4846-90f4-41c62ea1bca4 req-c6ffd787-8f45-40d7-bfdc-cb415d32cdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2802f93-a40c-4fe1-89d4-a6707b2b7eea", "tag": "e766e6b7-e10e-4604-8598-b74e37810cdb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:09.175966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-131b2312-ac5d-4846-90f4-41c62ea1bca4 req-c6ffd787-8f45-40d7-bfdc-cb415d32cdfd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.176862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-131b2312-ac5d-4846-90f4-41c62ea1bca4 req-c6ffd787-8f45-40d7-bfdc-cb415d32cdfd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.199889 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-131b2312-ac5d-4846-90f4-41c62ea1bca4 req-c6ffd787-8f45-40d7-bfdc-cb415d32cdfd service nova] Creating event network-changed:e766e6b7-e10e-4604-8598-b74e37810cdb for instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea on nch1-master-1 Jun 04 20:53:09.206488 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-131b2312-ac5d-4846-90f4-41c62ea1bca4 req-c6ffd787-8f45-40d7-bfdc-cb415d32cdfd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048228 Jun 04 20:53:09.207939 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 113/216] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:09.222913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:53:09.309541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:09.310269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:09.322301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.323247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.324110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.324555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.479381 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f54805a8-0280-4835-9621-08440b41863e tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 204 len: 0 microversion: 2.1 time: 1.203062 Jun 04 20:53:09.491078 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 104/217] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:08 2022] DELETE /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 20:53:09.506491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:09.507213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:09.527994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.528639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.529615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.530200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.536739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:09.573121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:09.581925 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-021cf865-2d8a-435f-ab19-fb86aaffce34 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.278865 Jun 04 20:53:09.584607 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 114/218] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:09 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:09.627115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:09.628047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:09.634209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.634958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.635956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.636583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.640978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:09.762894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:09.771722 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e70c37d3-9162-457b-a993-594bf29b1b1c tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1474 microversion: 2.1 time: 0.277134 Jun 04 20:53:09.772873 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 105/219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:09 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1474 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:09.816788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:09.825191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c207ba5b-fb27-428a-a5c3-38476fdb673f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1488 microversion: 2.1 time: 0.202648 Jun 04 20:53:09.826081 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 115/220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:09 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1488 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:09.843945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:09.844552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:09.851567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.852006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:09.852779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:09.853206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.160420 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4985c20c-22de-4cc1-84e5-fc69272caf9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1639 microversion: 2.1 time: 0.319757 Jun 04 20:53:10.161807 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 106/221] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:09 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1639 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:10.189032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:10.190056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:10.199415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.200131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.203076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.203686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.242148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:53:10.336832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-217137334", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:10.421965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:10.498169 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9ecb6c67-ec59-4f15-b496-2076825841c9 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 204 len: 0 microversion: 2.1 time: 0.314517 Jun 04 20:53:10.507647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 107/222] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:10 2022] DELETE /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 20:53:10.522970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:10.524593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:10.542923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.543777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.545222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.546409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.909019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:10.909394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:10.909888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:10.910363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:10.910884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:10.928018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:10.936192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.936711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.937603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.938045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.943649 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e667fcad-ae8a-4ebd-a2bc-dd6fe84d13a5 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1494 microversion: 2.1 time: 0.433893 Jun 04 20:53:10.944822 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 108/223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:10 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1494 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:10.949874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:10.950503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:10.967062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.967545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.968352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:10.968820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:10.992781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Getting quotas for project 2d9304b76a754b31bb48d933a61eb508. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:10.998921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Getting quotas for user 66b6d873574540ad866d203f7a562270 and project 2d9304b76a754b31bb48d933a61eb508. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:11.017299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:11.021035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:11.094912 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32ed1248-95b0-43f7-846b-982e252ad1f1 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971498 Jun 04 20:53:11.097322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 116/224] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 20:53:11.107973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.109700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:11.125166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:11.126549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:11.129027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:11.130498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:11.227902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:11.253732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3283b38-c837-4c0b-ad74-ba04153295d8 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.307482 Jun 04 20:53:11.254284 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 109/225] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:10 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:11.521474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:11.530878 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9419e57e-fa93-4bf1-b3b7-d9303490ea6a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1474 microversion: 2.1 time: 0.431440 Jun 04 20:53:11.536767 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 117/226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:11.543542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90ba0b6e-6770-4106-8da5-cc68c00b7b6a tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.559232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90ba0b6e-6770-4106-8da5-cc68c00b7b6a tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:11.697943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90ba0b6e-6770-4106-8da5-cc68c00b7b6a tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:11.704229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3415c064-6b63-4994-ba7a-9d6ff58f0353 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.728901 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3415c064-6b63-4994-ba7a-9d6ff58f0353 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.473422 Jun 04 20:53:11.739473 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90ba0b6e-6770-4106-8da5-cc68c00b7b6a tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1222 microversion: 2.1 time: 0.201174 Jun 04 20:53:11.743462 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 118/227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1222 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:11.750267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 110/228] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:11.756168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72ddadd3-be34-4b25-bd31-b122bccf2c36 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.826558 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72ddadd3-be34-4b25-bd31-b122bccf2c36 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors" status: 200 len: 3079 microversion: 2.1 time: 0.078312 Jun 04 20:53:11.831919 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 119/229] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/flavors => generated 3079 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:11.858049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aaf3ad4b-cf9d-4120-9277-e71220f92236 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.881455 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aaf3ad4b-cf9d-4120-9277-e71220f92236 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031685 Jun 04 20:53:11.884145 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 111/230] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:11.910070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd4eaf4d-511d-48cb-ae73-c302d3e3dce4 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.931661 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd4eaf4d-511d-48cb-ae73-c302d3e3dce4 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031530 Jun 04 20:53:11.943173 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 120/231] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:11.959310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6bc91e1a-d638-470e-a1bb-c84f21a3f868 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.969534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:11.979260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:12.001062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.003499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.006249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.006700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.047007 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6bc91e1a-d638-470e-a1bb-c84f21a3f868 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.097306 Jun 04 20:53:12.047736 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 112/232] 10.222.0.18 () {58 vars in 1164 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.069830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-68d27511-f184-4910-a31f-7a34b9240c59 req-9199d6a1-894f-4f38-9fdb-842c3ff15f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "254eb6e8-3c1f-4065-835c-fc095e96a562", "name": "network-vif-deleted", "tag": "eeca4c3c-b026-4be8-9764-28b53e277e59"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:12.087617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-68d27511-f184-4910-a31f-7a34b9240c59 req-9199d6a1-894f-4f38-9fdb-842c3ff15f92 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.088412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-68d27511-f184-4910-a31f-7a34b9240c59 req-9199d6a1-894f-4f38-9fdb-842c3ff15f92 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.103639 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-68d27511-f184-4910-a31f-7a34b9240c59 req-9199d6a1-894f-4f38-9fdb-842c3ff15f92 service nova] Creating event network-vif-deleted:eeca4c3c-b026-4be8-9764-28b53e277e59 for instance 254eb6e8-3c1f-4065-835c-fc095e96a562 on nch1-master-1 Jun 04 20:53:12.113062 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-68d27511-f184-4910-a31f-7a34b9240c59 req-9199d6a1-894f-4f38-9fdb-842c3ff15f92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054867 Jun 04 20:53:12.114574 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 113/233] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:12.122179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60dd3b1f-32a7-4a5e-9376-7999ab4ff1d4 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.131976 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60dd3b1f-32a7-4a5e-9376-7999ab4ff1d4 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015669 Jun 04 20:53:12.139680 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 114/234] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:12.145007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-625b6ae5-f02e-426a-aae8-6bf1f78719fc tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.182283 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-625b6ae5-f02e-426a-aae8-6bf1f78719fc tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.041087 Jun 04 20:53:12.193950 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1168 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.203178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ef33a85-133d-4fe6-b748-dd1bb6ca67e5 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.218182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ef33a85-133d-4fe6-b748-dd1bb6ca67e5 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020671 Jun 04 20:53:12.218893 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 116/236] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:12.235437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd013314-853d-4a40-a10a-12a4f62fd9ed tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.246778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd013314-853d-4a40-a10a-12a4f62fd9ed tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017918 Jun 04 20:53:12.248276 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 117/237] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:12.261029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d531003d-c9fb-4d16-be8b-a19be222d328 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.313670 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d531003d-c9fb-4d16-be8b-a19be222d328 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.056582 Jun 04 20:53:12.314829 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 118/238] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.331578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.332581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:12.343804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.344655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.346366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.347021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.643614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:12.651774 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f8ccf9d-e451-44c4-83b3-086f4090452f tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1494 microversion: 2.1 time: 0.688895 Jun 04 20:53:12.652474 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 121/239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:11 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1494 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.657143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-111dda7f-4f39-4249-a59a-381cf059ca52 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.684471 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-111dda7f-4f39-4249-a59a-381cf059ca52 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030875 Jun 04 20:53:12.685540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 122/240] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:12.690607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.692394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:12.701251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.701949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.702798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.703688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.746160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.746598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.747083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lazy-loading 'fault' on Instance uuid 254eb6e8-3c1f-4065-835c-fc095e96a562 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:53:12.758216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:12.766203 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f7dc2258-c903-44a7-a549-651fdd3bc77c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.439261 Jun 04 20:53:12.767856 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.817418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:12.826253 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6edfb71-cd15-4930-8956-9ada9071b942 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 200 len: 1308 microversion: 2.1 time: 0.139102 Jun 04 20:53:12.835662 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 123/242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 1308 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.840714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b536223d-223b-4458-8b3a-e3697b60a317 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.868986 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b536223d-223b-4458-8b3a-e3697b60a317 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.032030 Jun 04 20:53:12.870063 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 124/243] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:12.892295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:12.892928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:12.902920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.902920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:12.903674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:12.904116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.082281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a6eac138-c393-4a4e-83cd-0c049abe7fa8 tempest-InstanceUsageAuditLogTestJSON-629177779 tempest-InstanceUsageAuditLogTestJSON-629177779-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.083851 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.083851 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:13.089966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=53,nova_cell0:UPDATE=12 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:13.099049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.112607 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-387e35f9-aa4f-49f7-894e-a5de1d666808 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1295 microversion: 2.1 time: 0.241096 Jun 04 20:53:13.113244 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 125/244] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1295 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:13.153923 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a6eac138-c393-4a4e-83cd-0c049abe7fa8 tempest-InstanceUsageAuditLogTestJSON-629177779 tempest-InstanceUsageAuditLogTestJSON-629177779-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-04 20:53:12" status: 200 len: 318 microversion: 2.1 time: 0.384609 Jun 04 20:53:13.154531 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 120/245] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 20:53:12 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-04%2020%3A53%3A12 => generated 318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.165782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3096ed62-e362-4326-a893-c983df73f9ad tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.193032 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3096ed62-e362-4326-a893-c983df73f9ad tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033471 Jun 04 20:53:13.194074 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 121/246] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.206302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b91134de-7903-403f-8057-00e5b6722e8d tempest-InstanceUsageAuditLogTestJSON-629177779 tempest-InstanceUsageAuditLogTestJSON-629177779-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.210643 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.210643 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:13.234551 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b91134de-7903-403f-8057-00e5b6722e8d tempest-InstanceUsageAuditLogTestJSON-629177779 tempest-InstanceUsageAuditLogTestJSON-629177779-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.037469 Jun 04 20:53:13.255567 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 122/247] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.269764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a1d89c07-e7f7-4818-bcb1-49968b769d7d tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.322318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a1d89c07-e7f7-4818-bcb1-49968b769d7d tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.054798 Jun 04 20:53:13.326685 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 123/248] 10.222.0.18 () {58 vars in 1147 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:13.341428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e2b1e8e-0714-4b40-9603-f4933aabdf2b tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.380988 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e2b1e8e-0714-4b40-9603-f4933aabdf2b tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.046662 Jun 04 20:53:13.381985 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 124/249] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.391243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3a42aeab-c4fd-4777-a74f-fb30d463f7ba tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Calling method '.version_select at 0x7f2d034d53a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.392643 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.392643 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:13.394731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3a42aeab-c4fd-4777-a74f-fb30d463f7ba tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '8f6e44c00dc444d0bd6d318808a15bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a44b25c41d4fcc9674a91efe653c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3a42aeab-c4fd-4777-a74f-fb30d463f7ba tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Request method failure captured: Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y3kXLuIzom3Ri3KuEKkWRF-DvvrcHZodAhSoddSW9lygwxQQ68niGf15o9RTzVA_iRlzJZ2h2U-4XnwscrZkMbrfv7xMM1koQQpR660xWCTQZGPnmEBGRQhf91hTD0bdwOQCyZfvVyN3wtfzqEnKwb0QdR3p5RsTC1d3J9scd1m8M Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:13.397438 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 8f6e44c00dc444d0bd6d318808a15bec Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: action_args: {} Jun 04 20:53:13.398625 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:13.399350 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 04 20:53:13.400412 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.412732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3a42aeab-c4fd-4777-a74f-fb30d463f7ba tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.414085 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3a42aeab-c4fd-4777-a74f-fb30d463f7ba tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.297371 Jun 04 20:53:13.414867 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 126/250] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:13.416677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a31da6fb-1121-41dc-a4ac-34af1602fdd5 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.429785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c451226d-9a65-40ed-a2a6-f7facae29afc tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Calling method '.version_select at 0x7f2d035270d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.431049 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.431049 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:13.435748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c451226d-9a65-40ed-a2a6-f7facae29afc tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '8f6e44c00dc444d0bd6d318808a15bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a44b25c41d4fcc9674a91efe653c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c451226d-9a65-40ed-a2a6-f7facae29afc tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Request method failure captured: Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y3kXLuIzom3Ri3KuEKkWRF-DvvrcHZodAhSoddSW9lygwxQQ68niGf15o9RTzVA_iRlzJZ2h2U-4XnwscrZkMbrfv7xMM1koQQpR660xWCTQZGPnmEBGRQhf91hTD0bdwOQCyZfvVyN3wtfzqEnKwb0QdR3p5RsTC1d3J9scd1m8M Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:13.440880 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 8f6e44c00dc444d0bd6d318808a15bec Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: action_args: {} Jun 04 20:53:13.442318 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:13.443033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 04 20:53:13.444997 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.448328 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a31da6fb-1121-41dc-a4ac-34af1602fdd5 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040279 Jun 04 20:53:13.448760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c451226d-9a65-40ed-a2a6-f7facae29afc tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.450144 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c451226d-9a65-40ed-a2a6-f7facae29afc tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.029631 Jun 04 20:53:13.452075 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 125/251] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.452565 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 127/252] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:13.465568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3dfb9a0-ed9d-4b3e-9052-a6bd027d8b3e tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Calling method '.version_select at 0x7f2d02e83dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.466498 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.466498 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:13.467899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f3dfb9a0-ed9d-4b3e-9052-a6bd027d8b3e tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '8f6e44c00dc444d0bd6d318808a15bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a44b25c41d4fcc9674a91efe653c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.470068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8bcb2ca-adde-4e50-93ed-82cfb65acba8 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3dfb9a0-ed9d-4b3e-9052-a6bd027d8b3e tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Request method failure captured: Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Y3kXLuIzom3Ri3KuEKkWRF-DvvrcHZodAhSoddSW9lygwxQQ68niGf15o9RTzVA_iRlzJZ2h2U-4XnwscrZkMbrfv7xMM1koQQpR660xWCTQZGPnmEBGRQhf91hTD0bdwOQCyZfvVyN3wtfzqEnKwb0QdR3p5RsTC1d3J9scd1m8M Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:13.471937 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 8f6e44c00dc444d0bd6d318808a15bec Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 20:53:13.473245 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:13.474025 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 04 20:53:13.475115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.478467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3dfb9a0-ed9d-4b3e-9052-a6bd027d8b3e tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.479610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f3dfb9a0-ed9d-4b3e-9052-a6bd027d8b3e tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.022153 Jun 04 20:53:13.485478 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 126/253] 10.222.0.18 () {58 vars in 1178 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:13.529680 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8bcb2ca-adde-4e50-93ed-82cfb65acba8 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.067166 Jun 04 20:53:13.530483 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 128/254] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:13.552123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-54ac3f8d-df50-46c8-b703-0080516239f5 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.587368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-54ac3f8d-df50-46c8-b703-0080516239f5 tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.047867 Jun 04 20:53:13.589300 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 129/255] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:13.607092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fc5b17cb-3746-4ffd-9044-ef8d95ee22f6 req-15f31a45-684d-4bd8-88aa-7c7c81cbc244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7435eee0-6714-4225-9759-fff2ed40dcc5", "name": "network-vif-deleted", "tag": "9f7970ad-a469-46b4-917a-773476de78ef"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:13.628096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Calling method '.version_select at 0x7f2d08e52430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.629332 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.629332 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:13.631214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.632015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.632279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fc5b17cb-3746-4ffd-9044-ef8d95ee22f6 req-15f31a45-684d-4bd8-88aa-7c7c81cbc244 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.632917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fc5b17cb-3746-4ffd-9044-ef8d95ee22f6 req-15f31a45-684d-4bd8-88aa-7c7c81cbc244 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.646725 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fc5b17cb-3746-4ffd-9044-ef8d95ee22f6 req-15f31a45-684d-4bd8-88aa-7c7c81cbc244 service nova] Creating event network-vif-deleted:9f7970ad-a469-46b4-917a-773476de78ef for instance 7435eee0-6714-4225-9759-fff2ed40dcc5 on nch2-master-1 Jun 04 20:53:13.653402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fc5b17cb-3746-4ffd-9044-ef8d95ee22f6 req-15f31a45-684d-4bd8-88aa-7c7c81cbc244 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051582 Jun 04 20:53:13.659211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 130/256] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.666418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-709266ad-da3e-4cc5-acdc-89883f49adec tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.672341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.673765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.687443 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-709266ad-da3e-4cc5-acdc-89883f49adec tempest-FlavorsV2TestJSON-132860668 tempest-FlavorsV2TestJSON-132860668-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026602 Jun 04 20:53:13.688327 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.694294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.695243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:13.699208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:13.709726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.713480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.713698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.714373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.714873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.715493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.737603 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db2b474a-5c22-41f2-8e3a-77bf00eb8010 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.243126 Jun 04 20:53:13.744591 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 127/258] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.759253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed09aeb1-1d86-4ed9-aadb-66382f160158 tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Calling method '.version_select at 0x7f2d02eb1a60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.760440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.760997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.761118 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.761118 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:13.761681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lazy-loading 'fault' on Instance uuid 7435eee0-6714-4225-9759-fff2ed40dcc5 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:53:13.762387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed09aeb1-1d86-4ed9-aadb-66382f160158 tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '8f6e44c00dc444d0bd6d318808a15bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a44b25c41d4fcc9674a91efe653c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed09aeb1-1d86-4ed9-aadb-66382f160158 tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Request method failure captured: Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Y3kXLuIzom3Ri3KuEKkWRF-DvvrcHZodAhSoddSW9lygwxQQ68niGf15o9RTzVA_iRlzJZ2h2U-4XnwscrZkMbrfv7xMM1koQQpR660xWCTQZGPnmEBGRQhf91hTD0bdwOQCyZfvVyN3wtfzqEnKwb0QdR3p5RsTC1d3J9scd1m8M Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:13.764740 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 8f6e44c00dc444d0bd6d318808a15bec Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1'} Jun 04 20:53:13.766248 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:13.767558 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 04 20:53:13.770145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.778683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed09aeb1-1d86-4ed9-aadb-66382f160158 tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.779929 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed09aeb1-1d86-4ed9-aadb-66382f160158 tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.034058 Jun 04 20:53:13.781133 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 128/259] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:13.794575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.795542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:13.812171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.813384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c28978004214999bd5ff400f05fdc73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d9e0c4a4f7b409bab8b012092f7d1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.814994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.816127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.818781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.822857 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3825cb3d-0b40-4013-9cb9-65d2fc54cf89 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 200 len: 1328 microversion: 2.1 time: 0.132966 Jun 04 20:53:13.824107 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 132/260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 1328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:13.828982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc864c8a-e6f2-49b8-b784-661afea6a645 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Calling method '.version_select at 0x7f2d03527310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.830509 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.830509 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:13.831403 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-dc864c8a-e6f2-49b8-b784-661afea6a645 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] HTTP exception thrown: Hypervisor with ID 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89' could not be found. Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc864c8a-e6f2-49b8-b784-661afea6a645 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Request method failure captured: Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hypervisors/fc4864b8-f61e-48fe-9505-0cd9b80fcf89/uptime HTTP/1.1 Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y4QWufwXLOBn5YqsQ6eOdrErhOGrb-N_Kajqw9ig4fyBUdTFJUgZenUR9umPJRnhvsq8vOAU1aSGYueoySyctOCqEhl5tDqoe3-MzSA6VJpAe1h2GGjDl7PuvTZCaYF33miIwm4e5wUsPxaVYSSkAKXxigLSkRpbdBcxo87JGGS_s Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 270dcdc439594a3899ace6584ffd6557 Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1476243449 Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:13.839632 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_270dcdc439594a3899ace6584ffd6557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/270dcdc439594a3899ace6584ffd6557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/270dcdc439594a3899ace6584ffd6557"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/270dcdc439594a3899ace6584ffd6557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1476243449 Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 270dcdc439594a3899ace6584ffd6557 Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1476243449 Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 18454309b2d1482dbd4fd75d7d15a406 Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: exception: Hypervisor with ID 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89' could not be found. Jun 04 20:53:13.840933 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89'} Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89' Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 04 20:53:13.841628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89' could not be found. Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.842806 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89' could not be found. Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc864c8a-e6f2-49b8-b784-661afea6a645 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Returning 404 to user: Hypervisor with ID 'fc4864b8-f61e-48fe-9505-0cd9b80fcf89' could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.845736 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dc864c8a-e6f2-49b8-b784-661afea6a645 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/fc4864b8-f61e-48fe-9505-0cd9b80fcf89/uptime" status: 404 len: 123 microversion: 2.1 time: 0.016068 Jun 04 20:53:13.847099 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 133/261] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors/fc4864b8-f61e-48fe-9505-0cd9b80fcf89/uptime => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:13.860221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.861129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:13.869793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.879084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.879974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.880409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.900311 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] HTTP exception thrown: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Request method failure captured: Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 HTTP/1.1 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YJqV_DXNXfFxNAnqjh11tAhoDW958Z0MmyWPL3MNyWsUsZRztMI60n2n1ncwqokvc0ynFVZk4sdokO0NwZPRMDhokai9FcCsvqPMGTc_zq4Y-pHZyOUyg6jiv4hmikN9ZbrpZVzk2GqG8Au1dONC7es2qgKV-3oiUIvkOgyb1a2P0 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:13.902750 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2009577e16e48458dd3eebf04938841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2009577e16e48458dd3eebf04938841"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 71d0d753d0314e44b9cd7fba3ab1cd26 Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:13.903950 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '254eb6e8-3c1f-4065-835c-fc095e96a562'} Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.904646 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:13.905712 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.907101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Returning 404 to user: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.907101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac2c533b-4f3c-4b52-a3d7-71f8288bbfeb tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 404 len: 111 microversion: 2.1 time: 0.054975 Jun 04 20:53:13.916290 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 134/262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:13.921281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Calling method '.version_select at 0x7f2d0353d9d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.922506 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.922506 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:13.924109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.924109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.940468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.940940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.954067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:13.954501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:13.962132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f294b2d5-a8c5-46da-acbe-719b046f83d8 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044712 Jun 04 20:53:13.962751 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 135/263] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:13.973086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1e7a879-dcbf-44a7-8e33-02f4882516fa tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Calling method '.version_select at 0x7f2d0353ddc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:13.973937 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:13.973937 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:13.975062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a1e7a879-dcbf-44a7-8e33-02f4882516fa tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '8f6e44c00dc444d0bd6d318808a15bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a44b25c41d4fcc9674a91efe653c20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1e7a879-dcbf-44a7-8e33-02f4882516fa tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Request method failure captured: Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y3kXLuIzom3Ri3KuEKkWRF-DvvrcHZodAhSoddSW9lygwxQQ68niGf15o9RTzVA_iRlzJZ2h2U-4XnwscrZkMbrfv7xMM1koQQpR660xWCTQZGPnmEBGRQhf91hTD0bdwOQCyZfvVyN3wtfzqEnKwb0QdR3p5RsTC1d3J9scd1m8M Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:13.976766 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35a44b25c41d4fcc9674a91efe653c20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 35a44b25c41d4fcc9674a91efe653c20 Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691 Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 8f6e44c00dc444d0bd6d318808a15bec Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2062785691-project Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '1'} Jun 04 20:53:13.978250 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:13.979132 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 04 20:53:13.980351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:13.981547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1e7a879-dcbf-44a7-8e33-02f4882516fa tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:13.981547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1e7a879-dcbf-44a7-8e33-02f4882516fa tempest-HypervisorAdminNegativeTestJSON-2062785691 tempest-HypervisorAdminNegativeTestJSON-2062785691-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009530 Jun 04 20:53:13.981547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 136/264] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:53:13.994666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-270fe394-0bbf-49ce-89d9-903d53eb3a27 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Calling method '.version_select at 0x7f2d02c9f040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:14.015480 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-270fe394-0bbf-49ce-89d9-903d53eb3a27 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] HTTP exception thrown: Hypervisor with ID 'f2f804cd-ab9d-4198-b957-e4583208193e' could not be found. Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-270fe394-0bbf-49ce-89d9-903d53eb3a27 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Request method failure captured: Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-hypervisors/f2f804cd-ab9d-4198-b957-e4583208193e HTTP/1.1 Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y4QWufwXLOBn5YqsQ6eOdrErhOGrb-N_Kajqw9ig4fyBUdTFJUgZenUR9umPJRnhvsq8vOAU1aSGYueoySyctOCqEhl5tDqoe3-MzSA6VJpAe1h2GGjDl7PuvTZCaYF33miIwm4e5wUsPxaVYSSkAKXxigLSkRpbdBcxo87JGGS_s Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 270dcdc439594a3899ace6584ffd6557 Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1476243449 Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:14.021654 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_270dcdc439594a3899ace6584ffd6557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/270dcdc439594a3899ace6584ffd6557"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/270dcdc439594a3899ace6584ffd6557"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/270dcdc439594a3899ace6584ffd6557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1476243449 Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 270dcdc439594a3899ace6584ffd6557 Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1476243449 Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 18454309b2d1482dbd4fd75d7d15a406 Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: exception: Hypervisor with ID 'f2f804cd-ab9d-4198-b957-e4583208193e' could not be found. Jun 04 20:53:14.022825 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f2f804cd-ab9d-4198-b957-e4583208193e'} Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f2f804cd-ab9d-4198-b957-e4583208193e' Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 04 20:53:14.023491 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:53:14.025232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f2f804cd-ab9d-4198-b957-e4583208193e' could not be found. Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f2f804cd-ab9d-4198-b957-e4583208193e' could not be found. Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.026304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-270fe394-0bbf-49ce-89d9-903d53eb3a27 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] Returning 404 to user: Hypervisor with ID 'f2f804cd-ab9d-4198-b957-e4583208193e' could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:14.026926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-270fe394-0bbf-49ce-89d9-903d53eb3a27 tempest-HypervisorAdminNegativeTestJSON-1476243449 tempest-HypervisorAdminNegativeTestJSON-1476243449-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/f2f804cd-ab9d-4198-b957-e4583208193e" status: 404 len: 123 microversion: 2.1 time: 0.040280 Jun 04 20:53:14.028262 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 137/265] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/os-hypervisors/f2f804cd-ab9d-4198-b957-e4583208193e => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:53:14.094437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-397218567", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:14.144024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:14.174411 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7da65c7d-5754-4a3b-bb94-31a29cd53e05 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.390685 Jun 04 20:53:14.180227 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 129/266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:13 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:14.199765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:14.200875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:14.212281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.213455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:14.213642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:14.214695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.215535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:14.320203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:14.333897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99403c2f-5fad-419a-b7b8-62a725402463 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1301 microversion: 2.1 time: 0.149439 Jun 04 20:53:14.334823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 130/267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:14 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1301 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:14.658614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:14.659754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:14.660430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:14.661075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:14.661730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:14.679459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.680203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:14.683286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.683974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:14.702112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=15 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:14.729487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Getting quotas for project b2009577e16e48458dd3eebf04938841. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:14.757654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Getting quotas for user 71d0d753d0314e44b9cd7fba3ab1cd26 and project b2009577e16e48458dd3eebf04938841. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:14.787077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:14.796620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:14.842768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:14.844349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:14.877828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.886091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:14.888081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.890372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:14.935817 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] HTTP exception thrown: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Request method failure captured: Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 HTTP/1.1 Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YHOv9x6mdJ7RoQCkXfzy4vWBM1ziz_4uQ9Eam5BnEAg-Olc_UI6u6JxqE-PVv3GRpfODO0gjOXa9jaEce5UnsHjPh2aKj8R5lZVcp4vl10kTe2uqlUjstwx0JofmyYTdoyXn0QXyL0qNu4Ih3pCqTfqoU_MuCMNj__4fObi1emXOk Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0d9e0c4a4f7b409bab8b012092f7d1f2 Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:14.940788 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0d9e0c4a4f7b409bab8b012092f7d1f2 Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminTestJSON-111793161-project Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6c28978004214999bd5ff400f05fdc73 Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminTestJSON-111793161-project Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:14.942065 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7435eee0-6714-4225-9759-fff2ed40dcc5'} Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:14.942712 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:14.943760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:14.946188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Returning 404 to user: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:14.949775 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b615ace9-cbc2-4331-85ef-49dbdc3e4766 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 404 len: 111 microversion: 2.1 time: 0.112379 Jun 04 20:53:14.955172 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 131/268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:14 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:14.957926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e09c79bb-e19e-48d4-b287-67fc842ac075 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871525 Jun 04 20:53:14.959105 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 138/269] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:53:14.971854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64ffc98d-bd6c-4b3b-ac6c-25a76b9259a1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:14.974279 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:14.974279 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:14.976606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=20 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:14.996731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64ffc98d-bd6c-4b3b-ac6c-25a76b9259a1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:14.997902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64ffc98d-bd6c-4b3b-ac6c-25a76b9259a1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:15.041157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e05e882-22bf-4314-acd4-8b8d2c26fa21 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:15.041777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e05e882-22bf-4314-acd4-8b8d2c26fa21 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:15.216427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e05e882-22bf-4314-acd4-8b8d2c26fa21 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:15.219406 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64ffc98d-bd6c-4b3b-ac6c-25a76b9259a1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.259086 Jun 04 20:53:15.220834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 132/270] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:15.230836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:15.231463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:15.241874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:15.242321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:15.246870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:15.247354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:15.255220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e05e882-22bf-4314-acd4-8b8d2c26fa21 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1219 microversion: 2.1 time: 0.238724 Jun 04 20:53:15.258383 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 139/271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:15 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1219 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:15.289038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c49c51fa-b44f-43eb-8026-848441ae99a5 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:15.293013 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:15.293013 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:15.355893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c49c51fa-b44f-43eb-8026-848441ae99a5 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.088514 Jun 04 20:53:15.357769 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 140/272] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:15 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:15.371491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:15.374476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:15.396068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:15.398743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:15.399939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:15.400396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:15.756753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:15.765178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9890b8d3-fbab-4c49-bb3e-c6a4f431165d tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.542589 Jun 04 20:53:15.776124 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 133/273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:15 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:15.781460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61300576-3dc3-40c7-9640-09eb7a6e8cb4 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-118659578"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:15.783467 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:15.783467 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:15.784793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-61300576-3dc3-40c7-9640-09eb7a6e8cb4 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid e0d8cbd6-0fe0-4cfc-9f09-fb1edc69498f for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:15.832833 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61300576-3dc3-40c7-9640-09eb7a6e8cb4 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.055073 Jun 04 20:53:15.842596 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 134/274] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:15 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:15.849406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44a1a865-460c-47c7-aa35-53b0280a476a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:15.851970 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:15.851970 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:15.864305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44a1a865-460c-47c7-aa35-53b0280a476a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:15.865380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44a1a865-460c-47c7-aa35-53b0280a476a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:15.883214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:15.894945 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90b10db5-3f44-4b5d-95c1-ba5809a95261 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.533721 Jun 04 20:53:15.897812 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 141/275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:15 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:16.078788 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-44a1a865-460c-47c7-aa35-53b0280a476a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.234494 Jun 04 20:53:16.079713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 135/276] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:15 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:16.092960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fb61453-d851-4b8d-9b62-2b8ff7647e87 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:16.095304 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:16.095304 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:16.125719 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5fb61453-d851-4b8d-9b62-2b8ff7647e87 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.038589 Jun 04 20:53:16.127313 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 142/277] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:53:16 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:16.147260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a2fe710-2920-4d64-8cd6-9f967ab63912 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:16.149307 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:16.149307 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:16.162736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a2fe710-2920-4d64-8cd6-9f967ab63912 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.163612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a2fe710-2920-4d64-8cd6-9f967ab63912 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:16.276657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:16.278369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:16.300984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.309760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:16.310792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.318711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:16.340172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:16.368849 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a2fe710-2920-4d64-8cd6-9f967ab63912 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.232966 Jun 04 20:53:16.370174 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 136/278] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:16 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:16.398767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-104f317a-8328-4dc8-8433-06ea24974fe9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:16.400000 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:16.400000 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:16.468579 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-104f317a-8328-4dc8-8433-06ea24974fe9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.085473 Jun 04 20:53:16.469469 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 137/279] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:16 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:16.485256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4cd2f37-65e7-4e47-b38d-37e2263399e1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-117967132"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:16.489241 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:16.489241 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:16.493473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-e4cd2f37-65e7-4e47-b38d-37e2263399e1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 73d1dc55-4454-4a5b-a956-4d2476525398 for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:16.551895 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4cd2f37-65e7-4e47-b38d-37e2263399e1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.073184 Jun 04 20:53:16.557855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 138/280] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:16 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:16.558720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:16.578040 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f91f451-7bc2-4c46-8925-d0c0c3551bcf tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1271 microversion: 2.1 time: 0.306999 Jun 04 20:53:16.584378 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 143/281] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:16 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:16.588119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b45081ed-d651-4b26-9a5d-7503fcc7ed0d req-e8159c15-46f4-4e8b-91d3-56ec4688a609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc", "tag": "cd373d92-3884-44ad-88c8-a7be7dfae42d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:16.594965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-870eb20d-6f82-4932-bd78-9d236c1847ea tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:16.607079 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:16.607079 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:16.616988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b45081ed-d651-4b26-9a5d-7503fcc7ed0d req-e8159c15-46f4-4e8b-91d3-56ec4688a609 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.620751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b45081ed-d651-4b26-9a5d-7503fcc7ed0d req-e8159c15-46f4-4e8b-91d3-56ec4688a609 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:16.631367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-870eb20d-6f82-4932-bd78-9d236c1847ea tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.637901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-870eb20d-6f82-4932-bd78-9d236c1847ea tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:16.656922 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b45081ed-d651-4b26-9a5d-7503fcc7ed0d req-e8159c15-46f4-4e8b-91d3-56ec4688a609 service nova] Creating event network-changed:cd373d92-3884-44ad-88c8-a7be7dfae42d for instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc on nch2-master-1 Jun 04 20:53:16.692689 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b45081ed-d651-4b26-9a5d-7503fcc7ed0d req-e8159c15-46f4-4e8b-91d3-56ec4688a609 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129074 Jun 04 20:53:16.696186 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 139/282] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:16.783484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:16.784098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:16.811398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.812567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:16.813453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:16.823828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.261744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:17.276070 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ea30a0b8-3142-4884-8e22-717f5d5a9805 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.492797 Jun 04 20:53:17.276757 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 140/283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:16 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:17.293650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:17.294697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:17.303114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:17.303977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.305448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:17.306146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.537979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:17.551768 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45b8ed54-485a-4d97-b88d-8222941c84e4 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.262137 Jun 04 20:53:17.552723 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 141/284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:17 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:17.572529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4c40a359-8377-4f29-a67a-97665c8a83df req-937e5d2e-45df-439e-919d-6fc0e0080f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2802f93-a40c-4fe1-89d4-a6707b2b7eea", "name": "network-vif-plugged", "status": "completed", "tag": "e766e6b7-e10e-4604-8598-b74e37810cdb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:17.585881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4c40a359-8377-4f29-a67a-97665c8a83df req-937e5d2e-45df-439e-919d-6fc0e0080f4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:17.586575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4c40a359-8377-4f29-a67a-97665c8a83df req-937e5d2e-45df-439e-919d-6fc0e0080f4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.608791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:17.628852 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4c40a359-8377-4f29-a67a-97665c8a83df req-937e5d2e-45df-439e-919d-6fc0e0080f4e service nova] Creating event network-vif-plugged:e766e6b7-e10e-4604-8598-b74e37810cdb for instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea on nch1-master-1 Jun 04 20:53:17.634468 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4c40a359-8377-4f29-a67a-97665c8a83df req-937e5d2e-45df-439e-919d-6fc0e0080f4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068208 Jun 04 20:53:17.639004 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 142/285] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:17.647332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:17.648252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:17.657371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:17.658655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.660241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:17.660764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.684432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-870eb20d-6f82-4932-bd78-9d236c1847ea tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 1.098061 Jun 04 20:53:17.685424 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 144/286] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:17.699835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e3f0e0d-2f67-4704-90c5-6ea62aa3306a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:17.701786 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:17.701786 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:17.710607 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e3f0e0d-2f67-4704-90c5-6ea62aa3306a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.018154 Jun 04 20:53:17.711698 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 145/287] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:53:17 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:17.723344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d75bda84-9ac7-416c-a966-e0607e17aae8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:17.724720 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:17.724720 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:17.739098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d75bda84-9ac7-416c-a966-e0607e17aae8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:17.739649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d75bda84-9ac7-416c-a966-e0607e17aae8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:17.747076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:17.763151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0733398c-3e96-4564-8d9e-5e53057ae7ad tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1277 microversion: 2.1 time: 0.118833 Jun 04 20:53:17.765181 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 143/288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:17 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:17.908849 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d75bda84-9ac7-416c-a966-e0607e17aae8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.190620 Jun 04 20:53:17.915416 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 146/289] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:17 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:17.928385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be581070-3331-45bd-89e6-09d348423680 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:17.928953 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:17.928953 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:17.963068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be581070-3331-45bd-89e6-09d348423680 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.041030 Jun 04 20:53:17.965623 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 144/290] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:17 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:17.974956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0f521a61-8f08-404b-ad7b-d982635bc187 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1224810937"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:17.977417 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:17.977417 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:17.978743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-0f521a61-8f08-404b-ad7b-d982635bc187 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid d7333e39-1026-4c6b-b344-ecf189cd6210 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:18.019527 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0f521a61-8f08-404b-ad7b-d982635bc187 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047673 Jun 04 20:53:18.020922 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 147/291] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:18.034460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f48bb888-da57-4489-8ff2-8c2572c940ad tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:18.037009 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:18.037009 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:18.053237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f48bb888-da57-4489-8ff2-8c2572c940ad tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.054440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f48bb888-da57-4489-8ff2-8c2572c940ad tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.248209 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f48bb888-da57-4489-8ff2-8c2572c940ad tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.220268 Jun 04 20:53:18.254990 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 145/292] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:18 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:18.264502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01164cf3-bed8-4297-b5cc-b437c022df9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:18.266204 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:18.266204 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:18.280741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01164cf3-bed8-4297-b5cc-b437c022df9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.281199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01164cf3-bed8-4297-b5cc-b437c022df9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.296445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:18.297582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:18.309355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.309813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.310606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.311043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.465493 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01164cf3-bed8-4297-b5cc-b437c022df9c tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.208539 Jun 04 20:53:18.469169 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 148/293] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:18 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:18.556314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:18.569512 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e11921dd-ce5a-4b43-8280-c84ebf38bc66 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1387 microversion: 2.1 time: 0.277200 Jun 04 20:53:18.570493 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 146/294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:18 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1387 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:18.585598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a92a889c-405c-4680-a070-1c5aad174eef tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:18.586661 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:18.586661 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:18.619940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a92a889c-405c-4680-a070-1c5aad174eef tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.047683 Jun 04 20:53:18.622062 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 147/295] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:18 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:18.631226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:18.632073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:18.641865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.643115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.643496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.643988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.862712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:18.870723 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0eef48e-6f60-4869-8605-e7895cc53356 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.247018 Jun 04 20:53:18.880681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:18 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:18.886450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60d8a021-8eb4-45d0-83fe-12d8ee0aa417 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1797983681"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:18.887961 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:18.887961 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:18.888896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-60d8a021-8eb4-45d0-83fe-12d8ee0aa417 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 134daa6b-964d-4360-922d-652d251fd9f1 for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:18.921118 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60d8a021-8eb4-45d0-83fe-12d8ee0aa417 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038579 Jun 04 20:53:18.921940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 149/297] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:18.927995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a123133-3555-466b-8519-e7adce2ec62a tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d02c05160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:18.929436 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:18.929436 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:18.930664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a123133-3555-466b-8519-e7adce2ec62a tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.931090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a123133-3555-466b-8519-e7adce2ec62a tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.932001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a123133-3555-466b-8519-e7adce2ec62a tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.932447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a123133-3555-466b-8519-e7adce2ec62a tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.979894 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a123133-3555-466b-8519-e7adce2ec62a tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.056808 Jun 04 20:53:18.980677 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 150/298] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 20:53:18 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:18.986885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:18.987540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:18.994816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.995337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:18.996256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:18.996685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.013630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-78254118", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:19.120829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:19.295756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:19.312434 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3fa9511e-15fa-4524-9e70-cf8cd189ff38 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 0.330817 Jun 04 20:53:19.313336 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 151/299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:18 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:19.318244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed9c11b1-c013-4b09-97dc-0a01ec6290f1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.319115 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.319115 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:19.384831 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed9c11b1-c013-4b09-97dc-0a01ec6290f1 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.070034 Jun 04 20:53:19.386260 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 152/300] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:19 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:19.398139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4bddbfc-8bab-4b42-b547-1997ddd4f23c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d02d085e0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.403299 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.403299 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:19.408130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bddbfc-8bab-4b42-b547-1997ddd4f23c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.413759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bddbfc-8bab-4b42-b547-1997ddd4f23c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.415416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bddbfc-8bab-4b42-b547-1997ddd4f23c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.416450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bddbfc-8bab-4b42-b547-1997ddd4f23c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.517171 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4bddbfc-8bab-4b42-b547-1997ddd4f23c tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.129391 Jun 04 20:53:19.517823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 153/301] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:19.530820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-215c6cbd-9671-4f10-ad24-f228ebd3bcaa tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.532061 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.532061 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:19.541232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-215c6cbd-9671-4f10-ad24-f228ebd3bcaa tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-215c6cbd-9671-4f10-ad24-f228ebd3bcaa tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Request method failure captured: Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJyBhhXj8i-wH0Puy0WypXUPSCDENqxclP_KACrjMkhUfJiD_ZYiv8jA_sye-7WpO5nAzA_Y3YhC4mrDPj7lklMcLXuiDak3ui-2HOyIEimAeNa-bba1Jg4wmOfwBcQADrDxVwbr31f2wJUWxH8H51UEZ997WjhO2dkRkji3aAEik Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:19.543805 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc2cac01bd5043c39d678555c481266f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b31c087a046b40cca85dd462b3aaecc4 Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: exception: Aggregate 5 could not be found. Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '5'} Jun 04 20:53:19.545323 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:19.546147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jun 04 20:53:19.547276 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.550537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-215c6cbd-9671-4f10-ad24-f228ebd3bcaa tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:19.551822 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-215c6cbd-9671-4f10-ad24-f228ebd3bcaa tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032711 Jun 04 20:53:19.552855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 154/302] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:19.560019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35e4c6cb-bf1b-4dfb-bf9e-2df014fc8e76 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d02c4f940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.561833 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.561833 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:19.563368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35e4c6cb-bf1b-4dfb-bf9e-2df014fc8e76 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.564091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35e4c6cb-bf1b-4dfb-bf9e-2df014fc8e76 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.565118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35e4c6cb-bf1b-4dfb-bf9e-2df014fc8e76 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.565774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35e4c6cb-bf1b-4dfb-bf9e-2df014fc8e76 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.599132 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35e4c6cb-bf1b-4dfb-bf9e-2df014fc8e76 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.044935 Jun 04 20:53:19.599965 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 155/303] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:19.607782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-834ff5e6-7df8-454b-97bb-ea5a11cd4b44 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.608891 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.608891 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:19.629038 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-834ff5e6-7df8-454b-97bb-ea5a11cd4b44 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-834ff5e6-7df8-454b-97bb-ea5a11cd4b44 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Request method failure captured: Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJyBhhXj8i-wH0Puy0WypXUPSCDENqxclP_KACrjMkhUfJiD_ZYiv8jA_sye-7WpO5nAzA_Y3YhC4mrDPj7lklMcLXuiDak3ui-2HOyIEimAeNa-bba1Jg4wmOfwBcQADrDxVwbr31f2wJUWxH8H51UEZ997WjhO2dkRkji3aAEik Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:19.631898 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc2cac01bd5043c39d678555c481266f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b31c087a046b40cca85dd462b3aaecc4 Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: exception: Aggregate 5 could not be found. Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '5'} Jun 04 20:53:19.633079 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:19.633923 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:19.635095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-834ff5e6-7df8-454b-97bb-ea5a11cd4b44 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:19.637145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-834ff5e6-7df8-454b-97bb-ea5a11cd4b44 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.031998 Jun 04 20:53:19.640823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 156/304] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:19 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:19.646523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.647149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:19.655407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.655877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.656688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.657131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.660340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:19.661021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:19.661955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:19.662513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:19.663149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:19.680669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.681494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.682897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.683664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.710693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Getting quotas for project eec20993c56848f3b51ef657573fd2fa. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:19.717777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Getting quotas for user 90ddce5b88fa408ea66da1aba6af4a8f and project eec20993c56848f3b51ef657573fd2fa. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:19.733333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:19.736899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:19.812121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6fdd7f7b-3e3c-4f24-a6ec-7dc91c7470ab tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341702 Jun 04 20:53:19.818824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 149/305] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:53:19.825264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-575902c1-32b9-47ab-bea5-567824558fda tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d02c9f670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.828249 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.828249 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:19.841903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:19.845718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-575902c1-32b9-47ab-bea5-567824558fda tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.847768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-575902c1-32b9-47ab-bea5-567824558fda tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.852315 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e4e9c28-7142-40c6-bdd8-28bab461f4ec tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1584 microversion: 2.1 time: 0.210368 Jun 04 20:53:19.853076 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 157/306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1584 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:19.866799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-575902c1-32b9-47ab-bea5-567824558fda tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.867411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-575902c1-32b9-47ab-bea5-567824558fda tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.871348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc9ff71f-077d-43d4-a85d-a3ae2ef32aa6 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1157347063", "name": "tempest-test_aggregate-1614940834"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:19.873140 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:19.873140 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:19.874367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-dc9ff71f-077d-43d4-a85d-a3ae2ef32aa6 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 3f0e104c-d5c0-4aae-b864-93250790f118 for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:19.901548 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-575902c1-32b9-47ab-bea5-567824558fda tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.081102 Jun 04 20:53:19.902151 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 150/307] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:19.907419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c60a010e-1776-47f0-b5de-3a3a410d9a50 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.908244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c60a010e-1776-47f0-b5de-3a3a410d9a50 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:19.909176 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dc9ff71f-077d-43d4-a85d-a3ae2ef32aa6 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.042237 Jun 04 20:53:19.912590 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 158/308] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Jun 4 20:53:19 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:19.921374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.922042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:19.935811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.936492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.937164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:19.937807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:19.974636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c60a010e-1776-47f0-b5de-3a3a410d9a50 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:19.981951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c60a010e-1776-47f0-b5de-3a3a410d9a50 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1214 microversion: 2.1 time: 0.078681 Jun 04 20:53:19.982448 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 151/309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:19.996546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:19.997004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:20.004764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:20.005691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:20.006643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:20.007594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:20.144682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2efef0e6-9b6c-43e7-92a3-ffe7e531141a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230126 Jun 04 20:53:20.146134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 159/310] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:20.150068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6f824d4-c75f-413a-9ff4-0aaec334a299 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Calling method '.version_select at 0x7f2d02c4f040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:20.150853 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:20.150853 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:20.165282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f824d4-c75f-413a-9ff4-0aaec334a299 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:20.165762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f824d4-c75f-413a-9ff4-0aaec334a299 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:20.191384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f824d4-c75f-413a-9ff4-0aaec334a299 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:20.191889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f824d4-c75f-413a-9ff4-0aaec334a299 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:20.232556 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6f824d4-c75f-413a-9ff4-0aaec334a299 tempest-HostsAdminTestJSON-1752099149 tempest-HostsAdminTestJSON-1752099149-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 598 microversion: 2.1 time: 0.085850 Jun 04 20:53:20.239165 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 160/311] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 20:53:20 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 598 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:20.240752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-141c9eb0-fa6b-4517-a64c-184d311a31f7 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:20.241632 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:20.241632 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:20.274114 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-141c9eb0-fa6b-4517-a64c-184d311a31f7 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.037381 Jun 04 20:53:20.276185 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 161/312] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:20 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:20.566249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:20.576241 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d8044b20-d9ff-4e89-b0f4-51c00df1b9d5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.592710 Jun 04 20:53:20.580593 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 152/313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:19 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:20.601835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43115cc1-c4dc-4ce7-be4a-c018a05686e8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:20.608543 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:20.608543 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:20.630756 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-43115cc1-c4dc-4ce7-be4a-c018a05686e8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43115cc1-c4dc-4ce7-be4a-c018a05686e8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Request method failure captured: Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YJyBhhXj8i-wH0Puy0WypXUPSCDENqxclP_KACrjMkhUfJiD_ZYiv8jA_sye-7WpO5nAzA_Y3YhC4mrDPj7lklMcLXuiDak3ui-2HOyIEimAeNa-bba1Jg4wmOfwBcQADrDxVwbr31f2wJUWxH8H51UEZ997WjhO2dkRkji3aAEik Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:20.633254 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc2cac01bd5043c39d678555c481266f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: b31c087a046b40cca85dd462b3aaecc4 Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: exception: Aggregate 6 could not be found. Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6'} Jun 04 20:53:20.635473 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:20.636294 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jun 04 20:53:20.637299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:20.639275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43115cc1-c4dc-4ce7-be4a-c018a05686e8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:20.640675 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43115cc1-c4dc-4ce7-be4a-c018a05686e8 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.058671 Jun 04 20:53:20.642073 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 153/314] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:53:20 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:20.654490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:20.657644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:20.672145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:20.678711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:20.679428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:20.682479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:20.683106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:20.861689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ca50f75-4e80-461c-96e6-86750e59c9e3 tempest-NetworksTest-601047390 tempest-NetworksTest-601047390-project-admin] Calling method '.version_select at 0x7f2d02e51160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:21.762726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:21.776288 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f105e45d-ffa2-4666-95b0-7ae75aeae760 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 1.132335 Jun 04 20:53:21.776960 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 154/315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:20 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:21.790392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0825671-cf62-4f2d-bbf0-457821730c43 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:21.791450 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:21.791450 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:21.811641 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-d0825671-cf62-4f2d-bbf0-457821730c43 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0825671-cf62-4f2d-bbf0-457821730c43 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Request method failure captured: Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YJyBhhXj8i-wH0Puy0WypXUPSCDENqxclP_KACrjMkhUfJiD_ZYiv8jA_sye-7WpO5nAzA_Y3YhC4mrDPj7lklMcLXuiDak3ui-2HOyIEimAeNa-bba1Jg4wmOfwBcQADrDxVwbr31f2wJUWxH8H51UEZ997WjhO2dkRkji3aAEik Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:21.814974 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc2cac01bd5043c39d678555c481266f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc2cac01bd5043c39d678555c481266f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc2cac01bd5043c39d678555c481266f Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1073561405 Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: b31c087a046b40cca85dd462b3aaecc4 Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminTestJSON-1073561405-project-admin Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: exception: Aggregate 6 could not be found. Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6'} Jun 04 20:53:21.816403 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:21.817116 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:21.818172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:21.819386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:21.819386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:21.819386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:21.819386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Jun 04 20:53:21.819386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:21.821175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0825671-cf62-4f2d-bbf0-457821730c43 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:21.825950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d0825671-cf62-4f2d-bbf0-457821730c43 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.044452 Jun 04 20:53:21.826710 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 155/316] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:21 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:21.835766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:21.836384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:21.848571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:21.849590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:21.850639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:21.851578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:21.889457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:21.889774 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ca50f75-4e80-461c-96e6-86750e59c9e3 tempest-NetworksTest-601047390 tempest-NetworksTest-601047390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 3325 microversion: 2.1 time: 1.612477 Jun 04 20:53:21.890837 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 162/317] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:20 2022] GET /compute/v2.1/os-networks => generated 3325 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:21.899732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6b86f3cf-440f-4c10-aaad-221f8d6c9c6f req-0d0fc819-29c5-4e41-8e05-15b5b9fbae42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82bf488-79d8-4af3-8e20-c19cfccd0125", "tag": "1e66d5ec-1034-421c-9bfb-4dca41c70313"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:21.922162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6b86f3cf-440f-4c10-aaad-221f8d6c9c6f req-0d0fc819-29c5-4e41-8e05-15b5b9fbae42 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:21.923144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6b86f3cf-440f-4c10-aaad-221f8d6c9c6f req-0d0fc819-29c5-4e41-8e05-15b5b9fbae42 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:21.956279 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6b86f3cf-440f-4c10-aaad-221f8d6c9c6f req-0d0fc819-29c5-4e41-8e05-15b5b9fbae42 service nova] Creating event network-changed:1e66d5ec-1034-421c-9bfb-4dca41c70313 for instance c82bf488-79d8-4af3-8e20-c19cfccd0125 on nch1-master-1 Jun 04 20:53:21.967469 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6b86f3cf-440f-4c10-aaad-221f8d6c9c6f req-0d0fc819-29c5-4e41-8e05-15b5b9fbae42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075079 Jun 04 20:53:21.969472 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 163/318] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:21.977586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:21.978453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:21.986546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:21.987119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:21.988144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:21.988653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:22.038153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:22.129229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:22.147889 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-504834d1-0e84-4e65-a1cd-b7663c7acf15 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1272 microversion: 2.1 time: 0.310241 Jun 04 20:53:22.148967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 156/319] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:21 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:22.164412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ea7e75b-fc92-4156-b16e-fb17ce5448e9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1534482217"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:22.167575 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:22.167575 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:22.169141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-0ea7e75b-fc92-4156-b16e-fb17ce5448e9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 15c5b909-9c6f-4388-ae5b-eb5c0be88df2 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:22.201942 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ea7e75b-fc92-4156-b16e-fb17ce5448e9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051329 Jun 04 20:53:22.202946 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 157/320] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:22.215870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4471735c-37b1-41a1-9f28-48d3c71f9dde tempest-NetworksTest-601047390 tempest-NetworksTest-601047390-project-admin] Calling method '.version_select at 0x7f2d02b79e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:22.637628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:22.648465 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8cc8699d-fa6a-4fcc-b6a0-70cf46d8bbe5 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.676665 Jun 04 20:53:22.658703 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 164/321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:21 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:22.664119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1139d2d7-7ec7-4f03-b7c7-930e59508db4 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:22.666508 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:22.666508 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:22.675805 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1139d2d7-7ec7-4f03-b7c7-930e59508db4 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 227 microversion: 2.1 time: 0.015656 Jun 04 20:53:22.676685 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 165/322] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:53:22 2022] GET /compute/v2.1/os-aggregates/7 => generated 227 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:22.679861 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4471735c-37b1-41a1-9f28-48d3c71f9dde tempest-NetworksTest-601047390 tempest-NetworksTest-601047390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks/68fefb59-8f6d-41f3-89ac-cca30a7243e2" status: 200 len: 652 microversion: 2.1 time: 0.472737 Jun 04 20:53:22.680506 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 158/323] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 20:53:22 2022] GET /compute/v2.1/os-networks/68fefb59-8f6d-41f3-89ac-cca30a7243e2 => generated 652 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:22.690934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a5460931-4835-4a2b-a190-767be50016a5 tempest-NetworksTest-601047390 tempest-NetworksTest-601047390-project-admin] Calling method '.version_select at 0x7f2d02c36a60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:22.700484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e9666627-9797-4448-9681-36cf891a43d9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:22.703497 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:22.703497 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:22.746735 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e9666627-9797-4448-9681-36cf891a43d9 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 265 microversion: 2.1 time: 0.056288 Jun 04 20:53:22.755616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 159/324] 10.222.0.18 () {60 vars in 1190 bytes} [Sat Jun 4 20:53:22 2022] POST /compute/v2.1/os-aggregates/7/action => generated 265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:22.764751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d26cd2d-3f53-49ac-8b8f-0aa9d9e94d51 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:22.767235 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:22.767235 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:22.778941 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d26cd2d-3f53-49ac-8b8f-0aa9d9e94d51 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/7" status: 200 len: 241 microversion: 2.1 time: 0.021288 Jun 04 20:53:22.779560 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 160/325] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:53:22 2022] GET /compute/v2.1/os-aggregates/7 => generated 241 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:22.793044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8772f70f-f2c1-4488-8875-08bc46708d34 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:22.794078 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:22.794078 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:22.849677 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8772f70f-f2c1-4488-8875-08bc46708d34 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.060753 Jun 04 20:53:22.854986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 161/326] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:22 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:22.863899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:22.864801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:22.877039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:22.877839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:22.878786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:22.879547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:23.165534 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a5460931-4835-4a2b-a190-767be50016a5 tempest-NetworksTest-601047390 tempest-NetworksTest-601047390-project-admin] 10.222.0.18 "GET /compute/v2.1/os-networks" status: 200 len: 4020 microversion: 2.1 time: 0.479650 Jun 04 20:53:23.166426 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:22 2022] GET /compute/v2.1/os-networks => generated 4020 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:23.177012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e2764cd-8fc6-4d85-92f9-51e25566e121 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1430276406", "availability_zone": "tempest-test_az-1018766629"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:23.178985 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:23.178985 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:23.180584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-9e2764cd-8fc6-4d85-92f9-51e25566e121 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 8b155952-0493-4b58-93a9-eb707224124d for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:23.228087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=7 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:23.253084 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e2764cd-8fc6-4d85-92f9-51e25566e121 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.085033 Jun 04 20:53:23.260555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 167/328] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Jun 4 20:53:23 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:23.272417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:23.274043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:23.291915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:23.292972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:23.293767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:23.294406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:23.697614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:23.709507 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-12392644-35b8-4103-a2d1-f4adfe614575 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 0.852946 Jun 04 20:53:23.711901 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 162/329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:22 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:23.716776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb79edb4-1b3e-4ec0-93ef-8c420d3cd716 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1430276406_new", "availability_zone": "tempest-test_az-1018766629_new"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:23.918380 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:23.918380 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:23.950173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:23.961554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-34148d87-0775-42a6-865b-51b6e2d27c41 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.699526 Jun 04 20:53:23.967571 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:23 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:23.987287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:23.994792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:24.000496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb79edb4-1b3e-4ec0-93ef-8c420d3cd716 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.002536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb79edb4-1b3e-4ec0-93ef-8c420d3cd716 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.013286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.020177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.023235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.023921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.131098 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb79edb4-1b3e-4ec0-93ef-8c420d3cd716 tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/8" status: 200 len: 336 microversion: 2.1 time: 0.418020 Jun 04 20:53:24.150051 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 163/331] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:53:23 2022] PUT /compute/v2.1/os-aggregates/8 => generated 336 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:24.158890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ee440099-1cf0-4696-998b-dc2b1cb12a15 req-a9670203-89fe-4db2-8676-42fbce3638ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc", "name": "network-vif-plugged", "status": "completed", "tag": "cd373d92-3884-44ad-88c8-a7be7dfae42d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:24.172918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ee440099-1cf0-4696-998b-dc2b1cb12a15 req-a9670203-89fe-4db2-8676-42fbce3638ba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.174441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ee440099-1cf0-4696-998b-dc2b1cb12a15 req-a9670203-89fe-4db2-8676-42fbce3638ba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.193366 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ee440099-1cf0-4696-998b-dc2b1cb12a15 req-a9670203-89fe-4db2-8676-42fbce3638ba service nova] Creating event network-vif-plugged:cd373d92-3884-44ad-88c8-a7be7dfae42d for instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc on nch2-master-1 Jun 04 20:53:24.204526 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ee440099-1cf0-4696-998b-dc2b1cb12a15 req-a9670203-89fe-4db2-8676-42fbce3638ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052282 Jun 04 20:53:24.205813 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 164/332] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:24.214918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04b04920-f00e-4310-9985-a188d1d34d4a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:24.216743 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:24.216743 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:24.227211 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04b04920-f00e-4310-9985-a188d1d34d4a tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.019573 Jun 04 20:53:24.228655 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 165/333] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:53:24 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:24.241358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cbe2d576-8f81-42f9-b7c2-35155eb4e0bf tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:24.248821 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:24.248821 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:24.328628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cbe2d576-8f81-42f9-b7c2-35155eb4e0bf tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.092970 Jun 04 20:53:24.333871 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 166/334] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:24 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:24.393300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9b1e9f5c-529e-4852-af15-b9ae3e216c6f tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1834467834"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:24.398789 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:24.398789 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:24.400552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-9b1e9f5c-529e-4852-af15-b9ae3e216c6f tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Generated uuid 921ab400-1195-4ab4-824f-49875406b29e for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:24.482560 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9b1e9f5c-529e-4852-af15-b9ae3e216c6f tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.139515 Jun 04 20:53:24.485944 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 167/335] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:24.509382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:24.513213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:24.542356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.547122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.549177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.551947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.595792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:24.615761 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ceeb0768-cc86-4462-a76a-d6b3fcec1ef9 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.643077 Jun 04 20:53:24.631608 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 169/336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:23 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:24.631608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-171a484d-cddb-493a-a55f-addba89443ec req-c687966f-1a5e-4a04-ba40-40bb9ea889ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2802f93-a40c-4fe1-89d4-a6707b2b7eea", "tag": "e766e6b7-e10e-4604-8598-b74e37810cdb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:24.669241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-171a484d-cddb-493a-a55f-addba89443ec req-c687966f-1a5e-4a04-ba40-40bb9ea889ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.669629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-171a484d-cddb-493a-a55f-addba89443ec req-c687966f-1a5e-4a04-ba40-40bb9ea889ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.709670 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-171a484d-cddb-493a-a55f-addba89443ec req-c687966f-1a5e-4a04-ba40-40bb9ea889ef service nova] Creating event network-changed:e766e6b7-e10e-4604-8598-b74e37810cdb for instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea on nch1-master-1 Jun 04 20:53:24.723843 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-171a484d-cddb-493a-a55f-addba89443ec req-c687966f-1a5e-4a04-ba40-40bb9ea889ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103187 Jun 04 20:53:24.725778 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 170/337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:24.738553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c37f9efa-1e75-48b8-a4a1-fa7874bba6df tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:24.739469 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:24.739469 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:24.768087 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c37f9efa-1e75-48b8-a4a1-fa7874bba6df tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.040087 Jun 04 20:53:24.771169 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 171/338] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:53:24 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:24.792493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:24.794926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:24.811545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.812497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:24.815540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:24.817446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.007996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:25.026413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cbdf6479-1a15-4151-af88-464fbe61a013 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 200 len: 1584 microversion: 2.1 time: 0.537809 Jun 04 20:53:25.028951 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 168/339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:24 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 1584 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:25.039780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-102dd885-b6c5-4e42-a183-e20ec051eafe tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:25.044061 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:25.044061 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:25.100589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:25.109187 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-102dd885-b6c5-4e42-a183-e20ec051eafe tempest-AggregatesAdminTestJSON-1073561405 tempest-AggregatesAdminTestJSON-1073561405-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.073858 Jun 04 20:53:25.110345 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 169/340] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:25 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:25.117214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8016d396-a6a4-411b-ad20-61173c8467a0 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 0.336596 Jun 04 20:53:25.117812 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 172/341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:24 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:25.130195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:25.132860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:25.139422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:25.142100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:25.155154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.158567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.160747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.161194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.161394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.164387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.164571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.165939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.199094 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] HTTP exception thrown: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Request method failure captured: Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 HTTP/1.1 Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YHOv9x6mdJ7RoQCkXfzy4vWBM1ziz_4uQ9Eam5BnEAg-Olc_UI6u6JxqE-PVv3GRpfODO0gjOXa9jaEce5UnsHjPh2aKj8R5lZVcp4vl10kTe2uqlUjstwx0JofmyYTdoyXn0QXyL0qNu4Ih3pCqTfqoU_MuCMNj__4fObi1emXOk Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0d9e0c4a4f7b409bab8b012092f7d1f2 Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:25.203502 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0d9e0c4a4f7b409bab8b012092f7d1f2 Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminTestJSON-111793161-project Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6c28978004214999bd5ff400f05fdc73 Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminTestJSON-111793161-project Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.205037 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7435eee0-6714-4225-9759-fff2ed40dcc5'} Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:25.205690 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.206735 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.207961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Returning 404 to user: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:25.207961 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-405675e7-1198-4552-96e6-f3799635a241 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 404 len: 111 microversion: 2.1 time: 0.086802 Jun 04 20:53:25.211320 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 173/342] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:25 2022] DELETE /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:25.218018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:25.219790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] [instance: 7435eee0-6714-4225-9759-fff2ed40dcc5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:25.246546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.247150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.247973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.248405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.278064 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] HTTP exception thrown: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Request method failure captured: Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 HTTP/1.1 Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YHOv9x6mdJ7RoQCkXfzy4vWBM1ziz_4uQ9Eam5BnEAg-Olc_UI6u6JxqE-PVv3GRpfODO0gjOXa9jaEce5UnsHjPh2aKj8R5lZVcp4vl10kTe2uqlUjstwx0JofmyYTdoyXn0QXyL0qNu4Ih3pCqTfqoU_MuCMNj__4fObi1emXOk Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0d9e0c4a4f7b409bab8b012092f7d1f2 Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:25.281105 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d9e0c4a4f7b409bab8b012092f7d1f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0d9e0c4a4f7b409bab8b012092f7d1f2 Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-111793161 Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminTestJSON-111793161-project Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6c28978004214999bd5ff400f05fdc73 Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminTestJSON-111793161-project Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.284239 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7435eee0-6714-4225-9759-fff2ed40dcc5'} Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:25.284915 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. Jun 04 20:53:25.285989 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:25.290629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] Returning 404 to user: Instance 7435eee0-6714-4225-9759-fff2ed40dcc5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:25.291934 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-41b3b821-71cb-4c2e-a04a-9fa8c5f9ef79 tempest-AggregatesAdminTestJSON-111793161 tempest-AggregatesAdminTestJSON-111793161-project] 10.222.0.18 "GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5" status: 404 len: 111 microversion: 2.1 time: 0.079293 Jun 04 20:53:25.293132 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 174/343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:25 2022] GET /compute/v2.1/servers/7435eee0-6714-4225-9759-fff2ed40dcc5 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:25.541852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:25.555751 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da0624ea-4ae5-439a-adaf-52fafb1bc93f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.443896 Jun 04 20:53:25.569400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 170/344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:25 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:25.657944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:25.659349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:25.691166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.692209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.696080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.696806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.893280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5ba1ac6f-065c-4d0a-aa02-c3020f78fe43 req-cf7e0f8e-8ad1-401c-8591-a12976288192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8bf095-dc48-42b1-8889-3bb6abe49ccb", "tag": "90c9c55c-b56b-4a98-b0da-f598610d3ded"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:25.910756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5ba1ac6f-065c-4d0a-aa02-c3020f78fe43 req-cf7e0f8e-8ad1-401c-8591-a12976288192 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:25.911535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5ba1ac6f-065c-4d0a-aa02-c3020f78fe43 req-cf7e0f8e-8ad1-401c-8591-a12976288192 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:25.932740 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5ba1ac6f-065c-4d0a-aa02-c3020f78fe43 req-cf7e0f8e-8ad1-401c-8591-a12976288192 service nova] Creating event network-changed:90c9c55c-b56b-4a98-b0da-f598610d3ded for instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb on nch2-master-1 Jun 04 20:53:25.933109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:25.944151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-67f74495-6370-493f-8694-d12560342e1c tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1322 microversion: 2.1 time: 0.292952 Jun 04 20:53:25.945128 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 175/345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:25 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:25.956905 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5ba1ac6f-065c-4d0a-aa02-c3020f78fe43 req-cf7e0f8e-8ad1-401c-8591-a12976288192 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067744 Jun 04 20:53:25.957589 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 171/346] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:26.136000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:26.136459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:26.154082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:26.154538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:26.156923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:26.160258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:26.353958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:26.362572 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf920c44-090f-4b0c-9690-91c0ee395848 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 0.231915 Jun 04 20:53:26.366806 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 176/347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:26 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:26.578383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:26.579383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:26.588645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:26.589183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:26.590110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:26.591151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:26.817192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:26.834361 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d04230de-492a-46b9-8604-d74ed357b547 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.262657 Jun 04 20:53:26.848052 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 172/348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:26 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:26.964644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:26.965560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:26.983636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:26.984792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:26.989526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:26.990257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.211643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:27.215702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:27.224527 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7df1ec26-c572-4ede-bb4f-ea4909fe8416 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1472 microversion: 2.1 time: 0.266065 Jun 04 20:53:27.225825 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 177/349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:26 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:27.244137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:27.245455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:27.275383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.277761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.280736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.284386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.385540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:27.386305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:27.400374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.400965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.404056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.406854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.508696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Request method failure captured: Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc/diagnostics HTTP/1.1 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YzFKc6gjPq9zURxkr9IdkJe7rzXw36bPs5xhEeYpBtqz-x_jcS8Mos6sPHkRyLxWTOvaOPZ7rQ_yr8Krip9fcSYIU7cepsUbosuib-sOo2_WTyHYuZ-cgf2odY887r7r3SkDCHSKDy4c-LusheJRGTQT_Rzk94Ln7J-uXr3Q2a2F4 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 2d9304b76a754b31bb48d933a61eb508 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1208543219 Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:27.515792 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1208543219 Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 2d9304b76a754b31bb48d933a61eb508 Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1208543219 Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiagnosticsNegativeTest-1208543219-project Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 66b6d873574540ad866d203f7a562270 Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1208543219-project Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:27.517419 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': 'a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc'} Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:27.518211 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 04 20:53:27.519574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:27.523223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:27.525558 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-12ac8165-8ba7-47aa-b732-203c0935ed98 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.287147 Jun 04 20:53:27.528003 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 173/350] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:53:27 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc/diagnostics => generated 117 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:27.542218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:27.544214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:27.553326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.553786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.554737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.555326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.587651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:53:27.767839 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-983f3e5b-b933-4647-bd4e-e18c9831bdb8 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 204 len: 0 microversion: 2.1 time: 0.231432 Jun 04 20:53:27.769042 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 174/351] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:27 2022] DELETE /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:53:27.782456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:27.783776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:27.794033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.794865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.795817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.796768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.838658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:27.850575 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4a8771b1-7f09-4b8f-8f5e-138acaa03d9b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 0.471038 Jun 04 20:53:27.863643 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 178/352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:27 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:27.864484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:27.865408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:27.875055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.876040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:27.877660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:27.878879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.149727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:28.163009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10872440-829a-4de9-862d-febaea5d1b62 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1478 microversion: 2.1 time: 0.386035 Jun 04 20:53:28.176181 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 175/353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:27 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1478 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:28.271421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:28.293704 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-afc08799-954e-47b5-83ac-db274eb022c3 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.428328 Jun 04 20:53:28.296403 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 179/354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:27 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:28.751489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Calling method '.version_select at 0x7f2d02c9fd30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:28.753095 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:28.753095 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:28.754374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.754816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.786546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.786990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.840989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.841576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.871565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:28.872676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:28.873342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.873796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.885674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.887475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.889171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.890973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.905430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.906337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.914252 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60e0ab72-ddd9-4e20-9ec9-f36833be180b tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.576572 Jun 04 20:53:28.915413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 176/355] 10.222.0.18 () {60 vars in 1242 bytes} [Sat Jun 4 20:53:28 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:53:28.920922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-6f126895-98ab-427c-82a2-861d9de83fa3 req-c60720eb-05e8-4fb4-ab36-531288abc48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82bf488-79d8-4af3-8e20-c19cfccd0125", "name": "network-vif-plugged", "status": "completed", "tag": "1e66d5ec-1034-421c-9bfb-4dca41c70313"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:28.945383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6f126895-98ab-427c-82a2-861d9de83fa3 req-c60720eb-05e8-4fb4-ab36-531288abc48e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:28.945832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6f126895-98ab-427c-82a2-861d9de83fa3 req-c60720eb-05e8-4fb4-ab36-531288abc48e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:28.979085 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-6f126895-98ab-427c-82a2-861d9de83fa3 req-c60720eb-05e8-4fb4-ab36-531288abc48e service nova] Creating event network-vif-plugged:1e66d5ec-1034-421c-9bfb-4dca41c70313 for instance c82bf488-79d8-4af3-8e20-c19cfccd0125 on nch1-master-1 Jun 04 20:53:28.991758 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-6f126895-98ab-427c-82a2-861d9de83fa3 req-c60720eb-05e8-4fb4-ab36-531288abc48e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074686 Jun 04 20:53:28.992430 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 177/356] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:28.997719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Calling method '.version_select at 0x7f2d034d5b80>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:28.999311 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:28.999311 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:29.000476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.000988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.018738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.019182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.045979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.046437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.058084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.058807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.086569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.087219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.098822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c579d552-eb81-404d-989e-91a4f868e998 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 607 microversion: 2.53 time: 0.105008 Jun 04 20:53:29.099792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 178/357] 10.222.0.18 () {60 vars in 1221 bytes} [Sat Jun 4 20:53:28 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 607 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:29.114440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dfb68ead-e7a3-4ad8-9491-84fc3b710d33 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Calling method '.version_select at 0x7f2d02af8ee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:29.118072 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:29.118072 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:29.120226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfb68ead-e7a3-4ad8-9491-84fc3b710d33 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.121004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfb68ead-e7a3-4ad8-9491-84fc3b710d33 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.158386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfb68ead-e7a3-4ad8-9491-84fc3b710d33 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.159171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfb68ead-e7a3-4ad8-9491-84fc3b710d33 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.168417 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dfb68ead-e7a3-4ad8-9491-84fc3b710d33 tempest-HypervisorAdminV253TestBase-209529210 tempest-HypervisorAdminV253TestBase-209529210-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/fe1af910-905c-4475-be38-4960f46e2abb" status: 200 len: 792 microversion: 2.53 time: 0.059476 Jun 04 20:53:29.179366 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 179/358] 10.222.0.18 () {60 vars in 1297 bytes} [Sat Jun 4 20:53:29 2022] GET /compute/v2.1/os-hypervisors/fe1af910-905c-4475-be38-4960f46e2abb => generated 792 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:29.183755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:29.184504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:29.193968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.194421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.195394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.195883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.237502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.579808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.639845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:29.652050 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-254805b7-23eb-44d9-9322-7d768534bf51 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1478 microversion: 2.1 time: 0.474281 Jun 04 20:53:29.652639 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 180/359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:29 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1478 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:29.662148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:29.662774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:29.679251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.679866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.680660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:29.681102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:29.693752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.706948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:29.718474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:29.735769 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-400637bd-4b12-452e-b883-3348319826c1 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1319 microversion: 2.1 time: 0.869067 Jun 04 20:53:29.745478 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 180/360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:28 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1319 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:29.981371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=26 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:30.007092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:30.015852 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c3ed52e6-5c5b-4bd9-9e09-18c19223c7d9 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.362043 Jun 04 20:53:30.016580 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 181/361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:29 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:30.674911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b43d10d6-5e43-4bec-965c-6497e1ea596b req-1ec6bd37-4e47-478f-bfa6-4aa4d55ceacd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc", "name": "network-vif-deleted", "tag": "cd373d92-3884-44ad-88c8-a7be7dfae42d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:30.677204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:30.677886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:30.693438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b43d10d6-5e43-4bec-965c-6497e1ea596b req-1ec6bd37-4e47-478f-bfa6-4aa4d55ceacd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:30.693994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b43d10d6-5e43-4bec-965c-6497e1ea596b req-1ec6bd37-4e47-478f-bfa6-4aa4d55ceacd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:30.696419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:30.700448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:30.703642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:30.704525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:30.724077 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b43d10d6-5e43-4bec-965c-6497e1ea596b req-1ec6bd37-4e47-478f-bfa6-4aa4d55ceacd service nova] Creating event network-vif-deleted:cd373d92-3884-44ad-88c8-a7be7dfae42d for instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc on nch2-master-1 Jun 04 20:53:30.734447 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b43d10d6-5e43-4bec-965c-6497e1ea596b req-1ec6bd37-4e47-478f-bfa6-4aa4d55ceacd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061975 Jun 04 20:53:30.736287 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 182/362] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:30.761391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:30.762279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:30.778957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:30.779810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:30.780932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:30.781817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:30.847296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b6d873574540ad866d203f7a562270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9304b76a754b31bb48d933a61eb508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:30.858435 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-24f01e99-9fa2-4c6a-b8a8-3fc0b307aecb tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 200 len: 1436 microversion: 2.1 time: 0.193394 Jun 04 20:53:30.860203 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 181/363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:30 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 1436 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:31.018536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:31.028254 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d5457edb-23e4-49e0-9edf-a1c616da3cb6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1468 microversion: 2.1 time: 0.278210 Jun 04 20:53:31.028859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 183/364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:30 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1468 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:31.036544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:31.037151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:31.046220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.047053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.048395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.049016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.050624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:31.051659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:31.060159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.061785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.062767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.063314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.261968 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9be61dcf-893c-4738-924c-7effd0a5b784 tempest-DeleteServersAdminTestJSON-1085026425 tempest-DeleteServersAdminTestJSON-1085026425-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125/action" status: 202 len: 0 microversion: 2.1 time: 0.219463 Jun 04 20:53:31.266610 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 184/365] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:53:31 2022] POST /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:53:31.273960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:31.274840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:31.282269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.283232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.284384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.285050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.327133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.327852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.328456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lazy-loading 'fault' on Instance uuid c82bf488-79d8-4af3-8e20-c19cfccd0125 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:53:31.339948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:31.351956 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a05a4d9a-cf40-4f5c-8b7e-59eae3eef358 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.319210 Jun 04 20:53:31.365844 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 182/366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:31 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:31.593458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:31.602776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-55b55229-3957-4195-8fa3-eb6cec750e53 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1451 microversion: 2.1 time: 0.334296 Jun 04 20:53:31.619280 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 185/367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:31 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1451 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:31.625720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:31.626242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:31.644535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.648325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.652341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.653252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.712675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:53:31.884585 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d262ce8-ea63-4451-b5e9-a4e7363dda1e tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 204 len: 0 microversion: 2.1 time: 0.263953 Jun 04 20:53:31.886296 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 183/368] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:31 2022] DELETE /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:53:31.900439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:31.901529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] [instance: a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:31.909554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.910145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.911073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.911895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.928794 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] HTTP exception thrown: Instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc could not be found. Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Request method failure captured: Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc HTTP/1.1 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YzFKc6gjPq9zURxkr9IdkJe7rzXw36bPs5xhEeYpBtqz-x_jcS8Mos6sPHkRyLxWTOvaOPZ7rQ_yr8Krip9fcSYIU7cepsUbosuib-sOo2_WTyHYuZ-cgf2odY887r7r3SkDCHSKDy4c-LusheJRGTQT_Rzk94Ln7J-uXr3Q2a2F4 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2d9304b76a754b31bb48d933a61eb508 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1208543219 Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:31.930749 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2d9304b76a754b31bb48d933a61eb508"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1208543219 Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2d9304b76a754b31bb48d933a61eb508 Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1208543219 Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerDiagnosticsNegativeTest-1208543219-project Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 66b6d873574540ad866d203f7a562270 Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1208543219-project Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc could not be found. Jun 04 20:53:31.932278 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc'} Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc could not be found. Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:31.932973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc could not be found. Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc could not be found. Jun 04 20:53:31.934461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:31.935698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] Returning 404 to user: Instance a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:31.935698 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53d01323-044d-45c4-afff-7fa48dbb37a2 tempest-ServerDiagnosticsNegativeTest-1208543219 tempest-ServerDiagnosticsNegativeTest-1208543219-project] 10.222.0.18 "GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc" status: 404 len: 111 microversion: 2.1 time: 0.042663 Jun 04 20:53:31.937013 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 184/369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:31 2022] GET /compute/v2.1/servers/a1c0c7e7-63d9-49b8-996b-f3a2d4ada0fc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:31.942532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:31.943144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:31.950401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.950565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.951366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.951815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.989676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:31.990126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:31.990597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lazy-loading 'fault' on Instance uuid c82bf488-79d8-4af3-8e20-c19cfccd0125 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:53:32.145022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:32.159400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d1e1a0e-948b-4332-8fc9-800cb6f1d7d6 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1457 microversion: 2.1 time: 0.221226 Jun 04 20:53:32.160029 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 185/370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:31 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1457 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:32.242726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Calling method '.version_select at 0x7f2d02a4fee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:32.244740 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:32.244740 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:32.245940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.246568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:32.261108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.261558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:32.272852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.273254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:32.279740 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c488a8fd-2414-4046-a164-b1c2e56dd466 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.474354 Jun 04 20:53:32.280326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 186/371] 10.222.0.18 () {60 vars in 1207 bytes} [Sat Jun 4 20:53:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:53:32.295330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a2101ac-5d80-4301-bd6d-28721552e290 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-198026681"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:32.297181 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:32.297181 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:32.298134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-9a2101ac-5d80-4301-bd6d-28721552e290 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Generated uuid 9e9423c8-29ea-43b4-aa22-de627421eec8 for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:32.326890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a2101ac-5d80-4301-bd6d-28721552e290 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.035579 Jun 04 20:53:32.327904 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 186/372] 10.222.0.18 () {62 vars in 1204 bytes} [Sat Jun 4 20:53:32 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:32.338092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e51f663f-7131-4503-80b2-03d0c67b03d2 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319608805"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:32.439252 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:32.439252 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:32.479011 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e51f663f-7131-4503-80b2-03d0c67b03d2 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 299 microversion: 2.41 time: 0.143950 Jun 04 20:53:32.480096 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 187/373] 10.222.0.18 () {62 vars in 1212 bytes} [Sat Jun 4 20:53:32 2022] PUT /compute/v2.1/os-aggregates/10 => generated 299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:32.486541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:32.487178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:32.494762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.495130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:32.496116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.496542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:32.646965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:32.656522 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8d3dff60-e303-49ad-b450-9089f3e71761 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.174433 Jun 04 20:53:32.657411 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 188/374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:32 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:32.666405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e8019707-856d-4517-bb75-f311acd96629 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:32.667364 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:32.667364 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:32.676026 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e8019707-856d-4517-bb75-f311acd96629 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 299 microversion: 2.41 time: 0.017085 Jun 04 20:53:32.676838 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 189/375] 10.222.0.18 () {60 vars in 1192 bytes} [Sat Jun 4 20:53:32 2022] GET /compute/v2.1/os-aggregates/10 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:32.687157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1a25c98-ac90-4732-b6a5-0ca4c4f167da tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:32.689611 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:32.689611 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:32.699539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1a25c98-ac90-4732-b6a5-0ca4c4f167da tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.700451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1a25c98-ac90-4732-b6a5-0ca4c4f167da tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:32.824413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e746bef7-eb0b-4c62-aa48-55239279269b tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Calling method '.version_select at 0x7f2d02a4f430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:32.856786 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1a25c98-ac90-4732-b6a5-0ca4c4f167da tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 314 microversion: 2.41 time: 0.173326 Jun 04 20:53:32.872252 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 190/376] 10.222.0.18 () {62 vars in 1234 bytes} [Sat Jun 4 20:53:32 2022] POST /compute/v2.1/os-aggregates/10/action => generated 314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:32.878467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-894774bb-2200-4acd-857d-c5e345db8cef tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:32.879074 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:32.879074 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:32.897346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-894774bb-2200-4acd-857d-c5e345db8cef tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:32.897795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-894774bb-2200-4acd-857d-c5e345db8cef tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.066931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-894774bb-2200-4acd-857d-c5e345db8cef tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 299 microversion: 2.41 time: 0.193432 Jun 04 20:53:33.075737 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 191/377] 10.222.0.18 () {62 vars in 1234 bytes} [Sat Jun 4 20:53:32 2022] POST /compute/v2.1/os-aggregates/10/action => generated 299 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:33.082767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97ad26f2-d087-48d4-be4d-9ff825531166 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:33.084497 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:33.084497 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:33.126883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-97ad26f2-d087-48d4-be4d-9ff825531166 tempest-AggregatesAdminTestV241-924313196 tempest-AggregatesAdminTestV241-924313196-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.047740 Jun 04 20:53:33.128347 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 192/378] 10.222.0.18 () {60 vars in 1195 bytes} [Sat Jun 4 20:53:33 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:33.179861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:33.180731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:33.190422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:33.190875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.191803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:33.194198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.246160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:33.250702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:33.251387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.251898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lazy-loading 'fault' on Instance uuid c82bf488-79d8-4af3-8e20-c19cfccd0125 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:53:33.337465 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e746bef7-eb0b-4c62-aa48-55239279269b tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 371 microversion: 2.1 time: 1.035079 Jun 04 20:53:33.344369 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 187/379] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 20:53:32 2022] GET /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 371 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:33.350793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c27900cd-c4e0-4e9f-b40f-6d0cb39ef6d6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02a00820>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:33.452187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:33.463920 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6cd2054b-997e-4817-918b-7c289e6a609b tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1457 microversion: 2.1 time: 0.290050 Jun 04 20:53:33.474065 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 193/380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:33 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1457 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:33.489415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f4fb44a3-9b0b-44ca-933e-11b56d178f8e req-fe639f3c-dbcd-45eb-a22c-d23af9983838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8bf095-dc48-42b1-8889-3bb6abe49ccb", "name": "network-vif-plugged", "status": "completed", "tag": "90c9c55c-b56b-4a98-b0da-f598610d3ded"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:33.498948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f4fb44a3-9b0b-44ca-933e-11b56d178f8e req-fe639f3c-dbcd-45eb-a22c-d23af9983838 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:33.499382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f4fb44a3-9b0b-44ca-933e-11b56d178f8e req-fe639f3c-dbcd-45eb-a22c-d23af9983838 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.515681 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f4fb44a3-9b0b-44ca-933e-11b56d178f8e req-fe639f3c-dbcd-45eb-a22c-d23af9983838 service nova] Creating event network-vif-plugged:90c9c55c-b56b-4a98-b0da-f598610d3ded for instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb on nch2-master-1 Jun 04 20:53:33.523187 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f4fb44a3-9b0b-44ca-933e-11b56d178f8e req-fe639f3c-dbcd-45eb-a22c-d23af9983838 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038996 Jun 04 20:53:33.524469 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 194/381] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:33.674599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:33.675318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:33.692920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:33.693458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.694307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:33.697001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:33.934296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:33.946210 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8bbc4586-fcbf-4f7e-815f-a8700496487f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1314 microversion: 2.1 time: 0.275159 Jun 04 20:53:33.947162 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 195/382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:33 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:34.189429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27900cd-c4e0-4e9f-b40f-6d0cb39ef6d6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.190320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27900cd-c4e0-4e9f-b40f-6d0cb39ef6d6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.192989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27900cd-c4e0-4e9f-b40f-6d0cb39ef6d6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.193672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27900cd-c4e0-4e9f-b40f-6d0cb39ef6d6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.319007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c27900cd-c4e0-4e9f-b40f-6d0cb39ef6d6 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 328 microversion: 2.1 time: 0.973246 Jun 04 20:53:34.320824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 188/383] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:33 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 328 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:34.458078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d8214419-4b51-4079-95bf-a663c9be0dc5 req-f86e587d-a86f-4c0c-a403-4ce04162f669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82bf488-79d8-4af3-8e20-c19cfccd0125", "name": "network-vif-deleted", "tag": "1e66d5ec-1034-421c-9bfb-4dca41c70313"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:34.485824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:34.489182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:34.495019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d8214419-4b51-4079-95bf-a663c9be0dc5 req-f86e587d-a86f-4c0c-a403-4ce04162f669 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.500425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d8214419-4b51-4079-95bf-a663c9be0dc5 req-f86e587d-a86f-4c0c-a403-4ce04162f669 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.508006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.508567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.509562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.510001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.530377 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d8214419-4b51-4079-95bf-a663c9be0dc5 req-f86e587d-a86f-4c0c-a403-4ce04162f669 service nova] Creating event network-vif-deleted:1e66d5ec-1034-421c-9bfb-4dca41c70313 for instance c82bf488-79d8-4af3-8e20-c19cfccd0125 on nch1-master-1 Jun 04 20:53:34.540114 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d8214419-4b51-4079-95bf-a663c9be0dc5 req-f86e587d-a86f-4c0c-a403-4ce04162f669 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088769 Jun 04 20:53:34.542974 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 196/384] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:34.570314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.570781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.571247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lazy-loading 'fault' on Instance uuid c82bf488-79d8-4af3-8e20-c19cfccd0125 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:53:34.707699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d0d753d0314e44b9cd7fba3ab1cd26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2009577e16e48458dd3eebf04938841', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:34.721131 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f7de2abf-1d70-46eb-b311-bcf18db55595 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 200 len: 1287 microversion: 2.1 time: 0.241648 Jun 04 20:53:34.729326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 189/385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:34 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 1287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:34.965365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:34.966930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:34.975424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.976179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:34.977682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:34.978498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.210257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:35.222102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-122979636", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:35.223547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3a94def5-923a-4517-968b-4d3706ca5568 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1463 microversion: 2.1 time: 0.263795 Jun 04 20:53:35.237419 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 190/386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:34 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1463 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:35.246196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.246977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.254217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.254933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.255746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.256295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.301777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:53:35.313075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:35.424178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-89c5fc08-289f-4a92-868a-a9baa41784a2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 204 len: 0 microversion: 2.1 time: 0.184475 Jun 04 20:53:35.425784 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 191/387] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:35 2022] DELETE /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:53:35.436219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.436927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.444952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.445641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.446428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.446860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.615076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:35.615779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:35.616811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:35.617960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:35.619331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:35.632372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.633329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.634350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.635021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.648646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:35.656456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Getting quotas for project a805d2ab9d034eedb588e3efcae07c91. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:35.660366 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d910df7-de44-4e3d-938c-d37ac3db3dc2 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1469 microversion: 2.1 time: 0.228094 Jun 04 20:53:35.661976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Getting quotas for user ad8f2774f3254b9785b484f87f9563bf and project a805d2ab9d034eedb588e3efcae07c91. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:35.671314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 192/388] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:35 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:35.683761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.utils [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] cores quota exceeded for a805d2ab9d034eedb588e3efcae07c91, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137228) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 04 20:53:35.684591 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Request method failure captured: Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 144 Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZJDyLGswxnDXUZ1Ebltb69c5OGB65kR2KXyHZ1FEn4zvQGleR3cFFhXixHp4I3oz5dktTZ9bp1Vmb6WWDNODf_CwtQh8Iar82Rk5diT4i9xg6KYF3Gk1g8hYetZAh7NRVyBtejQ0yoIV4JN5e9dNQNEPirDJ0ndx4DYyFdXcEcKCo Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:35.688126 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ad8f2774f3254b9785b484f87f9563bf Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-122979636", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} Jun 04 20:53:35.690242 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-122979636', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452'}}} Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 04 20:53:35.691547 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.693032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.694818 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-02ced0b8-66e7-46bb-9268-472566d754bc tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.970580 Jun 04 20:53:35.696250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 197/389] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:34 2022] POST /compute/v2.1/servers => generated 111 bytes in 972 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:35.702900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4da5b3bc-d31e-4a97-b094-6dde9d73bd1c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Action: 'update', calling method: .version_select at 0x7f2d029fcd30>, body: {"quota_set": {"cores": 20}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:35.738267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.739703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.748311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.748761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.750381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.751591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.767909 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] HTTP exception thrown: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Request method failure captured: Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 HTTP/1.1 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJqV_DXNXfFxNAnqjh11tAhoDW958Z0MmyWPL3MNyWsUsZRztMI60n2n1ncwqokvc0ynFVZk4sdokO0NwZPRMDhokai9FcCsvqPMGTc_zq4Y-pHZyOUyg6jiv4hmikN9ZbrpZVzk2GqG8Au1dONC7es2qgKV-3oiUIvkOgyb1a2P0 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:35.769471 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2009577e16e48458dd3eebf04938841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2009577e16e48458dd3eebf04938841"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 71d0d753d0314e44b9cd7fba3ab1cd26 Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.771836 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c82bf488-79d8-4af3-8e20-c19cfccd0125'} Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:35.772726 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.774059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.775245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Returning 404 to user: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:35.775245 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99337ca7-ade7-4e6d-98ab-02d1e1ccc593 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 404 len: 111 microversion: 2.1 time: 0.038674 Jun 04 20:53:35.777082 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 198/390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:35 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:35.782236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.783558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.789752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.790203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.790985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.791419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.806387 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] HTTP exception thrown: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Request method failure captured: Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 HTTP/1.1 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJqV_DXNXfFxNAnqjh11tAhoDW958Z0MmyWPL3MNyWsUsZRztMI60n2n1ncwqokvc0ynFVZk4sdokO0NwZPRMDhokai9FcCsvqPMGTc_zq4Y-pHZyOUyg6jiv4hmikN9ZbrpZVzk2GqG8Au1dONC7es2qgKV-3oiUIvkOgyb1a2P0 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:35.807901 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2009577e16e48458dd3eebf04938841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2009577e16e48458dd3eebf04938841"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 71d0d753d0314e44b9cd7fba3ab1cd26 Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.809395 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c82bf488-79d8-4af3-8e20-c19cfccd0125'} Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:35.810181 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.811475 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.812966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Returning 404 to user: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:35.812966 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd4b68f0-2049-4e7d-afb7-0e5bddaed5ed tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 404 len: 111 microversion: 2.1 time: 0.031067 Jun 04 20:53:35.812966 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 199/391] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:35 2022] DELETE /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:35.818261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.818872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: c82bf488-79d8-4af3-8e20-c19cfccd0125] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.825306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.825923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.826698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.827131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.842855 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] HTTP exception thrown: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Request method failure captured: Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 HTTP/1.1 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJqV_DXNXfFxNAnqjh11tAhoDW958Z0MmyWPL3MNyWsUsZRztMI60n2n1ncwqokvc0ynFVZk4sdokO0NwZPRMDhokai9FcCsvqPMGTc_zq4Y-pHZyOUyg6jiv4hmikN9ZbrpZVzk2GqG8Au1dONC7es2qgKV-3oiUIvkOgyb1a2P0 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:35.852596 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2009577e16e48458dd3eebf04938841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2009577e16e48458dd3eebf04938841"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 71d0d753d0314e44b9cd7fba3ab1cd26 Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.854049 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c82bf488-79d8-4af3-8e20-c19cfccd0125'} Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:35.854837 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. Jun 04 20:53:35.856248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.857476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Returning 404 to user: Instance c82bf488-79d8-4af3-8e20-c19cfccd0125 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:35.857476 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1941e4bb-8830-4502-ac76-963c3726dfd5 tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125" status: 404 len: 111 microversion: 2.1 time: 0.042618 Jun 04 20:53:35.861791 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 200/392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:35 2022] GET /compute/v2.1/servers/c82bf488-79d8-4af3-8e20-c19cfccd0125 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:35.868510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.869127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.876731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.877184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.877958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.878416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.896213 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] HTTP exception thrown: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Request method failure captured: Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 HTTP/1.1 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJqV_DXNXfFxNAnqjh11tAhoDW958Z0MmyWPL3MNyWsUsZRztMI60n2n1ncwqokvc0ynFVZk4sdokO0NwZPRMDhokai9FcCsvqPMGTc_zq4Y-pHZyOUyg6jiv4hmikN9ZbrpZVzk2GqG8Au1dONC7es2qgKV-3oiUIvkOgyb1a2P0 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:35.897731 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2009577e16e48458dd3eebf04938841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2009577e16e48458dd3eebf04938841"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 71d0d753d0314e44b9cd7fba3ab1cd26 Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.899229 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '254eb6e8-3c1f-4065-835c-fc095e96a562'} Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:35.899992 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.901469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.902630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Returning 404 to user: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:35.902630 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a35049c5-522f-46c1-924a-5cfd2d5a635a tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "DELETE /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 404 len: 111 microversion: 2.1 time: 0.036325 Jun 04 20:53:35.902630 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 201/393] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:35 2022] DELETE /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:53:35.911588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:35.912410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] [instance: 254eb6e8-3c1f-4065-835c-fc095e96a562] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:35.918615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.919414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.920074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:35.920363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:35.925287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:35.936193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] HTTP exception thrown: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Request method failure captured: Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 HTTP/1.1 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YJqV_DXNXfFxNAnqjh11tAhoDW958Z0MmyWPL3MNyWsUsZRztMI60n2n1ncwqokvc0ynFVZk4sdokO0NwZPRMDhokai9FcCsvqPMGTc_zq4Y-pHZyOUyg6jiv4hmikN9ZbrpZVzk2GqG8Au1dONC7es2qgKV-3oiUIvkOgyb1a2P0 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:35.937827 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b2009577e16e48458dd3eebf04938841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b2009577e16e48458dd3eebf04938841"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b2009577e16e48458dd3eebf04938841"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b2009577e16e48458dd3eebf04938841 Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1570617445 Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 71d0d753d0314e44b9cd7fba3ab1cd26 Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersAdminTestJSON-1570617445-project Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.939962 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '254eb6e8-3c1f-4065-835c-fc095e96a562'} Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:35.940871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. Jun 04 20:53:35.942135 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:35.943526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] Returning 404 to user: Instance 254eb6e8-3c1f-4065-835c-fc095e96a562 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:35.943526 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-adb48130-8155-43af-8a1f-f89bb39b972d tempest-DeleteServersAdminTestJSON-1570617445 tempest-DeleteServersAdminTestJSON-1570617445-project] 10.222.0.18 "GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562" status: 404 len: 111 microversion: 2.1 time: 0.034471 Jun 04 20:53:35.943526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 202/394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:35 2022] GET /compute/v2.1/servers/254eb6e8-3c1f-4065-835c-fc095e96a562 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:36.350296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4da5b3bc-d31e-4a97-b094-6dde9d73bd1c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:36.351069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4da5b3bc-d31e-4a97-b094-6dde9d73bd1c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:36.355095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4da5b3bc-d31e-4a97-b094-6dde9d73bd1c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:36.355540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4da5b3bc-d31e-4a97-b094-6dde9d73bd1c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:36.423250 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4da5b3bc-d31e-4a97-b094-6dde9d73bd1c tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 329 microversion: 2.1 time: 0.724076 Jun 04 20:53:36.424048 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 193/395] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:35 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 329 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:36.435111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf61f4ea-f2d8-4277-a035-408b9d5bfc67 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Calling method '.version_select at 0x7f2d02c05e50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:36.678507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:36.679238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:36.701408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:36.702058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:36.703010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:36.703447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:37.003009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90ddce5b88fa408ea66da1aba6af4a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec20993c56848f3b51ef657573fd2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:37.010942 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8888930e-f704-483f-a66c-b3c3657abe47 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 200 len: 1469 microversion: 2.1 time: 0.336464 Jun 04 20:53:37.011542 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 194/396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:36 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:37.091348 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf61f4ea-f2d8-4277-a035-408b9d5bfc67 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 371 microversion: 2.1 time: 0.659897 Jun 04 20:53:37.099820 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 203/397] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 20:53:36 2022] GET /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 371 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:37.103275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca5513ad-3734-4e64-8cd6-97bcc001c217 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Action: 'update', calling method: .version_select at 0x7f2d029cdf70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:37.318026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21fab270-f015-47b7-a20b-a7a1d0261a2c tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:37.319784 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:37.319784 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:37.321754 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-21fab270-f015-47b7-a20b-a7a1d0261a2c tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21fab270-f015-47b7-a20b-a7a1d0261a2c tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin] Request method failure captured: Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZRTbGr8aQ9XHdBLG0q8-N2buoACpgosxVvQvLRS0Sw8mYBfHEqVHAbOQh3sDBSxvlamjBbtIOv9HPD0nwpAZZjg-5KRv-DojoJ6QrIh0hI_9cmXVAWtx8udnq4ZwtpHNxK024hB15zytIxf9dCG145Z1Kdp4IEbHAUWifbRohLRGI Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c3b5ab25488544b3a376ca33a4f1435d Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:37.330285 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c3b5ab25488544b3a376ca33a4f1435d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c3b5ab25488544b3a376ca33a4f1435d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c3b5ab25488544b3a376ca33a4f1435d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c3b5ab25488544b3a376ca33a4f1435d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c3b5ab25488544b3a376ca33a4f1435d Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: a944f5dd13e84ec2bb07722a5ef6a6b7 Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid timestamp for date invalid_time Jun 04 20:53:37.331788 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'invalid_time'} Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:37.332612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 04 20:53:37.333920 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.335434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21fab270-f015-47b7-a20b-a7a1d0261a2c tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:37.336450 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21fab270-f015-47b7-a20b-a7a1d0261a2c tempest-InstanceUsageAuditLogNegativeTestJSON-183683079 tempest-InstanceUsageAuditLogNegativeTestJSON-183683079-project-admin] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.209157 Jun 04 20:53:37.337118 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 204/398] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Jun 4 20:53:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:37.623807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca5513ad-3734-4e64-8cd6-97bcc001c217 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:37.624667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca5513ad-3734-4e64-8cd6-97bcc001c217 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:37.626048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca5513ad-3734-4e64-8cd6-97bcc001c217 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:37.626773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca5513ad-3734-4e64-8cd6-97bcc001c217 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:37.711015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca5513ad-3734-4e64-8cd6-97bcc001c217 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 328 microversion: 2.1 time: 0.611502 Jun 04 20:53:37.712682 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 195/399] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:37 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 328 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:37.717621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1552bf77-91bd-4250-a11c-ca810f47d7dd req-dc5edf8b-cda2-4f1d-b845-aebd4b67ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8bf095-dc48-42b1-8889-3bb6abe49ccb", "name": "network-vif-deleted", "tag": "90c9c55c-b56b-4a98-b0da-f598610d3ded"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:37.726489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1552bf77-91bd-4250-a11c-ca810f47d7dd req-dc5edf8b-cda2-4f1d-b845-aebd4b67ac14 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:37.727249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1552bf77-91bd-4250-a11c-ca810f47d7dd req-dc5edf8b-cda2-4f1d-b845-aebd4b67ac14 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:37.740099 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1552bf77-91bd-4250-a11c-ca810f47d7dd req-dc5edf8b-cda2-4f1d-b845-aebd4b67ac14 service nova] Creating event network-vif-deleted:90c9c55c-b56b-4a98-b0da-f598610d3ded for instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb on nch2-master-1 Jun 04 20:53:37.747391 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1552bf77-91bd-4250-a11c-ca810f47d7dd req-dc5edf8b-cda2-4f1d-b845-aebd4b67ac14 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 Jun 04 20:53:37.748755 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 196/400] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:37.935542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c12d9a2d-4a93-4c24-ac7e-c346d6db9b3a tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:37.937570 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:37.937570 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:37.940348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c12d9a2d-4a93-4c24-ac7e-c346d6db9b3a tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ff96d77ee4344ac5945c49400c23b0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbc12f9365047c9b7999773c46d4a4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c12d9a2d-4a93-4c24-ac7e-c346d6db9b3a tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Request method failure captured: Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZOuPxR05GRCELtKNeEyufGR3sdeyZkNBCcfscWJu_kD5sy69qyNtmNnEscIzujJFTqayBIANaak6yQMYunUNTU0-sGwJ1N4tbadsCTbnhQ-3cE2RmWG6helCjuiJANIynCec_gOkZ1Z7y9_603cddr_W88eAe5H-isgLifHiG0L7w Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 5cbc12f9365047c9b7999773c46d4a4a Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:37.942120 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 5cbc12f9365047c9b7999773c46d4a4a Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ff96d77ee4344ac5945c49400c23b0e1 Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:37.943749 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:37.944548 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 04 20:53:37.945714 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.947943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c12d9a2d-4a93-4c24-ac7e-c346d6db9b3a tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:37.948974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c12d9a2d-4a93-4c24-ac7e-c346d6db9b3a tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.605430 Jun 04 20:53:37.949597 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 205/401] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 20:53:37 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 607 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:37.962335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6de2abfd-4c98-4d6a-a00e-5741b5d3c184 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:37.963284 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:37.963284 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:37.964996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6de2abfd-4c98-4d6a-a00e-5741b5d3c184 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ff96d77ee4344ac5945c49400c23b0e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cbc12f9365047c9b7999773c46d4a4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6de2abfd-4c98-4d6a-a00e-5741b5d3c184 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Request method failure captured: Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-04%2020:53:37 HTTP/1.1 Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZOuPxR05GRCELtKNeEyufGR3sdeyZkNBCcfscWJu_kD5sy69qyNtmNnEscIzujJFTqayBIANaak6yQMYunUNTU0-sGwJ1N4tbadsCTbnhQ-3cE2RmWG6helCjuiJANIynCec_gOkZ1Z7y9_603cddr_W88eAe5H-isgLifHiG0L7w Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 5cbc12f9365047c9b7999773c46d4a4a Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:37.967608 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5cbc12f9365047c9b7999773c46d4a4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 5cbc12f9365047c9b7999773c46d4a4a Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ff96d77ee4344ac5945c49400c23b0e1 Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:37.969530 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '2022-06-04 20:53:37'} Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:37.970533 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 04 20:53:37.972027 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:37.974763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6de2abfd-4c98-4d6a-a00e-5741b5d3c184 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:37.975951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6de2abfd-4c98-4d6a-a00e-5741b5d3c184 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140 tempest-InstanceUsageAuditLogNegativeTestJSON-1667333140-project] 10.222.0.18 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-04 20:53:37" status: 403 len: 128 microversion: 2.1 time: 0.020103 Jun 04 20:53:37.981865 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 197/402] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 20:53:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-04%2020%3A53%3A37 => generated 128 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.033161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:38.033972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:38.042783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.043476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.044391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.044779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.063662 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb HTTP/1.1 Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:38.065376 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.067533 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ea8bf095-dc48-42b1-8889-3bb6abe49ccb'} Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.068326 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.069810 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.072097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.072097 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6b04532d-808c-4804-a07e-0c50d9539d68 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 404 len: 111 microversion: 2.1 time: 0.040527 Jun 04 20:53:38.072097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 206/403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:38 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.077609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-998363377", "metadata": {"image_type": "test"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:38.078900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:38.089397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.090922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.090922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.091594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.109564 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb/action HTTP/1.1 Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 111 Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:38.111489 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-998363377", "metadata": {"image_type": "test"}}} Jun 04 20:53:38.113373 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ea8bf095-dc48-42b1-8889-3bb6abe49ccb', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-998363377', 'metadata': {'image_type': 'test'}}}} Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.114570 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.116093 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-616f7d54-1157-4194-87bf-278efd267aad tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "POST /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb/action" status: 404 len: 111 microversion: 2.1 time: 0.040423 Jun 04 20:53:38.117444 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 198/404] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Jun 4 20:53:38 2022] POST /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.129292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ddbc7781-d7d7-471a-bd3e-4b997c87e771 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1419463177", "metadata": {"image_type": "test"}}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:38.130681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ddbc7781-d7d7-471a-bd3e-4b997c87e771 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Failed to fetch instance by id tempest-invalid-649537328 {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 20:53:38.131310 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-ddbc7781-d7d7-471a-bd3e-4b997c87e771 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance tempest-invalid-649537328 could not be found. Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ddbc7781-d7d7-471a-bd3e-4b997c87e771 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/tempest-invalid-649537328/action HTTP/1.1 Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 112 Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:38.133218 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1419463177", "metadata": {"image_type": "test"}}} Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:38.134728 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance tempest-invalid-649537328 could not be found. Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'tempest-invalid-649537328', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1419463177', 'metadata': {'image_type': 'test'}}}} Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-649537328 could not be found. Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.135643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-649537328 could not be found. Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-649537328 could not be found. Jun 04 20:53:38.136760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.137984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ddbc7781-d7d7-471a-bd3e-4b997c87e771 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance tempest-invalid-649537328 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.137984 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ddbc7781-d7d7-471a-bd3e-4b997c87e771 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "POST /compute/v2.1/servers/tempest-invalid-649537328/action" status: 404 len: 100 microversion: 2.1 time: 0.013397 Jun 04 20:53:38.144297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 207/405] 10.222.0.18 () {60 vars in 1245 bytes} [Sat Jun 4 20:53:38 2022] POST /compute/v2.1/servers/tempest-invalid-649537328/action => generated 100 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.156360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9da5932-84de-41c6-b3fb-8fe6df64bb87 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1360791175"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:38.157578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9da5932-84de-41c6-b3fb-8fe6df64bb87 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 20:53:38.158120 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f9da5932-84de-41c6-b3fb-8fe6df64bb87 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9da5932-84de-41c6-b3fb-8fe6df64bb87 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 57 Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:38.159944 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: {"createImage": {"name": "tempest-test-snap-1360791175"}} Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:38.161630 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1360791175'}}} Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.162630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.164422 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.165587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9da5932-84de-41c6-b3fb-8fe6df64bb87 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.165587 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9da5932-84de-41c6-b3fb-8fe6df64bb87 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009661 Jun 04 20:53:38.167647 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 199/406] 10.222.0.18 () {60 vars in 1274 bytes} [Sat Jun 4 20:53:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.173183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be5d249b-6b6b-4e76-b89c-6a74f59901b6 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1867437669"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:38.174321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be5d249b-6b6b-4e76-b89c-6a74f59901b6 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 20:53:38.174970 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-be5d249b-6b6b-4e76-b89c-6a74f59901b6 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be5d249b-6b6b-4e76-b89c-6a74f59901b6 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 57 Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:38.176659 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: {"createImage": {"name": "tempest-test-snap-1867437669"}} Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:38.178096 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1867437669'}}} Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.178951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 04 20:53:38.180332 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.181629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be5d249b-6b6b-4e76-b89c-6a74f59901b6 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.181629 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be5d249b-6b6b-4e76-b89c-6a74f59901b6 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011433 Jun 04 20:53:38.182634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 208/407] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Jun 4 20:53:38 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.193069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:38.193601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:38.202047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.202625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.203662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.204254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.223341 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.224442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-893254724", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb HTTP/1.1 Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:38.225254 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.226755 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ea8bf095-dc48-42b1-8889-3bb6abe49ccb'} Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.231242 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.232471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.234271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.234271 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-24fa52a8-efe5-4570-8e56-a3d1dda5677f tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 404 len: 111 microversion: 2.1 time: 0.038903 Jun 04 20:53:38.234271 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 200/408] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:38 2022] DELETE /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.235551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:38.236288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] [instance: ea8bf095-dc48-42b1-8889-3bb6abe49ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:38.243031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.243997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.244475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.245399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.261615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] HTTP exception thrown: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Request method failure captured: Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb HTTP/1.1 Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Y-FdimaPaV38vJVZCwFDaDQ7WqT_7pQSuyqatx5Cks5PUGLI6-VQdrFjHoouy0pnPR4pQVPOOT9FjdnitXsHmMYx5Z-vAUVAk10gQKVZpRqZT86oV64Vsr2vwiN-Vmpec7E0PQhjqQelQ6yrBwciug87Ys6qi019SQG2jxHD8jtaA Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:38.264070 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/eec20993c56848f3b51ef657573fd2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: eec20993c56848f3b51ef657573fd2fa Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1789500805 Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90ddce5b88fa408ea66da1aba6af4a8f Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesNegativeTestJSON-1789500805-project Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.265406 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ea8bf095-dc48-42b1-8889-3bb6abe49ccb'} Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.266201 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. Jun 04 20:53:38.267416 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.272086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] Returning 404 to user: Instance ea8bf095-dc48-42b1-8889-3bb6abe49ccb could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.273297 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdce47e1-ce5d-423d-8930-128a4f240f24 tempest-ImagesNegativeTestJSON-1789500805 tempest-ImagesNegativeTestJSON-1789500805-project] 10.222.0.18 "GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb" status: 404 len: 111 microversion: 2.1 time: 0.041569 Jun 04 20:53:38.274919 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 201/409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:38 2022] GET /compute/v2.1/servers/ea8bf095-dc48-42b1-8889-3bb6abe49ccb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.286843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:38.548940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:38.549359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:38.549937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:38.550473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:38.550894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:38.563408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.564026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.564907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:38.565397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:38.584847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Getting quotas for project a805d2ab9d034eedb588e3efcae07c91. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:38.591582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Getting quotas for user ad8f2774f3254b9785b484f87f9563bf and project a805d2ab9d034eedb588e3efcae07c91. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:38.605855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.utils [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] instances quota exceeded for a805d2ab9d034eedb588e3efcae07c91, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137228) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 04 20:53:38.606724 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Request method failure captured: Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 144 Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZJDyLGswxnDXUZ1Ebltb69c5OGB65kR2KXyHZ1FEn4zvQGleR3cFFhXixHp4I3oz5dktTZ9bp1Vmb6WWDNODf_CwtQh8Iar82Rk5diT4i9xg6KYF3Gk1g8hYetZAh7NRVyBtejQ0yoIV4JN5e9dNQNEPirDJ0ndx4DYyFdXcEcKCo Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:38.609270 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ad8f2774f3254b9785b484f87f9563bf Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-893254724", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} Jun 04 20:53:38.610949 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-893254724', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452'}}} Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 04 20:53:38.611648 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.612739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.614012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:38.615152 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b6259dcc-2f59-4537-b02a-126ffb4c72ea tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.394499 Jun 04 20:53:38.617374 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 209/410] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:38 2022] POST /compute/v2.1/servers => generated 119 bytes in 397 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:38.624142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6469a28e-49d2-441b-9226-9593bcf6f4e8 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02a4f430>, body: {"quota_set": {"instances": 10}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:39.377415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6469a28e-49d2-441b-9226-9593bcf6f4e8 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:39.379050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6469a28e-49d2-441b-9226-9593bcf6f4e8 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:39.379893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6469a28e-49d2-441b-9226-9593bcf6f4e8 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:39.380362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6469a28e-49d2-441b-9226-9593bcf6f4e8 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:39.392157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:39.444728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:39.502055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6469a28e-49d2-441b-9226-9593bcf6f4e8 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 329 microversion: 2.1 time: 0.881719 Jun 04 20:53:39.504989 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 202/411] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:38 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 329 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:39.518732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8b3a2370-f71f-454c-9f99-a762949fc549 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Calling method '.version_select at 0x7f2d02a6f3a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:39.532132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b52cdb62-c262-47a3-a825-0eb1e47ecfec tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02e35700>, body: {"quota_set": {"ram": "5120"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:39.940427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b52cdb62-c262-47a3-a825-0eb1e47ecfec tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:39.940874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b52cdb62-c262-47a3-a825-0eb1e47ecfec tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:39.941695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b52cdb62-c262-47a3-a825-0eb1e47ecfec tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:39.942123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b52cdb62-c262-47a3-a825-0eb1e47ecfec tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:39.977484 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8b3a2370-f71f-454c-9f99-a762949fc549 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 371 microversion: 2.1 time: 0.462854 Jun 04 20:53:39.978721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 203/412] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 20:53:39 2022] GET /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:39.993170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce88fbef-0463-4986-86ee-7e9775e43a43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02a6f040>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:40.014389 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b52cdb62-c262-47a3-a825-0eb1e47ecfec tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec" status: 200 len: 148 microversion: 2.57 time: 0.785306 Jun 04 20:53:40.019560 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 210/413] 10.222.0.18 () {62 vars in 1302 bytes} [Sat Jun 4 20:53:39 2022] PUT /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec => generated 148 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:53:40.025998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1cf33e1-3b5d-4ed1-a6dc-53dc31718e28 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Calling method '.version_select at 0x7f2d02c4f790>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:40.772506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce88fbef-0463-4986-86ee-7e9775e43a43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:40.774261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce88fbef-0463-4986-86ee-7e9775e43a43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:40.777541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce88fbef-0463-4986-86ee-7e9775e43a43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:40.778199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce88fbef-0463-4986-86ee-7e9775e43a43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:40.852153 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce88fbef-0463-4986-86ee-7e9775e43a43 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 325 microversion: 2.1 time: 0.865142 Jun 04 20:53:40.853097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 204/414] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:39 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 325 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:40.924379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1cf33e1-3b5d-4ed1-a6dc-53dc31718e28 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:40.924940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1cf33e1-3b5d-4ed1-a6dc-53dc31718e28 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:40.925744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1cf33e1-3b5d-4ed1-a6dc-53dc31718e28 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:40.926406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1cf33e1-3b5d-4ed1-a6dc-53dc31718e28 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:40.950700 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1cf33e1-3b5d-4ed1-a6dc-53dc31718e28 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec/detail" status: 200 len: 463 microversion: 2.57 time: 0.928257 Jun 04 20:53:40.952156 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 211/415] 10.222.0.18 () {60 vars in 1303 bytes} [Sat Jun 4 20:53:40 2022] GET /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec/detail => generated 463 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:53:40.990364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1479379870", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:41.052043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:41.056970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1378848208", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:41.118892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:41.408786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:41.409212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:41.410039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:41.410454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:41.410871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:41.423630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:41.424083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:41.425112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:41.425592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:41.449521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Getting quotas for project 3ef34a6d89d0462d8643be6625b114d9. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:41.458700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Getting quotas for user 05553baaba2b4467abbb9ca58afcebd9 and project 3ef34a6d89d0462d8643be6625b114d9. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:41.458846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:41.459215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:41.460459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:41.460876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:41.461433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:41.472619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:41.473061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:41.474079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:41.474656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:41.476618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:41.479778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:41.497299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Getting quotas for project a805d2ab9d034eedb588e3efcae07c91. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:41.504553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Getting quotas for user ad8f2774f3254b9785b484f87f9563bf and project a805d2ab9d034eedb588e3efcae07c91. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:41.523190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.utils [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] ram quota exceeded for a805d2ab9d034eedb588e3efcae07c91, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137228) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 04 20:53:41.524258 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Request method failure captured: Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 145 Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZJDyLGswxnDXUZ1Ebltb69c5OGB65kR2KXyHZ1FEn4zvQGleR3cFFhXixHp4I3oz5dktTZ9bp1Vmb6WWDNODf_CwtQh8Iar82Rk5diT4i9xg6KYF3Gk1g8hYetZAh7NRVyBtejQ0yoIV4JN5e9dNQNEPirDJ0ndx4DYyFdXcEcKCo Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:41.526664 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ad8f2774f3254b9785b484f87f9563bf Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1378848208", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} Jun 04 20:53:41.528119 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1378848208', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452'}}} Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 04 20:53:41.528809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:41.529869 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.532078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2fb67c9b-4278-42cc-a693-0e518aa2eacb tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.475655 Jun 04 20:53:41.534874 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 212/416] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:41 2022] POST /compute/v2.1/servers => generated 110 bytes in 480 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:41.541465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0939a928-443b-4da0-ad3d-f9db4940ef71 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02bd7ee0>, body: {"quota_set": {"ram": 51200}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:41.560148 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2b09cffd-4022-49fc-9e07-99fa55773e5a tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701410 Jun 04 20:53:41.560956 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 205/417] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:53:41.572613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98333dec-d63b-46fd-9160-5434ae9e6fd9 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:41.573666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98333dec-d63b-46fd-9160-5434ae9e6fd9 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:41.654334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98333dec-d63b-46fd-9160-5434ae9e6fd9 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:41.664211 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98333dec-d63b-46fd-9160-5434ae9e6fd9 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1222 microversion: 2.1 time: 0.095553 Jun 04 20:53:41.665410 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 206/418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:41 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:42.031950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02a4ff70>, body: {"quota_set": {"ram": "2048"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:42.182863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0939a928-443b-4da0-ad3d-f9db4940ef71 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.183643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0939a928-443b-4da0-ad3d-f9db4940ef71 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.185626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0939a928-443b-4da0-ad3d-f9db4940ef71 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.186302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0939a928-443b-4da0-ad3d-f9db4940ef71 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.269590 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0939a928-443b-4da0-ad3d-f9db4940ef71 tempest-QuotasAdminNegativeTest-7920754 tempest-QuotasAdminNegativeTest-7920754-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 200 len: 329 microversion: 2.1 time: 0.734264 Jun 04 20:53:42.271106 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 213/419] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:41 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 329 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:42.593257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.594259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.595143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.595988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.644733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.646236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.647413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.648240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.761879 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8410163-ada3-4346-bbaf-25f0671fb87f tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec?user_id=2e6cc75f4673455697c3ee3c140c4550" status: 200 len: 148 microversion: 2.57 time: 0.734030 Jun 04 20:53:42.763027 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 207/420] 10.222.0.18 () {62 vars in 1383 bytes} [Sat Jun 4 20:53:42 2022] PUT /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec?user_id=2e6cc75f4673455697c3ee3c140c4550 => generated 148 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:53:42.769159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9326fe47-5173-46fe-9a50-ca3511bf87a8 tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Action: 'update', calling method: .version_select at 0x7f2d0298d280>, body: {"quota_set": {"ram": 0}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:42.773027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9326fe47-5173-46fe-9a50-ca3511bf87a8 tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ad8f2774f3254b9785b484f87f9563bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a805d2ab9d034eedb588e3efcae07c91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9326fe47-5173-46fe-9a50-ca3511bf87a8 tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Request method failure captured: Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 HTTP/1.1 Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 25 Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZJDyLGswxnDXUZ1Ebltb69c5OGB65kR2KXyHZ1FEn4zvQGleR3cFFhXixHp4I3oz5dktTZ9bp1Vmb6WWDNODf_CwtQh8Iar82Rk5diT4i9xg6KYF3Gk1g8hYetZAh7NRVyBtejQ0yoIV4JN5e9dNQNEPirDJ0ndx4DYyFdXcEcKCo Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:42.789952 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a805d2ab9d034eedb588e3efcae07c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a805d2ab9d034eedb588e3efcae07c91 Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1665437393 Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ad8f2774f3254b9785b484f87f9563bf Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-QuotasAdminNegativeTest-1665437393-project Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: {"quota_set": {"ram": 0}} Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 04 20:53:42.791713 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a805d2ab9d034eedb588e3efcae07c91', 'body': {'quota_set': {'ram': 0}}} Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:42.792632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:42.794023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:42.795398 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:42.795398 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:42.795398 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:42.795398 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:42.795398 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 04 20:53:42.795398 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:42.796987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9326fe47-5173-46fe-9a50-ca3511bf87a8 tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:42.799638 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9326fe47-5173-46fe-9a50-ca3511bf87a8 tempest-QuotasAdminNegativeTest-1665437393 tempest-QuotasAdminNegativeTest-1665437393-project] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91" status: 403 len: 116 microversion: 2.1 time: 0.035243 Jun 04 20:53:42.807348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 208/421] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:53:42 2022] PUT /compute/v2.1/os-quota-sets/a805d2ab9d034eedb588e3efcae07c91 => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:42.827745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:42.829307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:42.840312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.841104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.842052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:42.842884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:42.942037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:42.952554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7e12a10b-9317-4b52-ac99-a41f3855851e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1292 microversion: 2.1 time: 0.143018 Jun 04 20:53:42.953965 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 209/422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:42 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1292 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:42.960790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3557965d-e003-4905-bd71-35421e32d223 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] Calling method '.version_select at 0x7f2d02a4f670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:43.042622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a364c1cf-6873-4302-a375-0c519da87515 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:43.044070 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:43.044070 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:43.045487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a364c1cf-6873-4302-a375-0c519da87515 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:43.046130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a364c1cf-6873-4302-a375-0c519da87515 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:43.047426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a364c1cf-6873-4302-a375-0c519da87515 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:43.048265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a364c1cf-6873-4302-a375-0c519da87515 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:43.078193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a364c1cf-6873-4302-a375-0c519da87515 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.805501 Jun 04 20:53:43.079445 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 214/423] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:53:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:43.440074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5e2c8eb2-76ec-4940-b84f-4a4ca15f4082 tempest-ListImagesTestJSON-390172584 tempest-ListImagesTestJSON-390172584-project] Calling method '.version_select at 0x7f2d02b3bdc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:43.491881 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5e2c8eb2-76ec-4940-b84f-4a4ca15f4082 tempest-ListImagesTestJSON-390172584 tempest-ListImagesTestJSON-390172584-project] 10.222.0.18 "GET /compute/v2.1/images/926a4015-c327-4be7-9086-5cce1a8e0ebf" status: 200 len: 784 microversion: 2.1 time: 0.411298 Jun 04 20:53:43.493031 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 215/424] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:53:43 2022] GET /compute/v2.1/images/926a4015-c327-4be7-9086-5cce1a8e0ebf => generated 784 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:43.498085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-49b579e2-e3d4-4862-b4e5-83aa8a417cad tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1531876283"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:43.502285 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:43.502285 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:43.503275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-49b579e2-e3d4-4862-b4e5-83aa8a417cad tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid 80b2830f-004f-4762-b541-9d02c79056ba for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:43.508664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:43.534279 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-49b579e2-e3d4-4862-b4e5-83aa8a417cad tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.039902 Jun 04 20:53:43.535779 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 216/425] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:43 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:43.551454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a53d2531-0c55-4fcb-b8a0-98d026dee749 tempest-ListImagesTestJSON-390172584 tempest-ListImagesTestJSON-390172584-project] Calling method '.version_select at 0x7f2d02b3b670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:43.608887 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3557965d-e003-4905-bd71-35421e32d223 tempest-QuotasAdminTestV257-1966132912 tempest-QuotasAdminTestV257-1966132912-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec?user_id=2e6cc75f4673455697c3ee3c140c4550" status: 200 len: 190 microversion: 2.57 time: 0.652781 Jun 04 20:53:43.611940 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 210/426] 10.222.0.18 () {60 vars in 1363 bytes} [Sat Jun 4 20:53:42 2022] GET /compute/v2.1/os-quota-sets/68fdb6ec9d2b4580b68677281a07afec?user_id=2e6cc75f4673455697c3ee3c140c4550 => generated 190 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:53:43.624791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e17921f-1e70-4c6e-85c0-9d77c0904511 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:43.629350 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:43.629350 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:43.651224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e17921f-1e70-4c6e-85c0-9d77c0904511 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:43.652017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e17921f-1e70-4c6e-85c0-9d77c0904511 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:43.673819 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a53d2531-0c55-4fcb-b8a0-98d026dee749 tempest-ListImagesTestJSON-390172584 tempest-ListImagesTestJSON-390172584-project] 10.222.0.18 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.135293 Jun 04 20:53:43.674423 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 217/427] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:43 2022] GET /compute/v2.1/images => generated 445 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:43.689199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20fa0132-0043-453d-b6d9-699d2cbfb6c8 tempest-ListImagesTestJSON-390172584 tempest-ListImagesTestJSON-390172584-project] Calling method '.version_select at 0x7f2d02b1e160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:43.760381 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20fa0132-0043-453d-b6d9-699d2cbfb6c8 tempest-ListImagesTestJSON-390172584 tempest-ListImagesTestJSON-390172584-project] 10.222.0.18 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.067103 Jun 04 20:53:43.760381 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 218/428] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:53:43 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:43.854943 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e17921f-1e70-4c6e-85c0-9d77c0904511 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.240474 Jun 04 20:53:43.863615 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 211/429] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:43.869014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:43.871195 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:43.871195 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:43.904822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:43.907105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:43.973993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:43.974932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:43.976485 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] HTTP exception thrown: Aggregate 11 already has host nch2-master-1. Jun 04 20:53:43.990023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:43.993139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:43.995365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:43.997282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 39 Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:44.011761 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: {"add_host": {"host": "nch2-master-1"}} Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:44.013080 ncdv-master-1 devstack@n-api.service[137228]: exception: Aggregate 11 already has host nch2-master-1. Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result.read() Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:53:44.013842 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi session.flush() Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:53:44.014877 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:53:44.019543 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:53:44.022225 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result.read() Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 4, 20, 53, 43, 961928), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 11}] Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:44.024473 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host nch2-master-1. Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.027358 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host nch2-master-1. Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:44.037821 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:44.040447 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host nch2-master-1. Jun 04 20:53:44.040447 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:44.040447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 409 to user: Aggregate 11 already has host nch2-master-1. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:44.040447 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-edc6bc5b-da5b-4e8b-8eeb-5fd783f92a36 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.165723 Jun 04 20:53:44.040447 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 219/430] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:43 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 04 20:53:44.047183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3970dd79-0640-4457-ba33-73d1fdab0c5b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:44.050132 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.050132 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:44.061202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3970dd79-0640-4457-ba33-73d1fdab0c5b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.062861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3970dd79-0640-4457-ba33-73d1fdab0c5b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.244601 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3970dd79-0640-4457-ba33-73d1fdab0c5b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.201596 Jun 04 20:53:44.246892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 220/431] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:44 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:44.268657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-381438f3-c237-4afd-a1df-4309460b5e87 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:44.273107 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.273107 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:44.323853 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-381438f3-c237-4afd-a1df-4309460b5e87 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.068372 Jun 04 20:53:44.328152 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 221/432] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:44 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:44.418718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:44.438449 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2470367e-c569-4b43-8408-20fde2b876b1 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.471281 Jun 04 20:53:44.450531 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 212/433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:43 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:44.458061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd5761b5-b77b-4889-b415-b54cc2999e28 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-430496874"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:44.460792 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.460792 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:44.461914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-bd5761b5-b77b-4889-b415-b54cc2999e28 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid bf9b3492-a13b-424e-97f8-72014f2a89e2 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:44.490895 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd5761b5-b77b-4889-b415-b54cc2999e28 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038544 Jun 04 20:53:44.496039 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 213/434] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:44.693752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Calling method '.version_select at 0x7f2d02b3bca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:44.695052 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.695052 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:44.697410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.697847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.720887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.721487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.735120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.736852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.744739 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-356ec164-3f5a-4734-af4a-2f96509c4565 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.414635 Jun 04 20:53:44.746061 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 222/435] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:44.758708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Calling method '.version_select at 0x7f2d029068b0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:44.759600 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.759600 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:44.760861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.761381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.794465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.795315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.838731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.839495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.852615 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45320265-8c27-498a-bd0d-732c8c43162c tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.099032 Jun 04 20:53:44.853882 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 223/436] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Jun 4 20:53:44 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:44.873986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Calling method '.version_select at 0x7f2d02b1eee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:44.880640 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.880640 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:44.884532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.887268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.927890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.928345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.949077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.949575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:44.964764 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3b45743-3ff4-46e9-a154-e2aa58411183 tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.100917 Jun 04 20:53:44.965844 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 224/437] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:53:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:44.976931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-34a9d254-cde5-44f8-b31c-1798cb473c3b tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Calling method '.version_select at 0x7f2d02906b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:44.978334 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:44.978334 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:44.980385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a9d254-cde5-44f8-b31c-1798cb473c3b tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:44.981139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a9d254-cde5-44f8-b31c-1798cb473c3b tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.005878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a9d254-cde5-44f8-b31c-1798cb473c3b tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:45.007615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a9d254-cde5-44f8-b31c-1798cb473c3b tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.024902 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-34a9d254-cde5-44f8-b31c-1798cb473c3b tempest-HypervisorAdminUnderV252Test-1463474421 tempest-HypervisorAdminUnderV252Test-1463474421-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.052212 Jun 04 20:53:45.028809 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 225/438] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 20:53:44 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:45.167087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-74273f0f-3533-4646-929f-9574f241c761 req-a1f19ed7-7be7-42a1-9267-5b82a03c5b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceff7c9e-d21b-4b51-8ac5-800163fd0cf6", "tag": "f990d591-ed16-442f-b0c2-92689eb89908"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.182579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4024e153-ca0b-4394-b548-14e6e23522a6 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.184445 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.184445 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.189113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4024e153-ca0b-4394-b548-14e6e23522a6 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '656e73f2cfc34336823facedf4b1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:45.190725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-74273f0f-3533-4646-929f-9574f241c761 req-a1f19ed7-7be7-42a1-9267-5b82a03c5b5a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4024e153-ca0b-4394-b548-14e6e23522a6 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Request method failure captured: Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 39 Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZTgZHJJIg4bDN6NHEl8VE_0kcFYbr1a2Zqe_AZnBjmMFhFeZ_ojJRF2UJhorIIjb0DbgkELArW99CfpPYOWL52RPSpio0hyZVsxMbwB7g9Qti2wHtWAUQIVjQzxin16lmMMbnkU72293KGhWyUK1_vufZsM8ZK1rcF9xIdAx5JsGc Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:45.191062 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 656e73f2cfc34336823facedf4b1a23a Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: {"add_host": {"host": "nch2-master-1"}} Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.192570 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '12', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.193940 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 04 20:53:45.195962 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.198096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-74273f0f-3533-4646-929f-9574f241c761 req-a1f19ed7-7be7-42a1-9267-5b82a03c5b5a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.199208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4024e153-ca0b-4394-b548-14e6e23522a6 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.200750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4024e153-ca0b-4394-b548-14e6e23522a6 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.702347 Jun 04 20:53:45.205434 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 214/439] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:44 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 708 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:53:45.212702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a0aff98-af6f-454f-adc1-9f72c3cf46b7 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.213947 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.213947 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.229325 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-74273f0f-3533-4646-929f-9574f241c761 req-a1f19ed7-7be7-42a1-9267-5b82a03c5b5a service nova] Creating event network-changed:f990d591-ed16-442f-b0c2-92689eb89908 for instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 on nch2-master-1 Jun 04 20:53:45.251246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a0aff98-af6f-454f-adc1-9f72c3cf46b7 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.043780 Jun 04 20:53:45.256887 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-74273f0f-3533-4646-929f-9574f241c761 req-a1f19ed7-7be7-42a1-9267-5b82a03c5b5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089009 Jun 04 20:53:45.258616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 215/440] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:45.265638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e73c077-2816-4f06-93e8-8ec8cc677cd5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-4499030"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.267811 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.267811 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.267993 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 226/441] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:45.269595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-2e73c077-2816-4f06-93e8-8ec8cc677cd5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid 7b35bdc6-cb89-48f4-bdeb-c7bd68581d34 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:45.312505 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e73c077-2816-4f06-93e8-8ec8cc677cd5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.051867 Jun 04 20:53:45.313271 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 216/442] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:45.324495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2122791290"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.326986 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.326986 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:45.344478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:45.344974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.377193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:45.377193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.401015 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2122791290 could not be found. Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 58 Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:45.403192 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: {"add_host": {"host": "tempest-nonexist_host-2122791290"}} Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:45.404713 ncdv-master-1 devstack@n-api.service[137228]: exception: Compute host tempest-nonexist_host-2122791290 could not be found. Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-2122791290'}}} Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2122791290' is not mapped to any cell Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.405621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 04 20:53:45.407607 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2122791290 could not be found. Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2122791290 could not be found. Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.409311 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2122791290 could not be found. Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2122791290 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f93c463-a9f9-4f28-9f4b-cbc230e0acd0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.084488 Jun 04 20:53:45.411674 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 227/443] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:53:45.426675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0691b32-fa43-4814-ab6a-ebd7002ff390 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.428381 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.428381 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.435066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:45.460621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.461831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:45.478140 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0691b32-fa43-4814-ab6a-ebd7002ff390 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.065039 Jun 04 20:53:45.480630 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 217/444] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:45.488321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:45.491715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.492396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f08b443-3f30-4f8c-a46a-c14096a96dab tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.494472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:45.495031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f08b443-3f30-4f8c-a46a-c14096a96dab tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 283 Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:45.499302 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:45.500892 ncdv-master-1 devstack@n-api.service[137229]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:53:45.501578 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:53:45.502255 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:53:45.503810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:53:45.505440 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:53:45.505440 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.511175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f08b443-3f30-4f8c-a46a-c14096a96dab tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.512735 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f08b443-3f30-4f8c-a46a-c14096a96dab tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.027957 Jun 04 20:53:45.514055 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 218/445] 10.222.0.18 () {60 vars in 1164 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:45.525908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cee56fba-89fd-49e7-8200-16c573bfe7ac tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cee56fba-89fd-49e7-8200-16c573bfe7ac tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 27 Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:45.529494 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: {"aggregate": {"name": ""}} Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.532171 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '' Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.533173 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 04 20:53:45.534629 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.537608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cee56fba-89fd-49e7-8200-16c573bfe7ac tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.538712 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cee56fba-89fd-49e7-8200-16c573bfe7ac tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.018974 Jun 04 20:53:45.540308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 219/446] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:53:45.552639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4cbb520a-c8aa-4df3-9666-d16b3fcc1d2d tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1609871055"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.557889 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.557889 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.559621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4cbb520a-c8aa-4df3-9666-d16b3fcc1d2d tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '656e73f2cfc34336823facedf4b1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4cbb520a-c8aa-4df3-9666-d16b3fcc1d2d tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Request method failure captured: Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 60 Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZTgZHJJIg4bDN6NHEl8VE_0kcFYbr1a2Zqe_AZnBjmMFhFeZ_ojJRF2UJhorIIjb0DbgkELArW99CfpPYOWL52RPSpio0hyZVsxMbwB7g9Qti2wHtWAUQIVjQzxin16lmMMbnkU72293KGhWyUK1_vufZsM8ZK1rcF9xIdAx5JsGc Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:45.565486 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 656e73f2cfc34336823facedf4b1a23a Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: {"aggregate": {"name": "tempest-test_aggregate-1609871055"}} Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.567009 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1609871055'}}} Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:45.568394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:45.569427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 04 20:53:45.571442 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.571442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4cbb520a-c8aa-4df3-9666-d16b3fcc1d2d tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.571442 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4cbb520a-c8aa-4df3-9666-d16b3fcc1d2d tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.021517 Jun 04 20:53:45.576384 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 220/447] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:53:45.586665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ec84e889-65b7-4013-aaf4-826f08fea99b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1709943589"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.588856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-ec84e889-65b7-4013-aaf4-826f08fea99b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid fe5fa8fa-ba5c-4403-b5d4-2a9814c0ba25 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:45.618601 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec84e889-65b7-4013-aaf4-826f08fea99b tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038180 Jun 04 20:53:45.622160 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 221/448] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:45.628339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5acd7a51-e73c-4ae2-8b05-2b7f1fd2c601 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1709943589"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.629709 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.629709 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.630632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-5acd7a51-e73c-4ae2-8b05-2b7f1fd2c601 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid eaa30cd6-0536-4922-9bb5-b2fd744582b6 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:45.644014 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5acd7a51-e73c-4ae2-8b05-2b7f1fd2c601 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1709943589 already exists. Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5acd7a51-e73c-4ae2-8b05-2b7f1fd2c601 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 60 Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:45.660243 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: {"aggregate": {"name": "tempest-test_aggregate-1709943589"}} Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.661455 ncdv-master-1 devstack@n-api.service[137229]: exception: Aggregate tempest-test_aggregate-1709943589 already exists. Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1709943589'}}} Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 04 20:53:45.662171 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1709943589 already exists. Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:45.663266 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1709943589 already exists. Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1709943589 already exists. Jun 04 20:53:45.664850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.666823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5acd7a51-e73c-4ae2-8b05-2b7f1fd2c601 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1709943589 already exists. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.667954 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5acd7a51-e73c-4ae2-8b05-2b7f1fd2c601 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.044704 Jun 04 20:53:45.670751 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 222/449] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:45.683696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35ce0ca0-1897-49b8-aae0-2d434f988f54 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.689347 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.689347 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.720143 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-35ce0ca0-1897-49b8-aae0-2d434f988f54 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.043711 Jun 04 20:53:45.729435 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 223/450] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:45.735468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e6ab613-6c81-4e73-a58b-1b6680d2aace tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-255210317"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.737771 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.737771 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.740020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-9e6ab613-6c81-4e73-a58b-1b6680d2aace tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid fc7409ff-f110-425a-a931-d5635438e349 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:45.771626 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e6ab613-6c81-4e73-a58b-1b6680d2aace tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039533 Jun 04 20:53:45.778572 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 224/451] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:45.788114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00f22bdf-4949-4bdc-a605-5cafc2ca1b57 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.789694 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.789694 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.791216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-00f22bdf-4949-4bdc-a605-5cafc2ca1b57 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '656e73f2cfc34336823facedf4b1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00f22bdf-4949-4bdc-a605-5cafc2ca1b57 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Request method failure captured: Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZTgZHJJIg4bDN6NHEl8VE_0kcFYbr1a2Zqe_AZnBjmMFhFeZ_ojJRF2UJhorIIjb0DbgkELArW99CfpPYOWL52RPSpio0hyZVsxMbwB7g9Qti2wHtWAUQIVjQzxin16lmMMbnkU72293KGhWyUK1_vufZsM8ZK1rcF9xIdAx5JsGc Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:45.794074 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 656e73f2cfc34336823facedf4b1a23a Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 04 20:53:45.795965 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '15'} Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.797353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.798689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00f22bdf-4949-4bdc-a605-5cafc2ca1b57 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.801389 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00f22bdf-4949-4bdc-a605-5cafc2ca1b57 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.018982 Jun 04 20:53:45.805177 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 225/452] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:45.813112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d09f4b70-50ba-4f25-a0c2-38e7e9dcb1a0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.857829 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d09f4b70-50ba-4f25-a0c2-38e7e9dcb1a0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.049423 Jun 04 20:53:45.862758 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 226/453] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:45.871443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0d463a5-6e9f-4780-9291-fedb5e9f612e tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.872570 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.872570 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.885009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-e0d463a5-6e9f-4780-9291-fedb5e9f612e tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0d463a5-6e9f-4780-9291-fedb5e9f612e tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:53:45.886755 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: exception: Aggregate -1 could not be found. Jun 04 20:53:45.888276 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '-1'} Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 04 20:53:45.888951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.892743 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0d463a5-6e9f-4780-9291-fedb5e9f612e tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0d463a5-6e9f-4780-9291-fedb5e9f612e tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.023276 Jun 04 20:53:45.899195 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 227/454] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:45.905365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23c233c7-ba78-4034-8231-b9de7e23af07 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1385660206"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:45.905365 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.905365 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.905365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-23c233c7-ba78-4034-8231-b9de7e23af07 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid 7f6fb059-5f18-46a9-b710-252358e8a015 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:45.943337 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23c233c7-ba78-4034-8231-b9de7e23af07 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046805 Jun 04 20:53:45.945625 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 228/455] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:45 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:45.963109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa7af05a-a55d-481b-b67b-db0619fa7fe4 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.966388 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.966388 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:45.968447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa7af05a-a55d-481b-b67b-db0619fa7fe4 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '656e73f2cfc34336823facedf4b1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa7af05a-a55d-481b-b67b-db0619fa7fe4 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Request method failure captured: Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZTgZHJJIg4bDN6NHEl8VE_0kcFYbr1a2Zqe_AZnBjmMFhFeZ_ojJRF2UJhorIIjb0DbgkELArW99CfpPYOWL52RPSpio0hyZVsxMbwB7g9Qti2wHtWAUQIVjQzxin16lmMMbnkU72293KGhWyUK1_vufZsM8ZK1rcF9xIdAx5JsGc Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:45.976277 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 656e73f2cfc34336823facedf4b1a23a Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 04 20:53:45.978122 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '16'} Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:45.978803 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:45.981235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa7af05a-a55d-481b-b67b-db0619fa7fe4 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:45.983069 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa7af05a-a55d-481b-b67b-db0619fa7fe4 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.023942 Jun 04 20:53:45.984398 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 229/456] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:45 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:45.988750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:45.989695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5ddfe3da-f76f-4382-ae1d-077c29361896 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:45.990566 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:45.990566 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:46.007166 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4bd8affd-7ea5-4bd7-ba59-5088957aaf3f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.552287 Jun 04 20:53:46.019170 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:45 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:46.035673 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5ddfe3da-f76f-4382-ae1d-077c29361896 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.049927 Jun 04 20:53:46.042266 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 230/458] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:45 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:46.048099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c3dbd28-4f14-4db8-9a2b-9404a7e1c123 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:46.049255 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.049255 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:46.072405 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0c3dbd28-4f14-4db8-9a2b-9404a7e1c123 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c3dbd28-4f14-4db8-9a2b-9404a7e1c123 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:46.076503 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: exception: Aggregate -1 could not be found. Jun 04 20:53:46.077748 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '-1'} Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.078454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 04 20:53:46.079625 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.080697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c3dbd28-4f14-4db8-9a2b-9404a7e1c123 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:46.080697 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c3dbd28-4f14-4db8-9a2b-9404a7e1c123 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035583 Jun 04 20:53:46.080697 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 229/459] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:53:46 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 20:53:46.091918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62c00dfd-672f-4dc2-a2cb-356fd7ea15d2 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:46.092982 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.092982 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:46.094654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62c00dfd-672f-4dc2-a2cb-356fd7ea15d2 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '656e73f2cfc34336823facedf4b1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62c00dfd-672f-4dc2-a2cb-356fd7ea15d2 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Request method failure captured: Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZTgZHJJIg4bDN6NHEl8VE_0kcFYbr1a2Zqe_AZnBjmMFhFeZ_ojJRF2UJhorIIjb0DbgkELArW99CfpPYOWL52RPSpio0hyZVsxMbwB7g9Qti2wHtWAUQIVjQzxin16lmMMbnkU72293KGhWyUK1_vufZsM8ZK1rcF9xIdAx5JsGc Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:46.098426 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 656e73f2cfc34336823facedf4b1a23a Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 04 20:53:46.099723 ncdv-master-1 devstack@n-api.service[137229]: action_args: {} Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:46.100443 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 04 20:53:46.101487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.106729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62c00dfd-672f-4dc2-a2cb-356fd7ea15d2 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:46.108094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62c00dfd-672f-4dc2-a2cb-356fd7ea15d2 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021881 Jun 04 20:53:46.109483 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 231/460] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:53:46 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:46.123423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-060b156e-379f-41b1-b758-346672b162b5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1633597387"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:46.128755 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.128755 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:46.134399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.aggregate [None req-060b156e-379f-41b1-b758-346672b162b5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid 24f3dc69-89f4-4fb8-b2fb-b54f6c831cc6 for aggregate {{(pid=137228) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:46.189573 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-060b156e-379f-41b1-b758-346672b162b5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073224 Jun 04 20:53:46.190963 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 230/461] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:46.209157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e0fedaa-6562-45a8-9b57-29981d4c43a0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:46.211742 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.211742 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:46.244055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e0fedaa-6562-45a8-9b57-29981d4c43a0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:46.245512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e0fedaa-6562-45a8-9b57-29981d4c43a0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:46.409905 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e0fedaa-6562-45a8-9b57-29981d4c43a0 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.209768 Jun 04 20:53:46.411168 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 232/462] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:46.424979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13a1899e-01b7-4903-94a4-72c6107b77d1 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:46.427779 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.427779 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:46.429178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13a1899e-01b7-4903-94a4-72c6107b77d1 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '656e73f2cfc34336823facedf4b1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64f58e2ac15e44a2b0cadd5f9efc1a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13a1899e-01b7-4903-94a4-72c6107b77d1 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Request method failure captured: Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 42 Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZTgZHJJIg4bDN6NHEl8VE_0kcFYbr1a2Zqe_AZnBjmMFhFeZ_ojJRF2UJhorIIjb0DbgkELArW99CfpPYOWL52RPSpio0hyZVsxMbwB7g9Qti2wHtWAUQIVjQzxin16lmMMbnkU72293KGhWyUK1_vufZsM8ZK1rcF9xIdAx5JsGc Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:53:46.431431 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/64f58e2ac15e44a2b0cadd5f9efc1a56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 64f58e2ac15e44a2b0cadd5f9efc1a56 Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715 Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 656e73f2cfc34336823facedf4b1a23a Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1739822715-project Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: {"remove_host": {"host": "nch2-master-1"}} Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:46.432708 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:46.433509 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 04 20:53:46.434826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.438086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13a1899e-01b7-4903-94a4-72c6107b77d1 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:46.439160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13a1899e-01b7-4903-94a4-72c6107b77d1 tempest-AggregatesAdminNegativeTestJSON-1739822715 tempest-AggregatesAdminNegativeTestJSON-1739822715-project] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021649 Jun 04 20:53:46.440273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 231/463] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:46.450211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43dbafb4-e15b-45fd-9804-c0d954bd76f6 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:46.453989 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.453989 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:46.472460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43dbafb4-e15b-45fd-9804-c0d954bd76f6 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:46.473697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43dbafb4-e15b-45fd-9804-c0d954bd76f6 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:46.624088 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43dbafb4-e15b-45fd-9804-c0d954bd76f6 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.179359 Jun 04 20:53:46.626759 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 233/464] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:46.637694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba9abb5b-fb08-4034-a966-3c559fc01ad8 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:46.638457 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.638457 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:46.680650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba9abb5b-fb08-4034-a966-3c559fc01ad8 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.047127 Jun 04 20:53:46.681377 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 232/465] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:46 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:46.691251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa64d258-305b-47ff-a0de-ad72e0a9ea17 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-836202301"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:46.693084 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.693084 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:46.694454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-fa64d258-305b-47ff-a0de-ad72e0a9ea17 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Generated uuid 82870b42-66e9-43dd-a4bc-a9c04085677c for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 20:53:46.722660 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa64d258-305b-47ff-a0de-ad72e0a9ea17 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035594 Jun 04 20:53:46.724299 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 234/466] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:46.734088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:46.735750 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.735750 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:53:46.747720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:46.748527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:46.755289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:46.756108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:46.767987 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.compute.aggregates [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 04 20:53:46.769254 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Request method failure captured: Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 42 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZWxrnonXuQ1V5uuTLl25XDb4cUtuFxZNR2BEIRqZj0tNUNqeQGV8efAyNLKbZlN5FzUomQdicMdKaeKYzFPFmzc0_v-uK56bi2BrWaNk29wIIqhgYL1lYC9AZcax05ydXu_6DrKvspKYUG6AnjvgZonNrjLXEm5kqL7ZKruWvps-I Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:46.772686 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a3250985e6ce4eb9ae0c50349138ab30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a3250985e6ce4eb9ae0c50349138ab30 Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971 Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 0dc2bc0acede47c48697da3f140a49da Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: {"remove_host": {"host": "nonexist_host"}} Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:46.773934 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot remove host nonexist_host in aggregate 18 Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 04 20:53:46.774653 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 04 20:53:46.775757 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.776838 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:46.777984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:46.777984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:46.777984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:46.777984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:46.777984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jun 04 20:53:46.777984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:46.780298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:46.781637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba7851fb-d646-4343-b30b-f41f12b9a0a5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.051232 Jun 04 20:53:46.782452 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 233/467] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:53:46.792571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-961496b8-961a-459b-90a7-1c1dd94782f5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:46.794279 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:46.794279 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:46.824711 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-961496b8-961a-459b-90a7-1c1dd94782f5 tempest-AggregatesAdminNegativeTestJSON-1163322971 tempest-AggregatesAdminNegativeTestJSON-1163322971-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.036423 Jun 04 20:53:46.825923 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 235/468] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 20:53:46 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 20:53:47.038357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:47.039615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:47.057475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:47.062011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:47.064227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:47.065178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:47.454102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-335006885", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:47.493497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:47.509970 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a6e42ce9-5f3a-4c0e-9253-a793b1c367e0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.475451 Jun 04 20:53:47.511941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 236/469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:47 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:47.519377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:48.188011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:48.189196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:48.189850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:48.190501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:48.191747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:48.217165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:48.220040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:48.222663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:48.224206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:48.259915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Getting quotas for project 55d1f67de5f9427bae166a10a5edff26. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:48.269931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Getting quotas for user 859de04797504bcbb5134dba5c8183a5 and project 55d1f67de5f9427bae166a10a5edff26. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:48.298973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:48.301134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:48.364502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e99955d-dd3d-4c6b-b518-61c2e4ac8fb6 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445407 Jun 04 20:53:48.371712 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 234/470] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:53:48.385984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4a95640-14be-4366-b522-6f4cd3dd59ba tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:48.387316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b4a95640-14be-4366-b522-6f4cd3dd59ba tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:48.532246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:48.532924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:48.544136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:48.544589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:48.545409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:48.545847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:48.734346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b4a95640-14be-4366-b522-6f4cd3dd59ba tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:48.743579 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4a95640-14be-4366-b522-6f4cd3dd59ba tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1218 microversion: 2.1 time: 0.362819 Jun 04 20:53:48.751722 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 237/471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:48 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:49.043890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:49.054685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05406663-4560-420f-a55a-5019a83aeac7 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.529536 Jun 04 20:53:49.068834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 235/472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:48 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:49.502520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-810a1c09-3f6b-4906-9a14-d262acc30cd8 tempest-AbsoluteLimitsTestJSON-2075655098 tempest-AbsoluteLimitsTestJSON-2075655098-project] Calling method '.version_select at 0x7f2d02a4f550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:49.534403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-810a1c09-3f6b-4906-9a14-d262acc30cd8 tempest-AbsoluteLimitsTestJSON-2075655098 tempest-AbsoluteLimitsTestJSON-2075655098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:49.535789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-810a1c09-3f6b-4906-9a14-d262acc30cd8 tempest-AbsoluteLimitsTestJSON-2075655098 tempest-AbsoluteLimitsTestJSON-2075655098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:49.538605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-810a1c09-3f6b-4906-9a14-d262acc30cd8 tempest-AbsoluteLimitsTestJSON-2075655098 tempest-AbsoluteLimitsTestJSON-2075655098-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:49.540385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-810a1c09-3f6b-4906-9a14-d262acc30cd8 tempest-AbsoluteLimitsTestJSON-2075655098 tempest-AbsoluteLimitsTestJSON-2075655098-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:49.582925 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-810a1c09-3f6b-4906-9a14-d262acc30cd8 tempest-AbsoluteLimitsTestJSON-2075655098 tempest-AbsoluteLimitsTestJSON-2075655098-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.604208 Jun 04 20:53:49.591291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 238/473] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 20:53:48 2022] GET /compute/v2.1/limits => generated 511 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:49.764029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:49.765934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:49.776433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:49.777183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:49.779048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:49.780138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:49.867006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:49.877595 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c6567d6-60f6-4f79-82e6-fe39deb2b59f tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1270 microversion: 2.1 time: 0.120182 Jun 04 20:53:49.878504 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 236/474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:49 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:50.078171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:50.079736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:50.091035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:50.095250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:50.098069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:50.100276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:50.311541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:50.324416 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f908c811-15e5-4e5b-a790-bec5d29e80a0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.253085 Jun 04 20:53:50.329346 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 239/475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:50 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:50.900628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:50.902776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:50.925428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:50.926226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:50.929646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:50.932581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:51.053933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:51.066275 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5c8a8bf9-4b5b-40a1-b329-511b0f7555fe tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1276 microversion: 2.1 time: 0.170784 Jun 04 20:53:51.068107 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 237/476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:50 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:51.346546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:51.347211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:51.353941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:51.354392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:51.355949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:51.356925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:51.621065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-baa3f5aa-df43-42a4-8a3e-e3b18282c665 req-d1e8ae41-abd0-448c-a31b-0d3e84935ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceff7c9e-d21b-4b51-8ac5-800163fd0cf6", "name": "network-vif-plugged", "status": "completed", "tag": "f990d591-ed16-442f-b0c2-92689eb89908"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:51.636851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-baa3f5aa-df43-42a4-8a3e-e3b18282c665 req-d1e8ae41-abd0-448c-a31b-0d3e84935ed1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:51.638637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-baa3f5aa-df43-42a4-8a3e-e3b18282c665 req-d1e8ae41-abd0-448c-a31b-0d3e84935ed1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:51.663289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:51.689204 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1bb59de5-1caf-45c7-bc14-9beec31d3061 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.345420 Jun 04 20:53:51.702063 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 240/477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:51 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:51.704258 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-baa3f5aa-df43-42a4-8a3e-e3b18282c665 req-d1e8ae41-abd0-448c-a31b-0d3e84935ed1 service nova] Creating event network-vif-plugged:f990d591-ed16-442f-b0c2-92689eb89908 for instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 on nch2-master-1 Jun 04 20:53:51.712784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-baa3f5aa-df43-42a4-8a3e-e3b18282c665 req-d1e8ae41-abd0-448c-a31b-0d3e84935ed1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096432 Jun 04 20:53:51.713769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 238/478] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:52.084861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:52.085477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:52.099699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:52.100221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:52.103809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:52.104471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:52.318861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:52.327271 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0d8deeec-a6e5-455e-9f73-fd3d012b23c1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.246431 Jun 04 20:53:52.328760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 241/479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:52 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:52.372067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b10a4646-23c9-4662-9f2e-a6c2065f1389 req-2b030aeb-2aa1-4a3f-90ac-71fecf5a0253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e626ec10-9545-4cd1-81a3-ee1fc3e39a68", "tag": "a39b98cf-ec8e-4d6e-a903-4bb66427ce87"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:52.393983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b10a4646-23c9-4662-9f2e-a6c2065f1389 req-2b030aeb-2aa1-4a3f-90ac-71fecf5a0253 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:52.394424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b10a4646-23c9-4662-9f2e-a6c2065f1389 req-2b030aeb-2aa1-4a3f-90ac-71fecf5a0253 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:52.418028 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b10a4646-23c9-4662-9f2e-a6c2065f1389 req-2b030aeb-2aa1-4a3f-90ac-71fecf5a0253 service nova] Creating event network-changed:a39b98cf-ec8e-4d6e-a903-4bb66427ce87 for instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 on nch1-master-1 Jun 04 20:53:52.433202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b10a4646-23c9-4662-9f2e-a6c2065f1389 req-2b030aeb-2aa1-4a3f-90ac-71fecf5a0253 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060770 Jun 04 20:53:52.434672 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 242/480] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:53:52.713846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:52.714744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:52.737924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:52.738379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:52.739250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:52.739715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:52.748066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1c2bfee5-cd5a-444f-a667-67641fd7df64 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:52.770034 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1c2bfee5-cd5a-444f-a667-67641fd7df64 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.516501 Jun 04 20:53:52.772088 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 239/481] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:53:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:53:53.264803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:53.278362 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3cc267ab-e09f-4c90-b6ce-b5a704638959 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1322 microversion: 2.1 time: 0.573112 Jun 04 20:53:53.279331 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 243/482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:52 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:53.346341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:53.346992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:53.357675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:53.358125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:53.362427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:53.363142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:53.700752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:53.713174 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61498165-2191-43b8-84b0-f7d829d8cf1c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.371717 Jun 04 20:53:53.715012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 240/483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:53 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:54.224813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01e2a7a7-69a8-4668-8da2-5db69ebde42d tempest-AZV2TestJSON-1626076197 tempest-AZV2TestJSON-1626076197-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:54.227223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a7-69a8-4668-8da2-5db69ebde42d tempest-AZV2TestJSON-1626076197 tempest-AZV2TestJSON-1626076197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:54.227947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a7-69a8-4668-8da2-5db69ebde42d tempest-AZV2TestJSON-1626076197 tempest-AZV2TestJSON-1626076197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:54.228972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a7-69a8-4668-8da2-5db69ebde42d tempest-AZV2TestJSON-1626076197 tempest-AZV2TestJSON-1626076197-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:54.229630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01e2a7a7-69a8-4668-8da2-5db69ebde42d tempest-AZV2TestJSON-1626076197 tempest-AZV2TestJSON-1626076197-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:54.256504 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01e2a7a7-69a8-4668-8da2-5db69ebde42d tempest-AZV2TestJSON-1626076197 tempest-AZV2TestJSON-1626076197-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.398627 Jun 04 20:53:54.257745 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 244/484] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Jun 4 20:53:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:53:54.295637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:54.296262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:54.305056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:54.305810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:54.306806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:54.307426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:54.343901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef0352c7-857e-4e24-a6b0-c8e5723e05f6 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-860610238", "imageRef": "a14d3a19-c16f-46ec-9b07-be1c783e246f", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:54.450277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-ef0352c7-857e-4e24-a6b0-c8e5723e05f6 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:54.606661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:54.622433 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35fc9cdb-badc-4316-9a50-c8189c954127 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1472 microversion: 2.1 time: 0.329119 Jun 04 20:53:54.637852 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 241/485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:54 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1472 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:54.820423 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ef0352c7-857e-4e24-a6b0-c8e5723e05f6 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef0352c7-857e-4e24-a6b0-c8e5723e05f6 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] Request method failure captured: Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 142 Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZgHX7DUpO5mZ09NjhUQXJSfoc1r8B_MHoImmiDjvi1xGf5ia8q6z4b5TxnTWAq5HZtId8uM0ACF9ELABXBhbHZQAp7D-ZpGLIXJ9VXVBBwRpbI--4jdp0o2CYP6liuZn0SjbjAKIG3kuKqhBOUJqPp6BdpTGZ8_lsrpufGgmh3_sE Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 406b8e76c3464355b7c897fc90e783c4 Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-FlavorsV2NegativeTest-1062889003 Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:54.822239 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_406b8e76c3464355b7c897fc90e783c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/406b8e76c3464355b7c897fc90e783c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/406b8e76c3464355b7c897fc90e783c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/406b8e76c3464355b7c897fc90e783c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-FlavorsV2NegativeTest-1062889003 Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 406b8e76c3464355b7c897fc90e783c4 Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1062889003 Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-FlavorsV2NegativeTest-1062889003-project Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d57e5637ee194b27888af0b55136c83e Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-FlavorsV2NegativeTest-1062889003-project Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-860610238", "imageRef": "a14d3a19-c16f-46ec-9b07-be1c783e246f", "flavorRef": "452"}} Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:54.823844 ncdv-master-1 devstack@n-api.service[137229]: exception: Flavor's memory is too small for requested image. Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-860610238', 'imageRef': 'a14d3a19-c16f-46ec-9b07-be1c783e246f', 'flavorRef': '452'}}} Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:54.825133 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:54.826876 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:54.828658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:54.828658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:54.828658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:54.828658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:54.828658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 04 20:53:54.828658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:54.830856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef0352c7-857e-4e24-a6b0-c8e5723e05f6 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:54.831731 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef0352c7-857e-4e24-a6b0-c8e5723e05f6 tempest-FlavorsV2NegativeTest-1062889003 tempest-FlavorsV2NegativeTest-1062889003-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.493294 Jun 04 20:53:54.832479 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 245/486] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:54 2022] POST /compute/v2.1/servers => generated 93 bytes in 495 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:54.845256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:54.846213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:54.861528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:54.862233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:54.863206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:54.863829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:55.033946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:55.045328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb8bec6d-6de5-489a-b9c4-1fa7696d02f9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.208035 Jun 04 20:53:55.046156 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 246/487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:54 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:55.102516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f985cbb0-286b-42cc-bd7e-4ebb971f23f9 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:55.103331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f985cbb0-286b-42cc-bd7e-4ebb971f23f9 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] [instance: d4fa2f34-58dd-44a3-bb76-d19f54fdda75] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:55.112226 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f985cbb0-286b-42cc-bd7e-4ebb971f23f9 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] HTTP exception thrown: Instance d4fa2f34-58dd-44a3-bb76-d19f54fdda75 could not be found. Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f985cbb0-286b-42cc-bd7e-4ebb971f23f9 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Request method failure captured: Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/d4fa2f34-58dd-44a3-bb76-d19f54fdda75/action HTTP/1.1 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZULrA54iCk6-hOx-2xlQyqtjEmwZa2kc3WBxH5XJ8oBI8_d6hGs_iMrWUmzGkyGtBs-oeubbakZOEo6ELlhsC6G8N75hDxzBGGZ3MMaLdMJtZUuNjuwZHCPHJxrdcoddJySFvirqpp2xURzCzX51W8tg72zWh0hLaQynHDWRBMJi4 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:53:55.114688 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88c4fc51e48a41f7901df21322139226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88c4fc51e48a41f7901df21322139226"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: aea29c7af6ba4ebda8b491e0ba2ae9f6 Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: {"migrate": {}} Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:53:55.115958 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance d4fa2f34-58dd-44a3-bb76-d19f54fdda75 could not be found. Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd4fa2f34-58dd-44a3-bb76-d19f54fdda75', 'body': {'migrate': {}}} Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4fa2f34-58dd-44a3-bb76-d19f54fdda75 could not be found. Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:55.116732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4fa2f34-58dd-44a3-bb76-d19f54fdda75 could not be found. Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4fa2f34-58dd-44a3-bb76-d19f54fdda75 could not be found. Jun 04 20:53:55.117917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:53:55.120032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f985cbb0-286b-42cc-bd7e-4ebb971f23f9 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Returning 404 to user: Instance d4fa2f34-58dd-44a3-bb76-d19f54fdda75 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:55.120889 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f985cbb0-286b-42cc-bd7e-4ebb971f23f9 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d4fa2f34-58dd-44a3-bb76-d19f54fdda75/action" status: 404 len: 111 microversion: 2.1 time: 0.481594 Jun 04 20:53:55.121474 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 242/488] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:53:54 2022] POST /compute/v2.1/servers/d4fa2f34-58dd-44a3-bb76-d19f54fdda75/action => generated 111 bytes in 483 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:55.383109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1010340298", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:55.454461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:55.760347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:55.761386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:55.762038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:55.762501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:55.763004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:55.776389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:55.777261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:55.778419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:55.780020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:55.809196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Getting quotas for project 3ef34a6d89d0462d8643be6625b114d9. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:55.812890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=11,nova_api:INSERT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:55.832017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Getting quotas for user 05553baaba2b4467abbb9ca58afcebd9 and project 3ef34a6d89d0462d8643be6625b114d9. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:55.850181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:55.853263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:55.919816 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25a9ec92-b181-4033-8dcf-5ca0301929d0 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537469 Jun 04 20:53:55.919816 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 247/489] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:53:55.923213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cadbe786-fa29-44b8-b04f-be19098e04b8 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:55.924032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cadbe786-fa29-44b8-b04f-be19098e04b8 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:56.000569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cadbe786-fa29-44b8-b04f-be19098e04b8 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:56.023541 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cadbe786-fa29-44b8-b04f-be19098e04b8 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1222 microversion: 2.1 time: 0.104778 Jun 04 20:53:56.024529 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 243/490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:55 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:56.066539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:56.067588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:56.078796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:56.079247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:56.080053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:56.080482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:56.275259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:56.286075 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dc5ec9ba-0875-4e31-9179-1ebf416790a1 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.223825 Jun 04 20:53:56.292859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 248/491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:56 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:57.040927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:57.051607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:57.074628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:57.077336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:57.082330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:57.083619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:57.249146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:57.262267 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4108d6f2-0e93-45f7-831f-1dbf93d8a720 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1274 microversion: 2.1 time: 0.225025 Jun 04 20:53:57.273334 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 244/492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:57 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:57.303994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:57.305401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:57.320391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:57.321477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:57.324907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:57.326151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:57.613091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:57.624235 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9bb48d78-1ba0-4609-96d5-9ca12113811d tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.324489 Jun 04 20:53:57.627603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 249/493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:57 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:58.089896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1064360176", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1c9de366-78f1-4170-a48a-3f63d1e5098e"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:58.165037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] validate_networks() for [('1c9de366-78f1-4170-a48a-3f63d1e5098e', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:53:58.249124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=20 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:58.280276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:58.281491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:58.291365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:58.292420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:58.293725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:58.294425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:58.421142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:58.429168 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f792f1f0-39c3-4128-8d3d-4fe05e43a4fe tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1280 microversion: 2.1 time: 0.153304 Jun 04 20:53:58.440919 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 250/494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:58 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:53:58.641799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:58.642413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:58.666079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:58.666872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:58.668925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:58.670216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:59.329287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:59.332060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:59.341637 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fec3544-6f01-42af-a968-84746346b82c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.703819 Jun 04 20:53:59.344566 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 251/495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:53:58 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:53:59.353788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:59.354301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:53:59.392091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:59.392896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:59.393946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:59.394388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:59.440958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:53:59.553621 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92cf9a71-b326-4803-a078-6c7d71d2ea87 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 204 len: 0 microversion: 2.1 time: 0.206838 Jun 04 20:53:59.554766 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 252/496] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:53:59 2022] DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:53:59.799152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:53:59.799726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:53:59.800104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:53:59.801880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:53:59.802271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:53:59.831766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:59.832748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:59.835611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:59.836038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:59.867520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=89,nova_api:DELETE=5 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:59.887793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a412915c-e325-482c-8294-3a32231303e8 tempest-AZAdminNegativeTestJSON-1286795220 tempest-AZAdminNegativeTestJSON-1286795220-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:53:59.888637 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:53:59.888637 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:53:59.889495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a412915c-e325-482c-8294-3a32231303e8 tempest-AZAdminNegativeTestJSON-1286795220 tempest-AZAdminNegativeTestJSON-1286795220-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e7725044a9c94dcc86c61e4e8f3facc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61871d9c8a11410588f6ee0c66806462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a412915c-e325-482c-8294-3a32231303e8 tempest-AZAdminNegativeTestJSON-1286795220 tempest-AZAdminNegativeTestJSON-1286795220-project] Request method failure captured: Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZmXHZKXXK4swSFqYXKJCnSsQvG8AzMyVlJ0E1BpHBbLZmN4r9juEZE0rSQrYZbYW1yq-VZOySMidVxzWDGjrXm_CvQNU_elinwVFc8b5QvysCk6d3skaYvpy5Fn0ILPm3XtFCbqC7VhWgv80Bzj7pYn8Vd6l9ZpiSp_oD8dhxAwS8 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 61871d9c8a11410588f6ee0c66806462 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1286795220 Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:53:59.891648 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_61871d9c8a11410588f6ee0c66806462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61871d9c8a11410588f6ee0c66806462"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/61871d9c8a11410588f6ee0c66806462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/61871d9c8a11410588f6ee0c66806462"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AZAdminNegativeTestJSON-1286795220 Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 61871d9c8a11410588f6ee0c66806462 Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1286795220 Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AZAdminNegativeTestJSON-1286795220-project Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e7725044a9c94dcc86c61e4e8f3facc9 Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AZAdminNegativeTestJSON-1286795220-project Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 04 20:53:59.893056 ncdv-master-1 devstack@n-api.service[137229]: action_args: {} Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:53:59.893804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:53:59.895385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a412915c-e325-482c-8294-3a32231303e8 tempest-AZAdminNegativeTestJSON-1286795220 tempest-AZAdminNegativeTestJSON-1286795220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:53:59.896467 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a412915c-e325-482c-8294-3a32231303e8 tempest-AZAdminNegativeTestJSON-1286795220 tempest-AZAdminNegativeTestJSON-1286795220-project] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.336737 Jun 04 20:53:59.898397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:53:59.901028 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 253/497] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 20:53:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:53:59.919794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for user ac8ef83fa94e4c9db70a0115cc867dfc and project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:53:59.923866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3239bdac-0da8-4bce-82d8-2d4fe1ebc7ed req-ad298b34-ff31-47d3-8d3b-48b71335fbcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e626ec10-9545-4cd1-81a3-ee1fc3e39a68", "name": "network-vif-plugged", "status": "completed", "tag": "a39b98cf-ec8e-4d6e-a903-4bb66427ce87"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:53:59.959385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3239bdac-0da8-4bce-82d8-2d4fe1ebc7ed req-ad298b34-ff31-47d3-8d3b-48b71335fbcf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:53:59.959912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3239bdac-0da8-4bce-82d8-2d4fe1ebc7ed req-ad298b34-ff31-47d3-8d3b-48b71335fbcf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:53:59.974772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:53:59.981892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:53:59.994366 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3239bdac-0da8-4bce-82d8-2d4fe1ebc7ed req-ad298b34-ff31-47d3-8d3b-48b71335fbcf service nova] Creating event network-vif-plugged:a39b98cf-ec8e-4d6e-a903-4bb66427ce87 for instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 on nch1-master-1 Jun 04 20:54:00.012930 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3239bdac-0da8-4bce-82d8-2d4fe1ebc7ed req-ad298b34-ff31-47d3-8d3b-48b71335fbcf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110550 Jun 04 20:54:00.013560 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 254/498] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:00.025117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:00.038088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:00.058059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:00.060934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:00.066874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:00.071051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:00.170776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8895f4b-c08f-45fc-b934-4ee05c0c9057 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.465626 Jun 04 20:54:00.180361 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 245/499] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:54:00.196977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1849761090", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "1090592326", "adminPass": "***", "networks": [{"uuid": "15ccdbd5-bc68-4958-9cc4-67d6874ef26c"}], "security_groups": [{"name": "tempest-securitygroup--185279577"}], "key_name": "tempest-keypair-559223619", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:00.556349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:00.564936 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5e879cdf-6a46-402f-931d-e21037c58e4b tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 0.543956 Jun 04 20:54:00.565515 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 255/500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:00 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:00.572488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] validate_networks() for [('15ccdbd5-bc68-4958-9cc4-67d6874ef26c', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:54:00.586048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1cc2775c-7c65-426d-b44f-d5a4f8f751aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:00.588204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1cc2775c-7c65-426d-b44f-d5a4f8f751aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:00.766895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1cc2775c-7c65-426d-b44f-d5a4f8f751aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:00.769677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=79 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:00.776247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1cc2775c-7c65-426d-b44f-d5a4f8f751aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1211 microversion: 2.1 time: 0.209679 Jun 04 20:54:00.780289 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 256/501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:00 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:00.790655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:00.791690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:00.803249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:00.804125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:00.806769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:00.807439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:01.564967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:01.576178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9bd2b3b4-f476-4647-be28-71bca41b0eb8 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.794216 Jun 04 20:54:01.578802 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 257/502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:00 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:01.590260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:01.591412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:01.604637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:01.608601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:01.610143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:01.610875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.054394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:02.064890 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85ea5992-e89f-464a-8c1b-be21af24ebe6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 0.484564 Jun 04 20:54:02.069484 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 258/503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:01 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:02.081955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:02.082855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:02.095335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.099940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.103235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.104020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.163112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:54:02.163669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:54:02.164137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:54:02.165759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:54:02.166189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:54:02.190875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.193673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.194803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.197245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.219980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:02.256335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Getting quotas for project afaae81a01be4c73acb908aae5be8312. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:02.269488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Getting quotas for user 90a9faf4a615437ca499c0ccbc1e7563 and project afaae81a01be4c73acb908aae5be8312. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:02.328975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:54:02.339743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:02.433229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:02.465181 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4eb01c12-5480-4203-9743-1cac7bb55ae0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1263 microversion: 2.1 time: 0.385123 Jun 04 20:54:02.468087 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 259/504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:02 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1263 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:02.480596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b97635fa-be13-4d07-81c8-b301374c5108 req-38514295-717a-44f1-99ff-9f4a27ad41c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "295d40b3-7e6b-4033-b688-46ce7fdcf48e", "tag": "72a9c015-9834-4eec-886f-01ee0faaa615"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:02.515345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b97635fa-be13-4d07-81c8-b301374c5108 req-38514295-717a-44f1-99ff-9f4a27ad41c2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.516324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b97635fa-be13-4d07-81c8-b301374c5108 req-38514295-717a-44f1-99ff-9f4a27ad41c2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.533267 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bfe8b297-7db7-44cb-b3a3-9abf627b2c6f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.347967 Jun 04 20:54:02.548646 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 246/505] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:54:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:54:02.555014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-30048178-0db8-4a9b-bdfb-47d9b26f5f94 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:02.566008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-30048178-0db8-4a9b-bdfb-47d9b26f5f94 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:02.568515 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b97635fa-be13-4d07-81c8-b301374c5108 req-38514295-717a-44f1-99ff-9f4a27ad41c2 service nova] Creating event network-changed:72a9c015-9834-4eec-886f-01ee0faaa615 for instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e on nch2-master-1 Jun 04 20:54:02.599877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b97635fa-be13-4d07-81c8-b301374c5108 req-38514295-717a-44f1-99ff-9f4a27ad41c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128721 Jun 04 20:54:02.612766 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 260/506] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:02.622549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:02.649387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:02.667741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.676894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.678861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:02.681645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:02.965501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-30048178-0db8-4a9b-bdfb-47d9b26f5f94 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:02.977591 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-30048178-0db8-4a9b-bdfb-47d9b26f5f94 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1264 microversion: 2.1 time: 0.425746 Jun 04 20:54:02.983050 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 247/507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:02 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1264 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:03.083029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:03.084221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:03.099456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:03.100375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:03.101915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:03.103179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:03.428186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:03.437574 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f2a93fbd-a5b7-4e2b-b98d-2ba6af50b88e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1318 microversion: 2.1 time: 0.818966 Jun 04 20:54:03.447976 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 261/508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:02 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:03.487034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:03.487683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:03.505920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:03.506370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:03.507153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:03.507602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:03.659645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:03.668314 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a944e7e0-de9e-4ba0-bc50-7b8a37d1247c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1269 microversion: 2.1 time: 0.185431 Jun 04 20:54:03.678949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 262/509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:03 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:54:03.846607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:03.871856 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66af73dd-1b92-43ff-bb38-a3086671c8e5 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 0.791981 Jun 04 20:54:03.873571 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 248/510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:03 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:54:03.994703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:03.995629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:04.002906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.003535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.004435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.005004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.081548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:04.094538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e5be77b-66c5-457f-83ea-d54e6f7898a3 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1316 microversion: 2.1 time: 0.103768 Jun 04 20:54:04.095614 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 263/511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:03 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1316 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:54:04.467053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:04.467950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:04.480146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.481065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.482033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.483641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.685872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:04.686687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:04.694845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.695777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.696942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.697661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.842123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:04.855287 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14a5856b-0538-4946-9d20-b9b82b7a3c6a tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1468 microversion: 2.1 time: 0.395363 Jun 04 20:54:04.868432 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 249/512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:04 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1468 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:04.897836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:04.938261 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d6b96d6-94fd-4fdd-8fc2-de058277bdfa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1269 microversion: 2.1 time: 0.253048 Jun 04 20:54:04.944627 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 264/513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:04 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1269 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:04.970314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:04.971129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:04.981145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.981758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:04.982616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:04.983060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:05.404356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-727235691", "block_migration": true, "disk_over_commit": false}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:05.405569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:05.412008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:05.412734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:05.413845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:05.414438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:05.550007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lazy-loading 'flavor' on Instance uuid e626ec10-9545-4cd1-81a3-ee1fc3e39a68 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:54:05.614426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Going to try to live migrate instance to tempest-host-727235691 {{(pid=137228) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:54:05.624412 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] HTTP exception thrown: Compute host tempest-host-727235691 could not be found. Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Request method failure captured: Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68/action HTTP/1.1 Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 106 Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZaIx6axeE4ACdLTzZYmvDNNG0kkjY4WDZhr8YAldVd4LRqTgudVLtV7CCvyhF6vr0Yme9BnicbW4jjJp-Qal22WUtRwzFaUFP0OSZlxV-vdR1CKoHJtIDqfkJ9f_DGWi1iQP_JFLTtKq0nKkcpBVdJPb9PtXr0XVdWOrD782L-oEM Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 00850f9935c54861ac162b84570e1213 Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveMigrationNegativeTest-1771119596 Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:54:05.630265 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_00850f9935c54861ac162b84570e1213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/00850f9935c54861ac162b84570e1213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/00850f9935c54861ac162b84570e1213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/00850f9935c54861ac162b84570e1213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveMigrationNegativeTest-1771119596 Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 00850f9935c54861ac162b84570e1213 Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1771119596 Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveMigrationNegativeTest-1771119596-project-admin Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 09b153e10d99483cbd0a5d0cba215739 Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveMigrationNegativeTest-1771119596-project-admin Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: {"os-migrateLive": {"host": "tempest-host-727235691", "block_migration": true, "disk_over_commit": false}} Jun 04 20:54:05.631612 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: exception: Compute host tempest-host-727235691 could not be found. Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e626ec10-9545-4cd1-81a3-ee1fc3e39a68', 'body': {'os-migrateLive': {'host': 'tempest-host-727235691', 'block_migration': True, 'disk_over_commit': False}}} Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:05.632465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-727235691 could not be found. Jun 04 20:54:05.633794 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-727235691 could not be found. Jun 04 20:54:05.636040 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-727235691 could not be found. Jun 04 20:54:05.638464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:05.640964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Returning 400 to user: Compute host tempest-host-727235691 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:05.642685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b62a1bf9-817f-4e5c-bd28-66835415c7e4 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68/action" status: 400 len: 99 microversion: 2.1 time: 0.772939 Jun 04 20:54:05.643839 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 250/514] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Jun 4 20:54:04 2022] POST /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68/action => generated 99 bytes in 775 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:54:05.649624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:05.650897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:05.658576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:05.659350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:05.660672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:05.661312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:05.793502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=23 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:05.959736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:05.972479 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1f431993-b70a-4704-ab12-165f7c2fcb14 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 1.026315 Jun 04 20:54:05.973105 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 265/515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:04 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:05.974870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:05.993429 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d385da28-b5aa-4dc7-85ce-fe13f6393d3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1322 microversion: 2.1 time: 0.347817 Jun 04 20:54:05.996019 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 251/516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:05 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:06.008557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:06.011061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:06.021483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:06.028836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:06.043785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:06.046177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:06.049067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:06.052269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:06.053130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:06.053432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:06.053552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:06.054122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:06.563800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:06.573841 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab0394a8-34ee-4748-bd36-205f0f436e0c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1269 microversion: 2.1 time: 0.574854 Jun 04 20:54:06.574434 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 252/517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:05 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1269 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:06.992700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:06.994304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:07.007121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:07.009232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:07.011811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:07.015492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:07.052832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:07.066238 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7a951bce-5cf6-48d7-a384-fd5a4b7611c4 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1468 microversion: 2.1 time: 1.081242 Jun 04 20:54:07.067019 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 266/518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:05 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1468 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:07.081313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:07.082259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:07.099144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:07.099786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:07.102557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:07.103468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:08.200832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:08.224117 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-84afb8e8-a5a6-4132-8cdd-0d0cc18d2b36 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 1.148614 Jun 04 20:54:08.228009 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 267/519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:07 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:08.264491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1292368955", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:08.417890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:54:09.357736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:09.372321 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8018c9a3-3561-47e2-a224-9445ccfbcb16 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 2.386780 Jun 04 20:54:09.374662 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 253/520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:06 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 2390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:09.397650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:09.398911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:09.414366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:09.414899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:09.417259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:09.423462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:10.619585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:54:10.620120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:54:10.620467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:54:10.621085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:54:10.621697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:54:10.637537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:10.648977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:10.650492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:10.651953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:10.699305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Getting quotas for project 55d1f67de5f9427bae166a10a5edff26. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:10.712516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Getting quotas for user 859de04797504bcbb5134dba5c8183a5 and project 55d1f67de5f9427bae166a10a5edff26. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:10.745255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:54:10.747865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:10.748008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:10.765718 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-43fe19ab-0dfa-4b94-b52a-cad80857c703 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1311 microversion: 2.1 time: 1.389141 Jun 04 20:54:10.773888 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 254/521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:09 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1311 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:10.795980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ce0bfc37-ad5b-40c3-901b-6779524c3ea8 req-65edfd88-d43e-4b87-a962-ccea8aaa121a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2802f93-a40c-4fe1-89d4-a6707b2b7eea", "name": "network-vif-deleted", "tag": "e766e6b7-e10e-4604-8598-b74e37810cdb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:10.842978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ce0bfc37-ad5b-40c3-901b-6779524c3ea8 req-65edfd88-d43e-4b87-a962-ccea8aaa121a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:10.845128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ce0bfc37-ad5b-40c3-901b-6779524c3ea8 req-65edfd88-d43e-4b87-a962-ccea8aaa121a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:10.854935 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bde0e6d6-0feb-4e86-b08d-e382a1d8c028 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613190 Jun 04 20:54:10.856768 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 268/522] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:54:10.931252 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ce0bfc37-ad5b-40c3-901b-6779524c3ea8 req-65edfd88-d43e-4b87-a962-ccea8aaa121a service nova] Creating event network-vif-deleted:e766e6b7-e10e-4604-8598-b74e37810cdb for instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea on nch1-master-1 Jun 04 20:54:10.941145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ce0bfc37-ad5b-40c3-901b-6779524c3ea8 req-65edfd88-d43e-4b87-a962-ccea8aaa121a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165439 Jun 04 20:54:10.942457 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 255/523] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:10.948549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:10.949507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:10.963337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:10.965024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:10.966022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:10.967277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:11.193504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1535258244", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:11.323259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:54:11.746627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:11.758802 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0eb3d497-ec65-432e-88c4-43f2dd3f2b51 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 0.814694 Jun 04 20:54:11.763094 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 256/524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:10 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:11.790472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:11.791276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:11.809249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:11.810335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:11.811376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:11.813801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:12.221176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:12.976317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=60 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:13.151198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:54:13.151808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:54:13.152127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:54:13.152552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:54:13.153374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:54:13.157421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:13.171495 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88f39a83-966e-4f48-a402-e5e54af6225d tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 1.406919 Jun 04 20:54:13.172409 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 257/525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:11 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:13.178460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:13.179454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:13.186299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.187811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.189307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.189927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.190645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.191249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.192059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.192584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.225844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:13.244794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:13.271495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:54:13.276107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:13.356785 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d6decaff-a85d-4677-8525-ff34328cd681 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498621 Jun 04 20:54:13.362260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 269/526] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:54:13.377241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7ccf1ac6-1497-42ef-ad1f-203aebbe38f3 req-974db29b-da0f-4eae-94f7-31ce6af44348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f079bb-05eb-4b12-a59e-5a5ba29fcc23", "tag": "a23c1a98-76c4-4832-9b05-88f371d7bdb0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:13.398643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7ccf1ac6-1497-42ef-ad1f-203aebbe38f3 req-974db29b-da0f-4eae-94f7-31ce6af44348 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.399544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7ccf1ac6-1497-42ef-ad1f-203aebbe38f3 req-974db29b-da0f-4eae-94f7-31ce6af44348 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.436723 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7ccf1ac6-1497-42ef-ad1f-203aebbe38f3 req-974db29b-da0f-4eae-94f7-31ce6af44348 service nova] Creating event network-changed:a23c1a98-76c4-4832-9b05-88f371d7bdb0 for instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 on nch2-master-1 Jun 04 20:54:13.451727 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7ccf1ac6-1497-42ef-ad1f-203aebbe38f3 req-974db29b-da0f-4eae-94f7-31ce6af44348 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085335 Jun 04 20:54:13.454909 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 270/527] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:13.467232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:13.470034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:13.485987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.488974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.491871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.496911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.526783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:13.537077 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-668c0b1d-091d-4a7b-9750-9a3c74db7fb5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1279 microversion: 2.1 time: 0.363173 Jun 04 20:54:13.538374 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 258/528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:13 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1279 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:13.543827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:13.544690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:13.552877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.554960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:13.557122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:13.557883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.357765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:14.394168 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d3ce094-f251-4983-922f-a81e14122a11 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 0.853506 Jun 04 20:54:14.411897 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 259/529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:13 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:14.420519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-63adc25f-5062-44eb-b336-7a015a84baa9 req-03d68ac9-70b6-4f0d-875b-9322329e777a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f994823a-4d87-426d-9673-d598a15b6ae2", "tag": "446b0ce5-8246-4b96-8079-6b17063c7982"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:14.430732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-63adc25f-5062-44eb-b336-7a015a84baa9 req-03d68ac9-70b6-4f0d-875b-9322329e777a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.435340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:14.440874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-63adc25f-5062-44eb-b336-7a015a84baa9 req-03d68ac9-70b6-4f0d-875b-9322329e777a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.449227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5f0d7705-dad4-4101-8dc6-bc3959da7227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1311 microversion: 2.1 time: 0.992691 Jun 04 20:54:14.451554 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 271/530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:13 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1311 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:14.466976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:14.468169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:14.474681 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-63adc25f-5062-44eb-b336-7a015a84baa9 req-03d68ac9-70b6-4f0d-875b-9322329e777a service nova] Creating event network-changed:446b0ce5-8246-4b96-8079-6b17063c7982 for instance f994823a-4d87-426d-9673-d598a15b6ae2 on nch1-master-1 Jun 04 20:54:14.483133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.484040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.486071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-63adc25f-5062-44eb-b336-7a015a84baa9 req-03d68ac9-70b6-4f0d-875b-9322329e777a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073458 Jun 04 20:54:14.487320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.488031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.490256 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 260/531] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:14.501168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:14.640543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a703a15e-7fd8-4fe7-aa58-5ee8b1f3ab15 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Action: 'create', calling method: .version_select at 0x7f2d028f0700>, body: {"keypair": {"name": "tempest-keypair-2107404665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPt2KkLJIyLtI76vdv9bUBckTsn8DvGLp9tSH0hVDt1VyxDavjHkMt6Y0owB1gDca9kjgf128YoblgH6tGwZ2QLHv1fZEVzVdMTi4o3HKViDqRRjWyKx7J5SGdcfP+RtA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:14.680819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a703a15e-7fd8-4fe7-aa58-5ee8b1f3ab15 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Getting quotas for project f8585f618d5f4203af8209f5483e2eca. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:14.696730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a703a15e-7fd8-4fe7-aa58-5ee8b1f3ab15 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Getting quotas for user 6b0c4b5dd6f0478e81580d12594528aa and project f8585f618d5f4203af8209f5483e2eca. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:14.711617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:14.726081 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76655bb5-2dbe-4f9c-b93c-3ffcad7614c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1221 microversion: 2.1 time: 0.268328 Jun 04 20:54:14.728899 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 272/532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:14 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:14.754241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:14.758031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:14.768453 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a703a15e-7fd8-4fe7-aa58-5ee8b1f3ab15 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.276450 Jun 04 20:54:14.769384 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 261/533] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:54:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:14.778030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.778704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.779754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.783006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.784549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:14.786266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:14.807096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.807996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:14.808987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:14.809826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:15.140243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:15.160076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72a440cc-fd19-4473-bec3-3bda59ee2e1e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1277 microversion: 2.1 time: 0.380515 Jun 04 20:54:15.161171 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 262/534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:14 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1277 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:15.173637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-15d542be-c88f-4a62-970d-37ed43816cc4 req-9c057faf-d90f-4ad1-be34-127151744e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295d40b3-7e6b-4033-b688-46ce7fdcf48e", "name": "network-vif-plugged", "status": "completed", "tag": "72a9c015-9834-4eec-886f-01ee0faaa615"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:15.199071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-15d542be-c88f-4a62-970d-37ed43816cc4 req-9c057faf-d90f-4ad1-be34-127151744e45 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:15.201231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-15d542be-c88f-4a62-970d-37ed43816cc4 req-9c057faf-d90f-4ad1-be34-127151744e45 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:15.239985 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-15d542be-c88f-4a62-970d-37ed43816cc4 req-9c057faf-d90f-4ad1-be34-127151744e45 service nova] Creating event network-vif-plugged:72a9c015-9834-4eec-886f-01ee0faaa615 for instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e on nch2-master-1 Jun 04 20:54:15.258508 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-15d542be-c88f-4a62-970d-37ed43816cc4 req-9c057faf-d90f-4ad1-be34-127151744e45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094159 Jun 04 20:54:15.261323 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 263/535] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:15.377491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:15.399609 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd7023dd-4680-4452-b1f7-4dc031102e49 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 0.665208 Jun 04 20:54:15.400759 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 273/536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:14 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:15.427596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:15.429074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:15.472063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:15.473130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:15.473768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:15.474286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:15.478714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:15.481094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:15.496917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:15.497631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:15.498660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:15.499353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:17.140041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:17.152952 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fa362fdf-4d4e-460d-9223-02614400caff tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 1.733747 Jun 04 20:54:17.158295 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 264/537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:15 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:17.168334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:17.171645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:17.223905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:17.228408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:17.229566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:17.233364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:17.610034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:17.612898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:17.619580 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f80167bc-224f-4088-af3a-4e36921c5dab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1311 microversion: 2.1 time: 2.154679 Jun 04 20:54:17.624598 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 274/538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:15 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1311 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:17.640712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:17.640712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:17.641210 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-63102495-69fd-4873-9cf6-55f3b8416263 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1275 microversion: 2.1 time: 0.474456 Jun 04 20:54:17.660058 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 265/539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:17 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1275 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:17.671886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:17.683893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:17.699849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:17.700526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:17.701142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:17.701622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:17.707365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:17.720605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:17.722919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:17.723755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:18.598037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:18.610286 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-58cf5d95-5a4b-4bb5-8b3f-d3ea4ceda2e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1322 microversion: 2.1 time: 0.942712 Jun 04 20:54:18.611661 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 266/540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:17 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1322 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:18.615955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:18.630975 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7a212db5-2369-42ec-a0a2-99106bab8bc2 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1319 microversion: 2.1 time: 1.000204 Jun 04 20:54:18.631962 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 275/541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:17 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1319 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:18.634094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:18.634894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:18.649072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:18.649964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:18.663163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:18.669237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:18.670403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:18.672628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:18.674268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:18.675185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:18.679599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:18.680625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:18.682027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:18.726543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:19.909095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:19.922221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:19.934566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9cde24cf-53ba-45dc-b613-dd2f5611ad46 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1311 microversion: 2.1 time: 1.297162 Jun 04 20:54:19.935814 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 276/542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:18 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1311 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:54:19.946395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:19.947226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:19.950944 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09b5074d-4dcd-4637-be3f-24d1eb11995c tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 1.321739 Jun 04 20:54:19.956946 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 267/543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:18 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:19.963471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-44aa4f29-e577-480e-92b9-d9e601b862bd req-e71a2d9c-158f-4b34-89fe-a10c0d51d83c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac", "tag": "4e098232-9c04-4472-b736-c04eceeed1cc"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:19.965019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:19.969462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:19.970393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:19.973998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:19.992066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-44aa4f29-e577-480e-92b9-d9e601b862bd req-e71a2d9c-158f-4b34-89fe-a10c0d51d83c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:19.992801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-44aa4f29-e577-480e-92b9-d9e601b862bd req-e71a2d9c-158f-4b34-89fe-a10c0d51d83c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:20.023227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-44aa4f29-e577-480e-92b9-d9e601b862bd req-e71a2d9c-158f-4b34-89fe-a10c0d51d83c service nova] Creating event network-changed:4e098232-9c04-4472-b736-c04eceeed1cc for instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac on nch1-master-1 Jun 04 20:54:20.038751 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-44aa4f29-e577-480e-92b9-d9e601b862bd req-e71a2d9c-158f-4b34-89fe-a10c0d51d83c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078707 Jun 04 20:54:20.043450 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 268/544] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:20.055620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:20.056779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:20.068547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:20.069642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:20.072200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:20.072886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:20.487709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:20.511056 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-49b19f17-02d6-42c6-8d4e-758e8498e38c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1317 microversion: 2.1 time: 0.573737 Jun 04 20:54:20.512941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 277/545] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:19 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:20.524580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:20.525500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:20.551678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:20.553423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:20.555264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:20.555989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:21.282031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:21.306865 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dff95693-4023-445b-907f-8e87782ba76f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1472 microversion: 2.1 time: 1.260596 Jun 04 20:54:21.308494 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 269/546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:20 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1472 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:21.320144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:21.321211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:21.335275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:21.336302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:21.337446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:21.338123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:21.709599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:21.719698 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-091a5d99-b3cd-4088-8d56-387eddfeef23 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1319 microversion: 2.1 time: 1.205330 Jun 04 20:54:21.720819 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 278/547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:20 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1319 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:21.726246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:21.727137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:21.749741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:21.750642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:21.754934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:21.756782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.035398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:22.045914 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5173eba6-c3af-4ff5-a7af-73d6819db150 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1311 microversion: 2.1 time: 0.735594 Jun 04 20:54:22.046565 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 270/548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:21 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1311 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:22.052360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:22.052902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:22.067565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.076330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.077612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.078561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.147585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lazy-loading 'flavor' on Instance uuid 295d40b3-7e6b-4033-b688-46ce7fdcf48e {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:54:22.279318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a608c483-204c-45dc-85b3-2dcb58f8834c tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e/action" status: 202 len: 0 microversion: 2.1 time: 0.231449 Jun 04 20:54:22.280052 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 271/549] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:22 2022] POST /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:22.288468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:22.289927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:22.298646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.299695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.300675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.301263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.621571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:22.630386 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d72a32ee-f191-4a68-ade1-c3dd9a2615ab tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 0.908138 Jun 04 20:54:22.630986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 279/550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:21 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:22.636700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-313105963", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9671b1df-853d-4900-a1d5-cdfaf042cf8d"}], "security_groups": [{"name": "tempest-securitygroup--1341344268"}], "key_name": "tempest-keypair-2107404665", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:22.709941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:22.718509 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5306bdba-93a3-4d01-bd11-72561324e536 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1317 microversion: 2.1 time: 0.433876 Jun 04 20:54:22.725410 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 272/551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:22 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:22.730000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ad20ec48-798d-410c-878b-87067ef29459 req-0c5516a3-e1de-4cf6-b973-9b7aad41e8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5dd136-9cec-4923-9c8c-2ba3024d18cc", "tag": "5b5bb7b6-3eee-4ee7-9679-d6b8686b2545"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:22.768946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ad20ec48-798d-410c-878b-87067ef29459 req-0c5516a3-e1de-4cf6-b973-9b7aad41e8fa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.769700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ad20ec48-798d-410c-878b-87067ef29459 req-0c5516a3-e1de-4cf6-b973-9b7aad41e8fa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.796083 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ad20ec48-798d-410c-878b-87067ef29459 req-0c5516a3-e1de-4cf6-b973-9b7aad41e8fa service nova] Creating event network-changed:5b5bb7b6-3eee-4ee7-9679-d6b8686b2545 for instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc on nch2-master-1 Jun 04 20:54:22.813388 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ad20ec48-798d-410c-878b-87067ef29459 req-0c5516a3-e1de-4cf6-b973-9b7aad41e8fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088476 Jun 04 20:54:22.814269 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 273/552] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:22.819626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:22.820673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:22.837905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.838800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.839895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:22.840584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:22.850602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] validate_networks() for [('9671b1df-853d-4900-a1d5-cdfaf042cf8d', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:54:23.206564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:23.281256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=13 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:24.099293 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-401a8126-93ad-4398-b840-fbd8c7a7d436 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1631 microversion: 2.1 time: 1.283399 Jun 04 20:54:24.101152 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 274/553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:22 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1631 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:24.126238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6ed801fd-bfe2-4128-8202-439714244d7d req-2b19ef18-dd01-4bad-a65f-63bf6b98ad38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f994823a-4d87-426d-9673-d598a15b6ae2", "name": "network-vif-plugged", "status": "completed", "tag": "446b0ce5-8246-4b96-8079-6b17063c7982"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:24.153935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6ed801fd-bfe2-4128-8202-439714244d7d req-2b19ef18-dd01-4bad-a65f-63bf6b98ad38 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.155355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6ed801fd-bfe2-4128-8202-439714244d7d req-2b19ef18-dd01-4bad-a65f-63bf6b98ad38 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.168931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6ed801fd-bfe2-4128-8202-439714244d7d req-2b19ef18-dd01-4bad-a65f-63bf6b98ad38 service nova] Creating event network-vif-plugged:446b0ce5-8246-4b96-8079-6b17063c7982 for instance f994823a-4d87-426d-9673-d598a15b6ae2 on nch1-master-1 Jun 04 20:54:24.176826 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6ed801fd-bfe2-4128-8202-439714244d7d req-2b19ef18-dd01-4bad-a65f-63bf6b98ad38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059117 Jun 04 20:54:24.177921 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 275/554] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:24.185502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:24.186623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:24.194259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:24.197270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.198547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.203888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.204606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.635986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Getting quotas for project f8585f618d5f4203af8209f5483e2eca. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:24.640820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:24.651665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de4fe674-dc6e-492c-8d87-9ccb07fb2e29 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1319 microversion: 2.1 time: 0.472147 Jun 04 20:54:24.659802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Getting quotas for user 6b0c4b5dd6f0478e81580d12594528aa and project f8585f618d5f4203af8209f5483e2eca. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:24.663721 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 276/555] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:24 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:24.674116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:24.677929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:24.689137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.695392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.696520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.696957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.719403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:54:24.721596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:54:24.722115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:54:24.722540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:54:24.722976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:54:24.730502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:24.754624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.755321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.756196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.757436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.780736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Getting quotas for project f8585f618d5f4203af8209f5483e2eca. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:24.786948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Getting quotas for user 6b0c4b5dd6f0478e81580d12594528aa and project f8585f618d5f4203af8209f5483e2eca. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:24.801969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:54:24.808051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:24.903841 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0dde460a-090a-4e30-9e36-b44e240c8534 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.267359 Jun 04 20:54:24.907767 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 280/556] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:54:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 2274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:54:24.931152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:24.933925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:24.950092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.953662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:24.956709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:24.957402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:25.035642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:25.049090 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c83d1ff6-2ecc-4415-b56a-1bb705265d80 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1311 microversion: 2.1 time: 0.379587 Jun 04 20:54:25.050081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 277/557] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:24 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:25.068240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:25.069055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:25.080559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:25.081320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:25.082387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:25.083156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:25.737321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:25.747899 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9937d60b-3db6-4d6d-841f-162d67d2ee16 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 0.838468 Jun 04 20:54:25.749309 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 281/558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:24 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:25.791195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:25.803009 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1c90c56d-1d83-4d47-bbff-d3e4541eeee0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1317 microversion: 2.1 time: 0.749913 Jun 04 20:54:25.803632 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 278/559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:25 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:25.820849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:25.830453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:25.842046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:25.842869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:25.844067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:25.844671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:25.964972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:25.974966 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-efe64617-20b8-4372-8cac-46840f26ab64 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1281 microversion: 2.1 time: 0.158020 Jun 04 20:54:25.976282 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 279/560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:25 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1281 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:25.984328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:25.985212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:26.000712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:26.003476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:26.004871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:26.005501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:26.030492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a14b5cd5-7b05-499e-8f20-7590f7d88e40 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Action: 'create', calling method: .version_select at 0x7f2d02b1e280>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:26.423311 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7abc5296-b45a-4709-9fa4-69198aea6707 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1614 microversion: 2.1 time: 0.445091 Jun 04 20:54:26.424942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 280/561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:25 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1614 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:26.430177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:26.431077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:26.439298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:26.440781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:26.441871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:26.442491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:26.800356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:26.812624 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1a16c8d-2e85-4258-8a8c-e95182f3d5f5 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1319 microversion: 2.1 time: 0.385381 Jun 04 20:54:26.813260 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 281/562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:26 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:26.831771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:26.832519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:26.842294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:26.844244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:26.845496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:26.846552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.258034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:27.277696 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0b02f5c-d911-4fa1-8726-d3f00674abb2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1493 microversion: 2.1 time: 0.449893 Jun 04 20:54:27.279102 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 282/563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:26 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1493 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:27.297363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4fcad8ca-22de-4cb2-a1ef-c84c49ad09b1 req-7138178d-a211-424a-aa6d-507bdd515d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f079bb-05eb-4b12-a59e-5a5ba29fcc23", "name": "network-vif-plugged", "status": "completed", "tag": "a23c1a98-76c4-4832-9b05-88f371d7bdb0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:27.311261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4fcad8ca-22de-4cb2-a1ef-c84c49ad09b1 req-7138178d-a211-424a-aa6d-507bdd515d11 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.312684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4fcad8ca-22de-4cb2-a1ef-c84c49ad09b1 req-7138178d-a211-424a-aa6d-507bdd515d11 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.336400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4fcad8ca-22de-4cb2-a1ef-c84c49ad09b1 req-7138178d-a211-424a-aa6d-507bdd515d11 service nova] Creating event network-vif-plugged:a23c1a98-76c4-4832-9b05-88f371d7bdb0 for instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 on nch2-master-1 Jun 04 20:54:27.343863 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4fcad8ca-22de-4cb2-a1ef-c84c49ad09b1 req-7138178d-a211-424a-aa6d-507bdd515d11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061939 Jun 04 20:54:27.345408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 283/564] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:27.367627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:27.368563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:27.397716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.398817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.412643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.413129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.533330 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] HTTP exception thrown: Cannot 'migrate' instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e while it is in vm_state suspended Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Request method failure captured: Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e/action HTTP/1.1 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZULrA54iCk6-hOx-2xlQyqtjEmwZa2kc3WBxH5XJ8oBI8_d6hGs_iMrWUmzGkyGtBs-oeubbakZOEo6ELlhsC6G8N75hDxzBGGZ3MMaLdMJtZUuNjuwZHCPHJxrdcoddJySFvirqpp2xURzCzX51W8tg72zWh0hLaQynHDWRBMJi4 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:54:27.535798 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88c4fc51e48a41f7901df21322139226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88c4fc51e48a41f7901df21322139226"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: aea29c7af6ba4ebda8b491e0ba2ae9f6 Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: {"migrate": {}} Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:54:27.537452 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'migrate' instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e while it is in vm_state suspended Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '295d40b3-7e6b-4033-b688-46ce7fdcf48e', 'body': {'migrate': {}}} Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e in vm_state suspended. Cannot resize while the instance is in this state. Jun 04 20:54:27.538533 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e while it is in vm_state suspended Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:27.540155 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:27.541652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:27.541652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:27.541652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:27.541652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:27.541652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e while it is in vm_state suspended Jun 04 20:54:27.541652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:27.551211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Returning 409 to user: Cannot 'migrate' instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e while it is in vm_state suspended {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:27.552439 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8c1b5d33-ecdf-4082-901b-1ec845b71e63 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e/action" status: 409 len: 148 microversion: 2.1 time: 0.205717 Jun 04 20:54:27.553287 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 284/565] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:27 2022] POST /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e/action => generated 148 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:54:27.575747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:27.576412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:27.592383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.596248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.597705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.600329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.611581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:27.891816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:27.904428 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ebf61f7-0b64-463b-928e-1964c46b06ca tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1389 microversion: 2.1 time: 0.340779 Jun 04 20:54:27.916113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 285/566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:27 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1389 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:27.923043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:27.924028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:27.934498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.935331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:27.937653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:27.938595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:28.250839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:28.312642 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e08fa026-673d-4814-9ffb-51aef1efc0d5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1317 microversion: 2.1 time: 0.392790 Jun 04 20:54:28.313441 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 286/567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:27 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:28.331124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:28.331977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:28.351454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:28.352061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:28.352859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:28.353312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:28.527252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:28.550383 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-10a7a3f0-def8-4892-af1e-2e33f7a90b27 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1335 microversion: 2.1 time: 0.231925 Jun 04 20:54:28.552433 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 287/568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:28 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1335 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:28.748901 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a14b5cd5-7b05-499e-8f20-7590f7d88e40 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.997797 Jun 04 20:54:28.750068 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 282/569] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:54:25 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:28.755348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e68481a-7e97-4269-bfcd-6a5ded1074cc tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e68481a-7e97-4269-bfcd-6a5ded1074cc tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Request method failure captured: Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6/action HTTP/1.1 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 39 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZULrA54iCk6-hOx-2xlQyqtjEmwZa2kc3WBxH5XJ8oBI8_d6hGs_iMrWUmzGkyGtBs-oeubbakZOEo6ELlhsC6G8N75hDxzBGGZ3MMaLdMJtZUuNjuwZHCPHJxrdcoddJySFvirqpp2xURzCzX51W8tg72zWh0hLaQynHDWRBMJi4 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:54:28.758215 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88c4fc51e48a41f7901df21322139226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88c4fc51e48a41f7901df21322139226"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: aea29c7af6ba4ebda8b491e0ba2ae9f6 Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: {"os-resetState": {"state": "invalid"}} Jun 04 20:54:28.759668 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ceff7c9e-d21b-4b51-8ac5-800163fd0cf6', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'invalid' Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:28.760827 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:54:28.762674 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 04 20:54:28.764978 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:28.765649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e68481a-7e97-4269-bfcd-6a5ded1074cc tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:28.768762 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e68481a-7e97-4269-bfcd-6a5ded1074cc tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6/action" status: 400 len: 144 microversion: 2.1 time: 0.016446 Jun 04 20:54:28.775074 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 283/570] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:28 2022] POST /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:54:28.781650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:28.782759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:28.787236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:28.788076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:28.795252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:28.796197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:28.798579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:28.799558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:28.800488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:28.801000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:28.801880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:28.802574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:29.100790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:29.117144 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20e0408a-21b8-441e-89ca-4a0aea667210 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1319 microversion: 2.1 time: 0.340695 Jun 04 20:54:29.117744 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 284/571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:28 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:29.123793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2ffbb9d-0361-4867-bb0a-078a63d73d22 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Action: 'create', calling method: .version_select at 0x7f2d02a6ff70>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:29.146430 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc943f48-2f9c-4970-8481-81107a14a5e1 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1644 microversion: 2.1 time: 0.592469 Jun 04 20:54:29.147479 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 288/572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:28 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1644 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:29.154175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ebecd58-b9b3-4eb6-92eb-8deae0f8bcbd tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ebecd58-b9b3-4eb6-92eb-8deae0f8bcbd tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Request method failure captured: Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6/action HTTP/1.1 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 31 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZULrA54iCk6-hOx-2xlQyqtjEmwZa2kc3WBxH5XJ8oBI8_d6hGs_iMrWUmzGkyGtBs-oeubbakZOEo6ELlhsC6G8N75hDxzBGGZ3MMaLdMJtZUuNjuwZHCPHJxrdcoddJySFvirqpp2xURzCzX51W8tg72zWh0hLaQynHDWRBMJi4 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:54:29.156797 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88c4fc51e48a41f7901df21322139226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88c4fc51e48a41f7901df21322139226"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: aea29c7af6ba4ebda8b491e0ba2ae9f6 Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: {"os-resetState": {"state": 1}} Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:54:29.158334 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ceff7c9e-d21b-4b51-8ac5-800163fd0cf6', 'body': {'os-resetState': {'state': 1}}} Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 1 Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:29.159295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 04 20:54:29.160844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:29.162184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ebecd58-b9b3-4eb6-92eb-8deae0f8bcbd tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:29.162184 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ebecd58-b9b3-4eb6-92eb-8deae0f8bcbd tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6/action" status: 400 len: 120 microversion: 2.1 time: 0.011442 Jun 04 20:54:29.164267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 289/573] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:29 2022] POST /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6/action => generated 120 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:54:29.173805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:29.174829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:29.188729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:29.189486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:29.190597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:29.191201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:29.582035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:29.604204 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-42ee9d00-4357-4953-990a-afb817c3099e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1587 microversion: 2.1 time: 0.438468 Jun 04 20:54:29.604813 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 290/574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:29 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1587 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:29.614634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:29.627626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:29.643401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:29.643953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:29.646065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:29.646604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.016819 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a5a6eae-561c-4e43-b147-996a69abb0ca tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1644 microversion: 2.1 time: 0.410672 Jun 04 20:54:30.022801 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 291/575] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:29 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1644 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:30.031662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8469989e-2bc1-4a8d-9c4b-857d14994865 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:30.032776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8469989e-2bc1-4a8d-9c4b-857d14994865 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Failed to fetch instance by id 999 {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 20:54:30.033528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8469989e-2bc1-4a8d-9c4b-857d14994865 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8469989e-2bc1-4a8d-9c4b-857d14994865 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Request method failure captured: Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 37 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZULrA54iCk6-hOx-2xlQyqtjEmwZa2kc3WBxH5XJ8oBI8_d6hGs_iMrWUmzGkyGtBs-oeubbakZOEo6ELlhsC6G8N75hDxzBGGZ3MMaLdMJtZUuNjuwZHCPHJxrdcoddJySFvirqpp2xURzCzX51W8tg72zWh0hLaQynHDWRBMJi4 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:54:30.045767 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88c4fc51e48a41f7901df21322139226"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88c4fc51e48a41f7901df21322139226"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88c4fc51e48a41f7901df21322139226"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 88c4fc51e48a41f7901df21322139226 Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1369194127 Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: aea29c7af6ba4ebda8b491e0ba2ae9f6 Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1369194127-project-admin Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: {"os-resetState": {"state": "error"}} Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:54:30.047418 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 999 could not be found. Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:30.048686 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 04 20:54:30.050296 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:30.055700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8469989e-2bc1-4a8d-9c4b-857d14994865 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:30.057742 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8469989e-2bc1-4a8d-9c4b-857d14994865 tempest-ServersAdminNegativeTestJSON-1369194127 tempest-ServersAdminNegativeTestJSON-1369194127-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.032684 Jun 04 20:54:30.058360 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 292/576] 10.222.0.18 () {60 vars in 1178 bytes} [Sat Jun 4 20:54:30 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:54:30.079540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:30.080961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:30.091450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.092658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.099419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.100571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.375194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:30.396419 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ae940d1-658d-4f3c-ae89-fb4593aba018 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1317 microversion: 2.1 time: 0.325907 Jun 04 20:54:30.397250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 293/577] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:30 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:30.403115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2d222948-fb96-4c7b-9389-ae7bc9b3bf98 req-94e87f2b-4c74-44c0-a2d2-d2e21095403c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac", "name": "network-vif-plugged", "status": "completed", "tag": "4e098232-9c04-4472-b736-c04eceeed1cc"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:30.414974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2d222948-fb96-4c7b-9389-ae7bc9b3bf98 req-94e87f2b-4c74-44c0-a2d2-d2e21095403c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.415746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2d222948-fb96-4c7b-9389-ae7bc9b3bf98 req-94e87f2b-4c74-44c0-a2d2-d2e21095403c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.446640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2d222948-fb96-4c7b-9389-ae7bc9b3bf98 req-94e87f2b-4c74-44c0-a2d2-d2e21095403c service nova] Creating event network-vif-plugged:4e098232-9c04-4472-b736-c04eceeed1cc for instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac on nch1-master-1 Jun 04 20:54:30.452980 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2d222948-fb96-4c7b-9389-ae7bc9b3bf98 req-94e87f2b-4c74-44c0-a2d2-d2e21095403c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054189 Jun 04 20:54:30.454183 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 294/578] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:30.464691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:30.466370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:30.484541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.485028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.486214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.486881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.914605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:30.934819 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-500c30ee-8667-4706-a998-2396e4b0a708 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1403 microversion: 2.1 time: 0.474981 Jun 04 20:54:30.935418 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 295/579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:30 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1403 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:30.945771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:30.948212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:30.968768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.970133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:30.971684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:30.972400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:31.157140 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84079a07-30a6-446a-bfe9-9540c44dcce1 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.218439 Jun 04 20:54:31.158460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 296/580] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:54:30 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:31.166623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b5566b77-a79b-4a1f-9c63-99a8dc72fc28 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:31.175410 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:54:31.175410 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:54:31.180064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5566b77-a79b-4a1f-9c63-99a8dc72fc28 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:31.180525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5566b77-a79b-4a1f-9c63-99a8dc72fc28 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:31.183942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5566b77-a79b-4a1f-9c63-99a8dc72fc28 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:31.184492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5566b77-a79b-4a1f-9c63-99a8dc72fc28 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:31.272384 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b5566b77-a79b-4a1f-9c63-99a8dc72fc28 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.112287 Jun 04 20:54:31.280940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 297/581] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:54:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:31.288470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:31.289031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:31.297276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:31.297722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:31.298533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:31.298968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:31.336869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:54:31.522607 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-797cc922-b20d-483e-a3cb-8434762373e6 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 204 len: 0 microversion: 2.1 time: 0.240066 Jun 04 20:54:31.523614 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 298/582] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:54:31 2022] DELETE /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:54:31.548131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:31.549044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:31.564748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:31.565195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:31.565997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:31.566438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:32.560754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:32.569684 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-972b8508-cd58-46fc-a40f-d601c29878da tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1319 microversion: 2.1 time: 1.032708 Jun 04 20:54:32.582372 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 299/583] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:31 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1319 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:32.587075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:32.588348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:32.599866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:32.600927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:32.602195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:32.603988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:32.657596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lazy-loading 'flavor' on Instance uuid f994823a-4d87-426d-9673-d598a15b6ae2 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:54:32.675034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Going to try to live migrate instance to nch2-master-1 {{(pid=137228) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:54:32.871900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e2ffbb9d-0361-4867-bb0a-078a63d73d22 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.752677 Jun 04 20:54:32.873040 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 285/584] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:54:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:32.880208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:32.888330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:32.898382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:32.900074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:32.901128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:32.901729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:33.155925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:33.183092 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a9c8bd6f-4f7f-4669-bc08-9d9de4d68862 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1317 microversion: 2.1 time: 0.307605 Jun 04 20:54:33.196805 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 286/585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:32 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:33.201832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:33.209145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:33.234177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:33.234911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:33.235913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:33.237359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:33.631837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:33.641884 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83b35d20-db0a-4374-82b5-73b9c11a4f21 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 200 len: 1469 microversion: 2.1 time: 0.443901 Jun 04 20:54:33.643439 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 287/586] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:33 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:33.650937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a9392c1f-087d-4d2f-9081-acdd73f05b77 req-84473365-6256-4a1c-852c-1b0f2998c98c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77800c5-96da-4b7f-8b6a-76dbf40b4ba9", "tag": "04917853-faab-4547-80ad-fc7871874d25"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:33.674752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a9392c1f-087d-4d2f-9081-acdd73f05b77 req-84473365-6256-4a1c-852c-1b0f2998c98c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:33.675201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a9392c1f-087d-4d2f-9081-acdd73f05b77 req-84473365-6256-4a1c-852c-1b0f2998c98c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:33.748502 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a9392c1f-087d-4d2f-9081-acdd73f05b77 req-84473365-6256-4a1c-852c-1b0f2998c98c service nova] Creating event network-changed:04917853-faab-4547-80ad-fc7871874d25 for instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 on nch1-master-1 Jun 04 20:54:33.770707 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a9392c1f-087d-4d2f-9081-acdd73f05b77 req-84473365-6256-4a1c-852c-1b0f2998c98c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125345 Jun 04 20:54:33.775377 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 288/587] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:33.781048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:33.781825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:33.818677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:33.819135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:33.823030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:33.826574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:34.218852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:34.236594 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-062b8048-34a6-4ae0-b40c-d2d0dec71e8b tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1403 microversion: 2.1 time: 0.459756 Jun 04 20:54:34.252448 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 289/588] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:33 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1403 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:34.258027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-038afd64-e0ca-41bf-95b4-a33a5e4875dc req-e83eaf49-d715-4656-8433-c2dd7c7dc6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5dd136-9cec-4923-9c8c-2ba3024d18cc", "name": "network-vif-plugged", "status": "completed", "tag": "5b5bb7b6-3eee-4ee7-9679-d6b8686b2545"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:34.285831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-038afd64-e0ca-41bf-95b4-a33a5e4875dc req-e83eaf49-d715-4656-8433-c2dd7c7dc6a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:34.288254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-038afd64-e0ca-41bf-95b4-a33a5e4875dc req-e83eaf49-d715-4656-8433-c2dd7c7dc6a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:34.328433 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-038afd64-e0ca-41bf-95b4-a33a5e4875dc req-e83eaf49-d715-4656-8433-c2dd7c7dc6a8 service nova] Creating event network-vif-plugged:5b5bb7b6-3eee-4ee7-9679-d6b8686b2545 for instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc on nch2-master-1 Jun 04 20:54:34.341514 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-038afd64-e0ca-41bf-95b4-a33a5e4875dc req-e83eaf49-d715-4656-8433-c2dd7c7dc6a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087156 Jun 04 20:54:34.342870 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 290/589] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:34.349554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-29ef2421-bdeb-4e69-a8e0-7ee187767206 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Action: 'create', calling method: .version_select at 0x7f2d029a5700>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:34.769503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:34.796767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:36.278237 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-07213154-0019-4d2a-858e-d44a72ddd927 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2/action" status: 202 len: 0 microversion: 2.1 time: 3.694765 Jun 04 20:54:36.278951 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 300/590] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:32 2022] POST /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2/action => generated 0 bytes in 3696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:36.285440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:36.286475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:36.313031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:36.313881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:36.314932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:36.315676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:36.669376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:36.677609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:36.689479 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd9a7697-0008-42f7-ac18-6e533928a45e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1468 microversion: 2.1 time: 0.407664 Jun 04 20:54:36.696252 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 301/591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:36 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1468 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:36.709483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:36.728314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:36.752284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:36.755852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:36.757441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:36.758044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:37.715830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:37.765219 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5cfa2e93-2de4-409b-96e6-cc13cf1a6c13 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1467 microversion: 2.1 time: 1.064286 Jun 04 20:54:37.766023 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 302/592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:36 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1467 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:37.788719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:37.798183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:37.824096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:37.828952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:37.836592 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-29ef2421-bdeb-4e69-a8e0-7ee187767206 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.492196 Jun 04 20:54:37.837991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:37.839681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:37.875811 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 291/593] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:54:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:37.881082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-71e219d5-a77a-41dd-b6f9-daffed08bac7 req-28131771-b995-404f-810d-d1c4d089d574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f079bb-05eb-4b12-a59e-5a5ba29fcc23", "tag": "a23c1a98-76c4-4832-9b05-88f371d7bdb0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:37.915068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-71e219d5-a77a-41dd-b6f9-daffed08bac7 req-28131771-b995-404f-810d-d1c4d089d574 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:37.916560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-71e219d5-a77a-41dd-b6f9-daffed08bac7 req-28131771-b995-404f-810d-d1c4d089d574 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:37.944050 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-71e219d5-a77a-41dd-b6f9-daffed08bac7 req-28131771-b995-404f-810d-d1c4d089d574 service nova] Creating event network-changed:a23c1a98-76c4-4832-9b05-88f371d7bdb0 for instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 on nch2-master-1 Jun 04 20:54:37.956191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-71e219d5-a77a-41dd-b6f9-daffed08bac7 req-28131771-b995-404f-810d-d1c4d089d574 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074653 Jun 04 20:54:37.957428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 292/594] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:37.971128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:37.975058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: 295d40b3-7e6b-4033-b688-46ce7fdcf48e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:37.983152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:37.984017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:37.985010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:37.985644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.001207 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] HTTP exception thrown: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e could not be found. Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Request method failure captured: Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e HTTP/1.1 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZSAoeUZq39H1nIkapFrnc9KAGoE8mSie1vWnpFh_Aa5rX1RlREg6OkjiZTLTKc0IJY6zg7RhGwCd1FsHS-GdOfr4RK6lmADJ0hMAvzh04PsvPWUlxlBNNa7PfT6TrsLMGdJFQaZOUPWUupovDvcNE41c6OC-Kijsuxsg4pRSIGVR4 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 3ef34a6d89d0462d8643be6625b114d9 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1664229506 Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:54:38.005734 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1664229506 Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 3ef34a6d89d0462d8643be6625b114d9 Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1664229506 Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersAdminNegativeTestJSON-1664229506-project Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 05553baaba2b4467abbb9ca58afcebd9 Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1664229506-project Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e could not be found. Jun 04 20:54:38.008245 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '295d40b3-7e6b-4033-b688-46ce7fdcf48e'} Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e could not be found. Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:38.008993 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e could not be found. Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e could not be found. Jun 04 20:54:38.010196 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:38.014309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Returning 404 to user: Instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:38.016547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a98d592-b6f5-4459-a367-36defa7160aa tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e" status: 404 len: 111 microversion: 2.1 time: 0.055899 Jun 04 20:54:38.017812 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 293/595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:37 2022] GET /compute/v2.1/servers/295d40b3-7e6b-4033-b688-46ce7fdcf48e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:54:38.032828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:38.033820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:38.049669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.052473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.055371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.056550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.244325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:38.314107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b35e61d-d446-423d-87af-69426d64349e tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1587 microversion: 2.1 time: 0.542139 Jun 04 20:54:38.325486 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 303/596] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:37 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1587 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:38.339098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-49655207-2865-43f2-a1a0-e09df313faea req-0281edc7-0e10-4873-8fd3-dcfc3713c7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "295d40b3-7e6b-4033-b688-46ce7fdcf48e", "name": "network-vif-deleted", "tag": "72a9c015-9834-4eec-886f-01ee0faaa615"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:38.360433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-49655207-2865-43f2-a1a0-e09df313faea req-0281edc7-0e10-4873-8fd3-dcfc3713c7bf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.366786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-49655207-2865-43f2-a1a0-e09df313faea req-0281edc7-0e10-4873-8fd3-dcfc3713c7bf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.425915 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-49655207-2865-43f2-a1a0-e09df313faea req-0281edc7-0e10-4873-8fd3-dcfc3713c7bf service nova] Creating event network-vif-deleted:72a9c015-9834-4eec-886f-01ee0faaa615 for instance 295d40b3-7e6b-4033-b688-46ce7fdcf48e on nch2-master-1 Jun 04 20:54:38.438821 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-49655207-2865-43f2-a1a0-e09df313faea req-0281edc7-0e10-4873-8fd3-dcfc3713c7bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111467 Jun 04 20:54:38.440457 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 304/597] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:38.446129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:38.446980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:38.455026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.455756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.456689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.457272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.822165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:38.838204 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a35185d6-c71b-4e14-8653-7e9031955b83 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1403 microversion: 2.1 time: 0.816120 Jun 04 20:54:38.852277 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 294/598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:38 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1403 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:38.862634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:38.865130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:38.884114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.884114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.888059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:38.895778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:38.946457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lazy-loading 'flavor' on Instance uuid a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:54:39.038030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:39.051605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26089352-65d5-4fdd-bc0c-65fa89e9d1c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.609660 Jun 04 20:54:39.061420 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 305/599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:38 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:39.196675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:39.356325 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db2dbd84-8224-4f96-b5cc-bb8f1fd16213 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac/action" status: 202 len: 0 microversion: 2.1 time: 0.502359 Jun 04 20:54:39.356977 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 295/600] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:38 2022] POST /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:39.393356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e889c3e-15f3-49ed-9c35-874c18125242 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Action: 'create', calling method: .version_select at 0x7f2d029423a0>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:39.459992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:39.460610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:39.474208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:39.474666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:39.478492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:39.489951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.161160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-afe62963-4510-45e3-a80c-8448aa283be0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1618 microversion: 2.1 time: 1.102696 Jun 04 20:54:40.164015 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 306/601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:39 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1618 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:40.170960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:40.175228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:40.182010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.182710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.183715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.190191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.245429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:54:40.353397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-90b3c996-be30-473e-a1df-4bea43644a8e tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 204 len: 0 microversion: 2.1 time: 0.187547 Jun 04 20:54:40.359166 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 307/602] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:54:40 2022] DELETE /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:54:40.371640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e54a63ea-b376-4212-adfd-b631296ac7c7 req-6f1b16e2-844c-4638-993c-0a3e0f3c3da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77800c5-96da-4b7f-8b6a-76dbf40b4ba9", "name": "network-vif-plugged", "status": "completed", "tag": "04917853-faab-4547-80ad-fc7871874d25"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:40.384044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e54a63ea-b376-4212-adfd-b631296ac7c7 req-6f1b16e2-844c-4638-993c-0a3e0f3c3da3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.384899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e54a63ea-b376-4212-adfd-b631296ac7c7 req-6f1b16e2-844c-4638-993c-0a3e0f3c3da3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.402965 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e54a63ea-b376-4212-adfd-b631296ac7c7 req-6f1b16e2-844c-4638-993c-0a3e0f3c3da3 service nova] Creating event network-vif-plugged:04917853-faab-4547-80ad-fc7871874d25 for instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 on nch1-master-1 Jun 04 20:54:40.411843 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e54a63ea-b376-4212-adfd-b631296ac7c7 req-6f1b16e2-844c-4638-993c-0a3e0f3c3da3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053206 Jun 04 20:54:40.412644 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 308/603] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:40.419046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:40.419907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:40.427877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.428354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.429140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.429758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.633992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:40.645859 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a22315a-86f6-4034-804d-a8ee93e2cf42 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1459 microversion: 2.1 time: 0.232113 Jun 04 20:54:40.647194 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 309/604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:40 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1459 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:40.652788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:40.654191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:40.664313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.665063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.666503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.667995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.897174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:40.905738 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6cb0f38d-6e33-4b5b-8ac2-a241802002d2 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1403 microversion: 2.1 time: 0.256962 Jun 04 20:54:40.911266 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 310/605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:40 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1403 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:40.920641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:40.921267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:40.927388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.927923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:40.928706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:40.929157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:41.156889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:41.165866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54370bc9-8600-4f20-bf3f-98ba0be61648 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.251197 Jun 04 20:54:41.172366 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 311/606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:40 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:41.172366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e49d3a6-0a23-40f8-84d9-7be582ce5a3b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: .version_select at 0x7f2d027f79d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-977583635", "policies": ["affinity"]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:41.193588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1e49d3a6-0a23-40f8-84d9-7be582ce5a3b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:41.199755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1e49d3a6-0a23-40f8-84d9-7be582ce5a3b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:41.212232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:41.249849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:41.263685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1e49d3a6-0a23-40f8-84d9-7be582ce5a3b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:41.270425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1e49d3a6-0a23-40f8-84d9-7be582ce5a3b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:41.293779 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e49d3a6-0a23-40f8-84d9-7be582ce5a3b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.125612 Jun 04 20:54:41.294838 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 312/607] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 20:54:41 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:41.304607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:41.304607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:41.316934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:41.318096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:41.320430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:41.321335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:41.597254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:41.611036 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b1f7364-54f5-459d-ab8b-974b7bdd390f tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1478 microversion: 2.1 time: 0.312117 Jun 04 20:54:41.612369 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 313/608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:41 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1478 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:41.623116 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e889c3e-15f3-49ed-9c35-874c18125242 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.257082 Jun 04 20:54:41.624407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-271b19eb-c9e8-4beb-89d7-b8ebbda43224 req-5cbb95c4-bef8-4094-a422-15e5f2f09a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f994823a-4d87-426d-9673-d598a15b6ae2", "name": "network-vif-unplugged", "status": "completed", "tag": "446b0ce5-8246-4b96-8079-6b17063c7982"}, {"name": "network-changed", "server_uuid": "f994823a-4d87-426d-9673-d598a15b6ae2", "tag": "446b0ce5-8246-4b96-8079-6b17063c7982"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:41.626124 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 296/609] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:54:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:41.636343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-271b19eb-c9e8-4beb-89d7-b8ebbda43224 req-5cbb95c4-bef8-4094-a422-15e5f2f09a10 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:41.636914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-271b19eb-c9e8-4beb-89d7-b8ebbda43224 req-5cbb95c4-bef8-4094-a422-15e5f2f09a10 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:41.642238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:41.643875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:41.655745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:41.656636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:41.657182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-271b19eb-c9e8-4beb-89d7-b8ebbda43224 req-5cbb95c4-bef8-4094-a422-15e5f2f09a10 service nova] Creating event network-vif-unplugged:446b0ce5-8246-4b96-8079-6b17063c7982 for instance f994823a-4d87-426d-9673-d598a15b6ae2 on nch1-master-1 Jun 04 20:54:41.657724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:41.657838 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-271b19eb-c9e8-4beb-89d7-b8ebbda43224 req-5cbb95c4-bef8-4094-a422-15e5f2f09a10 service nova] Creating event network-changed:446b0ce5-8246-4b96-8079-6b17063c7982 for instance f994823a-4d87-426d-9673-d598a15b6ae2 on nch1-master-1 Jun 04 20:54:41.658288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:41.662884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-271b19eb-c9e8-4beb-89d7-b8ebbda43224 req-5cbb95c4-bef8-4094-a422-15e5f2f09a10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.048696 Jun 04 20:54:41.663764 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 314/610] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:41.668874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-874146189", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "932e20d9-0edf-44f8-acb6-b6bf58404713"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:41.724944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:54:42.490833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:54:42.493435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:54:42.495185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:54:42.495925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:54:42.497697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:54:42.545104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:42.545870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:42.547385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:42.547934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:42.572073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:42.579556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:42.594218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Going to run 2 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:54:42.596866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:42.632133 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9bf3e253-f9e2-4109-ba94-91b50ae2805a tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1610 microversion: 2.1 time: 1.002682 Jun 04 20:54:42.650857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 297/611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:41 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1610 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:42.665356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2a21ffe-7683-4225-ab92-c44fa0e5971d tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d029fc040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:42.688828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137228) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 04 20:54:42.716513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:42.722699 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:42.776794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:42.782589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:42.800036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=0e371596-f73e-48de-aab1-77cbf45388e4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:42.858099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:42.864396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:42.905270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:42.910666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:42.949914 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2139b025-d9b6-47cd-b66d-d05ce4fec254 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.284953 Jun 04 20:54:42.950542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 315/612] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:54:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1286 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 04 20:54:42.957948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:42.958574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:42.969159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:42.969669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:42.970461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:42.970905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:42.992668 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e2a21ffe-7683-4225-ab92-c44fa0e5971d tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/401fe465-e75e-47f5-9800-1a13fd2a4ae1" status: 200 len: 142 microversion: 2.1 time: 0.337921 Jun 04 20:54:42.993560 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 298/613] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 20:54:42 2022] GET /compute/v2.1/os-floating-ips/401fe465-e75e-47f5-9800-1a13fd2a4ae1 => generated 142 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:43.003444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:43.004322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:43.019409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.023350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.024463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.026250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.277887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:43.294008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:43.299000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff175ffd-1ea6-40df-9007-e0317b1b4665 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1591 microversion: 2.1 time: 0.346736 Jun 04 20:54:43.299878 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 316/614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:42 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1591 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:43.306305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:43.307007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:43.316665 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85027699-4dea-46e2-864e-6fdf5ae71d55 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.318488 Jun 04 20:54:43.317138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.317138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.317596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.317877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.318752 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 299/615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:42 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:43.341214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee0d693e-006f-4106-b27e-37aba54a0898 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:43.343525 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:54:43.343525 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:54:43.345297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee0d693e-006f-4106-b27e-37aba54a0898 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.348630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee0d693e-006f-4106-b27e-37aba54a0898 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.349586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee0d693e-006f-4106-b27e-37aba54a0898 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.349985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee0d693e-006f-4106-b27e-37aba54a0898 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.399755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ee0d693e-006f-4106-b27e-37aba54a0898 tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.069117 Jun 04 20:54:43.400433 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 300/616] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:54:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:43.404656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.408674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.409606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lazy-loading 'fault' on Instance uuid ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:54:43.412820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:43.416763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:43.423158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Searching by: {'deleted': False, 'project_id': '007f08ee799d431fb8d18c31dd5991e0'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:54:43.465516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.466351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.467537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.468598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.496390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05553baaba2b4467abbb9ca58afcebd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ef34a6d89d0462d8643be6625b114d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:43.506517 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d18576e-b0fd-4ffd-b237-7fe2aee6ca51 tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 200 len: 1312 microversion: 2.1 time: 0.205436 Jun 04 20:54:43.514929 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 317/617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:43 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:43.514929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-698a532f-c424-4aa0-b309-9a2e873e797c tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d0272fd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:43.648362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:54:43.837042 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c1dc3b86-d007-4b44-99c1-360ea7476551 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.433408 Jun 04 20:54:43.850653 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 301/618] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 20:54:43 2022] GET /compute/v2.1/servers => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:43.865018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-55c279a7-e7b5-4381-b240-0f964cc2b648 req-dc831d61-8bd3-4382-b1e7-96d8fe017bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceff7c9e-d21b-4b51-8ac5-800163fd0cf6", "name": "network-vif-deleted", "tag": "f990d591-ed16-442f-b0c2-92689eb89908"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:43.886903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-55c279a7-e7b5-4381-b240-0f964cc2b648 req-dc831d61-8bd3-4382-b1e7-96d8fe017bfb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.887580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-55c279a7-e7b5-4381-b240-0f964cc2b648 req-dc831d61-8bd3-4382-b1e7-96d8fe017bfb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.912528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-55c279a7-e7b5-4381-b240-0f964cc2b648 req-dc831d61-8bd3-4382-b1e7-96d8fe017bfb service nova] Creating event network-vif-deleted:f990d591-ed16-442f-b0c2-92689eb89908 for instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 on nch2-master-1 Jun 04 20:54:43.924940 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-55c279a7-e7b5-4381-b240-0f964cc2b648 req-dc831d61-8bd3-4382-b1e7-96d8fe017bfb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071567 Jun 04 20:54:43.926842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 302/619] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:43.940353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:43.942375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:43.956390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.962658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:43.974929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:43.976460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:44.213463 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0c84b0b-b1aa-4dc0-86dd-4ad7491803ae tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.284986 Jun 04 20:54:44.220452 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 303/620] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:54:43 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:44.228769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:44.229891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:44.236813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:44.237280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:44.238067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:44.238686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:44.604895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Lazy-loading 'flavor' on Instance uuid a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:54:44.651608 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac while it is in vm_state suspended Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Request method failure captured: Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac/action HTTP/1.1 Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 97 Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZaIx6axeE4ACdLTzZYmvDNNG0kkjY4WDZhr8YAldVd4LRqTgudVLtV7CCvyhF6vr0Yme9BnicbW4jjJp-Qal22WUtRwzFaUFP0OSZlxV-vdR1CKoHJtIDqfkJ9f_DGWi1iQP_JFLTtKq0nKkcpBVdJPb9PtXr0XVdWOrD782L-oEM Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 00850f9935c54861ac162b84570e1213 Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-LiveMigrationNegativeTest-1771119596 Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 20:54:44.656180 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_00850f9935c54861ac162b84570e1213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/00850f9935c54861ac162b84570e1213"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/00850f9935c54861ac162b84570e1213"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/00850f9935c54861ac162b84570e1213"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-LiveMigrationNegativeTest-1771119596 Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 00850f9935c54861ac162b84570e1213 Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1771119596 Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-LiveMigrationNegativeTest-1771119596-project-admin Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 09b153e10d99483cbd0a5d0cba215739 Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-LiveMigrationNegativeTest-1771119596-project-admin Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Jun 04 20:54:44.657715 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: exception: Cannot 'os-migrateLive' instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac while it is in vm_state suspended Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 04 20:54:44.658471 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:44.659602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac while it is in vm_state suspended Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac while it is in vm_state suspended Jun 04 20:54:44.661058 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:44.662079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac while it is in vm_state suspended {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:44.662079 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c2e3289-109e-4ba3-b59e-043c50d19d9f tempest-LiveMigrationNegativeTest-1771119596 tempest-LiveMigrationNegativeTest-1771119596-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac/action" status: 409 len: 155 microversion: 2.1 time: 0.442581 Jun 04 20:54:44.668986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 304/621] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:54:44 2022] POST /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac/action => generated 155 bytes in 453 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:54:44.679930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:44.681864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:44.717196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:44.718115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:44.719193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:44.721033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:44.807040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:44.819482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0785e1bd-2708-4edc-84b5-160103331c14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1270 microversion: 2.1 time: 0.146622 Jun 04 20:54:44.826912 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 305/622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:44 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:44.831583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:44.831855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:44.845287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:44.845932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:44.847626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:44.848172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:45.138304 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-698a532f-c424-4aa0-b309-9a2e873e797c tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/401fe465-e75e-47f5-9800-1a13fd2a4ae1" status: 202 len: 0 microversion: 2.1 time: 1.629993 Jun 04 20:54:45.140774 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 318/623] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:54:43 2022] DELETE /compute/v2.1/os-floating-ips/401fe465-e75e-47f5-9800-1a13fd2a4ae1 => generated 0 bytes in 1633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:45.150631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:45.151784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] [instance: ceff7c9e-d21b-4b51-8ac5-800163fd0cf6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:45.162128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:45.163005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:45.164315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:45.164970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:45.185570 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] HTTP exception thrown: Instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 could not be found. Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Request method failure captured: Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 HTTP/1.1 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZSAoeUZq39H1nIkapFrnc9KAGoE8mSie1vWnpFh_Aa5rX1RlREg6OkjiZTLTKc0IJY6zg7RhGwCd1FsHS-GdOfr4RK6lmADJ0hMAvzh04PsvPWUlxlBNNa7PfT6TrsLMGdJFQaZOUPWUupovDvcNE41c6OC-Kijsuxsg4pRSIGVR4 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 3ef34a6d89d0462d8643be6625b114d9 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1664229506 Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:54:45.190295 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ef34a6d89d0462d8643be6625b114d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1664229506 Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 3ef34a6d89d0462d8643be6625b114d9 Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1664229506 Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-1664229506-project Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 05553baaba2b4467abbb9ca58afcebd9 Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1664229506-project Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 could not be found. Jun 04 20:54:45.191857 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ceff7c9e-d21b-4b51-8ac5-800163fd0cf6'} Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 could not be found. Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:45.192654 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 could not be found. Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 could not be found. Jun 04 20:54:45.195185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:45.200988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] Returning 404 to user: Instance ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:45.203218 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f54e0e0c-453c-4974-89bb-188a9bbe310c tempest-ServersAdminNegativeTestJSON-1664229506 tempest-ServersAdminNegativeTestJSON-1664229506-project] 10.222.0.18 "GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6" status: 404 len: 111 microversion: 2.1 time: 0.061029 Jun 04 20:54:45.205143 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 319/624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:45 2022] GET /compute/v2.1/servers/ceff7c9e-d21b-4b51-8ac5-800163fd0cf6 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:54:45.219024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:45.233667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:45.234597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:45.238085 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-86b6fd2a-de4a-4ed5-85b9-0c7386920d65 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.415508 Jun 04 20:54:45.243846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:45.244706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:45.245792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:45.247165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:45.276178 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 306/625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:44 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:45.288421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b649b8bf-7db4-4619-ac04-21c908d1a2e0 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d02942550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:45.293642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:54:45.369458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:45.453719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:45.498671 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35eb9af3-fd4b-491c-8b44-e8b0c4229d1b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 204 len: 0 microversion: 2.1 time: 0.290541 Jun 04 20:54:45.501126 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 320/626] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:54:45 2022] DELETE /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:54:45.517180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:45.518154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:45.539283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:45.539283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:45.557321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:45.562538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:46.064685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b649b8bf-7db4-4619-ac04-21c908d1a2e0 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.787287 Jun 04 20:54:46.074961 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 307/627] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Jun 4 20:54:45 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:54:46.101386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:46.104015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:46.138739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:46.143236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:46.146279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:46.148810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:46.254666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:46.274671 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9ec56fc7-cf17-4a3d-8123-e905e242511e tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1465 microversion: 2.1 time: 0.767046 Jun 04 20:54:46.275465 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 321/628] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:45 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1465 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:46.283206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc8cb423-dc08-4202-8896-ef301df71d56 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d0265c670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:46.378807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:46.387953 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7166aab6-b6d6-492a-a751-61ca58d12e27 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1276 microversion: 2.1 time: 0.310461 Jun 04 20:54:46.396842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 308/629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:46 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:46.406084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:46.408294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:46.415151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:46.416250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:46.417268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:46.426721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:47.016684 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc8cb423-dc08-4202-8896-ef301df71d56 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.739118 Jun 04 20:54:47.018250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 322/630] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:54:46 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:47.024637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:47.025604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:47.048384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:47.049591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:47.050663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:47.051283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:47.193683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:47.207552 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c5c8cbe3-6537-4244-a863-e174ba766e79 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.807252 Jun 04 20:54:47.222753 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 309/631] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:46 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:47.237827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-cc003c59-70c6-47ff-8637-b3aca797502c req-2e8a74b9-51b5-4175-9bce-93bfddd21cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77800c5-96da-4b7f-8b6a-76dbf40b4ba9", "tag": "04917853-faab-4547-80ad-fc7871874d25"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:47.260599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cc003c59-70c6-47ff-8637-b3aca797502c req-2e8a74b9-51b5-4175-9bce-93bfddd21cf0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:47.260599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cc003c59-70c6-47ff-8637-b3aca797502c req-2e8a74b9-51b5-4175-9bce-93bfddd21cf0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:47.296145 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-cc003c59-70c6-47ff-8637-b3aca797502c req-2e8a74b9-51b5-4175-9bce-93bfddd21cf0 service nova] Creating event network-changed:04917853-faab-4547-80ad-fc7871874d25 for instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 on nch1-master-1 Jun 04 20:54:47.319246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-cc003c59-70c6-47ff-8637-b3aca797502c req-2e8a74b9-51b5-4175-9bce-93bfddd21cf0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091680 Jun 04 20:54:47.321263 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 310/632] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:47.336021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92b8857d-87cb-4b33-a8bd-9c3b5ea9a9ce tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d02af8430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:47.714866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:47.727885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26885f8f-c658-4701-8c2c-8cf9d1ae8995 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1591 microversion: 2.1 time: 0.706244 Jun 04 20:54:47.745052 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 323/633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:47 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1591 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:47.764501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:47.765591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:47.789472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:47.790150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:47.791118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:47.791837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:49.018601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:49.033805 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae055515-d4be-41be-96e7-5ed1035bebab tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 200 len: 1465 microversion: 2.1 time: 1.286533 Jun 04 20:54:49.034905 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 324/634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:47 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 1465 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:49.039976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:49.040947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:49.056381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:49.056845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:49.057842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:49.059142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:50.021458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:50.034845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d886d24a-661d-48ad-8bea-08a4e744f6a9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 0.998518 Jun 04 20:54:50.050077 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 325/635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:49 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:50.062864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:50.064070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:50.075857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:50.076384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:50.077198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:50.078205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:51.008736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:51.028877 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0059ad5a-1e3c-4cb5-aca1-3a64ed3915c1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.968199 Jun 04 20:54:51.047074 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 326/636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:50 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:51.063439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3b1e526a-4d68-4668-9246-8168b9c285b4 req-e1bfd9e9-6039-4655-9b53-c7070e3971a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac", "name": "network-vif-deleted", "tag": "4e098232-9c04-4472-b736-c04eceeed1cc"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:51.075332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b1e526a-4d68-4668-9246-8168b9c285b4 req-e1bfd9e9-6039-4655-9b53-c7070e3971a3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:51.078129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b1e526a-4d68-4668-9246-8168b9c285b4 req-e1bfd9e9-6039-4655-9b53-c7070e3971a3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:51.107371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3b1e526a-4d68-4668-9246-8168b9c285b4 req-e1bfd9e9-6039-4655-9b53-c7070e3971a3 service nova] Creating event network-vif-deleted:4e098232-9c04-4472-b736-c04eceeed1cc for instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac on nch1-master-1 Jun 04 20:54:51.120448 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3b1e526a-4d68-4668-9246-8168b9c285b4 req-e1bfd9e9-6039-4655-9b53-c7070e3971a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071544 Jun 04 20:54:51.121483 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 327/637] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:51.133732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:51.135153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:51.146268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:51.147887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:51.155830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:51.156691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:51.174133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] HTTP exception thrown: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac could not be found. Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Request method failure captured: Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac HTTP/1.1 Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZXfRTzCdDi4tylWnFpjnHOBevjK4FhNQVhyKIhzrqaeGaWdb0qABHqDlIloa30vSxLap6ml7vTwoUN4hlViPns_Bv-rJmfG5HQHxhSeSVnO1U6pWKkNg70J41a3wS1QZf2YboG8SS9HtAEzGjgL_jyko7irctOOp5_S5-LLMCiCOk Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 55d1f67de5f9427bae166a10a5edff26 Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveMigrationNegativeTest-1343945013 Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:54:51.176254 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveMigrationNegativeTest-1343945013 Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 55d1f67de5f9427bae166a10a5edff26 Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1343945013 Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveMigrationNegativeTest-1343945013-project Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 859de04797504bcbb5134dba5c8183a5 Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveMigrationNegativeTest-1343945013-project Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac could not be found. Jun 04 20:54:51.177624 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac'} Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac could not be found. Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:51.178481 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac could not be found. Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac could not be found. Jun 04 20:54:51.179809 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:51.183341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Returning 404 to user: Instance a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:51.184465 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-455ec7cf-f683-45f5-9529-8765f3906c0c tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac" status: 404 len: 111 microversion: 2.1 time: 0.061478 Jun 04 20:54:51.185732 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 328/638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:51 2022] GET /compute/v2.1/servers/a4db22fe-4cb9-4b0b-a63f-ddb4c02105ac => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:54:51.192768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:51.198507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:51.206465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:51.207315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:51.208440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:51.209092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.170173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:52.215348 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59ab3e3a-c3a3-487a-ab1c-46c2d5e48ec5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 1.028225 Jun 04 20:54:52.220055 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 329/639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:51 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:52.225195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:52.228551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:52.246726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:52.249523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.250504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:52.260341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.321236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:54:52.449650 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92b8857d-87cb-4b33-a8bd-9c3b5ea9a9ce tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/ff744bff-ca3d-4148-9090-2d514c053ba4" status: 202 len: 0 microversion: 2.1 time: 5.126944 Jun 04 20:54:52.451339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 311/640] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:54:47 2022] DELETE /compute/v2.1/os-floating-ips/ff744bff-ca3d-4148-9090-2d514c053ba4 => generated 0 bytes in 5130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:52.460342 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14cca35f-c95f-4482-920f-bd90cc1c8fb9 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 204 len: 0 microversion: 2.1 time: 0.238496 Jun 04 20:54:52.465829 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 330/641] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:54:52 2022] DELETE /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:54:52.467445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:52.468206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:52.475836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:52.476293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.477279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:52.477724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.561799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:52.630201 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d1a4440-becc-4d93-ade4-1a9a72263afb tempest-TenantUsagesNegativeTestJSON-1259512281 tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-03T20%3A54%3A51.845772&end=2022-06-05T20%3A54%3A51.845772" status: 404 len: 112 microversion: - time: 0.176962 Jun 04 20:54:52.638358 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 312/642] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Jun 4 20:54:52 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-03T20%3A54%3A51.845772&end=2022-06-05T20%3A54%3A51.845772 => generated 112 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 20:54:52.645837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1222a69d-b666-4d93-8f63-15f3f662ca10 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d02b1e5e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:52.841405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:52.850087 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2bfb426a-080c-408f-96f0-ac2a63adb3d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1503 microversion: 2.1 time: 0.387649 Jun 04 20:54:52.852718 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 331/643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:52 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1503 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:52.858124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:52.858946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:52.866733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:52.867193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.868027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:52.868675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:52.920862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=30 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:53.314299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:53.323439 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e506ad4-697a-4c8b-8ede-ff34de404e97 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1474 microversion: 2.1 time: 0.469061 Jun 04 20:54:53.331306 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 332/644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:52 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1474 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:53.336354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44734a29-8c26-4584-9b62-4b4cde15b067 tempest-TenantUsagesNegativeTestJSON-1259512281 tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin] Calling method '.version_select at 0x7f2d0262fee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:53.340901 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-44734a29-8c26-4584-9b62-4b4cde15b067 tempest-TenantUsagesNegativeTestJSON-1259512281 tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44734a29-8c26-4584-9b62-4b4cde15b067 tempest-TenantUsagesNegativeTestJSON-1259512281 tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin] Request method failure captured: Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-simple-tenant-usage/909ca001b6524880a206dfe2ccfe7c43?start=2022-06-05T20%3A54%3A51.845772&end=2022-06-03T20%3A54%3A51.845772 HTTP/1.1 Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8abkQLy2LUw5CwFUiBa1gGSH-mc3KMjf-j-LoQwr8vNY_1t6oglGblr-CLnBAkH5U8YAjKpARJap-d9SYg_pozee-SBdmKn0sXUcoNVR4lHuS217rm78oaZkurhUrlgOKm0Nf3u1a0ffsOh7Ldm5Gkcs3gLkjh6JD-MkVNC6a4kgqw Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 52629a4e1ca2403098b9fd8e5e8821e7 Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1259512281 Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:54:53.342784 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_52629a4e1ca2403098b9fd8e5e8821e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52629a4e1ca2403098b9fd8e5e8821e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/52629a4e1ca2403098b9fd8e5e8821e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/52629a4e1ca2403098b9fd8e5e8821e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1259512281 Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 52629a4e1ca2403098b9fd8e5e8821e7 Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1259512281 Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 8614c60c652a40ab930cb1f5ebcba0d5 Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid start time. The start time cannot occur after the end time. Jun 04 20:54:53.344690 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '909ca001b6524880a206dfe2ccfe7c43'} Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 04 20:54:53.345465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:53.347009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44734a29-8c26-4584-9b62-4b4cde15b067 tempest-TenantUsagesNegativeTestJSON-1259512281 tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:53.356474 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-44734a29-8c26-4584-9b62-4b4cde15b067 tempest-TenantUsagesNegativeTestJSON-1259512281 tempest-TenantUsagesNegativeTestJSON-1259512281-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/909ca001b6524880a206dfe2ccfe7c43?start=2022-06-05T20%3A54%3A51.845772&end=2022-06-03T20%3A54%3A51.845772" status: 400 len: 111 microversion: 2.1 time: 0.023636 Jun 04 20:54:53.357059 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 333/645] 10.222.0.18 () {58 vars in 1411 bytes} [Sat Jun 4 20:54:53 2022] GET /compute/v2.1/os-simple-tenant-usage/909ca001b6524880a206dfe2ccfe7c43?start=2022-06-05T20%3A54%3A51.845772&end=2022-06-03T20%3A54%3A51.845772 => generated 111 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:54:53.367886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-09763d24-69b7-4aa3-af4e-28d08edbe5f7 req-5aad895c-a5aa-405b-8704-6b74949ea430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87206a05-9a22-451a-9215-ab44a3fbd388", "tag": "eb4a45ef-67fc-4c08-9e57-4ae0953af300"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:53.386638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-09763d24-69b7-4aa3-af4e-28d08edbe5f7 req-5aad895c-a5aa-405b-8704-6b74949ea430 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:53.388537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-09763d24-69b7-4aa3-af4e-28d08edbe5f7 req-5aad895c-a5aa-405b-8704-6b74949ea430 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:53.402266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-09763d24-69b7-4aa3-af4e-28d08edbe5f7 req-5aad895c-a5aa-405b-8704-6b74949ea430 service nova] Creating event network-changed:eb4a45ef-67fc-4c08-9e57-4ae0953af300 for instance 87206a05-9a22-451a-9215-ab44a3fbd388 on nch2-master-1 Jun 04 20:54:53.408127 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-09763d24-69b7-4aa3-af4e-28d08edbe5f7 req-5aad895c-a5aa-405b-8704-6b74949ea430 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043664 Jun 04 20:54:53.411914 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 334/646] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:53.417418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:53.418442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:53.426215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:53.426959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:53.427947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:53.428539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:53.540895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:54.006581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:54.019138 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1dbf2686-03f9-46ca-ab75-cc0eabb883e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 0.605516 Jun 04 20:54:54.032371 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 335/647] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:53 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:54.274505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4dfb7c64-f9a0-42dc-b484-eecca32ea678 tempest-TenantUsagesNegativeTestJSON-1059599754 tempest-TenantUsagesNegativeTestJSON-1059599754-project] Calling method '.version_select at 0x7f2d0262f3a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:54.277730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4dfb7c64-f9a0-42dc-b484-eecca32ea678 tempest-TenantUsagesNegativeTestJSON-1059599754 tempest-TenantUsagesNegativeTestJSON-1059599754-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '05e7dbe556db4492ae035998db29fdab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909ca001b6524880a206dfe2ccfe7c43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4dfb7c64-f9a0-42dc-b484-eecca32ea678 tempest-TenantUsagesNegativeTestJSON-1059599754 tempest-TenantUsagesNegativeTestJSON-1059599754-project] Request method failure captured: Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-03T20%3A54%3A51.845772&end=2022-06-05T20%3A54%3A51.845772&detailed=1 HTTP/1.1 Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8aaaU1FhRHd7nPQSH6cR75m9HSSIMTwoFTGmMnB0bywRMYO7Z9KggyqZZuPuLUYhLAD7at1f45x9Hfsy_jr1Vk4V7InmuL-FvIvDzgmblOazxUS_nmHZHlFQLI0WhLKC17ZdZm1FegiTVV-84OE91Vrg5r76ONkEKnzGdZ9pxfsmuc Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 909ca001b6524880a206dfe2ccfe7c43 Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1059599754 Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:54:54.283860 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_909ca001b6524880a206dfe2ccfe7c43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/909ca001b6524880a206dfe2ccfe7c43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/909ca001b6524880a206dfe2ccfe7c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/909ca001b6524880a206dfe2ccfe7c43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1059599754 Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 909ca001b6524880a206dfe2ccfe7c43 Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1059599754 Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TenantUsagesNegativeTestJSON-1059599754-project Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 05e7dbe556db4492ae035998db29fdab Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1059599754-project Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 20:54:54.285632 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:54:54.290586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:54:54.292113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:54:54.293586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 04 20:54:54.293586 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:54:54.293586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4dfb7c64-f9a0-42dc-b484-eecca32ea678 tempest-TenantUsagesNegativeTestJSON-1059599754 tempest-TenantUsagesNegativeTestJSON-1059599754-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:54.293586 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4dfb7c64-f9a0-42dc-b484-eecca32ea678 tempest-TenantUsagesNegativeTestJSON-1059599754 tempest-TenantUsagesNegativeTestJSON-1059599754-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-03T20%3A54%3A51.845772&end=2022-06-05T20%3A54%3A51.845772&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.252052 Jun 04 20:54:54.293586 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 336/648] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jun 4 20:54:54 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-03T20%3A54%3A51.845772&end=2022-06-05T20%3A54%3A51.845772&detailed=1 => generated 123 bytes in 254 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:54:54.298290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-8346f01a-45fd-449e-b48e-d61c0bdc2bb7 req-5d9ea9a1-5c11-4956-aadc-f9d0ef7a465c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e371596-f73e-48de-aab1-77cbf45388e4", "tag": "7ea111fa-e59f-4092-8352-7af47d7965ee"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:54.332371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8346f01a-45fd-449e-b48e-d61c0bdc2bb7 req-5d9ea9a1-5c11-4956-aadc-f9d0ef7a465c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:54.333001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8346f01a-45fd-449e-b48e-d61c0bdc2bb7 req-5d9ea9a1-5c11-4956-aadc-f9d0ef7a465c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:54.354707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-8346f01a-45fd-449e-b48e-d61c0bdc2bb7 req-5d9ea9a1-5c11-4956-aadc-f9d0ef7a465c service nova] Creating event network-changed:7ea111fa-e59f-4092-8352-7af47d7965ee for instance 0e371596-f73e-48de-aab1-77cbf45388e4 on nch2-master-1 Jun 04 20:54:54.364410 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-8346f01a-45fd-449e-b48e-d61c0bdc2bb7 req-5d9ea9a1-5c11-4956-aadc-f9d0ef7a465c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073134 Jun 04 20:54:54.368803 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 337/649] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:54.384058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:54.398373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:54.417262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:54.417716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:54.418519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:54.418961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:54.917329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:54.931111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ef9d93b-fb97-4af6-9491-2eebba2d45ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1493 microversion: 2.1 time: 0.560704 Jun 04 20:54:54.934101 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 338/650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:54 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1493 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:54.940375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:54.941295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:54.956907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:54.957715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:54.971466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:54.972373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:55.175074 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1222a69d-b666-4d93-8f63-15f3f662ca10 tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/40ca24c9-8988-4603-a2a8-71b446194ee5" status: 202 len: 0 microversion: 2.1 time: 2.534458 Jun 04 20:54:55.179053 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 313/651] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:54:52 2022] DELETE /compute/v2.1/os-floating-ips/40ca24c9-8988-4603-a2a8-71b446194ee5 => generated 0 bytes in 2536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:55.185064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7a50b1f4-3bd2-4334-bb61-2e98767b3cf7 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '.version_select at 0x7f2d029fcd30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:55.189699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a50b1f4-3bd2-4334-bb61-2e98767b3cf7 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:55.194534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a50b1f4-3bd2-4334-bb61-2e98767b3cf7 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:55.234015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7a50b1f4-3bd2-4334-bb61-2e98767b3cf7 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.056575 Jun 04 20:54:55.235546 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 314/652] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:54:55 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:55.242337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:55.244148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:55.246648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:55.255271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:55.256102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:55.257144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:55.257728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:55.372501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859de04797504bcbb5134dba5c8183a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55d1f67de5f9427bae166a10a5edff26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:55.396180 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4169023-e62d-4c81-97ed-150117539578 tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 200 len: 1474 microversion: 2.1 time: 0.449101 Jun 04 20:54:55.397264 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 339/653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:54 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:55.402160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87409343-77b8-4172-90a6-e475b07ce66d tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] Calling method '.version_select at 0x7f2d0265c940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:55.662294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:55.672245 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5aed28f-2a49-4c4e-84f5-334e2b71d198 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 0.435357 Jun 04 20:54:55.672837 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 315/654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:55 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:55.687028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:55.695897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:55.715942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:55.717536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:55.722641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:55.723143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:56.919375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3ebd077-ea5d-471a-b0e3-653eaee61837 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 200 len: 1644 microversion: 2.1 time: 1.241522 Jun 04 20:54:56.923531 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 316/655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:55 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 1644 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:56.929604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:56.930574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] [instance: e626ec10-9545-4cd1-81a3-ee1fc3e39a68] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:56.942305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:56.943388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:56.944867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:56.946311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:56.967289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] HTTP exception thrown: Instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 could not be found. Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Request method failure captured: Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 HTTP/1.1 Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZXfRTzCdDi4tylWnFpjnHOBevjK4FhNQVhyKIhzrqaeGaWdb0qABHqDlIloa30vSxLap6ml7vTwoUN4hlViPns_Bv-rJmfG5HQHxhSeSVnO1U6pWKkNg70J41a3wS1QZf2YboG8SS9HtAEzGjgL_jyko7irctOOp5_S5-LLMCiCOk Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 55d1f67de5f9427bae166a10a5edff26 Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-LiveMigrationNegativeTest-1343945013 Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:54:56.969388 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/55d1f67de5f9427bae166a10a5edff26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-LiveMigrationNegativeTest-1343945013 Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 55d1f67de5f9427bae166a10a5edff26 Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1343945013 Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-LiveMigrationNegativeTest-1343945013-project Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 859de04797504bcbb5134dba5c8183a5 Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-LiveMigrationNegativeTest-1343945013-project Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 could not be found. Jun 04 20:54:56.970970 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e626ec10-9545-4cd1-81a3-ee1fc3e39a68'} Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 could not be found. Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:54:56.971954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 could not be found. Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 could not be found. Jun 04 20:54:56.973222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:54:56.975668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] Returning 404 to user: Instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:54:56.977035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce7268d9-f2b5-4dfd-a27d-a23c97d4c47b tempest-LiveMigrationNegativeTest-1343945013 tempest-LiveMigrationNegativeTest-1343945013-project] 10.222.0.18 "GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68" status: 404 len: 111 microversion: 2.1 time: 0.052017 Jun 04 20:54:56.978315 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 317/656] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:56 2022] GET /compute/v2.1/servers/e626ec10-9545-4cd1-81a3-ee1fc3e39a68 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:54:56.984171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-93654a2c-606a-4fa5-b5fd-d5ba45fa390b req-c049cd15-a197-4398-9093-831e8fef05d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e626ec10-9545-4cd1-81a3-ee1fc3e39a68", "name": "network-vif-deleted", "tag": "a39b98cf-ec8e-4d6e-a903-4bb66427ce87"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:56.999292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-93654a2c-606a-4fa5-b5fd-d5ba45fa390b req-c049cd15-a197-4398-9093-831e8fef05d2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:57.000024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-93654a2c-606a-4fa5-b5fd-d5ba45fa390b req-c049cd15-a197-4398-9093-831e8fef05d2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:57.019150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-93654a2c-606a-4fa5-b5fd-d5ba45fa390b req-c049cd15-a197-4398-9093-831e8fef05d2 service nova] Creating event network-vif-deleted:a39b98cf-ec8e-4d6e-a903-4bb66427ce87 for instance e626ec10-9545-4cd1-81a3-ee1fc3e39a68 on nch1-master-1 Jun 04 20:54:57.029998 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-93654a2c-606a-4fa5-b5fd-d5ba45fa390b req-c049cd15-a197-4398-9093-831e8fef05d2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049839 Jun 04 20:54:57.031096 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 318/657] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:57.038575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:57.039650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:57.049628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:57.050394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:57.052195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:57.052791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:57.334297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:57.346627 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae02dfa5-900a-4025-b35a-1bfc2fc0312d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 0.313919 Jun 04 20:54:57.357863 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 319/658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:57 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:57.374637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1579860108", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1c9de366-78f1-4170-a48a-3f63d1e5098e"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:57.475402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] validate_networks() for [('1c9de366-78f1-4170-a48a-3f63d1e5098e', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:54:57.629632 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87409343-77b8-4172-90a6-e475b07ce66d tempest-FloatingIPDetailsTestJSON-272456207 tempest-FloatingIPDetailsTestJSON-272456207-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/037c52e0-2534-4b68-86ec-cfca38d34a7a" status: 202 len: 0 microversion: 2.1 time: 2.231172 Jun 04 20:54:57.630210 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 340/659] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:54:55 2022] DELETE /compute/v2.1/os-floating-ips/037c52e0-2534-4b68-86ec-cfca38d34a7a => generated 0 bytes in 2232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:54:58.241660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-15e7450e-b38d-4910-bb98-67d60bee622f req-8d885b48-7ddc-4d19-9880-e488527e0e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87206a05-9a22-451a-9215-ab44a3fbd388", "name": "network-vif-plugged", "status": "completed", "tag": "eb4a45ef-67fc-4c08-9e57-4ae0953af300"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:54:58.261810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-15e7450e-b38d-4910-bb98-67d60bee622f req-8d885b48-7ddc-4d19-9880-e488527e0e4d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:58.263623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-15e7450e-b38d-4910-bb98-67d60bee622f req-8d885b48-7ddc-4d19-9880-e488527e0e4d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:58.306388 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-15e7450e-b38d-4910-bb98-67d60bee622f req-8d885b48-7ddc-4d19-9880-e488527e0e4d service nova] Creating event network-vif-plugged:eb4a45ef-67fc-4c08-9e57-4ae0953af300 for instance 87206a05-9a22-451a-9215-ab44a3fbd388 on nch2-master-1 Jun 04 20:54:58.324127 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-15e7450e-b38d-4910-bb98-67d60bee622f req-8d885b48-7ddc-4d19-9880-e488527e0e4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086151 Jun 04 20:54:58.330026 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 341/660] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:54:58.370687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:58.372493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:58.389072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:58.389525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:58.393009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:58.396572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:58.455906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:54:58.662019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:54:58.662608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:54:58.662924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:54:58.663343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:54:58.663808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:54:58.684044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:58.684765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:58.686010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:54:58.686639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:54:58.733303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:54:58.744421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for user ac8ef83fa94e4c9db70a0115cc867dfc and project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:54:58.781068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:54:58.784802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:54:58.894259 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a1294be-e143-44be-8dc0-64a2f3045cf7 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534731 Jun 04 20:54:58.896476 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 320/661] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:54:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:54:58.912634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4831720-40b4-48aa-82d9-324d423e23bc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:54:58.913515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b4831720-40b4-48aa-82d9-324d423e23bc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:54:59.061571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b4831720-40b4-48aa-82d9-324d423e23bc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:59.072843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4831720-40b4-48aa-82d9-324d423e23bc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1211 microversion: 2.1 time: 0.168413 Jun 04 20:54:59.088394 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 321/662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:58 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:54:59.097152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:54:59.131018 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0a449d88-1472-444c-bad5-c8087a26a534 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 0.769987 Jun 04 20:54:59.140751 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 342/663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:54:58 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:00.091143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:00.092177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:00.125300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:00.125851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:00.126722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:00.127112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:00.155619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:00.156451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:00.174992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:00.183879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:00.188734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:00.194627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:00.414411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:00.427589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:00.438265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d9177be2-b9f8-40f3-ae69-289a15783a12 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1263 microversion: 2.1 time: 0.351973 Jun 04 20:55:00.449056 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 322/664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:00 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1263 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:00.458102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8985b1b2-dc27-485f-b8b0-172d8473db02 req-0d80bec4-164e-4df7-b968-350b942f80f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e371596-f73e-48de-aab1-77cbf45388e4", "name": "network-vif-plugged", "status": "completed", "tag": "7ea111fa-e59f-4092-8352-7af47d7965ee"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:00.485740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8985b1b2-dc27-485f-b8b0-172d8473db02 req-0d80bec4-164e-4df7-b968-350b942f80f3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:00.486143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8985b1b2-dc27-485f-b8b0-172d8473db02 req-0d80bec4-164e-4df7-b968-350b942f80f3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:00.522298 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8985b1b2-dc27-485f-b8b0-172d8473db02 req-0d80bec4-164e-4df7-b968-350b942f80f3 service nova] Creating event network-vif-plugged:7ea111fa-e59f-4092-8352-7af47d7965ee for instance 0e371596-f73e-48de-aab1-77cbf45388e4 on nch2-master-1 Jun 04 20:55:00.541843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8985b1b2-dc27-485f-b8b0-172d8473db02 req-0d80bec4-164e-4df7-b968-350b942f80f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093595 Jun 04 20:55:00.542467 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 323/665] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:00.874621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:00.887331 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f3775936-ae6b-4fa4-8426-df6e1f4e4e9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1318 microversion: 2.1 time: 0.735548 Jun 04 20:55:00.898926 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 343/666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:00 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:55:01.459853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:01.460566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:01.480683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:01.483425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:01.484602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:01.488021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:01.906972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:01.907712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:01.924846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:01.925384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:01.930643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:01.931091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:02.334704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:02.351618 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0432938-6b7f-4abf-a7db-6570520c74a1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1269 microversion: 2.1 time: 0.897315 Jun 04 20:55:02.353627 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 324/667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:01 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1269 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:03.098824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:03.114664 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5c4ff711-4fb5-4e8f-96bf-1e3048da7ba2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1468 microversion: 2.1 time: 1.209792 Jun 04 20:55:03.115775 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 344/668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:01 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1468 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:03.135548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:03.137705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:03.147962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:03.148693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:03.149707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:03.151260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:03.514217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-730b9422-b37e-4316-a29a-1f174c5b8cf9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '.version_select at 0x7f2d0266f940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:03.675878 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-730b9422-b37e-4316-a29a-1f174c5b8cf9 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd" status: 200 len: 371 microversion: 2.1 time: 0.440362 Jun 04 20:55:03.677716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 345/669] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 20:55:03 2022] GET /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd => generated 371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:03.685550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:03.687169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:03.696684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:03.697655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:03.698635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:03.699221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:03.959675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:03.969065 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a3a69e7-9668-4350-84e8-1c606bc7cbf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 200 len: 1468 microversion: 2.1 time: 0.838850 Jun 04 20:55:03.969670 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 325/670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:03 2022] GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 1468 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:03.984485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae3488e4-bd6e-4bac-8c4d-40d36c359c02 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Action: 'update', calling method: .version_select at 0x7f2d037bbca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:04.073439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3488e4-bd6e-4bac-8c4d-40d36c359c02 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:04.074043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3488e4-bd6e-4bac-8c4d-40d36c359c02 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:04.074826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3488e4-bd6e-4bac-8c4d-40d36c359c02 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:04.075267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3488e4-bd6e-4bac-8c4d-40d36c359c02 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:04.116147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:04.156554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4e09f6d-9eac-45ed-9a58-8f272fef1a74 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.476539 Jun 04 20:55:04.159088 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 346/671] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:03 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:04.164806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:04.170645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:04.172177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Searching by: {'reservation_id': 'r-7jqvmsx8', 'deleted': False, 'project_id': '007f08ee799d431fb8d18c31dd5991e0'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:55:04.185205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:04.186066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:04.187126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:04.187804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:04.219562 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae3488e4-bd6e-4bac-8c4d-40d36c359c02 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd" status: 200 len: 328 microversion: 2.1 time: 0.248752 Jun 04 20:55:04.220364 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 326/672] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:55:03 2022] PUT /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd => generated 328 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:04.230247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b6c35e0a-4a17-42db-a41d-5e40a88a54dc tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:04.248702 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b6c35e0a-4a17-42db-a41d-5e40a88a54dc tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd" status: 202 len: 0 microversion: 2.1 time: 0.022085 Jun 04 20:55:04.249984 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 327/673] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 20:55:04 2022] DELETE /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:55:04.257496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-912d893c-2b08-4c0b-bbec-40b46b8debc8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '.version_select at 0x7f2d0292c9d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:04.392403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:55:04.393238 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-912d893c-2b08-4c0b-bbec-40b46b8debc8 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd" status: 200 len: 371 microversion: 2.1 time: 0.139108 Jun 04 20:55:04.395928 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 328/674] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 20:55:04 2022] GET /compute/v2.1/os-quota-sets/894bd8a0cf73482db6cdae64dfd34cfd => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:55:04.655457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26e727bb-ca52-44ac-affc-3fbfcbc5da6b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '.version_select at 0x7f2d026c8c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:04.700782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:04.727620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:04.730955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:05.071363 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26e727bb-ca52-44ac-affc-3fbfcbc5da6b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.421778 Jun 04 20:55:05.072614 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 329/675] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:55:04 2022] GET /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9/defaults => generated 371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:05.174979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:05.176053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:05.190584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:05.192548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:05.194963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:05.195950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:05.240566 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b6fab6e2-32e2-464c-b302-ef6db9c4ad8d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-7jqvmsx8" status: 200 len: 2929 microversion: 2.1 time: 1.080133 Jun 04 20:55:05.242347 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 347/676] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Jun 4 20:55:04 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7jqvmsx8 => generated 2929 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:05.263843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6e9f13f3-a961-4a5e-9192-c1d7fa0b89b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:05.305568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.compute.server_groups [None req-6e9f13f3-a961-4a5e-9192-c1d7fa0b89b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Querying cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) for 2 instances {{(pid=137228) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 04 20:55:05.318741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e9f13f3-a961-4a5e-9192-c1d7fa0b89b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:05.321795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e9f13f3-a961-4a5e-9192-c1d7fa0b89b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:05.462693 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6e9f13f3-a961-4a5e-9192-c1d7fa0b89b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/932e20d9-0edf-44f8-acb6-b6bf58404713" status: 200 len: 265 microversion: 2.1 time: 0.202664 Jun 04 20:55:05.468554 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 348/677] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:55:05 2022] GET /compute/v2.1/os-server-groups/932e20d9-0edf-44f8-acb6-b6bf58404713 => generated 265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:55:05.496468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:05.497139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:05.530998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:05.531620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:05.532483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:05.532933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.068374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:06.085165 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-467e53b1-576b-4569-bb5d-df4027aa2aff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.913097 Jun 04 20:55:06.088835 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 330/678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:05 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:55:06.099987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-216de601-c298-4488-af4b-9f1bc0d45a73 req-25f09b85-8c61-4807-9355-c667d9becb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1874cbcd-e559-43ca-8100-8bae0571c90b", "tag": "e8ba6caf-a3be-4046-b49a-213d13e43a01"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:06.147436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-216de601-c298-4488-af4b-9f1bc0d45a73 req-25f09b85-8c61-4807-9355-c667d9becb63 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.148215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-216de601-c298-4488-af4b-9f1bc0d45a73 req-25f09b85-8c61-4807-9355-c667d9becb63 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.172055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-216de601-c298-4488-af4b-9f1bc0d45a73 req-25f09b85-8c61-4807-9355-c667d9becb63 service nova] Creating event network-changed:e8ba6caf-a3be-4046-b49a-213d13e43a01 for instance 1874cbcd-e559-43ca-8100-8bae0571c90b on nch1-master-1 Jun 04 20:55:06.179156 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-216de601-c298-4488-af4b-9f1bc0d45a73 req-25f09b85-8c61-4807-9355-c667d9becb63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087792 Jun 04 20:55:06.180967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 331/679] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:06.192989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b3f808c-2689-40f3-ba17-c8f904bed8b4 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Action: 'update', calling method: .version_select at 0x7f2d029420d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:06.284045 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5359c6c1-9008-4cde-b373-dd007634429f tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 200 len: 1619 microversion: 2.1 time: 0.809865 Jun 04 20:55:06.287879 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 349/680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:05 2022] GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 1619 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:06.325771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:06.326387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:06.341743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.342193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.352680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.353421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.523704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b3f808c-2689-40f3-ba17-c8f904bed8b4 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.524155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b3f808c-2689-40f3-ba17-c8f904bed8b4 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.525232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b3f808c-2689-40f3-ba17-c8f904bed8b4 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.525888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b3f808c-2689-40f3-ba17-c8f904bed8b4 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.608308 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b3f808c-2689-40f3-ba17-c8f904bed8b4 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a" status: 200 len: 328 microversion: 2.1 time: 0.420213 Jun 04 20:55:06.612607 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 332/681] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:55:06 2022] PUT /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a => generated 328 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:06.624866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26076554-9840-4ad9-8978-913b9c64e057 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '.version_select at 0x7f2d026c89d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:06.735936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26076554-9840-4ad9-8978-913b9c64e057 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.737029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26076554-9840-4ad9-8978-913b9c64e057 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.738811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26076554-9840-4ad9-8978-913b9c64e057 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:06.740345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26076554-9840-4ad9-8978-913b9c64e057 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:06.768157 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26076554-9840-4ad9-8978-913b9c64e057 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a/detail" status: 200 len: 916 microversion: 2.1 time: 0.146672 Jun 04 20:55:06.789842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 333/682] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:55:06 2022] GET /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a/detail => generated 916 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:07.036986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Action: 'update', calling method: .version_select at 0x7f2d02a6fd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:07.144380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:07.145408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:07.145990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:07.146418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:07.186275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:07.186993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:07.188157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:07.188752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:07.226385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:07.300637 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b72e3f5-e81e-4fe1-8272-a9bae9cb1824 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a?user_id=730cbc268edc49cdbc30059cb27f3dc8" status: 200 len: 328 microversion: 2.1 time: 0.268525 Jun 04 20:55:07.315879 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 334/683] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Jun 4 20:55:07 2022] PUT /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a?user_id=730cbc268edc49cdbc30059cb27f3dc8 => generated 328 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:07.336835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:07.344529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:07.372782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ea5a834-5134-4c2c-8730-5125c24040c0 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 200 len: 1619 microversion: 2.1 time: 1.068874 Jun 04 20:55:07.380107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:07.387664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:07.388709 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 350/684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:06 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 1619 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:07.389814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:07.394741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:07.399560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99de45bc-b5cd-4195-8d45-e22c99485e1a tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '.version_select at 0x7f2d02bd7dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:07.559396 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99de45bc-b5cd-4195-8d45-e22c99485e1a tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a?user_id=730cbc268edc49cdbc30059cb27f3dc8" status: 200 len: 370 microversion: 2.1 time: 0.169059 Jun 04 20:55:07.561169 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 351/685] 10.222.0.18 () {58 vars in 1322 bytes} [Sat Jun 4 20:55:07 2022] GET /compute/v2.1/os-quota-sets/68d2272d91c64140a7a56db928dd0d7a?user_id=730cbc268edc49cdbc30059cb27f3dc8 => generated 370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:07.585471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-755054bd-385c-4974-bfdd-aa251cb0e281 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: .version_select at 0x7f2d0262f160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-500936607", "policies": ["anti-affinity"]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:07.635439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-755054bd-385c-4974-bfdd-aa251cb0e281 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:07.652327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-755054bd-385c-4974-bfdd-aa251cb0e281 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:07.758901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-755054bd-385c-4974-bfdd-aa251cb0e281 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:07.773847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-755054bd-385c-4974-bfdd-aa251cb0e281 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:07.809763 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-755054bd-385c-4974-bfdd-aa251cb0e281 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.246381 Jun 04 20:55:07.812664 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 352/686] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 20:55:07 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:07.966902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:07.980788 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26c344b3-d171-47e6-84d8-f36a3e09fe3d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.663457 Jun 04 20:55:07.982031 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 335/687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:07 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:08.434797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-71282710", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "94a540cc-d991-40e7-8c5d-ccd28f9106d0"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:08.450992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:08.509131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:08.999614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:09.002539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:09.013245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:09.016155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:09.017879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:09.022058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:09.547265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:09.549558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:09.550364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:09.551647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:09.555056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:09.588597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:09.589512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:09.590852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:09.593285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:09.623253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:09.624639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:09.630159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:09.634200 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5bd949ab-77ce-4b83-bb51-8168d3d386be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.639583 Jun 04 20:55:09.638971 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 336/688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:08 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:09.655270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c32ebafb-40e2-4ca5-b55a-e3335eeafea5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Calling method '.version_select at 0x7f2d02a435e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:09.658997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Going to run 2 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:09.666029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:09.757271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:09.771352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:09.893823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:09.911111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:09.962506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=68670f7a-f4d6-40da-ba98-48ee00bd5d3a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:10.056262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:10.073812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:10.174803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:10.189775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'server_group_members'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:10.292316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2613564-086b-4f29-be6a-0b23aa93e188 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.860615 Jun 04 20:55:10.303291 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 353/689] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1871 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Jun 04 20:55:10.312144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:10.328293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:10.329164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Searching by: {'deleted': False, 'project_id': '007f08ee799d431fb8d18c31dd5991e0'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:55:10.374494 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c32ebafb-40e2-4ca5-b55a-e3335eeafea5 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.732634 Jun 04 20:55:10.375842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 337/690] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:55:09 2022] GET /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9/defaults => generated 371 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:10.378106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:10.379049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:10.380131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:10.380775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:10.390781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-564a3dd1-3249-4056-ba3e-2a658e1138d3 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Action: 'update', calling method: .version_select at 0x7f2d0292c8b0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:10.564154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:55:10.746792 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c51ff9f0-7e49-431c-8b42-acb42a2adcb7 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.441474 Jun 04 20:55:10.748683 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 354/691] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 20:55:10 2022] GET /compute/v2.1/servers => generated 1660 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:10.761732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:10.762697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:10.780135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:10.781527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:10.784823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:10.785574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:10.888738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-564a3dd1-3249-4056-ba3e-2a658e1138d3 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:10.890332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-564a3dd1-3249-4056-ba3e-2a658e1138d3 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:10.891378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-564a3dd1-3249-4056-ba3e-2a658e1138d3 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:10.891915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-564a3dd1-3249-4056-ba3e-2a658e1138d3 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:11.174482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:11.186931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c5010cf0-16e1-48b7-9a59-52e9d6d51b2c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.436749 Jun 04 20:55:11.199969 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 355/692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:10 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:11.423615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-564a3dd1-3249-4056-ba3e-2a658e1138d3 tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9" status: 200 len: 329 microversion: 2.1 time: 1.037188 Jun 04 20:55:11.429005 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 338/693] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Jun 4 20:55:10 2022] PUT /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9 => generated 329 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:11.435913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6cb17203-6329-40a0-82c8-ba5986bb7c55 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:11.437306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6cb17203-6329-40a0-82c8-ba5986bb7c55 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:11.524393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6cb17203-6329-40a0-82c8-ba5986bb7c55 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:11.535190 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6cb17203-6329-40a0-82c8-ba5986bb7c55 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1217 microversion: 2.1 time: 0.104301 Jun 04 20:55:11.539470 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 339/694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:11 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:11.560679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e655bc68-c628-4b1d-bbb2-e1e63a48816b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Action: 'update', calling method: .version_select at 0x7f2d0292c940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:11.597387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78fa922d-977c-40d9-acf6-4a0686e67289 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Action: 'create', calling method: .version_select at 0x7f2d026ceb80>, body: {"keypair": {"name": "tempest-keypair-815918993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlVpVecl4pTQsFXwE8eWEONoeoyEHoqgaqqoJJOBCep8jrD8MLvJ03DuKevacmjgAzyC5/ZMMot7ssaa2J+JgX5fqRHrulk+X2GlSwuP9hR6AEQMYiKDHG7IYAaGD53mg=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:11.640175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-78fa922d-977c-40d9-acf6-4a0686e67289 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Getting quotas for project 6707eb81235a4370a48c97279b7cfd21. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:11.663084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-78fa922d-977c-40d9-acf6-4a0686e67289 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Getting quotas for user 39e45a1e351c47bc8d9c9f317a7d915e and project 6707eb81235a4370a48c97279b7cfd21. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:11.743249 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78fa922d-977c-40d9-acf6-4a0686e67289 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.541412 Jun 04 20:55:11.744769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 356/695] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:55:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:11.931378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e655bc68-c628-4b1d-bbb2-e1e63a48816b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:11.931858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e655bc68-c628-4b1d-bbb2-e1e63a48816b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:11.932658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e655bc68-c628-4b1d-bbb2-e1e63a48816b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:11.933091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e655bc68-c628-4b1d-bbb2-e1e63a48816b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.208573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:12.225812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:12.245102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.246003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.248469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.249514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.395445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:INSERT=24,nova_api:SELECT=68,nova_api:UPDATE=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:12.417383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:12.705835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:12.714338 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e655bc68-c628-4b1d-bbb2-e1e63a48816b tempest-QuotasAdminTestJSON-116973775 tempest-QuotasAdminTestJSON-116973775-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9" status: 200 len: 329 microversion: 2.1 time: 1.158680 Jun 04 20:55:12.716680 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 340/696] 10.222.0.18 () {60 vars in 1262 bytes} [Sat Jun 4 20:55:11 2022] PUT /compute/v2.1/os-quota-sets/26a9cb105a3e4e85808453fb1b3fafe9 => generated 329 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:12.724854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:12.725744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:12.735617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.736236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.737717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.738324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.744266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-331e4666-4958-45d7-838c-642888de5eef tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.538479 Jun 04 20:55:12.752367 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 357/697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:12 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:12.832377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-906def18-923f-4df0-be00-92055766a20c req-c25182ca-ccf9-4d27-ab52-2c89c6e0d120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1874cbcd-e559-43ca-8100-8bae0571c90b", "name": "network-vif-plugged", "status": "completed", "tag": "e8ba6caf-a3be-4046-b49a-213d13e43a01"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:12.855804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-906def18-923f-4df0-be00-92055766a20c req-c25182ca-ccf9-4d27-ab52-2c89c6e0d120 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.856629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-906def18-923f-4df0-be00-92055766a20c req-c25182ca-ccf9-4d27-ab52-2c89c6e0d120 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.899652 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-906def18-923f-4df0-be00-92055766a20c req-c25182ca-ccf9-4d27-ab52-2c89c6e0d120 service nova] Creating event network-vif-plugged:e8ba6caf-a3be-4046-b49a-213d13e43a01 for instance 1874cbcd-e559-43ca-8100-8bae0571c90b on nch1-master-1 Jun 04 20:55:12.903942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:12.918970 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-906def18-923f-4df0-be00-92055766a20c req-c25182ca-ccf9-4d27-ab52-2c89c6e0d120 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096184 Jun 04 20:55:12.921139 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e1b3c054-9695-4f37-a0e4-5a2013c87031 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1269 microversion: 2.1 time: 0.203007 Jun 04 20:55:12.921820 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 358/698] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:55:12.928329 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 341/699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:12 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1269 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:12.948311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:12.949428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:12.979619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.981775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:12.984571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:12.985290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:13.057798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:55:13.233915 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1ef2866-f1a2-49f0-ab5a-ad01181e8fe5 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "DELETE /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 204 len: 0 microversion: 2.1 time: 0.296513 Jun 04 20:55:13.234958 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 359/700] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:55:12 2022] DELETE /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:55:13.248631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:13.249541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:13.261788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:13.262784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:13.263887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:13.264828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:13.767451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:13.768882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:13.787838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:13.789429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:13.790511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:13.791320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:13.937017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:13.954237 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ebf36fe-65fd-47d2-8e45-b7fb1e1f995f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1711 microversion: 2.1 time: 0.712600 Jun 04 20:55:13.954900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 342/701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:13 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1711 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:55:14.146614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1663790776", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1397b8c1-156c-4d89-baa3-b4b97df18a8a"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:14.260090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:14.260231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] validate_networks() for [('1397b8c1-156c-4d89-baa3-b4b97df18a8a', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:14.271635 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-428411db-b9a1-49c8-bea6-ed6f0d1a771c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1311 microversion: 2.1 time: 0.505904 Jun 04 20:55:14.272281 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 360/702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:13 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1311 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:14.291033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:14.292005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:14.302421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:14.304328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:14.304860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:14.306315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:14.307023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:14.474330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:14.487973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4eceb6d5-a507-4579-b77c-c2c498668265 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1275 microversion: 2.1 time: 0.214543 Jun 04 20:55:14.488950 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 361/703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:14 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1275 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:14.972737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:14.973461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:14.990995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:14.991458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:14.995326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:14.995977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:15.012486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:16.192747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:16.193332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:16.193880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:16.194558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:16.195195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:16.213360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:16.217194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:16.222152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:16.223113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:16.286400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for project 84c448aaa2a549c8a333b029ea89b104. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:16.299710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for user 598884c9d0964ad6992f79eaf770507d and project 84c448aaa2a549c8a333b029ea89b104. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:16.337375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:16.340111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:16.390289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:16.406727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66f48a04-5eca-40e7-b22b-63f8de7abc8b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1711 microversion: 2.1 time: 1.438006 Jun 04 20:55:16.423148 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 362/704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:14 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1711 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:55:16.444162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:16.449953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:16.470855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:16.471383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:16.474581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:16.475039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:16.488847 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c833b5f-7594-41cb-ad62-ac48ca5525d6 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.522778 Jun 04 20:55:16.508010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 343/705] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:16.515214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:16.517386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:16.534219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:16.534819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:16.535773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:16.539108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:17.100375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:17.130990 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d98fca78-9c73-42d3-b4f4-19b466bc9df6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1493 microversion: 2.1 time: 0.718491 Jun 04 20:55:17.145439 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 363/706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:16 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1493 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:17.167016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8737adda-72a6-46a4-a5a4-8fc80a887d48 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:17.167930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8737adda-72a6-46a4-a5a4-8fc80a887d48 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:17.396502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8737adda-72a6-46a4-a5a4-8fc80a887d48 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:17.406935 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8737adda-72a6-46a4-a5a4-8fc80a887d48 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1225 microversion: 2.1 time: 0.258925 Jun 04 20:55:17.407587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 364/707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:17 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1225 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:17.424266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:17.426532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:17.439057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:17.439825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:17.454435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:17.455901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:17.744129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:17.766975 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d3e8f789-c5a0-4ff3-a13f-8c7d28929977 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1317 microversion: 2.1 time: 1.255514 Jun 04 20:55:17.784984 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 344/708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:16 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1317 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:17.800741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:17.808900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:17.836772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:17.837911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:17.839276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:17.839969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:18.368138 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e5dfe698-b43d-4444-afdc-2d5dc602c859 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1644 microversion: 2.1 time: 0.955652 Jun 04 20:55:18.369892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 365/709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:17 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1644 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:18.395239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-419736288", "imageRef": "51b8bf1c-7694-4f9c-a6b1-a6d9b177d0c8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "fc92016e-92c9-408b-8c04-cc7035f63ad2"}], "security_groups": [{"name": "tempest-securitygroup--1877530336"}], "key_name": "tempest-keypair-815918993", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:19.145727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90a9faf4a615437ca499c0ccbc1e7563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaae81a01be4c73acb908aae5be8312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:19.158666 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c72a7b63-5aab-430d-a29e-b8a52a06f674 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 200 len: 1711 microversion: 2.1 time: 1.371950 Jun 04 20:55:19.159325 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 345/710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:17 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 1711 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:19.174768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:19.177604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:19.196827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:19.197313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:19.198105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:19.198610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:19.469917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] validate_networks() for [('fc92016e-92c9-408b-8c04-cc7035f63ad2', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:19.927743 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e713db1a-8150-45fc-83e8-d391f4b53a6a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1644 microversion: 2.1 time: 0.767262 Jun 04 20:55:19.928350 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 346/711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:19 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1644 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:19.950003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:19.950862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:19.965826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:19.966334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:19.967371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:19.967913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:20.320925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:20.405518 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e456184e-2cc5-4fa6-85d4-91e1a62c1efc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1283 microversion: 2.1 time: 0.471445 Jun 04 20:55:20.407637 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 347/712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:19 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1283 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:20.414159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:20.415140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:20.425009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:20.430145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:20.431665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:20.432374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:20.439949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:21.591458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:21.610411 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef5a17b5-f947-4f71-b839-d33d17d3087e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1317 microversion: 2.1 time: 1.198519 Jun 04 20:55:21.611063 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 348/713] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:20 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1317 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:21.629911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-079a8a93-08a4-4d74-8670-44b1188fce30 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:21.637662 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:55:21.637662 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:55:21.639241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-079a8a93-08a4-4d74-8670-44b1188fce30 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.645458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-079a8a93-08a4-4d74-8670-44b1188fce30 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:21.646562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-079a8a93-08a4-4d74-8670-44b1188fce30 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.647006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-079a8a93-08a4-4d74-8670-44b1188fce30 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:21.726324 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-079a8a93-08a4-4d74-8670-44b1188fce30 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094038 Jun 04 20:55:21.734821 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 349/714] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:55:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:21.750443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:21.752112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:21.761149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.761875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:21.762853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.764863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:21.789835 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 HTTP/1.1 Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:55:21.791892 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:21.793537 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '11f079bb-05eb-4b12-a59e-5a5ba29fcc23'} Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:21.795009 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:21.796965 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:21.799283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:21.800432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3bb97787-c285-45cc-afc1-cb1e1ad97827 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 404 len: 111 microversion: 2.1 time: 0.064086 Jun 04 20:55:21.801581 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 350/715] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:21 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:21.806938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-cb615801-c614-4134-9162-0ba40c9a9391 req-9d518a16-442d-4504-ae5c-0bb367cb0fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f079bb-05eb-4b12-a59e-5a5ba29fcc23", "name": "network-vif-deleted", "tag": "a23c1a98-76c4-4832-9b05-88f371d7bdb0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:21.817393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cb615801-c614-4134-9162-0ba40c9a9391 req-9d518a16-442d-4504-ae5c-0bb367cb0fb2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.818127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cb615801-c614-4134-9162-0ba40c9a9391 req-9d518a16-442d-4504-ae5c-0bb367cb0fb2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:21.823769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:21.838586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-cb615801-c614-4134-9162-0ba40c9a9391 req-9d518a16-442d-4504-ae5c-0bb367cb0fb2 service nova] Creating event network-vif-deleted:a23c1a98-76c4-4832-9b05-88f371d7bdb0 for instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 on nch2-master-1 Jun 04 20:55:21.858610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-cb615801-c614-4134-9162-0ba40c9a9391 req-9d518a16-442d-4504-ae5c-0bb367cb0fb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053504 Jun 04 20:55:21.861047 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 351/716] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:21.880120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:21.881116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:21.893659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.894402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:21.895990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:21.896609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.312179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:22.312787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:22.314587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:22.315456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:22.316173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:22.343922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.345210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.346737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.347793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.393983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Getting quotas for project 6707eb81235a4370a48c97279b7cfd21. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:22.400492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Getting quotas for user 39e45a1e351c47bc8d9c9f317a7d915e and project 6707eb81235a4370a48c97279b7cfd21. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:22.422096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:22.426184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='51b8bf1c-7694-4f9c-a6b1-a6d9b177d0c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:22.449286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:22.464473 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec8603f5-eedc-4a12-bd47-a93fe4a2eab2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1325 microversion: 2.1 time: 0.600263 Jun 04 20:55:22.465146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 352/717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:21 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1325 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:22.494873 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-af3327be-811a-4a66-9216-8185b4f18b52 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.113746 Jun 04 20:55:22.496152 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 366/718] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 4116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:22.512041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:22.518372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:22.531424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.532405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.539403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.540271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.701685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ec729ae4-79da-4713-af2b-0b1ae17b684a tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b/action" status: 202 len: 0 microversion: 2.1 time: 0.203125 Jun 04 20:55:22.702670 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 367/719] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:55:22 2022] POST /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:55:22.715059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:22.718917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:22.731331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Searching by: {'deleted': False, 'project_id': 'f8585f618d5f4203af8209f5483e2eca'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:55:22.741930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.742793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.744224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.744965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.758769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-133466390", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:22.797688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:55:22.843730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:22.893049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6459e89-445f-456e-ab0f-9c7f000dc439 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.187319 Jun 04 20:55:22.893676 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 368/720] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 20:55:22 2022] GET /compute/v2.1/servers => generated 339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:22.914837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:22.915714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:22.927270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.927782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.928604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:22.929016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:22.948876 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea HTTP/1.1 Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:55:22.951630 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:22.953206 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b2802f93-a40c-4fe1-89d4-a6707b2b7eea'} Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:22.954167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:22.956452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:22.959113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:22.960244 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83c5b13c-464b-4c9a-97cd-e3ce2f36186b tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 404 len: 111 microversion: 2.1 time: 0.058065 Jun 04 20:55:22.960981 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 369/721] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:55:22 2022] DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:22.967715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b0c9c1d8-0ba9-4115-b04f-c4dea33b86d9 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:22.968795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b0c9c1d8-0ba9-4115-b04f-c4dea33b86d9 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:23.136085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b0c9c1d8-0ba9-4115-b04f-c4dea33b86d9 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:23.161676 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b0c9c1d8-0ba9-4115-b04f-c4dea33b86d9 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1244 microversion: 2.1 time: 0.197804 Jun 04 20:55:23.162440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 370/722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:22 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1244 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:23.175047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:23.177655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:23.199228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:23.200022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:23.200973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:23.201631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.086570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:24.088518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:24.089101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:24.089745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:24.090183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:24.090594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:24.097433 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bbd998a0-c747-44a5-941c-b5afe516208a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1317 microversion: 2.1 time: 0.929091 Jun 04 20:55:24.098458 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 371/723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:23 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:24.106229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.106229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.106229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.106229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.115248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:24.116319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:24.131920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.133590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=22 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:24.133946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.139570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.141729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.147476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Getting quotas for project 9fa1452a653049abab26a782a7d36583. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:24.160405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Getting quotas for user 246c32bb6dfc4692beeac1675dd13293 and project 9fa1452a653049abab26a782a7d36583. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:24.210523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:24.213144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:24.278922 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ca6c802-c9cc-4ad6-b0bf-179c164d76c4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.812402 Jun 04 20:55:24.280291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 353/724] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:24.285155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:24.290393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:24.292349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Searching by: {'deleted': False, 'project_id': 'f8585f618d5f4203af8209f5483e2eca'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:55:24.336415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.342409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.345118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.349573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:24.622728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:55:24.876774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:24.896912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:24.898912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.649617 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d673030-6ee7-4e23-8bec-6a14975db14e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1629 microversion: 2.1 time: 1.540435 Jun 04 20:55:25.653014 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 372/725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:24 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1629 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:25.660456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:25.672146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:25.690066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:25.691631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.696335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:25.699297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.749136 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea HTTP/1.1 Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:55:25.752009 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:25.753520 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b2802f93-a40c-4fe1-89d4-a6707b2b7eea'} Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:25.754366 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:25.755786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:25.757369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:25.757369 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7eb0806c-5397-412a-9ca6-893b6b2c8bbe tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 404 len: 111 microversion: 2.1 time: 0.102432 Jun 04 20:55:25.757546 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 373/726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:25 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:25.775567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-9f3e3d10-533a-41ae-802e-1a55ef411b9b req-bc7f83c1-26ce-490c-83c8-802fd6199d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68670f7a-f4d6-40da-ba98-48ee00bd5d3a", "tag": "316e977d-ddf0-45c2-96fd-3ed95fb29fbe"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:25.798731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9f3e3d10-533a-41ae-802e-1a55ef411b9b req-bc7f83c1-26ce-490c-83c8-802fd6199d9b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:25.805532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9f3e3d10-533a-41ae-802e-1a55ef411b9b req-bc7f83c1-26ce-490c-83c8-802fd6199d9b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.831868 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-9f3e3d10-533a-41ae-802e-1a55ef411b9b req-bc7f83c1-26ce-490c-83c8-802fd6199d9b service nova] Creating event network-changed:316e977d-ddf0-45c2-96fd-3ed95fb29fbe for instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a on nch2-master-1 Jun 04 20:55:25.838346 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-9f3e3d10-533a-41ae-802e-1a55ef411b9b req-bc7f83c1-26ce-490c-83c8-802fd6199d9b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070698 Jun 04 20:55:25.839294 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 374/727] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:25.847315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:25.848706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:25.857733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:25.857733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.858516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:25.858965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.910046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-573af3cb-eba1-43ff-85f4-a2edca31739c tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 1.628256 Jun 04 20:55:25.911015 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 354/728] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:55:24 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:25.916143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c8d3afee-1082-4025-9245-d5b13b1d0ea8 req-2ab29f06-162e-4442-befc-852e09d45f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10eef31-7d50-4c80-8203-81f58c19cd76", "tag": "eb4f0d5b-fffa-4e1c-ad51-9e68da3264a9"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:25.945040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c8d3afee-1082-4025-9245-d5b13b1d0ea8 req-2ab29f06-162e-4442-befc-852e09d45f66 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:25.945772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c8d3afee-1082-4025-9245-d5b13b1d0ea8 req-2ab29f06-162e-4442-befc-852e09d45f66 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:25.976689 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c8d3afee-1082-4025-9245-d5b13b1d0ea8 req-2ab29f06-162e-4442-befc-852e09d45f66 service nova] Creating event network-changed:eb4f0d5b-fffa-4e1c-ad51-9e68da3264a9 for instance c10eef31-7d50-4c80-8203-81f58c19cd76 on nch1-master-1 Jun 04 20:55:25.982842 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c8d3afee-1082-4025-9245-d5b13b1d0ea8 req-2ab29f06-162e-4442-befc-852e09d45f66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070342 Jun 04 20:55:25.988163 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 355/729] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:25.995464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:25.996874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:26.005557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:26.006209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:26.007322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:26.008011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:26.392773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:26.407319 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e6d6760-76c9-4b2e-b90e-cb5aece63e6b tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1302 microversion: 2.1 time: 0.414881 Jun 04 20:55:26.408570 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 356/730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:25 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1302 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:26.417590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-299464513", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:26.612004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:27.329309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:27.349700 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6e2ec3fa-c495-4809-9633-0adb15660e58 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1325 microversion: 2.1 time: 1.508557 Jun 04 20:55:27.368587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 375/731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:25 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1325 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:27.380655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:27.382475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:27.397697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:27.400011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:27.402194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:27.403700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.131464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:28.134104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:28.135465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:28.136640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:28.138420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:28.169846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.170770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.171849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.172517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.209447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Getting quotas for project 9fa1452a653049abab26a782a7d36583. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:28.218275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Getting quotas for user 246c32bb6dfc4692beeac1675dd13293 and project 9fa1452a653049abab26a782a7d36583. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:28.235355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:UPDATE=6,nova_api:SELECT=83,nova_api:INSERT=11 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:28.237242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:28.240272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:28.273560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:28.282006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d535d2c-930d-4dcc-af16-c6da92aa7a7d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1317 microversion: 2.1 time: 0.911125 Jun 04 20:55:28.291876 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 376/732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:27 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1317 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:28.297364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:28.299069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:28.323081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.323329 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-073e706d-35ef-400c-97a4-4155a08df8ac tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.911915 Jun 04 20:55:28.323777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 357/733] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:28.330643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.331432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-45ea8027-3751-41d0-93ef-b8ee82f58c3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '.version_select at 0x7f2d036fc5e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:28.332403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.334378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.368636 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-45ea8027-3751-41d0-93ef-b8ee82f58c3f tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559223619" status: 202 len: 0 microversion: 2.1 time: 0.043729 Jun 04 20:55:28.375630 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 358/734] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 20:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559223619 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:55:28.380736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8adbe47a-4ecd-421c-ac02-60ca140b0748 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:28.387789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lazy-loading 'flavor' on Instance uuid 1874cbcd-e559-43ca-8100-8bae0571c90b {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:55:28.392359 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8adbe47a-4ecd-421c-ac02-60ca140b0748 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021495 Jun 04 20:55:28.395367 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 359/735] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:55:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:28.404749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-850b2943-875d-4eb5-907d-a5f24eec9878 req-7b191fee-15e0-44c9-8b15-52b69bdf295b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10eef31-7d50-4c80-8203-81f58c19cd76", "name": "network-vif-plugged", "status": "completed", "tag": "eb4f0d5b-fffa-4e1c-ad51-9e68da3264a9"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:28.414505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-850b2943-875d-4eb5-907d-a5f24eec9878 req-7b191fee-15e0-44c9-8b15-52b69bdf295b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.414939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-850b2943-875d-4eb5-907d-a5f24eec9878 req-7b191fee-15e0-44c9-8b15-52b69bdf295b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.418807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Going to try to live migrate instance to nch2-master-1 {{(pid=137228) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:55:28.435824 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-850b2943-875d-4eb5-907d-a5f24eec9878 req-7b191fee-15e0-44c9-8b15-52b69bdf295b service nova] Creating event network-vif-plugged:eb4f0d5b-fffa-4e1c-ad51-9e68da3264a9 for instance c10eef31-7d50-4c80-8203-81f58c19cd76 on nch1-master-1 Jun 04 20:55:28.443651 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-850b2943-875d-4eb5-907d-a5f24eec9878 req-7b191fee-15e0-44c9-8b15-52b69bdf295b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046049 Jun 04 20:55:28.447116 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 360/736] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:28.453094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:28.453988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:28.460691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.461924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:28.462877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:28.463449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:30.036943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:30.045452 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-577404b1-6b0c-420b-bb88-bf9c5f239e51 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 1.596893 Jun 04 20:55:30.050790 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 361/737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:28 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:30.062756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ef0ead5c-bc5f-4659-bc5d-1c2626135976 req-f0b3c7ff-d1a8-4e65-b8fc-2c1f326b3987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8450d7af-48da-41c7-ae02-87f6e2f11e61", "tag": "463ceab6-8121-4d0e-a3f5-ada2246072d4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:30.084614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ef0ead5c-bc5f-4659-bc5d-1c2626135976 req-f0b3c7ff-d1a8-4e65-b8fc-2c1f326b3987 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:30.085748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ef0ead5c-bc5f-4659-bc5d-1c2626135976 req-f0b3c7ff-d1a8-4e65-b8fc-2c1f326b3987 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:30.106212 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ef0ead5c-bc5f-4659-bc5d-1c2626135976 req-f0b3c7ff-d1a8-4e65-b8fc-2c1f326b3987 service nova] Creating event network-changed:463ceab6-8121-4d0e-a3f5-ada2246072d4 for instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 on nch2-master-1 Jun 04 20:55:30.116913 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ef0ead5c-bc5f-4659-bc5d-1c2626135976 req-f0b3c7ff-d1a8-4e65-b8fc-2c1f326b3987 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063773 Jun 04 20:55:30.119754 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 362/738] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:30.131154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:30.133488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:30.149791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:30.150591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:30.151808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:30.153009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:30.417287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:30.431723 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00e3fdec-59c1-4a33-8fbd-c1c69c42b602 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1265 microversion: 2.1 time: 0.307493 Jun 04 20:55:30.435305 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 363/739] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:30 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:30.445906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:30.456217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:30.489623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:30.490338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:30.491321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:30.492090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:31.527693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:31.552264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10d493d3-94c5-4367-9b8a-c3516709dfbb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1325 microversion: 2.1 time: 1.114631 Jun 04 20:55:31.565521 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 364/740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:30 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1325 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:31.574782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:31.578813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:31.604012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:31.608525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:31.611406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:31.615438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:31.666692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:55:31.942900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50a20f72-457b-4641-919c-ba03f2a335a3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 204 len: 0 microversion: 2.1 time: 0.375417 Jun 04 20:55:31.944144 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 365/741] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:55:31 2022] DELETE /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:55:31.953500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:31.955089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:31.977165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:31.979693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:31.985029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:31.986190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:32.665679 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33be1c08-c552-4fad-81d5-d9989a468dfb tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b/action" status: 202 len: 0 microversion: 2.1 time: 4.372057 Jun 04 20:55:32.668503 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 377/742] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:55:28 2022] POST /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b/action => generated 0 bytes in 4375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:55:32.674640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d637916b-08b0-4cbb-88a0-ef596882db5c tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:32.675979 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:55:32.675979 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:55:32.746502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d637916b-08b0-4cbb-88a0-ef596882db5c tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/630456234" status: 202 len: 0 microversion: 2.1 time: 0.076003 Jun 04 20:55:32.747956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 378/743] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:55:32 2022] DELETE /compute/v2.1/flavors/630456234 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:55:32.757172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:32.758127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:32.766287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:32.768705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:32.770108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:32.771289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:32.772023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:33.158803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=52 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:33.668749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:33.681527 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db8dce32-d255-497e-9111-281f8c6be1c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1317 microversion: 2.1 time: 1.734306 Jun 04 20:55:33.682139 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 366/744] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:31 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1317 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:33.689269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:33.690153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:33.725674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:33.726325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:33.727312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:33.729675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:33.830012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:33.861996 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88bf7cee-bad9-4e12-a974-d72eb25394ba tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 1.112313 Jun 04 20:55:33.877952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 379/745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:32 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:33.886209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:33.887139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:33.896550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:33.897292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:33.899221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:33.899892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:34.422172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:34.449223 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ab25e91-0829-4613-ad5f-24286b345f26 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1313 microversion: 2.1 time: 0.765748 Jun 04 20:55:34.449821 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 367/746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:33 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:34.455238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-922c146f-28df-48a2-b605-76981b7133d7 req-bb62208e-b8e5-4d32-9514-f8cbeffd9f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68670f7a-f4d6-40da-ba98-48ee00bd5d3a", "name": "network-vif-plugged", "status": "completed", "tag": "316e977d-ddf0-45c2-96fd-3ed95fb29fbe"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:34.472333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-922c146f-28df-48a2-b605-76981b7133d7 req-bb62208e-b8e5-4d32-9514-f8cbeffd9f77 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:34.472771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-922c146f-28df-48a2-b605-76981b7133d7 req-bb62208e-b8e5-4d32-9514-f8cbeffd9f77 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:34.501058 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-922c146f-28df-48a2-b605-76981b7133d7 req-bb62208e-b8e5-4d32-9514-f8cbeffd9f77 service nova] Creating event network-vif-plugged:316e977d-ddf0-45c2-96fd-3ed95fb29fbe for instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a on nch2-master-1 Jun 04 20:55:34.511675 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-922c146f-28df-48a2-b605-76981b7133d7 req-bb62208e-b8e5-4d32-9514-f8cbeffd9f77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060174 Jun 04 20:55:34.512490 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 368/747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:34.517964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:34.518674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:34.537915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:34.547234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:34.547723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:34.548519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:34.552414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6dcde55f-73b9-433c-a761-9697ed0c3086 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1716 microversion: 2.1 time: 0.671683 Jun 04 20:55:34.553210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:34.573380 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 380/748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:33 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1716 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:34.590289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:34.594153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:34.612403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:34.612821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:34.618198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:34.618984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:34.628181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:35.281058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:35.307563 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0288eff2-fd74-4683-858c-2c4f4362fbab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.732531 Jun 04 20:55:35.323073 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 381/749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:34 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:35.343385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f0f2c11-0af0-433e-8648-bafdee7ed6b5 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:35.414656 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f0f2c11-0af0-433e-8648-bafdee7ed6b5 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.080224 Jun 04 20:55:35.420493 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 382/750] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:55:35 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:35.496429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:35.524198 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0c0bfa5e-d61f-47a6-9ae7-cb4e1961c1d7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1325 microversion: 2.1 time: 1.008899 Jun 04 20:55:35.526730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 369/751] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:34 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1325 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:35.590058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-69da1d46-8221-4dd3-b506-fb69f6377343 req-0a9029e1-e3af-4599-b96d-ed1d0518f8df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d253f1-151b-4060-b7c3-d197cda87dc1", "tag": "7459fa5e-384a-47b2-90a4-9184bda4ea84"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:35.652145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-69da1d46-8221-4dd3-b506-fb69f6377343 req-0a9029e1-e3af-4599-b96d-ed1d0518f8df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:35.656406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-69da1d46-8221-4dd3-b506-fb69f6377343 req-0a9029e1-e3af-4599-b96d-ed1d0518f8df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:35.714742 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-69da1d46-8221-4dd3-b506-fb69f6377343 req-0a9029e1-e3af-4599-b96d-ed1d0518f8df service nova] Creating event network-changed:7459fa5e-384a-47b2-90a4-9184bda4ea84 for instance b7d253f1-151b-4060-b7c3-d197cda87dc1 on nch2-master-1 Jun 04 20:55:35.734586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-69da1d46-8221-4dd3-b506-fb69f6377343 req-0a9029e1-e3af-4599-b96d-ed1d0518f8df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193572 Jun 04 20:55:35.738445 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 370/752] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:35.751557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:35.752328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:35.765101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:35.765924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:35.767060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:35.767744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:35.870108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0dda0210-68c3-4138-8d04-9a176eda797b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Action: 'create', calling method: .version_select at 0x7f2d024491f0>, body: {"keypair": {"name": "tempest-keypair-1629363586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZBYOYdFkeppGD3RTfBdwC2DoxmpXOqc6heGbpiSzeiXaWC/dUJELeNtotDmIIC72e2+TiL1BQgI03TxsK8db0M9B1v/TnxswgkbR098PwJ1uMqS3y6fW+ec9n5/Tu54A=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:35.954497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0dda0210-68c3-4138-8d04-9a176eda797b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Getting quotas for project a23b90f117684cff9d0ffccf630d8307. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:35.977826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0dda0210-68c3-4138-8d04-9a176eda797b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Getting quotas for user 71d29871def3409f89efcda0e82a4ad3 and project a23b90f117684cff9d0ffccf630d8307. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:36.032537 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0dda0210-68c3-4138-8d04-9a176eda797b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.598754 Jun 04 20:55:36.033457 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 383/753] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:55:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:36.049850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:36.055738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:36.069276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:36.070130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:36.071208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:36.075028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:36.154245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:36.174415 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d814494a-fc7a-454d-8dc9-c126093f2b60 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1466 microversion: 2.1 time: 0.427683 Jun 04 20:55:36.175703 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 371/754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:35 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1466 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:36.190089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-46be3ff2-7b51-48e5-b384-d0fbdb510326 req-64c42c13-5b64-412c-9fc2-0b13f00c2b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e3ca0-740c-47ff-a635-ebbabc3609e4", "tag": "f922a9a4-5b23-461e-befb-4b0ac1ffd77d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:36.232654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-46be3ff2-7b51-48e5-b384-d0fbdb510326 req-64c42c13-5b64-412c-9fc2-0b13f00c2b99 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:36.233480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-46be3ff2-7b51-48e5-b384-d0fbdb510326 req-64c42c13-5b64-412c-9fc2-0b13f00c2b99 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:36.286755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-46be3ff2-7b51-48e5-b384-d0fbdb510326 req-64c42c13-5b64-412c-9fc2-0b13f00c2b99 service nova] Creating event network-changed:f922a9a4-5b23-461e-befb-4b0ac1ffd77d for instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 on nch1-master-1 Jun 04 20:55:36.304222 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-46be3ff2-7b51-48e5-b384-d0fbdb510326 req-64c42c13-5b64-412c-9fc2-0b13f00c2b99 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126641 Jun 04 20:55:36.305213 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 372/755] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:36.312432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad3b6638-08e0-44cf-9351-8ca841e38356 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:36.317384 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:55:36.317384 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:55:36.343044 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ad3b6638-08e0-44cf-9351-8ca841e38356 tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/1090592326" status: 202 len: 0 microversion: 2.1 time: 0.035900 Jun 04 20:55:36.344542 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 373/756] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 20:55:36 2022] DELETE /compute/v2.1/flavors/1090592326 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:55:36.359368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:36.386931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:36.412461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:36.413017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:36.425428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:36.433591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:36.496641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:37.079496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:37.104795 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-418c05c2-52d2-415a-a826-63a83bfe5371 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 1.068792 Jun 04 20:55:37.105885 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 384/757] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:36 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:37.119953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:37.121424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:37.141953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:37.144415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:37.146345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:37.147335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:37.832146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:37.841710 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a1cc543-fb56-42bb-9e54-019539832664 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1313 microversion: 2.1 time: 1.495498 Jun 04 20:55:37.852706 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 374/758] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:36 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1313 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:37.861433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:37.863169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:37.870168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:37.870974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:37.873020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:37.873649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:37.882208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:37.902519 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-624b13e8-23c8-4669-9ad4-870f4fc8e8d3 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1716 microversion: 2.1 time: 0.793038 Jun 04 20:55:37.905158 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 385/759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:37 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1716 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:37.913874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:37.914695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:37.922784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:37.923591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:37.926205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:37.927716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:38.195814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:38.230536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=30 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:38.799282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:38.805547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:38.812647 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b9dc544a-a156-4e10-b889-5eaca7e11e26 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a" status: 200 len: 1467 microversion: 2.1 time: 0.957510 Jun 04 20:55:38.814188 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 375/760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:37 2022] GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a => generated 1467 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:38.822714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68862232-74fe-4766-a5c3-a99679fb253f tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:38.828536 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1aa8e7ef-4d05-4228-980f-3e634a1ba8df tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.921790 Jun 04 20:55:38.829497 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 386/761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:37 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:38.836468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:38.838807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:38.865372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:38.866147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:38.867226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:38.869212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:38.874755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68862232-74fe-4766-a5c3-a99679fb253f tempest-ServersWithSpecificFlavorTestJSON-728015708 tempest-ServersWithSpecificFlavorTestJSON-728015708-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059151 Jun 04 20:55:38.876496 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 376/762] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:55:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:38.884321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c0adb472-3228-49e3-95b3-b145d0484cb8 req-e9474583-c314-489e-bd6b-ba8615d02efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d7af-48da-41c7-ae02-87f6e2f11e61", "name": "network-vif-plugged", "status": "completed", "tag": "463ceab6-8121-4d0e-a3f5-ada2246072d4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:38.918490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c0adb472-3228-49e3-95b3-b145d0484cb8 req-e9474583-c314-489e-bd6b-ba8615d02efc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:38.919341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c0adb472-3228-49e3-95b3-b145d0484cb8 req-e9474583-c314-489e-bd6b-ba8615d02efc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:38.949426 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c0adb472-3228-49e3-95b3-b145d0484cb8 req-e9474583-c314-489e-bd6b-ba8615d02efc service nova] Creating event network-vif-plugged:463ceab6-8121-4d0e-a3f5-ada2246072d4 for instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 on nch2-master-1 Jun 04 20:55:38.957663 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c0adb472-3228-49e3-95b3-b145d0484cb8 req-e9474583-c314-489e-bd6b-ba8615d02efc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078562 Jun 04 20:55:38.959050 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 377/763] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:38.987478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:38.990965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:39.046918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.047310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:39.051981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.052877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:39.427861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:39.445823 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de9049b6-03f3-4067-9219-a3df71545259 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1325 microversion: 2.1 time: 0.615051 Jun 04 20:55:39.446422 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 387/764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:38 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:39.463212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:39.473294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:39.474386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Searching by: {'reservation_id': 'r-qpo3dz59', 'deleted': False, 'project_id': '007f08ee799d431fb8d18c31dd5991e0'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:55:39.482181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.483022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:39.484095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.484703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:39.643433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:55:39.729784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:39.742143 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-948ba33b-b288-4f60-a87c-dbc8e9540ee4 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 0.780510 Jun 04 20:55:39.742753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:39.756280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.756949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 378/765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:38 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:39.757851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:39.763161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:39.763161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:39.771202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.771841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:39.773473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:39.774033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.170714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:40.174062 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7c4d851d-3226-462e-86d6-1c7f64e2d09b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?reservation_id=r-qpo3dz59" status: 200 len: 2926 microversion: 2.1 time: 0.715194 Jun 04 20:55:40.176061 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 388/766] 10.222.0.18 () {58 vars in 1196 bytes} [Sat Jun 4 20:55:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-qpo3dz59 => generated 2926 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:40.183933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.184752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:40.185776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75892c89-a827-4abe-ac78-362d139dfc37 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1313 microversion: 2.1 time: 0.427105 Jun 04 20:55:40.193718 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 379/767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:39 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:40.195642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.196476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.197579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.198322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.199743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.200635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:40.207157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.207895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.208878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.209481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.219266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 HTTP/1.1 Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:55:40.221557 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.223257 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '11f079bb-05eb-4b12-a59e-5a5ba29fcc23'} Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:40.224697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.225981 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.227786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:40.227786 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fab22310-418c-4ead-b017-3d0fffb6c1a7 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "DELETE /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 404 len: 111 microversion: 2.1 time: 0.045780 Jun 04 20:55:40.227786 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 389/768] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:55:40 2022] DELETE /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:40.228468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b16079de-f612-4771-9c65-e1437261f632 req-f67ab831-547e-4761-b895-33456a14869b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1874cbcd-e559-43ca-8100-8bae0571c90b", "name": "network-vif-unplugged", "status": "completed", "tag": "e8ba6caf-a3be-4046-b49a-213d13e43a01"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:40.239790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b16079de-f612-4771-9c65-e1437261f632 req-f67ab831-547e-4761-b895-33456a14869b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.240288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b16079de-f612-4771-9c65-e1437261f632 req-f67ab831-547e-4761-b895-33456a14869b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.263799 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b16079de-f612-4771-9c65-e1437261f632 req-f67ab831-547e-4761-b895-33456a14869b service nova] Creating event network-vif-unplugged:e8ba6caf-a3be-4046-b49a-213d13e43a01 for instance 1874cbcd-e559-43ca-8100-8bae0571c90b on nch1-master-1 Jun 04 20:55:40.272182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b16079de-f612-4771-9c65-e1437261f632 req-f67ab831-547e-4761-b895-33456a14869b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046515 Jun 04 20:55:40.273415 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 390/769] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:40.282118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.283017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:40.291835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.292377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.293190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.293760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.389421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0c4b5dd6f0478e81580d12594528aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8585f618d5f4203af8209f5483e2eca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:40.402502 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cde216aa-8d65-4bbd-ba53-bedc68151c09 tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 200 len: 1648 microversion: 2.1 time: 0.207497 Jun 04 20:55:40.403295 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 380/770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:40 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 1648 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:40.418660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d8efab5-d70e-4a52-8011-dc58799c0e28 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.451000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.server_groups [None req-9d8efab5-d70e-4a52-8011-dc58799c0e28 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Querying cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) for 2 instances {{(pid=137229) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 04 20:55:40.451940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8efab5-d70e-4a52-8011-dc58799c0e28 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.452562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8efab5-d70e-4a52-8011-dc58799c0e28 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.489214 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d8efab5-d70e-4a52-8011-dc58799c0e28 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/94a540cc-d991-40e7-8c5d-ccd28f9106d0" status: 200 len: 270 microversion: 2.1 time: 0.074547 Jun 04 20:55:40.495186 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 381/771] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:55:40 2022] GET /compute/v2.1/os-server-groups/94a540cc-d991-40e7-8c5d-ccd28f9106d0 => generated 270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:40.502097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.502344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: 11f079bb-05eb-4b12-a59e-5a5ba29fcc23] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:40.510302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.510856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.511815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.512308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.529078 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 HTTP/1.1 Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:55:40.531214 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.532746 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '11f079bb-05eb-4b12-a59e-5a5ba29fcc23'} Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:40.533487 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. Jun 04 20:55:40.534693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:40.535970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance 11f079bb-05eb-4b12-a59e-5a5ba29fcc23 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:40.535970 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98115042-b23d-4eee-83bf-4f170f4f7c76 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23" status: 404 len: 111 microversion: 2.1 time: 0.035973 Jun 04 20:55:40.536967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 382/772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:40 2022] GET /compute/v2.1/servers/11f079bb-05eb-4b12-a59e-5a5ba29fcc23 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:40.542439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.543063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:40.550250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.550703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.551498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.551970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.790270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:40.803304 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ea71cd27-ad08-4da3-929f-a220405337a4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.527742 Jun 04 20:55:40.805460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 391/773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:40 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:40.816913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e14b0f61-70af-477f-bc89-e147a229385d req-bb467c67-77d3-4896-9460-d31af91ccee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77800c5-96da-4b7f-8b6a-76dbf40b4ba9", "name": "network-vif-deleted", "tag": "04917853-faab-4547-80ad-fc7871874d25"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:40.822663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:40.829147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e14b0f61-70af-477f-bc89-e147a229385d req-bb467c67-77d3-4896-9460-d31af91ccee3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.829993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e14b0f61-70af-477f-bc89-e147a229385d req-bb467c67-77d3-4896-9460-d31af91ccee3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.845761 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e14b0f61-70af-477f-bc89-e147a229385d req-bb467c67-77d3-4896-9460-d31af91ccee3 service nova] Creating event network-vif-deleted:04917853-faab-4547-80ad-fc7871874d25 for instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 on nch1-master-1 Jun 04 20:55:40.852881 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e14b0f61-70af-477f-bc89-e147a229385d req-bb467c67-77d3-4896-9460-d31af91ccee3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039511 Jun 04 20:55:40.854006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 392/774] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:40.860110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:40.861452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:40.870050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.871060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:40.872420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:40.873039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.095559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:41.114679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5129852c-e9f5-4598-83b9-60e79869fe5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1325 microversion: 2.1 time: 0.574036 Jun 04 20:55:41.117595 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 383/775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:40 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1325 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:41.142666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:41.143572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:41.160372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.161539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.162701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.163491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.195161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea HTTP/1.1 Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:55:41.201174 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.202871 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b2802f93-a40c-4fe1-89d4-a6707b2b7eea'} Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:41.203763 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.205172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.216393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:41.217928 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7fa88849-831d-4149-aa6c-536b3dabb235 tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 404 len: 111 microversion: 2.1 time: 0.098180 Jun 04 20:55:41.226642 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 384/776] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:55:41 2022] DELETE /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:41.246288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:41.252514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:41.273736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.277339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.278510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.279564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.321509 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-77a5ba21-0b0f-4938-837c-1d43173f4e4b tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1617 microversion: 2.1 time: 0.466060 Jun 04 20:55:41.323374 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 393/777] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:40 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1617 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:41.328974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6fc528c1-4b9a-48a1-a36d-4b031520b867 req-6efdf792-fdfc-4810-a284-2e093e467239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77800c5-96da-4b7f-8b6a-76dbf40b4ba9", "name": "network-vif-unplugged", "status": "completed", "tag": "04917853-faab-4547-80ad-fc7871874d25"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:41.338269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6fc528c1-4b9a-48a1-a36d-4b031520b867 req-6efdf792-fdfc-4810-a284-2e093e467239 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.338867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6fc528c1-4b9a-48a1-a36d-4b031520b867 req-6efdf792-fdfc-4810-a284-2e093e467239 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.353107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6fc528c1-4b9a-48a1-a36d-4b031520b867 req-6efdf792-fdfc-4810-a284-2e093e467239 service nova] Creating event network-vif-unplugged:04917853-faab-4547-80ad-fc7871874d25 for instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 on nch1-master-1 Jun 04 20:55:41.377112 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6fc528c1-4b9a-48a1-a36d-4b031520b867 req-6efdf792-fdfc-4810-a284-2e093e467239 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051432 Jun 04 20:55:41.389982 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 394/778] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:41.400178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:41.401564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:41.409174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.409940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.410919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.411746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.618887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:41.627724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c7885bb-208f-4c50-a43d-75deebd2962e tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 0.390388 Jun 04 20:55:41.637252 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 385/779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:41 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:41.643251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:41.644471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] [instance: b2802f93-a40c-4fe1-89d4-a6707b2b7eea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:41.651500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.652216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.654469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.655142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.677657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:41.684093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] HTTP exception thrown: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.686708 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d48e7569-2567-4d51-a769-4287a496e87f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1313 microversion: 2.1 time: 0.294811 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Request method failure captured: Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea HTTP/1.1 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8YRDBS0jLFIlREEl8dtFk4AXTqiAfc-vhDAoERTgpfxM29xwck4-uiTQnZk-ZtK36dunrVYCiSwMmkAjqPd6MNOW5bA--djJU2WdebRSQiMzICkz0Wa4_vpoO9304LWNhkjBSpkbRB2ZXKETYB1yWcGn_dqY8fu5hxplv8DEggNWrM Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:55:41.687473 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_afaae81a01be4c73acb908aae5be8312"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/afaae81a01be4c73acb908aae5be8312"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: afaae81a01be4c73acb908aae5be8312 Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121 Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 90a9faf4a615437ca499c0ccbc1e7563 Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1693869121-project Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.689082 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b2802f93-a40c-4fe1-89d4-a6707b2b7eea'} Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:41.689969 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. Jun 04 20:55:41.692338 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:41.694644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] Returning 404 to user: Instance b2802f93-a40c-4fe1-89d4-a6707b2b7eea could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:41.694644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c552b24-2bef-4994-a459-5e6cc42bb07a tempest-ServersWithSpecificFlavorTestJSON-1693869121 tempest-ServersWithSpecificFlavorTestJSON-1693869121-project] 10.222.0.18 "GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea" status: 404 len: 111 microversion: 2.1 time: 0.049635 Jun 04 20:55:41.694644 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 386/780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:41 2022] GET /compute/v2.1/servers/b2802f93-a40c-4fe1-89d4-a6707b2b7eea => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:41.699552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 395/781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:41 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:41.699964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-186766990", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "52b403b7-892f-41aa-92f1-2e90876421b7"}], "security_groups": [{"name": "tempest-securitygroup--1048671744"}], "key_name": "tempest-keypair-1629363586", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:41.704819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:41.710867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:41.732715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.734795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.735896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:41.738859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:41.892690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] validate_networks() for [('52b403b7-892f-41aa-92f1-2e90876421b7', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:42.177982 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d91d0709-207b-438f-9929-0ee97d283554 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a" status: 200 len: 1618 microversion: 2.1 time: 0.476667 Jun 04 20:55:42.195578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 396/782] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:41 2022] GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a => generated 1618 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:42.198979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:42.199806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] [instance: e77800c5-96da-4b7f-8b6a-76dbf40b4ba9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:42.216017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:42.216508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:42.219300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:42.219792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:42.240743 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] HTTP exception thrown: Instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 could not be found. Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Request method failure captured: Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 HTTP/1.1 Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Z1GhtF3L0aDS1D8087Ro1qbuuqb3tmfSbPkQEUobBIX40vq1-Znst2CZNt3HTMXLpgNXunfrR7QKrvSP5BpRXFSGUT8t3Z91GYn7_eyZwna6ZC8j4OU7_N2J0wSn0_j6QZqYW9ErAXVLz72Tjg7ybC2oOOMduvERUygP7Uzhh1etw Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f8585f618d5f4203af8209f5483e2eca Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestManualDisk-923628341 Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:55:42.246120 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f8585f618d5f4203af8209f5483e2eca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8585f618d5f4203af8209f5483e2eca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f8585f618d5f4203af8209f5483e2eca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f8585f618d5f4203af8209f5483e2eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestManualDisk-923628341 Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f8585f618d5f4203af8209f5483e2eca Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestManualDisk-923628341 Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestManualDisk-923628341-project Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6b0c4b5dd6f0478e81580d12594528aa Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestManualDisk-923628341-project Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 could not be found. Jun 04 20:55:42.247699 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e77800c5-96da-4b7f-8b6a-76dbf40b4ba9'} Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 could not be found. Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:42.248462 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 could not be found. Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 could not be found. Jun 04 20:55:42.250557 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:42.252389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Returning 404 to user: Instance e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:42.252389 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72689a12-f174-4a32-9139-9d7cfe41e1ee tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9" status: 404 len: 111 microversion: 2.1 time: 0.068386 Jun 04 20:55:42.252389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 397/783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:42 2022] GET /compute/v2.1/servers/e77800c5-96da-4b7f-8b6a-76dbf40b4ba9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:55:42.257377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:42.258009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:42.268637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:42.269015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:42.270170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:42.270633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:42.637926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:42.654562 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-43e45e0e-f348-4907-bcea-0fd8e101bfea tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.399603 Jun 04 20:55:42.655689 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 398/784] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:42 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:42.663107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:42.672320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:42.680689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:42.681123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:42.681913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:42.682361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.208774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:43.209811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:43.210518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:43.211192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:43.211840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:43.218602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:43.227689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.228394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.230196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.230932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.236446 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bdbd4079-ea50-45c1-924f-d60a8852ecaa tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.579032 Jun 04 20:55:43.237051 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 399/785] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:42 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:43.255820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84050353-7083-41bf-a677-7c9669fb32ab tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] Calling method '.version_select at 0x7f2d02c36a60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:43.276231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Getting quotas for project a23b90f117684cff9d0ffccf630d8307. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:43.285367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Getting quotas for user 71d29871def3409f89efcda0e82a4ad3 and project a23b90f117684cff9d0ffccf630d8307. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:43.288227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84050353-7083-41bf-a677-7c9669fb32ab tempest-ServersTestManualDisk-923628341 tempest-ServersTestManualDisk-923628341-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107404665" status: 202 len: 0 microversion: 2.1 time: 0.037714 Jun 04 20:55:43.288823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 400/786] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 20:55:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2107404665 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:55:43.302938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-bed1893c-1b77-4fa4-825c-00e95389ddfa req-95a23166-0a50-4c45-99d9-9e268a8ff41d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1874cbcd-e559-43ca-8100-8bae0571c90b", "tag": "e8ba6caf-a3be-4046-b49a-213d13e43a01"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:43.327702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bed1893c-1b77-4fa4-825c-00e95389ddfa req-95a23166-0a50-4c45-99d9-9e268a8ff41d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.328037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bed1893c-1b77-4fa4-825c-00e95389ddfa req-95a23166-0a50-4c45-99d9-9e268a8ff41d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.343667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:43.347189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:43.355022 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-bed1893c-1b77-4fa4-825c-00e95389ddfa req-95a23166-0a50-4c45-99d9-9e268a8ff41d service nova] Creating event network-changed:e8ba6caf-a3be-4046-b49a-213d13e43a01 for instance 1874cbcd-e559-43ca-8100-8bae0571c90b on nch1-master-1 Jun 04 20:55:43.387430 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-bed1893c-1b77-4fa4-825c-00e95389ddfa req-95a23166-0a50-4c45-99d9-9e268a8ff41d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096485 Jun 04 20:55:43.389744 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 401/787] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:43.397576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1818446823", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "2d5dd136-9cec-4923-9c8c-2ba3024d18cc"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:43.425850 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f6dc8f5-2dc0-453f-98b6-5885a177f1c3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.731535 Jun 04 20:55:43.426518 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 387/788] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:43.437010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:43.437635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:43.457700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.458423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.459369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.460010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.489450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:43.843052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:43.858503 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a299c6b-720f-4924-bb0d-affdc44c6210 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 0.428821 Jun 04 20:55:43.873674 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 388/789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:43 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:43.879365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:43.880570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:43.883833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:43.891871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.892705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.893757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.894493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.951320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:43.952020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:43.952213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:43.952618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:43.953016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:43.974488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.974938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:43.975791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:43.976225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.019613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:44.025965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:44.040447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:44.043523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:44.092940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ead64d6e-8a7b-4d8c-9178-ce0b0f68bc88 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701243 Jun 04 20:55:44.094171 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 402/790] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:44.098897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2aea578f-bbed-45df-9d04-9f17e6c74795 req-ef65b836-6dad-4c34-8851-e6d3f4436385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:44.109158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2aea578f-bbed-45df-9d04-9f17e6c74795 req-ef65b836-6dad-4c34-8851-e6d3f4436385 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.109629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2aea578f-bbed-45df-9d04-9f17e6c74795 req-ef65b836-6dad-4c34-8851-e6d3f4436385 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.124641 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2aea578f-bbed-45df-9d04-9f17e6c74795 req-ef65b836-6dad-4c34-8851-e6d3f4436385 service nova] Creating event network-changed:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:55:44.132252 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2aea578f-bbed-45df-9d04-9f17e6c74795 req-ef65b836-6dad-4c34-8851-e6d3f4436385 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036201 Jun 04 20:55:44.133422 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 403/791] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:44.136169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:44.139788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:44.140580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:44.148819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.149536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.150341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.150935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.160007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26674db1-4184-4a8f-a6d1-b59c3cd9f1b6 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1313 microversion: 2.1 time: 0.284739 Jun 04 20:55:44.160603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 389/792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:43 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:44.166021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:44.166786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:44.187067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.187647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.188491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.199875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.352643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:44.388298 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9854ae4-44ff-4179-8057-0f79e36a1bb3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1245 microversion: 2.1 time: 0.225401 Jun 04 20:55:44.389905 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 390/793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:44 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1245 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:44.395521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-32f402d9-9e12-456b-b641-4ea82594ae7f req-3ddc63d1-f0f9-490d-a021-f1893b6470a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d253f1-151b-4060-b7c3-d197cda87dc1", "name": "network-vif-plugged", "status": "completed", "tag": "7459fa5e-384a-47b2-90a4-9184bda4ea84"}, {"server_uuid": "f86e3ca0-740c-47ff-a635-ebbabc3609e4", "name": "network-vif-plugged", "status": "completed", "tag": "f922a9a4-5b23-461e-befb-4b0ac1ffd77d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:44.409098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-32f402d9-9e12-456b-b641-4ea82594ae7f req-3ddc63d1-f0f9-490d-a021-f1893b6470a9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.409998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-32f402d9-9e12-456b-b641-4ea82594ae7f req-3ddc63d1-f0f9-490d-a021-f1893b6470a9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.428891 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-32f402d9-9e12-456b-b641-4ea82594ae7f req-3ddc63d1-f0f9-490d-a021-f1893b6470a9 service nova] Creating event network-vif-plugged:7459fa5e-384a-47b2-90a4-9184bda4ea84 for instance b7d253f1-151b-4060-b7c3-d197cda87dc1 on nch2-master-1 Jun 04 20:55:44.444150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-32f402d9-9e12-456b-b641-4ea82594ae7f req-3ddc63d1-f0f9-490d-a021-f1893b6470a9 service nova] Creating event network-vif-plugged:f922a9a4-5b23-461e-befb-4b0ac1ffd77d for instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 on nch1-master-1 Jun 04 20:55:44.482338 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-32f402d9-9e12-456b-b641-4ea82594ae7f req-3ddc63d1-f0f9-490d-a021-f1893b6470a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088315 Jun 04 20:55:44.487203 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 391/794] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:44.509452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:44.515173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:44.540258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.541103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.542687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:44.543765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:44.563146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:44.574095 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c3745938-e891-4089-abd4-080a4125714d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.439423 Jun 04 20:55:44.589193 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 404/795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:44 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:44.594667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-94f10999-923e-469c-ae64-2c4d543de9af tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:44.596797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-94f10999-923e-469c-ae64-2c4d543de9af tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:44.978035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-94f10999-923e-469c-ae64-2c4d543de9af tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:44.987109 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-94f10999-923e-469c-ae64-2c4d543de9af tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1217 microversion: 2.1 time: 0.396217 Jun 04 20:55:44.996943 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 405/796] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:44 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1217 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:45.002278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-433282e9-ab1a-42c0-8512-3039ac0f29bc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-518893079", "metadata": {"": ""}}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-433282e9-ab1a-42c0-8512-3039ac0f29bc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action HTTP/1.1 Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 106 Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:55:45.005450 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-518893079", "metadata": {"": ""}}} Jun 04 20:55:45.007046 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-518893079', 'metadata': {'': ''}}}} Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'': ''} Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:45.008320 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.010039 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:45.011611 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:45.011611 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:45.011611 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:55:45.011611 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:55:45.011611 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:45.011611 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:45.013100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-433282e9-ab1a-42c0-8512-3039ac0f29bc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:45.014160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-433282e9-ab1a-42c0-8512-3039ac0f29bc tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action" status: 400 len: 170 microversion: 2.1 time: 0.015891 Jun 04 20:55:45.018986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 406/797] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Jun 4 20:55:44 2022] POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action => generated 170 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:55:45.025415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:45.026464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:45.033692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.034544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.035576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.036214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.059553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:45.385283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:45.407629 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6c911ad7-23cd-4d9b-bb3a-9ec2d5974bae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.916605 Jun 04 20:55:45.409122 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 392/798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:44 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:45.415101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:45.416385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:45.433302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.434059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.439136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.439858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.626214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:45.635323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0e5a2c2-70a8-421e-bd4e-fba59068b120 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 0.614379 Jun 04 20:55:45.636762 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 407/799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:45 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:45.641420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:45.642205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:45.648998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.649755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.650585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.651164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.814466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:45.823019 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-440892b5-7f4d-4450-9493-71ae0746f132 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.412629 Jun 04 20:55:45.836127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 393/800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:45 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:45.842262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:45.843088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:45.850363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.851086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:45.852071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:45.852502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.022560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:46.042061 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c19f0c6-2984-4a3d-a041-9024b7911fae tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1299 microversion: 2.1 time: 0.201919 Jun 04 20:55:46.045717 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 394/801] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:45 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:46.060915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:46.061975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:46.090902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.093304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.095817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.099062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.202787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:46.219473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14d89c79-427e-427d-a095-5093c7fa0eca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1313 microversion: 2.1 time: 0.580254 Jun 04 20:55:46.223547 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 408/802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:45 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:46.232194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:46.239118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:46.253498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.254837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.256035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.256625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.481179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:46.494492 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-06de93ea-1487-4f30-b05e-4b7e01c99f30 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1269 microversion: 2.1 time: 0.268497 Jun 04 20:55:46.511956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 409/803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:46 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1269 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:46.518097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:46.518819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:46.525505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.526045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.526924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.527421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.628590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:46.642903 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81009cfb-36d5-4a62-ba1c-5c91bcc84eed tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.592377 Jun 04 20:55:46.644181 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 395/804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:46 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:46.655482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:46.656762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:46.672722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.673528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.674532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:46.676437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:46.700394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:47.391024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:47.407076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ac9dd6b-30c0-421f-a6dd-c2b2b3fd77f2 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.893183 Jun 04 20:55:47.409432 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 410/805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:46 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:47.419783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-369fb6e1-1fa0-4e89-9455-01c35445d202 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-857875003", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-369fb6e1-1fa0-4e89-9455-01c35445d202 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action HTTP/1.1 Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 618 Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:55:47.430005 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:47.432402 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:55:47.433488 ncdv-master-1 devstack@n-api.service[137228]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-857875003", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 04 20:55:47.433488 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:55:47.433488 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-857875003', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 04 20:55:47.433843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:47.434984 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.438041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:47.440153 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:47.440153 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:47.440153 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:55:47.440153 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:55:47.440153 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:55:47.440153 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:55:47.444411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-369fb6e1-1fa0-4e89-9455-01c35445d202 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:47.444411 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-369fb6e1-1fa0-4e89-9455-01c35445d202 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action" status: 400 len: 938 microversion: 2.1 time: 0.019073 Jun 04 20:55:47.444411 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 411/806] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Jun 4 20:55:47 2022] POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:55:47.449873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:47.451109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:47.466389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:47.466865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:47.469212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:47.469800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:47.551302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:47.562968 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6c307696-6203-4bf5-9ecc-2091a97923ca tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1370 microversion: 2.1 time: 0.914042 Jun 04 20:55:47.576482 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 396/807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:46 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1370 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:47.593552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:47.596249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:47.601841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:47.604063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:47.604755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:47.606069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:47.607156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:47.616952 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9799825d-7af5-4896-9cd4-b4e3cf259e95 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1299 microversion: 2.1 time: 0.179781 Jun 04 20:55:47.618822 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 412/808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:47 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:47.630520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:47.632382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:47.648177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:47.651451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:47.652782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:47.660717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.084120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:48.095290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8a529bf-d767-4924-a651-8871dcef6cb9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1462 microversion: 2.1 time: 0.516626 Jun 04 20:55:48.096631 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 397/809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:47 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1462 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:48.103283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:48.104240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:48.114695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.115872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.117301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.118111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.143891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:48.155700 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6b55e5a6-1b5f-46ee-9f39-145894e704e5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.532305 Jun 04 20:55:48.159434 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 413/810] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:47 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:48.168355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:48.177131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:48.198651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.200554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.203089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.203942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.364141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:48.389154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c03eb785-7d8d-48eb-bda8-b32b2b39a102 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1275 microversion: 2.1 time: 0.291182 Jun 04 20:55:48.390547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 398/811] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:48 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1275 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:48.405622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:48.409218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:48.424553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.425312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.426118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.426588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.805769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:48.820916 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be284117-ce10-4df3-a380-b33e6176d138 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1313 microversion: 2.1 time: 0.658926 Jun 04 20:55:48.822670 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 414/812] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:48 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:48.835257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:48.835257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:48.855017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.863159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.864183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.864669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.937319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:48.946805 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5be8b7d2-9da0-4401-b0b0-7c84715b3611 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.554871 Jun 04 20:55:48.947407 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 399/813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:48 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:48.957887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:48.967654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:48.986195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.987312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:48.988743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:48.989397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:49.377242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:49.393945 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9303f77e-1507-4236-8d8c-69ce86567219 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1503 microversion: 2.1 time: 0.569500 Jun 04 20:55:49.396282 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 415/814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:48 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:49.404155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:49.405097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:49.431184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:49.432392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:49.435218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:49.436932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:49.516583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:49.542158 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f52ba65-c978-42ea-8492-f6930c807d7a tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1556 microversion: 2.1 time: 0.588725 Jun 04 20:55:49.543129 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 400/815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:48 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1556 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:49.570386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62cb7c61-658d-44e6-b9ba-45e7250c1a8d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62cb7c61-658d-44e6-b9ba-45e7250c1a8d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action HTTP/1.1 Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 285 Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:55:49.573334 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:55:49.574760 ncdv-master-1 devstack@n-api.service[137229]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:55:49.575701 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:55:49.576392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:55:49.577554 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:55:49.578319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:55:49.578319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:49.580384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62cb7c61-658d-44e6-b9ba-45e7250c1a8d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:49.581528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62cb7c61-658d-44e6-b9ba-45e7250c1a8d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action" status: 400 len: 619 microversion: 2.1 time: 0.015155 Jun 04 20:55:49.582831 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 401/816] 10.222.0.18 () {60 vars in 1278 bytes} [Sat Jun 4 20:55:49 2022] POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:55:49.587847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:49.588805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:49.596547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:49.597388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:49.598604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:49.599616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.003656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:50.044429 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-93174f78-bb3b-4ab2-b3a7-d20e294d3324 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.646443 Jun 04 20:55:50.056429 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 416/817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:49 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:50.070064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:50.070567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:50.081295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.081744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.082541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.083029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.290521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:50.303921 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69bb50a9-a542-4626-a33f-2fd005a8aaa8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.719612 Jun 04 20:55:50.316255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 402/818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:49 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:50.324622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:50.327233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:50.336932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.337396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.338186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.338981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.343578 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1eca9589-b4d4-4935-9c81-343d1f19e6db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285726 Jun 04 20:55:50.344798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 417/819] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:55:50 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:50.350917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0cb267ef-a5ce-4ce0-a0e6-b1b2cce299e5 req-1824debf-7a84-4c7e-a203-45b9aa21c895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "name": "network-vif-plugged", "status": "completed", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:50.377272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0cb267ef-a5ce-4ce0-a0e6-b1b2cce299e5 req-1824debf-7a84-4c7e-a203-45b9aa21c895 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.385763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0cb267ef-a5ce-4ce0-a0e6-b1b2cce299e5 req-1824debf-7a84-4c7e-a203-45b9aa21c895 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.436032 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0cb267ef-a5ce-4ce0-a0e6-b1b2cce299e5 req-1824debf-7a84-4c7e-a203-45b9aa21c895 service nova] Creating event network-vif-plugged:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:55:50.447873 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0cb267ef-a5ce-4ce0-a0e6-b1b2cce299e5 req-1824debf-7a84-4c7e-a203-45b9aa21c895 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101565 Jun 04 20:55:50.448933 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 418/820] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:50.455325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:50.456407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:50.467872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.468794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:50.469626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:50.470127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:51.466961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:51.480155 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73d47ec6-9d8a-41df-a2bb-5a57286c057a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1313 microversion: 2.1 time: 1.029928 Jun 04 20:55:51.483274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:51.494071 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 419/821] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:50 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1313 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:51.502298 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-132d904a-00d2-49aa-9b83-546816bcbbcb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 1.184361 Jun 04 20:55:51.504536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:51.505518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:51.515766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:51.516011 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 403/822] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:50 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:51.517300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:51.519128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:51.520886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:51.521423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a9ecdfe4-76e4-4269-a2da-a9f6fda402d0 req-299d322e-2e23-4cc3-afdf-95c960d929dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d54c244-5d4f-4346-a5d9-83eea81ff576", "tag": "3443b767-f8e9-4dca-b30b-375569064aa6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:51.539813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a9ecdfe4-76e4-4269-a2da-a9f6fda402d0 req-299d322e-2e23-4cc3-afdf-95c960d929dd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:51.540261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a9ecdfe4-76e4-4269-a2da-a9f6fda402d0 req-299d322e-2e23-4cc3-afdf-95c960d929dd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:51.564041 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a9ecdfe4-76e4-4269-a2da-a9f6fda402d0 req-299d322e-2e23-4cc3-afdf-95c960d929dd service nova] Creating event network-changed:3443b767-f8e9-4dca-b30b-375569064aa6 for instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 on nch1-master-1 Jun 04 20:55:51.577033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a9ecdfe4-76e4-4269-a2da-a9f6fda402d0 req-299d322e-2e23-4cc3-afdf-95c960d929dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059437 Jun 04 20:55:51.578697 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 404/823] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:51.585586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:51.586389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:51.595970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:51.596664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:51.597778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:51.598472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.028570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:52.044934 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fea35d01-c41c-4d89-8dcc-b42af1b8476f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1478 microversion: 2.1 time: 0.549592 Jun 04 20:55:52.046201 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 420/824] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:51 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1478 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:52.052871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:52.053894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:52.063637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.065125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.067113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.069053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.188866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:52.203653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5e42482-a0d3-4ec6-9a54-90a582a894d2 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.623842 Jun 04 20:55:52.205183 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 405/825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:51 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:52.217163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:52.218380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:52.243969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.244761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.245952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.246618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.574197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:52.584373 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a68955ed-6234-42f5-b228-c36039203821 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.535822 Jun 04 20:55:52.585764 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 421/826] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:52 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:52.591482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c15d649f-4bc4-4a43-9c3b-2372a79da5bc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '.version_select at 0x7f2d02698820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:52.598499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c15d649f-4bc4-4a43-9c3b-2372a79da5bc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.599039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c15d649f-4bc4-4a43-9c3b-2372a79da5bc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.616686 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c15d649f-4bc4-4a43-9c3b-2372a79da5bc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 784 microversion: 2.1 time: 0.029457 Jun 04 20:55:52.618558 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 422/827] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:55:52 2022] GET /compute/v2.1/os-migrations => generated 784 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:52.625093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:52.626338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:52.634133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.634785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.636076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.636700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.732631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:52.744047 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8c43aa1-2b51-4d01-a429-d53d9ce54f1f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.537372 Jun 04 20:55:52.752083 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 406/828] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:52 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:52.757262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:52.758178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:52.766031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.766703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:52.767947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:52.768781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:53.051687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:53.061560 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8d1786e1-a3da-4b5b-8451-6d20a17195ef tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1313 microversion: 2.1 time: 0.441528 Jun 04 20:55:53.074463 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 423/829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:52 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:53.081656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-90753161"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:53.083057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:53.103367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:53.103966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:53.104864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:53.105372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:53.232423 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a6bae47-947c-4791-863b-a52e67360649 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1629 microversion: 2.1 time: 0.476430 Jun 04 20:55:53.233477 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 407/830] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:52 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1629 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:53.242607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:53.248867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:53.264074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:53.277049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:53.278021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:53.279423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:53.280048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:53.329188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:53.648897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-349f34d1-8eb5-46f3-9f43-66a3c9cd26b9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action" status: 202 len: 0 microversion: 2.1 time: 0.568642 Jun 04 20:55:53.651010 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 424/831] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:55:53 2022] POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 20:55:53.667922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-269514517", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1c9de366-78f1-4170-a48a-3f63d1e5098e"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:53.732842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] validate_networks() for [('1c9de366-78f1-4170-a48a-3f63d1e5098e', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:53.985453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:54.194047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:54.204345 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10cb70c2-42b7-4e20-a396-2c1d69eb15ff tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.966836 Jun 04 20:55:54.205226 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 408/832] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:53 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:54.221512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:54.236558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:54.250479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.251001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.251909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.252344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.745835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:54.767404 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5ff0c8a0-8ac0-4482-bd1b-56b688851b85 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.553668 Jun 04 20:55:54.767746 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 409/833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:54 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:54.777481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-658aa4f7-7be7-4ef5-8e88-1d0d1691121b req-7c317383-24be-45c5-8f4e-b80488c92d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d163cd0-9337-433d-8d26-eff631b67b79", "tag": "a498e472-baac-49e3-82b9-1a52ea85b732"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:54.797331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-658aa4f7-7be7-4ef5-8e88-1d0d1691121b req-7c317383-24be-45c5-8f4e-b80488c92d24 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.799149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-658aa4f7-7be7-4ef5-8e88-1d0d1691121b req-7c317383-24be-45c5-8f4e-b80488c92d24 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.828821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:54.829860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:54.830491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:54.831049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:54.831763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:54.839357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-658aa4f7-7be7-4ef5-8e88-1d0d1691121b req-7c317383-24be-45c5-8f4e-b80488c92d24 service nova] Creating event network-changed:a498e472-baac-49e3-82b9-1a52ea85b732 for instance 0d163cd0-9337-433d-8d26-eff631b67b79 on nch1-master-1 Jun 04 20:55:54.843946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.844790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.845909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.846556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.874497 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-658aa4f7-7be7-4ef5-8e88-1d0d1691121b req-7c317383-24be-45c5-8f4e-b80488c92d24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104852 Jun 04 20:55:54.874985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:54.876134 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 410/834] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:54.887224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for user ac8ef83fa94e4c9db70a0115cc867dfc and project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:54.908423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:54.908649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268160620"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:54.910410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:54.911785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:54.930774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.932221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.933566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:54.936591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:54.983726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-235d0d55-489c-44c9-bae1-ce128b02b163 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328724 Jun 04 20:55:54.984790 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 425/835] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:55.000253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:55.001371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:55.015928 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Cannot 'createImage' instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 while it is in task_state image_snapshot Jun 04 20:55:55.016937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.017489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:55.018414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.019092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:55.025315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action HTTP/1.1 Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 84 Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:55:55.027922 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-268160620"}} Jun 04 20:55:55.029387 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: exception: Cannot 'createImage' instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 while it is in task_state image_snapshot Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-268160620'}}} Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:55:55.030130 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 while it is in task_state image_snapshot Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 while it is in task_state image_snapshot Jun 04 20:55:55.031356 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:55:55.034659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 409 to user: Cannot 'createImage' instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 while it is in task_state image_snapshot {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:55:55.035926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7f05b39-c591-41cc-87eb-822ab7f0c504 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action" status: 409 len: 159 microversion: 2.1 time: 0.157443 Jun 04 20:55:55.042299 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 411/836] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:55:54 2022] POST /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61/action => generated 159 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:55:55.052150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-09c01905-e530-4edb-943e-7811a2580a26 req-6f47d8e1-d524-4d5d-870e-722857cece83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86e3ca0-740c-47ff-a635-ebbabc3609e4", "tag": "f922a9a4-5b23-461e-befb-4b0ac1ffd77d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:55.068312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-09c01905-e530-4edb-943e-7811a2580a26 req-6f47d8e1-d524-4d5d-870e-722857cece83 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.073708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-09c01905-e530-4edb-943e-7811a2580a26 req-6f47d8e1-d524-4d5d-870e-722857cece83 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:55.106950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-09c01905-e530-4edb-943e-7811a2580a26 req-6f47d8e1-d524-4d5d-870e-722857cece83 service nova] Creating event network-changed:f922a9a4-5b23-461e-befb-4b0ac1ffd77d for instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 on nch1-master-1 Jun 04 20:55:55.117486 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-09c01905-e530-4edb-943e-7811a2580a26 req-6f47d8e1-d524-4d5d-870e-722857cece83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073611 Jun 04 20:55:55.118785 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 412/837] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:55.124967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1cd1530b-23c7-4b45-b041-460e0ef374d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:55.126067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1cd1530b-23c7-4b45-b041-460e0ef374d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:55.301786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1cd1530b-23c7-4b45-b041-460e0ef374d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:55.314126 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1cd1530b-23c7-4b45-b041-460e0ef374d1 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1210 microversion: 2.1 time: 0.192911 Jun 04 20:55:55.315991 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 413/838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:55 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1210 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:55.325607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-785dccbb-c7d5-4a07-93ab-2acd6ae699d3 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '.version_select at 0x7f2d025f4280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:55.472064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:55.484618 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14e16a3a-369b-4438-a3fa-d6b184aa48c9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1463 microversion: 2.1 time: 0.495081 Jun 04 20:55:55.486094 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 426/839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:54 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1463 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:55.494779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:55.496157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:55.508748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.509698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:55.510781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.514856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:55.602145 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-785dccbb-c7d5-4a07-93ab-2acd6ae699d3 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/images/d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78" status: 204 len: 0 microversion: 2.1 time: 0.283559 Jun 04 20:55:55.602841 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 414/840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:55 2022] DELETE /compute/v2.1/images/d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:55:55.612420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:55.612930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:55.627831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.630679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:55.633392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:55.634357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:56.164473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:56.175086 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5e1bbf9d-43f6-4586-80d8-b1a75b51fbe3 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.687495 Jun 04 20:55:56.176767 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 427/841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:55 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:56.182628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-961605677", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "224b7274-0065-4e26-806c-ec0195ff3260"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:56.251053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:55:56.578558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:56.590357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-535cd97c-521f-4d37-bba4-c443d29c5a2e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1540 microversion: 2.1 time: 0.982437 Jun 04 20:55:56.594750 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 415/842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:55 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1540 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:55:56.603532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:56.606538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:56.621562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:56.622059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:56.624429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:56.625600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.036168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:57.045129 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9bed6625-178a-4a85-95e6-fdd6a69a0ac9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.448851 Jun 04 20:55:57.048626 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 416/843] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:56 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:57.056914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:57.057879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:57.082562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.083415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.084745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.085684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.193777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:55:57.195059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:55:57.196551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:55:57.197379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:55:57.198034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:55:57.208900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:57.211318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:57.220373 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22810dae-383d-4439-88a9-e1bb95056715 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1280 microversion: 2.1 time: 0.170268 Jun 04 20:55:57.221969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.222749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.223770 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 417/844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:57 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:57.223893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.224396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.248572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Getting quotas for project 9fa1452a653049abab26a782a7d36583. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:55:57.255549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Getting quotas for user 246c32bb6dfc4692beeac1675dd13293 and project 9fa1452a653049abab26a782a7d36583. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:55:57.261468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:57.264602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:57.275405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.276145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.277306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.277964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.293057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:55:57.295751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:55:57.308471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:57.357608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5ea4d2c7-408d-4332-bf38-96106d07b7c0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179159 Jun 04 20:55:57.364229 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 428/845] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:55:57.370423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33541b75-eb90-4ec2-9231-81595d166cab tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:57.371668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33541b75-eb90-4ec2-9231-81595d166cab tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:57.588641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-33541b75-eb90-4ec2-9231-81595d166cab tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:57.598179 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33541b75-eb90-4ec2-9231-81595d166cab tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1213 microversion: 2.1 time: 0.232201 Jun 04 20:55:57.598760 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 429/846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:57 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1213 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:57.622508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:57.623127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:57.641266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.641898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.642904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:57.643392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:57.746134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:57.760630 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-762a0c74-9812-493e-8edc-7080a1931b04 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.535150 Jun 04 20:55:57.767198 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 418/847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:57 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:58.067344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:58.068116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:58.081595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.082083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.088930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.089355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.519555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:58.534529 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba711e77-a95f-414d-8849-2d4a24f11887 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1522 microversion: 2.1 time: 0.920165 Jun 04 20:55:58.540569 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 430/848] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:57 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1522 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:58.562557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:58.565240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:58.567359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:58.572221 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb5ef921-3cb9-4af6-af4b-7f1d3882c8e6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.509833 Jun 04 20:55:58.578062 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 419/849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:58 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:55:58.578960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.579687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.581685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.582364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.583716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:58.584346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:58.609148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.609812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.612591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.613330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.644808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:55:58.695866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:58.705956 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15b8dfa6-37b9-4ca0-b5a1-595aafbc2aed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1268 microversion: 2.1 time: 0.162867 Jun 04 20:55:58.707156 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 431/850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:58 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:58.712880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:58.713668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:58.721022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.721473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.722559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.723005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.826479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:58.828576 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e060a2ef-57bf-4dd7-b8f4-81814d593114 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 204 len: 0 microversion: 2.1 time: 0.247756 Jun 04 20:55:58.834020 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 420/851] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:55:58 2022] DELETE /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:55:58.842464 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f8b62f8f-7b39-4dac-908b-6b7785263793 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1265 microversion: 2.1 time: 0.133754 Jun 04 20:55:58.853092 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 432/852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:58 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:58.853092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:58.853092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:58.853581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:58.854641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:58.871280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.871757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.877489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.877960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.878785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.883396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:58.883614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:58.883968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:59.382906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:59.391696 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-108f4103-32f6-42db-8283-ba8c7c924af0 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.557563 Jun 04 20:55:59.392717 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 421/853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:58 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:59.406656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-091c65a8-3881-44a1-9344-68d8da2fc866 req-47957341-a436-4863-9c81-8fae66c1ab4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d54c244-5d4f-4346-a5d9-83eea81ff576", "name": "network-vif-plugged", "status": "completed", "tag": "3443b767-f8e9-4dca-b30b-375569064aa6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:59.430492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-091c65a8-3881-44a1-9344-68d8da2fc866 req-47957341-a436-4863-9c81-8fae66c1ab4f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:59.431453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-091c65a8-3881-44a1-9344-68d8da2fc866 req-47957341-a436-4863-9c81-8fae66c1ab4f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:59.450532 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-091c65a8-3881-44a1-9344-68d8da2fc866 req-47957341-a436-4863-9c81-8fae66c1ab4f service nova] Creating event network-vif-plugged:3443b767-f8e9-4dca-b30b-375569064aa6 for instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 on nch1-master-1 Jun 04 20:55:59.462579 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-091c65a8-3881-44a1-9344-68d8da2fc866 req-47957341-a436-4863-9c81-8fae66c1ab4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068312 Jun 04 20:55:59.464842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 422/854] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:55:59.487362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:55:59.501077 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e7e5c5d-2c00-4be9-829e-29e06b75a2ab tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1528 microversion: 2.1 time: 0.655816 Jun 04 20:55:59.514405 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 433/855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:58 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1528 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:55:59.599706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:55:59.601065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:55:59.625882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:59.629878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:59.630923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:55:59.632953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:55:59.709731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-656155216", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "7fe230fa-36c4-4e71-87a1-f7b5d240e42e"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:55:59.845842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] validate_networks() for [('7fe230fa-36c4-4e71-87a1-f7b5d240e42e', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:00.067147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:00.078068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0a0dd2db-07da-44a7-a1ec-ba7c4ac04eaf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.484507 Jun 04 20:56:00.080573 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 434/856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:55:59 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:00.095344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:00.095984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:00.107066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:00.107853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:00.109642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:00.111231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:00.553919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:00.589310 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-506dc85f-f391-4e7d-8639-e07cf4233c94 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.507434 Jun 04 20:56:00.590222 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 435/857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:00 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:00.607958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:00.610049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:00.618961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:00.620394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:00.621653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:00.622862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:00.733356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:00.733788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:00.734269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:00.734680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:00.735093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:00.761145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:00.761882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:00.763244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:00.764365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:00.805446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Getting quotas for project d7e3eb86f0f143ff9186ebfd23f098d8. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:00.821389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Getting quotas for user c42a1a43a21342fd9cbdd5a48b828485 and project d7e3eb86f0f143ff9186ebfd23f098d8. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:00.849229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:00.851900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:00.966598 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b3fd09a5-95c6-473a-a305-b8536cd03ba3 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498859 Jun 04 20:56:00.972647 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 423/858] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:56:00.999653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:01.000676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:01.011438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.014506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.015947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.017287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.128452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:01.139493 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3c99785b-a139-4c81-9c2d-f92cbf5004c3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.547844 Jun 04 20:56:01.140134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 436/859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:00 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:01.153036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:01.154140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:01.165438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.166872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.167750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.168480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.505107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:01.514180 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf29937d-f3eb-49a0-b4ae-51caeb42a5a4 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1367 microversion: 2.1 time: 0.538730 Jun 04 20:56:01.527255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 424/860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:00 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:01.532955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ed350cb-bba6-479c-94cf-c944f56e55a6 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:01.533978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ed350cb-bba6-479c-94cf-c944f56e55a6 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:01.649591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ed350cb-bba6-479c-94cf-c944f56e55a6 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:01.660191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ed350cb-bba6-479c-94cf-c944f56e55a6 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1216 microversion: 2.1 time: 0.131171 Jun 04 20:56:01.670537 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 425/861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:01 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:01.687148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:01.687148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:01.690506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:01.705960 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6e6160da-f42f-4061-9f46-77d5547c0527 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1528 microversion: 2.1 time: 0.560259 Jun 04 20:56:01.717552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.717552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.717552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.717552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.718767 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 437/862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:01 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1528 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:01.730848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:01.732871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:01.756119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.757537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:01.761848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:01.764580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.189255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:02.207406 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b37c6903-7ad7-4b0f-b447-811fcb1336f3 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.487087 Jun 04 20:56:02.209629 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 438/863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:01 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:02.216070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:02.220089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0b6fd7ae-fb73-4fd8-9763-7af959bfb6ce req-c95d562d-13b2-4480-8ece-df86895cb73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d7e4b8-0a2f-475c-b7e4-4c82582b189b", "tag": "dfa86e07-8d1c-4846-80e1-da35a0f8beb8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:02.227207 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb4b8d73-7d1c-4692-8f8b-3601f4d56fc2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.556563 Jun 04 20:56:02.232410 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 426/864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:01 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:02.253193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:02.255317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:02.271451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.272013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.273926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.275199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.288622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0b6fd7ae-fb73-4fd8-9763-7af959bfb6ce req-c95d562d-13b2-4480-8ece-df86895cb73e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.289156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0b6fd7ae-fb73-4fd8-9763-7af959bfb6ce req-c95d562d-13b2-4480-8ece-df86895cb73e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.305363 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0b6fd7ae-fb73-4fd8-9763-7af959bfb6ce req-c95d562d-13b2-4480-8ece-df86895cb73e service nova] Creating event network-changed:dfa86e07-8d1c-4846-80e1-da35a0f8beb8 for instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b on nch1-master-1 Jun 04 20:56:02.313139 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0b6fd7ae-fb73-4fd8-9763-7af959bfb6ce req-c95d562d-13b2-4480-8ece-df86895cb73e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101089 Jun 04 20:56:02.314184 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 439/865] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:02.435282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a563cce3-0605-4d0c-a72c-9c265e3c4a53 req-443f30f9-88d6-4097-a1a4-d6d804528bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d163cd0-9337-433d-8d26-eff631b67b79", "name": "network-vif-plugged", "status": "completed", "tag": "a498e472-baac-49e3-82b9-1a52ea85b732"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:02.462979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a563cce3-0605-4d0c-a72c-9c265e3c4a53 req-443f30f9-88d6-4097-a1a4-d6d804528bdd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.464472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a563cce3-0605-4d0c-a72c-9c265e3c4a53 req-443f30f9-88d6-4097-a1a4-d6d804528bdd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.490178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a563cce3-0605-4d0c-a72c-9c265e3c4a53 req-443f30f9-88d6-4097-a1a4-d6d804528bdd service nova] Creating event network-vif-plugged:a498e472-baac-49e3-82b9-1a52ea85b732 for instance 0d163cd0-9337-433d-8d26-eff631b67b79 on nch1-master-1 Jun 04 20:56:02.498958 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a563cce3-0605-4d0c-a72c-9c265e3c4a53 req-443f30f9-88d6-4097-a1a4-d6d804528bdd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070152 Jun 04 20:56:02.500247 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 440/866] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:02.558557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:02.562944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:02.598758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.603007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.610081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.611558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.816175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:02.837141 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0a9a30c-d326-4d8e-bef9-19c493d446d2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.602656 Jun 04 20:56:02.838465 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 427/867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:02 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:02.853923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:02.855350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:02.875531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.881499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:02.882352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:02.883199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.009581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:03.018332 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3763f001-6217-432b-ac36-f5c46a781318 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1286 microversion: 2.1 time: 0.176311 Jun 04 20:56:03.018920 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 428/868] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:02 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:03.026252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:03.026868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:03.030904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:03.034963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.035632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.036626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.037063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.073304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.073746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.074196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lazy-loading 'fault' on Instance uuid 8450d7af-48da-41c7-ae02-87f6e2f11e61 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:03.086316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:03.095320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ac61e4f-77fc-48e0-9183-166b63019652 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1555 microversion: 2.1 time: 0.561855 Jun 04 20:56:03.095912 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 441/869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:02 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1555 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:03.113149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:03.114040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:03.122725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.123497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.124236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.124839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.158602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:03.166616 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d8f8b30-4b63-42e7-b544-a6f060ff0d06 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 200 len: 1315 microversion: 2.1 time: 0.144059 Jun 04 20:56:03.167693 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 429/870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:03 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:03.180563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2049e78e-1f39-433e-b5c5-488a553d4494 req-d3caf507-9acf-4e54-a8bc-1976023263e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "035c612b-2d06-4d52-a27d-c917714c1b39", "tag": "dfeaa60f-c871-4ada-9f0d-e029f1ce9898"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:03.190951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2049e78e-1f39-433e-b5c5-488a553d4494 req-d3caf507-9acf-4e54-a8bc-1976023263e4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.191745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2049e78e-1f39-433e-b5c5-488a553d4494 req-d3caf507-9acf-4e54-a8bc-1976023263e4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.209666 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2049e78e-1f39-433e-b5c5-488a553d4494 req-d3caf507-9acf-4e54-a8bc-1976023263e4 service nova] Creating event network-changed:dfeaa60f-c871-4ada-9f0d-e029f1ce9898 for instance 035c612b-2d06-4d52-a27d-c917714c1b39 on nch1-master-1 Jun 04 20:56:03.216575 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2049e78e-1f39-433e-b5c5-488a553d4494 req-d3caf507-9acf-4e54-a8bc-1976023263e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046772 Jun 04 20:56:03.217514 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 430/871] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:03.229303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:03.229728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:03.245903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.246766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.247434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.247829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.286436 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd766aa1-427a-46bf-abb1-64da729112a1 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177916 Jun 04 20:56:03.287044 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 442/872] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:56:03 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:03.295481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:03.296133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:03.313627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.314217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.315024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.315468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.766413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:03.772212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:03.776072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-02b855c3-d7df-47eb-bd65-2c64ce99bb9f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.487657 Jun 04 20:56:03.777491 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 443/873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:03 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:03.790796 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a634dee-0a3b-4ee7-8c98-ad966cfedb20 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.565950 Jun 04 20:56:03.802764 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 431/874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:03 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:03.856957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:03.857579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:03.867967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.868652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:03.869840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:03.870500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.036272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:04.037683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:04.046370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.047549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.048820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.049840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.438735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:04.447374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72372184-e4be-4ef5-b42e-b82ea1b4e2ad tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.594604 Jun 04 20:56:04.448657 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 444/875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:03 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:04.455143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:04.456097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:04.463965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.464567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.465230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.465700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.482866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 HTTP/1.1 Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:04.484910 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:04.486553 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61'} Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:04.487621 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:04.489157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:04.490796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:04.490796 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3447fd3e-a7f9-426c-9d2c-46544bce1635 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 404 len: 111 microversion: 2.1 time: 0.036483 Jun 04 20:56:04.490796 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 445/876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:04 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:04.499894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cec7dc37-113b-40e2-9d4b-749e28a6a570 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'create', calling method: .version_select at 0x7f2d026989d0>, body: {"keypair": {"name": "tempest-keypair-1338783525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWnWKesPohdno2CMsI7/UCZbWH5lvdHyGp7bh2fj5Yz5y3BFM38AjurNRxy/KG8gmMrtpfuVMlwwbciTeqt3grntUdbxJU6+OIvVYR8rzLT/IVkUuh/xE+oNr4Wi5I+OA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:04.513857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=29 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:04.516781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-cec7dc37-113b-40e2-9d4b-749e28a6a570 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for project 84c448aaa2a549c8a333b029ea89b104. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:04.523719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-cec7dc37-113b-40e2-9d4b-749e28a6a570 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for user 598884c9d0964ad6992f79eaf770507d and project 84c448aaa2a549c8a333b029ea89b104. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:04.564091 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cec7dc37-113b-40e2-9d4b-749e28a6a570 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068731 Jun 04 20:56:04.564908 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 446/877] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:56:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:04.619201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a09194a3-af55-4ed7-b7e9-241ed0787dc0 req-aca102ab-1f4c-4de1-a583-52f7837a7972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8450d7af-48da-41c7-ae02-87f6e2f11e61", "name": "network-vif-deleted", "tag": "463ceab6-8121-4d0e-a3f5-ada2246072d4"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:04.630983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a09194a3-af55-4ed7-b7e9-241ed0787dc0 req-aca102ab-1f4c-4de1-a583-52f7837a7972 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.631678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a09194a3-af55-4ed7-b7e9-241ed0787dc0 req-aca102ab-1f4c-4de1-a583-52f7837a7972 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.632632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:04.647843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40fff029-5199-4b2c-947f-4543ad680e19 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.616172 Jun 04 20:56:04.651931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a09194a3-af55-4ed7-b7e9-241ed0787dc0 req-aca102ab-1f4c-4de1-a583-52f7837a7972 service nova] Creating event network-vif-deleted:463ceab6-8121-4d0e-a3f5-ada2246072d4 for instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 on nch2-master-1 Jun 04 20:56:04.660096 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 432/878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:04 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:04.662205 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a09194a3-af55-4ed7-b7e9-241ed0787dc0 req-aca102ab-1f4c-4de1-a583-52f7837a7972 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046843 Jun 04 20:56:04.663103 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 447/879] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:04.795607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:04.796393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:04.808773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:04.809625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:04.813804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.814935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.815741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.819008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.824733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.825229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.826348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:04.828823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:04.872537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:05.349455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:05.353575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:05.360715 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-68536813-52a5-402b-a22f-8ea689b948ce tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.556311 Jun 04 20:56:05.374245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 448/880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:04 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:05.382282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c0cd2969-97c5-4151-b62c-ef51fca1478c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1317 microversion: 2.1 time: 0.591260 Jun 04 20:56:05.392327 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 433/881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:04 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:05.473524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:05.474159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:05.484312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:05.484762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:05.485546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:05.486606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:05.667319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:05.668014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:05.684653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:05.687240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:05.690367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:05.693673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.091778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:06.107178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6f435f6-22a2-4a9b-a270-600bd89dd48a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.643897 Jun 04 20:56:06.111528 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 449/882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:05 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:06.127288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4d92013c-94a4-4dbe-8f81-12a946679b93 req-10ab113b-ecfe-4483-8858-5978706a2c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d54c244-5d4f-4346-a5d9-83eea81ff576", "tag": "3443b767-f8e9-4dca-b30b-375569064aa6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:06.139949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:06.156316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4d92013c-94a4-4dbe-8f81-12a946679b93 req-10ab113b-ecfe-4483-8858-5978706a2c64 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.158155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4d92013c-94a4-4dbe-8f81-12a946679b93 req-10ab113b-ecfe-4483-8858-5978706a2c64 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.170506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-130ee9b7-9453-4ebb-915b-37a33f51c8e7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.507745 Jun 04 20:56:06.174428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 434/883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:05 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:06.195108 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4d92013c-94a4-4dbe-8f81-12a946679b93 req-10ab113b-ecfe-4483-8858-5978706a2c64 service nova] Creating event network-changed:3443b767-f8e9-4dca-b30b-375569064aa6 for instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 on nch1-master-1 Jun 04 20:56:06.223968 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4d92013c-94a4-4dbe-8f81-12a946679b93 req-10ab113b-ecfe-4483-8858-5978706a2c64 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108985 Jun 04 20:56:06.226350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 450/884] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:06.381807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:06.382792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:06.396138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.396688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.398438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.401977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.403419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:06.404526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:06.415815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.420443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.422345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.423401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.786180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:06.798394 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cee41ae9-de41-4eed-ae77-69c60a1f64dd tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1466 microversion: 2.1 time: 0.398700 Jun 04 20:56:06.801603 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 451/885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:06 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1466 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:06.803744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:06.811348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:06.813167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5ab5cde0-eb65-49c3-ad83-33623eec5f9b req-c0953836-bf8c-4a7d-bedc-27885b291f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e678f271-2e46-42e1-84a0-10c25de10d33", "tag": "2a2c345e-002b-4d98-8ce4-f9f7b6df43c4"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:06.818841 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9cd8d258-ad35-43cf-8b1f-b734483c08c4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.441983 Jun 04 20:56:06.819994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 435/886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:06 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:06.826764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:06.827867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:06.835120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5ab5cde0-eb65-49c3-ad83-33623eec5f9b req-c0953836-bf8c-4a7d-bedc-27885b291f2c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.835712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5ab5cde0-eb65-49c3-ad83-33623eec5f9b req-c0953836-bf8c-4a7d-bedc-27885b291f2c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.836036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.836573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.837499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:06.838883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:06.880714 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5ab5cde0-eb65-49c3-ad83-33623eec5f9b req-c0953836-bf8c-4a7d-bedc-27885b291f2c service nova] Creating event network-changed:2a2c345e-002b-4d98-8ce4-f9f7b6df43c4 for instance e678f271-2e46-42e1-84a0-10c25de10d33 on nch2-master-1 Jun 04 20:56:06.891616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5ab5cde0-eb65-49c3-ad83-33623eec5f9b req-c0953836-bf8c-4a7d-bedc-27885b291f2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086563 Jun 04 20:56:06.891616 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 452/887] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:07.009497 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-64b189fa-476d-44e0-ac59-fd45163bc6d9 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1617 microversion: 2.1 time: 0.188209 Jun 04 20:56:07.010109 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 436/888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:06 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1617 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:07.128428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:07.129072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:07.136764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:07.137223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:07.138169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:07.141297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:07.234414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:07.360905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-93d7e83e-8689-4408-864e-9d42c3a17f19 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-342234532", "ram": 512, "vcpus": 1, "disk": 10, "id": 432277663, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:07.363034 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:07.363034 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:07.403771 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-93d7e83e-8689-4408-864e-9d42c3a17f19 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.310957 Jun 04 20:56:07.411094 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 453/889] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:56:07 2022] POST /compute/v2.1/flavors => generated 412 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:07.411464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:07.412684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:07.413739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:07.417605 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20b3add5-15da-403c-ad06-6a87a9a4f735 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.291823 Jun 04 20:56:07.424326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 437/890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:07 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:07.429817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-425015886", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["2d5dd136-9cec-4923-9c8c-2ba3024d18cc"]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:07.431585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:07.432184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:07.433089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:07.433624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:07.520414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:07.852710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:07.862234 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-07405229-41bf-4653-b92e-4013a4e99e55 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.455940 Jun 04 20:56:07.863311 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 454/891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:07 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:08.029331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45bc423d-88a6-4965-aaf3-8f226e23f5be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:08.040012 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-45bc423d-88a6-4965-aaf3-8f226e23f5be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] HTTP exception thrown: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45bc423d-88a6-4965-aaf3-8f226e23f5be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Request method failure captured: Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/flavors/432277663/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8blV91ekgwAm4q_gjPv0cH2AQMbSnPxCxk2QIG-KYToxLIaFPKSHDlaQM1bUPxHByj-hRYzEiw6-9AO-0G5LEuDLVj1PhEiI12Xq0nxvvW1keGA0cZHHh7CHi9kXH1YI-GnRnQriOL0rc4ZvW1e7HfcRK5ExB9F4MO_DYVbB_kZ7kU Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:08.041895 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: cf10808b90884cdbaa2c0a3270aa3c30 Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:08.043780 ncdv-master-1 devstack@n-api.service[137228]: exception: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'flavor_id': '432277663', 'id': 'hw:cpu_thread_policy'} Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:08.044954 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45bc423d-88a6-4965-aaf3-8f226e23f5be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Returning 404 to user: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:08.046675 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45bc423d-88a6-4965-aaf3-8f226e23f5be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] 10.222.0.18 "GET /compute/v2.1/flavors/432277663/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.180471 Jun 04 20:56:08.048310 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 455/892] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:56:07 2022] GET /compute/v2.1/flavors/432277663/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:08.055873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:08.056773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:08.064391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.064928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.065810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.066304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.110537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:08.111207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:08.112236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:08.112754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:08.113234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:08.128038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.128618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.129594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.131158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.160077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:08.179869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:08.213524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:08.216136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:08.273671 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52139a9a-65f9-4f48-9290-d49001407012 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.847104 Jun 04 20:56:08.274882 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 438/893] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:56:08.289485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-896a5441-553b-4e54-875b-5ca1bf29d806 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:08.291880 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:08.291880 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:08.293378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-896a5441-553b-4e54-875b-5ca1bf29d806 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'cf10808b90884cdbaa2c0a3270aa3c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5ba47d66148bab8b148fc01bee663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-896a5441-553b-4e54-875b-5ca1bf29d806 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Request method failure captured: Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/flavors/432277663/os-extra_specs HTTP/1.1 Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 66 Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8blV91ekgwAm4q_gjPv0cH2AQMbSnPxCxk2QIG-KYToxLIaFPKSHDlaQM1bUPxHByj-hRYzEiw6-9AO-0G5LEuDLVj1PhEiI12Xq0nxvvW1keGA0cZHHh7CHi9kXH1YI-GnRnQriOL0rc4ZvW1e7HfcRK5ExB9F4MO_DYVbB_kZ7kU Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:08.296395 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: cf10808b90884cdbaa2c0a3270aa3c30 Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 04 20:56:08.298022 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'flavor_id': '432277663', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:56:08.298955 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 04 20:56:08.300408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.315851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-896a5441-553b-4e54-875b-5ca1bf29d806 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:08.318407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-896a5441-553b-4e54-875b-5ca1bf29d806 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] 10.222.0.18 "POST /compute/v2.1/flavors/432277663/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.034823 Jun 04 20:56:08.324330 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 439/894] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Jun 4 20:56:08 2022] POST /compute/v2.1/flavors/432277663/os-extra_specs => generated 124 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:08.329882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2123519378", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:08.337100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:08.356955 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6ff042d1-80a5-49ff-8482-680c3e045900 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.307241 Jun 04 20:56:08.358033 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 456/895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:08 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:08.374439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-11946581-970e-42e3-a669-71d8c08c5253 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:08.377087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-11946581-970e-42e3-a669-71d8c08c5253 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:08.416674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] validate_networks() for [('1397b8c1-156c-4d89-baa3-b4b97df18a8a', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:08.504400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-11946581-970e-42e3-a669-71d8c08c5253 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:08.513553 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-11946581-970e-42e3-a669-71d8c08c5253 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1216 microversion: 2.1 time: 0.154209 Jun 04 20:56:08.523557 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 457/896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:08 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:08.526697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a1c57f6c-ad3d-4d00-81ed-464ac1ad3c30 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:08.529361 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:08.529361 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:08.567942 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a1c57f6c-ad3d-4d00-81ed-464ac1ad3c30 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/432277663/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045757 Jun 04 20:56:08.574017 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 458/897] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Jun 4 20:56:08 2022] POST /compute/v2.1/flavors/432277663/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:08.579289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:08.580179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:08.582074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:08.587684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.588455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.589556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.590197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.858372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:08.874304 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d40c9bfa-43f3-4850-bcc2-97cea7098a07 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.298712 Jun 04 20:56:08.884440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 459/898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:08 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:08.890288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-360d2cf6-355b-495b-9252-2fcbee961e2c tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:08.891130 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:08.891130 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:08.892094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-360d2cf6-355b-495b-9252-2fcbee961e2c tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'cf10808b90884cdbaa2c0a3270aa3c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5ba47d66148bab8b148fc01bee663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-360d2cf6-355b-495b-9252-2fcbee961e2c tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Request method failure captured: Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8blV91ekgwAm4q_gjPv0cH2AQMbSnPxCxk2QIG-KYToxLIaFPKSHDlaQM1bUPxHByj-hRYzEiw6-9AO-0G5LEuDLVj1PhEiI12Xq0nxvvW1keGA0cZHHh7CHi9kXH1YI-GnRnQriOL0rc4ZvW1e7HfcRK5ExB9F4MO_DYVbB_kZ7kU Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:08.895552 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: cf10808b90884cdbaa2c0a3270aa3c30 Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:08.896913 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'flavor_id': '432277663', 'id': 'hw:numa_nodes'} Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:56:08.897624 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:08.898798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-360d2cf6-355b-495b-9252-2fcbee961e2c tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:08.899864 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-360d2cf6-355b-495b-9252-2fcbee961e2c tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] 10.222.0.18 "DELETE /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009692 Jun 04 20:56:08.899864 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 460/899] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 20:56:08 2022] DELETE /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:08.901288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:08.902035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:08.910962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.910962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:08.911595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:08.912040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.013855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:09.014263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:09.014738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:09.015140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:09.015558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:09.027407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.028173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.029571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.030175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.052141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for project 84c448aaa2a549c8a333b029ea89b104. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:09.058734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for user 598884c9d0964ad6992f79eaf770507d and project 84c448aaa2a549c8a333b029ea89b104. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:09.072974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:09.075723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:09.082816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:09.092748 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01b5a272-6343-426c-92e4-9406bde6540c tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.195390 Jun 04 20:56:09.099599 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 461/900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:08 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:09.099599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ee12a5c-af82-42ef-8012-48421ff10e71 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:09.100667 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:09.100667 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:09.126458 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9ee12a5c-af82-42ef-8012-48421ff10e71 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors/432277663/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031205 Jun 04 20:56:09.127384 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 462/901] 10.222.0.18 () {60 vars in 1220 bytes} [Sat Jun 4 20:56:09 2022] POST /compute/v2.1/flavors/432277663/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:09.134186 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ac39ea0-8ff8-4951-913b-c3857f85f8a0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.812566 Jun 04 20:56:09.135547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 440/902] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:56:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:56:09.144649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13371c75-5e56-427a-9e6b-77245bb538be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:09.146532 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:09.146532 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:09.147581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f554261e-af46-4bfd-8c86-2ef56457162d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.148257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13371c75-5e56-427a-9e6b-77245bb538be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'cf10808b90884cdbaa2c0a3270aa3c30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e5ba47d66148bab8b148fc01bee663', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13371c75-5e56-427a-9e6b-77245bb538be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Request method failure captured: Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 22 Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8blV91ekgwAm4q_gjPv0cH2AQMbSnPxCxk2QIG-KYToxLIaFPKSHDlaQM1bUPxHByj-hRYzEiw6-9AO-0G5LEuDLVj1PhEiI12Xq0nxvvW1keGA0cZHHh7CHi9kXH1YI-GnRnQriOL0rc4ZvW1e7HfcRK5ExB9F4MO_DYVbB_kZ7kU Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:09.150524 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/81e5ba47d66148bab8b148fc01bee663"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 81e5ba47d66148bab8b148fc01bee663 Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: cf10808b90884cdbaa2c0a3270aa3c30 Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: {"hw:numa_nodes": "1"} Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:09.152333 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'flavor_id': '432277663', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:56:09.153524 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 04 20:56:09.154687 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.155895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f554261e-af46-4bfd-8c86-2ef56457162d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:09.156697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13371c75-5e56-427a-9e6b-77245bb538be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:09.158167 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13371c75-5e56-427a-9e6b-77245bb538be tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292 tempest-FlavorsExtraSpecsNegativeTestJSON-1252802292-project] 10.222.0.18 "PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.023409 Jun 04 20:56:09.158972 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 463/903] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:56:09 2022] PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes => generated 124 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:56:09.171180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da9b83cd-623a-4f33-b032-e277a63146c5 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.172029 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:09.172029 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:09.181262 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-da9b83cd-623a-4f33-b032-e277a63146c5 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] HTTP exception thrown: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da9b83cd-623a-4f33-b032-e277a63146c5 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Request method failure captured: Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/flavors/432277663/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8bm8PQfJVeZexfnW2cnRd1I-F1qu6GLBQ4lv_WG7f2pxKuSAlEzTfwD6p4NINd5e9-z94aU1WXDM6n6DMzmgNsfitN2E1RPduXvF-gkPiJ_FVOWrwSZL1TcdiXHEVK2U_Zr2Wyl0DkY_Ced9z7crBMsW2fBkId4RcLbZSWTU4ogLsw Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89d716f2995a43ce834489ceee1da263 Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:56:09.182657 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89d716f2995a43ce834489ceee1da263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d716f2995a43ce834489ceee1da263"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89d716f2995a43ce834489ceee1da263"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d716f2995a43ce834489ceee1da263"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89d716f2995a43ce834489ceee1da263 Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 39ad1af628324c22a7e0233d6bc2652c Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:09.184026 ncdv-master-1 devstack@n-api.service[137228]: exception: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'flavor_id': '432277663', 'id': 'hw:cpu_thread_policy'} Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:09.184868 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da9b83cd-623a-4f33-b032-e277a63146c5 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Returning 404 to user: Flavor 432277663 has no extra specs with key hw:cpu_thread_policy. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:09.186202 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da9b83cd-623a-4f33-b032-e277a63146c5 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/432277663/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.018385 Jun 04 20:56:09.187636 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 464/904] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 20:56:09 2022] DELETE /compute/v2.1/flavors/432277663/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:09.194992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b71f5b5-4d3d-4b03-93e7-660eab78c6fd tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:09.197078 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0b71f5b5-4d3d-4b03-93e7-660eab78c6fd tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b71f5b5-4d3d-4b03-93e7-660eab78c6fd tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Request method failure captured: Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 27 Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8bm8PQfJVeZexfnW2cnRd1I-F1qu6GLBQ4lv_WG7f2pxKuSAlEzTfwD6p4NINd5e9-z94aU1WXDM6n6DMzmgNsfitN2E1RPduXvF-gkPiJ_FVOWrwSZL1TcdiXHEVK2U_Zr2Wyl0DkY_Ced9z7crBMsW2fBkId4RcLbZSWTU4ogLsw Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89d716f2995a43ce834489ceee1da263 Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:56:09.198757 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89d716f2995a43ce834489ceee1da263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d716f2995a43ce834489ceee1da263"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89d716f2995a43ce834489ceee1da263"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d716f2995a43ce834489ceee1da263"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89d716f2995a43ce834489ceee1da263 Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 39ad1af628324c22a7e0233d6bc2652c Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: {"hw:cpu_policy": "shared"} Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:09.200676 ncdv-master-1 devstack@n-api.service[137228]: exception: Request body and URI mismatch Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'flavor_id': '432277663', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.201804 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.203289 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:09.203289 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:09.203289 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 04 20:56:09.203289 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.203289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b71f5b5-4d3d-4b03-93e7-660eab78c6fd tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:09.204246 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b71f5b5-4d3d-4b03-93e7-660eab78c6fd tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.013036 Jun 04 20:56:09.204896 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 465/905] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:56:09 2022] PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes => generated 73 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 04 20:56:09.214364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e0a7532-4552-4b67-bae8-d4eacda10805 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e0a7532-4552-4b67-bae8-d4eacda10805 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Request method failure captured: Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 49 Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8bm8PQfJVeZexfnW2cnRd1I-F1qu6GLBQ4lv_WG7f2pxKuSAlEzTfwD6p4NINd5e9-z94aU1WXDM6n6DMzmgNsfitN2E1RPduXvF-gkPiJ_FVOWrwSZL1TcdiXHEVK2U_Zr2Wyl0DkY_Ced9z7crBMsW2fBkId4RcLbZSWTU4ogLsw Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89d716f2995a43ce834489ceee1da263 Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:56:09.217581 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89d716f2995a43ce834489ceee1da263"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d716f2995a43ce834489ceee1da263"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89d716f2995a43ce834489ceee1da263"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89d716f2995a43ce834489ceee1da263"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89d716f2995a43ce834489ceee1da263 Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 39ad1af628324c22a7e0233d6bc2652c Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 04 20:56:09.219137 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'flavor_id': '432277663', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance: Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 04 20:56:09.220060 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.222572 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e0a7532-4552-4b67-bae8-d4eacda10805 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e0a7532-4552-4b67-bae8-d4eacda10805 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.010452 Jun 04 20:56:09.224048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 466/906] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 20:56:09 2022] PUT /compute/v2.1/flavors/432277663/os-extra_specs/hw:numa_nodes => generated 117 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:56:09.231258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f554261e-af46-4bfd-8c86-2ef56457162d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:09.233095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-099bb399-6643-4021-a28a-199237cea021 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.233095 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:09.233095 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:09.240087 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f554261e-af46-4bfd-8c86-2ef56457162d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1225 microversion: 2.1 time: 0.096866 Jun 04 20:56:09.240975 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 441/907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:09 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:09.258291 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-099bb399-6643-4021-a28a-199237cea021 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/432277663" status: 202 len: 0 microversion: 2.1 time: 0.031351 Jun 04 20:56:09.258868 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 467/908] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:56:09 2022] DELETE /compute/v2.1/flavors/432277663 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:56:09.268271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3f652d4-4b9e-4b23-b293-344cc84c1f5d tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.288652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3f652d4-4b9e-4b23-b293-344cc84c1f5d tempest-FlavorsExtraSpecsNegativeTestJSON-247134289 tempest-FlavorsExtraSpecsNegativeTestJSON-247134289-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024895 Jun 04 20:56:09.289216 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 442/909] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:09.375557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.376270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:09.384982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.385705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.386647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.387232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.533398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.534136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:09.549237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.550113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.551441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.554019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.630932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:09.647668 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98b2c31e-5973-42f6-9262-1e15d7c2ed72 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.275843 Jun 04 20:56:09.649811 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 468/910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:09 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:09.697231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:09.715418 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-124aba43-7c8f-4d59-9beb-ccb8bbaf43e0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1268 microversion: 2.1 time: 0.184983 Jun 04 20:56:09.719042 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 443/911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:09 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:09.893131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:09.893850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:09.914890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.914890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:09.915684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:09.916071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.101746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-85250c44-0f8a-443c-b32c-d752039a59df req-70fc063f-b83f-46cd-ae0a-4ea3c2fd62bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d7e4b8-0a2f-475c-b7e4-4c82582b189b", "name": "network-vif-plugged", "status": "completed", "tag": "dfa86e07-8d1c-4846-80e1-da35a0f8beb8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:10.129903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-85250c44-0f8a-443c-b32c-d752039a59df req-70fc063f-b83f-46cd-ae0a-4ea3c2fd62bb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.131927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-85250c44-0f8a-443c-b32c-d752039a59df req-70fc063f-b83f-46cd-ae0a-4ea3c2fd62bb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.179492 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-85250c44-0f8a-443c-b32c-d752039a59df req-70fc063f-b83f-46cd-ae0a-4ea3c2fd62bb service nova] Creating event network-vif-plugged:dfa86e07-8d1c-4846-80e1-da35a0f8beb8 for instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b on nch1-master-1 Jun 04 20:56:10.195733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:10.201725 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-85250c44-0f8a-443c-b32c-d752039a59df req-70fc063f-b83f-46cd-ae0a-4ea3c2fd62bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105559 Jun 04 20:56:10.203581 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 444/912] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:10.208838 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3bb9adc-ea09-44ff-9ccc-9d2003776054 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.320533 Jun 04 20:56:10.209657 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 469/913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:09 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:10.230131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:10.231403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:10.246658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.247501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.248725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.249176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.267200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:10.267865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:10.292900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.293366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.299308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.299943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.854013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:10.863704 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b28a0e6-172e-477b-adec-7a142e4c0557 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1277 microversion: 2.1 time: 0.609881 Jun 04 20:56:10.874249 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 470/914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:10 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1277 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:10.879608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:10.881067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:10.888110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.888694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:10.889846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:10.890389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:11.160984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:11.175265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-888ddbe7-1d74-4cef-9810-67dab215bcd8 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.969953 Jun 04 20:56:11.176403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 445/915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:10 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:11.181565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:11.187336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:11.195991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:11.196861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:11.197921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:11.198556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:11.315153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:11.324688 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4b62a6c-a490-4ac8-b726-039ca19477ae tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.448955 Jun 04 20:56:11.336540 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 471/916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:10 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:11.342255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:11.343186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:11.365001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:11.365650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:11.366794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:11.367452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:11.689646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:11.699115 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8db6e4c-da59-4bfe-912d-3146189b11be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.521120 Jun 04 20:56:11.699740 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 446/917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:11 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:11.725518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:11.733765 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a720816-49ed-4ca8-ae0c-48aa26f8d614 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.395677 Jun 04 20:56:11.745014 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 472/918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:11 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:11.881087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:11.882073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:11.890281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:11.891193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:11.892086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:11.893224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.036257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:12.047996 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a3744bce-5ec7-4535-9ca1-bf0b66b23053 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1283 microversion: 2.1 time: 0.170807 Jun 04 20:56:12.062500 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 447/919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:11 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:12.194295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:12.198916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:12.216968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.217717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.219024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.219945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.291541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4d942d01-9d00-446e-b771-f7ea6f42313a req-bdfacf5c-c911-4952-8484-b0f270581c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1e680a2-7857-43ab-bb59-3c7ddb5ef666", "tag": "36ac5132-5332-4755-bb63-e4be93fabd3d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:12.308065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d942d01-9d00-446e-b771-f7ea6f42313a req-bdfacf5c-c911-4952-8484-b0f270581c43 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.318251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d942d01-9d00-446e-b771-f7ea6f42313a req-bdfacf5c-c911-4952-8484-b0f270581c43 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.336263 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4d942d01-9d00-446e-b771-f7ea6f42313a req-bdfacf5c-c911-4952-8484-b0f270581c43 service nova] Creating event network-changed:36ac5132-5332-4755-bb63-e4be93fabd3d for instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 on nch1-master-1 Jun 04 20:56:12.349198 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4d942d01-9d00-446e-b771-f7ea6f42313a req-bdfacf5c-c911-4952-8484-b0f270581c43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061578 Jun 04 20:56:12.351950 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 448/920] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:12.368677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:12.369865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:12.384952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.385826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.387020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.387932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.612373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:12.627377 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3655c57a-44fb-459d-b93f-2d88ea07201e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.433445 Jun 04 20:56:12.639999 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 473/921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:12 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:12.718149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:12.719064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:12.726271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.726722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.727713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.728287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.755739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:12.776926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5699ce61-7dbd-43c9-a5ae-96bf12a0c453 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1310 microversion: 2.1 time: 0.423287 Jun 04 20:56:12.785343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 449/922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:12 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1310 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:12.801934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:12.808084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:12.815833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.816952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:12.818284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:12.819223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.043076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:13.067760 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cfb3c4e8-dc6d-4d50-a2e8-449c955f52ef tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.353607 Jun 04 20:56:13.079122 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 474/923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:12 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:13.084613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:13.085676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:13.093684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.094473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.095470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.096826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.149201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:13.160896 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7ac96569-f785-4af3-8770-08e2f7c22ebb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.373924 Jun 04 20:56:13.173127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 450/924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:12 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:13.222946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-83bdb900-6480-4086-b944-05e839004d39 req-82be3fb0-087c-4fcf-af77-59f636954226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035c612b-2d06-4d52-a27d-c917714c1b39", "name": "network-vif-plugged", "status": "completed", "tag": "dfeaa60f-c871-4ada-9f0d-e029f1ce9898"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:13.237570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-83bdb900-6480-4086-b944-05e839004d39 req-82be3fb0-087c-4fcf-af77-59f636954226 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.240829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-83bdb900-6480-4086-b944-05e839004d39 req-82be3fb0-087c-4fcf-af77-59f636954226 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.267849 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-83bdb900-6480-4086-b944-05e839004d39 req-82be3fb0-087c-4fcf-af77-59f636954226 service nova] Creating event network-vif-plugged:dfeaa60f-c871-4ada-9f0d-e029f1ce9898 for instance 035c612b-2d06-4d52-a27d-c917714c1b39 on nch1-master-1 Jun 04 20:56:13.279591 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-83bdb900-6480-4086-b944-05e839004d39 req-82be3fb0-087c-4fcf-af77-59f636954226 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060222 Jun 04 20:56:13.288202 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 451/925] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:13.592593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:13.605840 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4499bbd9-31b0-4862-b20e-1231a47fdbc1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1325 microversion: 2.1 time: 0.525035 Jun 04 20:56:13.608122 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 475/926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:13 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:13.650025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:13.650861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:13.660354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.661067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.661972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.662612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.697125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0381cf8b-db1d-4987-ae1b-b7ee7c57db29 req-b2482969-5bdd-42e6-b382-b14ba0918004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30ca160-6726-48c7-803a-ab92978dc2db", "tag": "08a79507-9f73-439a-8a5f-f0486ffc2075"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:13.725848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0381cf8b-db1d-4987-ae1b-b7ee7c57db29 req-b2482969-5bdd-42e6-b382-b14ba0918004 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.727178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0381cf8b-db1d-4987-ae1b-b7ee7c57db29 req-b2482969-5bdd-42e6-b382-b14ba0918004 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.741970 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0381cf8b-db1d-4987-ae1b-b7ee7c57db29 req-b2482969-5bdd-42e6-b382-b14ba0918004 service nova] Creating event network-changed:08a79507-9f73-439a-8a5f-f0486ffc2075 for instance e30ca160-6726-48c7-803a-ab92978dc2db on nch2-master-1 Jun 04 20:56:13.747568 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0381cf8b-db1d-4987-ae1b-b7ee7c57db29 req-b2482969-5bdd-42e6-b382-b14ba0918004 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054827 Jun 04 20:56:13.748334 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 476/927] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:13.801231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:13.802112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:13.809586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.810193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:13.811195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:13.811818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.002389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:14.010762 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d3cc23d8-c8ee-4533-b886-6ffb636fa3ad tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.367441 Jun 04 20:56:14.011609 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 452/928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:13 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:14.088301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:14.088926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:14.096938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.097763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.098878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.099499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.099683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:14.113151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ee3d01c4-d4b4-44ca-807c-61aa3e043b88 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1493 microversion: 2.1 time: 0.316504 Jun 04 20:56:14.114449 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 477/929] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:13 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1493 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:14.130422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:14.130802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:14.145871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.146513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.147451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.147846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.155347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:14.441786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:14.453286 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dfe1bf76-8078-4b10-9e96-b4fcf4d79706 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.369625 Jun 04 20:56:14.454384 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 453/930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:14 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:14.461116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:14.462145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:14.472302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.473060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.474368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.474968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.477347 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc374c7b-5838-432e-9d98-e14d3dd2dabc tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1644 microversion: 2.1 time: 0.350744 Jun 04 20:56:14.479363 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 478/931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:14 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1644 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:14.500679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:14.503951 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:14.503951 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:14.506943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.508418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.509893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.510448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.543182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048822 Jun 04 20:56:14.551006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 479/932] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:56:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:14.551006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:14.551006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b80540f0-b926-4f20-a333-5eab293073e0 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001198 Jun 04 20:56:14.551006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 480/933] 10.222.0.18 () {56 vars in 885 bytes} [Sat Jun 4 20:56:14 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 04 20:56:14.625815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:14.626361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:14.633494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.633943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.634920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:14.635785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:14.659906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:14.671933 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5207eac-a6d4-4088-836e-89120286790a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.216075 Jun 04 20:56:14.673945 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 454/934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:14 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:14.799067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:14.807255 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45671af6-a7c0-48f4-bdfc-187e311f4d5d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1325 microversion: 2.1 time: 0.186128 Jun 04 20:56:14.811776 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 481/935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:14 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:15.031953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:15.033101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:15.041277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.042069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.043028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.043704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.239653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:15.250807 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-339df814-9357-4a60-aed6-f5ecb594e292 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.223361 Jun 04 20:56:15.252401 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 455/936] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:15 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:15.306385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-29ea0dd9-014e-406e-b519-0b3546153e92 req-3d195dd7-cd5b-4624-91c8-a068afbbbdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e678f271-2e46-42e1-84a0-10c25de10d33", "name": "network-vif-plugged", "status": "completed", "tag": "2a2c345e-002b-4d98-8ce4-f9f7b6df43c4"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:15.325376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-29ea0dd9-014e-406e-b519-0b3546153e92 req-3d195dd7-cd5b-4624-91c8-a068afbbbdc7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.326705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-29ea0dd9-014e-406e-b519-0b3546153e92 req-3d195dd7-cd5b-4624-91c8-a068afbbbdc7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.339447 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-29ea0dd9-014e-406e-b519-0b3546153e92 req-3d195dd7-cd5b-4624-91c8-a068afbbbdc7 service nova] Creating event network-vif-plugged:2a2c345e-002b-4d98-8ce4-f9f7b6df43c4 for instance e678f271-2e46-42e1-84a0-10c25de10d33 on nch2-master-1 Jun 04 20:56:15.345021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-29ea0dd9-014e-406e-b519-0b3546153e92 req-3d195dd7-cd5b-4624-91c8-a068afbbbdc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045496 Jun 04 20:56:15.349230 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 482/937] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:15.476033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:15.476751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:15.496009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.496527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.505416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.505920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.695205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:15.697073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:15.709986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.710883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.712843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.713684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.734383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:15.751412 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd1f400c-6ecc-4816-af02-ad2e7f736c29 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.279349 Jun 04 20:56:15.755066 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 456/938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:15 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:15.828472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:15.829513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:15.843682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.844706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:15.847251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:15.848036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:16.053844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:16.065239 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5a93b1fe-b527-4e3c-9ba7-8acb35f3a7e5 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1313 microversion: 2.1 time: 0.376889 Jun 04 20:56:16.066174 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 483/939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:15 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:16.109680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:16.119121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dbfca02e-a856-4873-a0f4-0a9e86fac8ff tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1325 microversion: 2.1 time: 0.296575 Jun 04 20:56:16.129730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 457/940] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:15 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1325 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:16.269548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:16.270939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:16.279012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:16.280318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:16.281651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:16.282281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:16.446862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94b159b1-5ff2-48ce-8547-8af2ac101852", "device": "/dev/xvdb"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:16.450157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:16.458583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:16.459391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:16.460372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:16.460990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:16.570355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:16.582028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-95eadb9a-e11b-4c18-86dd-02fb6120b1c7 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1316 microversion: 2.1 time: 0.316596 Jun 04 20:56:16.582641 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 484/941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:16 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:16.706598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:16.770426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:16.771478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:16.781364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:16.783208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:16.784385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:16.785290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.017408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:17.027142 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb772b34-95c1-45c3-8c6a-9c8c55b9b255 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.261327 Jun 04 20:56:17.027820 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 485/942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:16 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:17.033855 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-562a4f39-e025-495a-84f2-e730fdeb8568 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "POST /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593050 Jun 04 20:56:17.034687 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 458/943] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 20:56:16 2022] POST /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:17.095711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:17.096236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:17.104406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:17.105516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.106802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:17.107579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.140407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:17.141105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:17.149088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:17.149535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.150350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:17.150779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.703362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:17.716135 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-204f57ee-34e0-4f8d-b071-be04028c657d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1463 microversion: 2.1 time: 0.633317 Jun 04 20:56:17.733877 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 486/944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:17 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1463 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:17.740304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:17.741496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:17.747865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:17.758272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:17.759137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.760297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:17.761125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:17.762523 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdcaaa80-7315-4d79-a467-394cba2cab61 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1325 microversion: 2.1 time: 0.628014 Jun 04 20:56:17.763324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 459/945] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:17 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1325 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:17.990102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:17.999296 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4e5e3af-e626-4e70-ade1-3e23f3bb77eb tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1505 microversion: 2.1 time: 0.272581 Jun 04 20:56:18.000630 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 487/946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:17 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:18.019469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.020517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:18.038813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.040471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.042216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.042890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.075280 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fb570e28-2e4a-4b95-81ea-58aa559e0d72 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33/ips" status: 200 len: 109 microversion: 2.1 time: 0.059765 Jun 04 20:56:18.098748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 488/947] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33/ips => generated 109 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:18.108632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.115826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:18.139345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.139969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.141531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.143047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.144778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.148933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'deleted': False, 'project_id': '348fba13f0894035849ca231b5ed317e'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:18.160226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.160678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.161488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.161927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.254283 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-acd3bed8-13a8-4834-9ae0-dd6d7c2f51dc tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.489815 Jun 04 20:56:18.256380 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 460/948] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:17 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:18.262161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.262924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:18.273025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.273944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.274896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.275526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.328596 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1f682638-9726-4e2a-8226-967fca5d9e2d tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33/ips" status: 200 len: 109 microversion: 2.1 time: 0.070606 Jun 04 20:56:18.330241 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 461/949] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33/ips => generated 109 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:18.342249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.349687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'deleted': False} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:18.361347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.367903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.369048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.369530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.415937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:18.439239 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-28654c44-aec4-4ac9-af8c-2df907bf1d8b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.338370 Jun 04 20:56:18.440392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 489/950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:18.445334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.446084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:18.454458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.455356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.456572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.458023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.491377 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01d37c5b-5b6c-46af-aa54-ac0a0d63ea01 tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33/ips/tempest-ServerAddressesTestJSON-1188025022-network" status: 200 len: 94 microversion: 2.1 time: 0.049829 Jun 04 20:56:18.496123 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 490/951] 10.222.0.18 () {58 vars in 1400 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33/ips/tempest-ServerAddressesTestJSON-1188025022-network => generated 94 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:18.506986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.507495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:18.524894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=5 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:18.533337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.537019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.538644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.542145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.575052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:56:18.584328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:18.670892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:18.678607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.679064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.698117 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b695fb4f-d3ed-434c-891d-2bb911525e7f tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 204 len: 0 microversion: 2.1 time: 0.194435 Jun 04 20:56:18.704099 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 491/952] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:18 2022] DELETE /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:18.897170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d0266fd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.898413 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:18.898413 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:18.899891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.900422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.920952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.921435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.938448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.939098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.947605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9561fd5b-993e-4425-922a-22514ff0b55b tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.241477 Jun 04 20:56:18.954067 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 492/953] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:18.957580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:18.959282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:18.968248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.968248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:18.969415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:18.970361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.205857 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df610f7c-5387-4c0e-aa7b-da81466e57f6 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 27604 microversion: 2.1 time: 0.868794 Jun 04 20:56:19.206518 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 462/954] 10.222.0.18 () {58 vars in 1170 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 27604 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:56:19.210735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:19.218065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.218809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:19.218973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ae1178c-0f2c-4133-b315-5f4282ed756e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1511 microversion: 2.1 time: 0.268849 Jun 04 20:56:19.219720 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 493/955] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:18 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:19.225835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.226351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.227179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.229064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.234201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d022cf160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.234931 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.234931 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:19.236134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.236603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.252721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.253192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.265605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.266053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.274840 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f36e2e2-7458-4377-a9ff-7d38586c0cad tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.044982 Jun 04 20:56:19.275574 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 494/956] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:19.287789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.292941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'deleted': False, 'project_id': '348fba13f0894035849ca231b5ed317e'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:19.303207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.303683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.304478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.305043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.391128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:19.401964 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-216b4e32-c11e-4399-b009-cba5c88e2d10 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1325 microversion: 2.1 time: 0.193917 Jun 04 20:56:19.403294 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 463/957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:19.406917 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9f04d0c-d89f-489a-8d2c-8d35eaa32f7f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?tenant_id=9fa1452a653049abab26a782a7d36583" status: 200 len: 15 microversion: 2.1 time: 0.125624 Jun 04 20:56:19.407109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 495/958] 10.222.0.18 () {58 vars in 1230 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers/detail?tenant_id=9fa1452a653049abab26a782a7d36583 => generated 15 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:19.411055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d024a9c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.411739 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.411739 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.413660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.414169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.424628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.429566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'tenant_id': '9fa1452a653049abab26a782a7d36583', 'deleted': False} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:19.431324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.431795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.435064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.435638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.436696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.437357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.444575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.445022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.453015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c613e00c-3e53-4b72-8969-450632e1ac93 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048058 Jun 04 20:56:19.454030 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 464/959] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:19.459170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.460595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:19.467102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.467578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.468365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.468863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.478302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:56:19.495649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:19.568083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.568548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.642519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:19.652335 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b39f9e07-b944-4c72-a470-34fb7863f00d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.196940 Jun 04 20:56:19.653076 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 465/960] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:19.658090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7087b1e3-6057-4e7f-9b8a-01542ddd7a4f tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d0248f160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.659167 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.659167 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.660714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7087b1e3-6057-4e7f-9b8a-01542ddd7a4f tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.661365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7087b1e3-6057-4e7f-9b8a-01542ddd7a4f tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.681758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7087b1e3-6057-4e7f-9b8a-01542ddd7a4f tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.682384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7087b1e3-6057-4e7f-9b8a-01542ddd7a4f tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.691284 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7087b1e3-6057-4e7f-9b8a-01542ddd7a4f tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.036875 Jun 04 20:56:19.692089 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 466/961] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:19.706588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2db6f731-e204-4c87-8637-9cd3f0c8faa6 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d0248f0d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.707652 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.707652 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.708332 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-289f5941-6fc9-42ca-b478-0de744e2b772 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9fa1452a653049abab26a782a7d36583" status: 200 len: 4824 microversion: 2.1 time: 0.288003 Jun 04 20:56:19.709287 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 496/962] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9fa1452a653049abab26a782a7d36583 => generated 4824 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:19.710210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2db6f731-e204-4c87-8637-9cd3f0c8faa6 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.710737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2db6f731-e204-4c87-8637-9cd3f0c8faa6 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.729118 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2db6f731-e204-4c87-8637-9cd3f0c8faa6 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.026451 Jun 04 20:56:19.729498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.730003 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 467/963] 10.222.0.18 () {58 vars in 1178 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:19.741947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d0248f670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.742375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'tenant_id': '348fba13f0894035849ca231b5ed317e', 'deleted': False} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:19.742813 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.742813 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.744122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.744600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.748656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.749371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.750225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.750525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.760811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.761297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.773362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.773849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.780519 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da1b41b2-2ef2-437b-91eb-3624a486f0a3 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042360 Jun 04 20:56:19.781189 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 468/964] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:19.786116 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0ff2cc0-00ab-4f03-a922-6263f63839d4 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=348fba13f0894035849ca231b5ed317e" status: 200 len: 15 microversion: 2.1 time: 0.060366 Jun 04 20:56:19.786850 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 497/965] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=348fba13f0894035849ca231b5ed317e => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:19.791283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b9eaf3f0-bb4b-4de9-9fb1-cbd3f5bcfbf5 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d024a9d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.792122 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.792122 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.793378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9eaf3f0-bb4b-4de9-9fb1-cbd3f5bcfbf5 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.794012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9eaf3f0-bb4b-4de9-9fb1-cbd3f5bcfbf5 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.804388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cbd8ba79-dd1f-4d72-8e15-b69d34f9f338 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.808884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cbd8ba79-dd1f-4d72-8e15-b69d34f9f338 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008675 Jun 04 20:56:19.809555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 498/966] 10.222.0.18 () {58 vars in 1188 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 20:56:19.810244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9eaf3f0-bb4b-4de9-9fb1-cbd3f5bcfbf5 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.810418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9eaf3f0-bb4b-4de9-9fb1-cbd3f5bcfbf5 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.818605 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b9eaf3f0-bb4b-4de9-9fb1-cbd3f5bcfbf5 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.031278 Jun 04 20:56:19.823692 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 469/967] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:19.827321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:19.828326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:19.832161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=92,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:19.835018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-724b18a6-e316-44a5-9cd5-9ae75cad0451 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d024a94c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.836240 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.836240 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.837780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.838014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-724b18a6-e316-44a5-9cd5-9ae75cad0451 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.838377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.839122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-724b18a6-e316-44a5-9cd5-9ae75cad0451 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.839253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.839758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.855501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-724b18a6-e316-44a5-9cd5-9ae75cad0451 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.856221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-724b18a6-e316-44a5-9cd5-9ae75cad0451 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.864565 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-724b18a6-e316-44a5-9cd5-9ae75cad0451 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.035059 Jun 04 20:56:19.866150 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 470/968] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:19.884381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Calling method '.version_select at 0x7f2d024a9550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.885803 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:19.885803 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:56:19.887429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.887925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.906007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.906546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.919603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.920139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.943343 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed66a09e-5e42-4976-b50f-4de26f79d321 tempest-HypervisorAdminTestJSON-151485412 tempest-HypervisorAdminTestJSON-151485412-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.065797 Jun 04 20:56:19.945068 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 471/969] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:19.949512 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-74642e64-47c7-468f-b14f-4f75a5067ded tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 0 microversion: 2.1 time: 0.126397 Jun 04 20:56:19.950429 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 499/970] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:19 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:56:19.959363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:19.963179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:19.963995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '9fa1452a653049abab26a782a7d36583'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:19.971301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.971976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:19.972860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:19.973342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.009795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3dc25a18-b011-4b8d-b32a-7aeab8f0ef15 req-f3c7e26f-2dfd-40e7-8852-286cfd6a32dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30ca160-6726-48c7-803a-ab92978dc2db", "name": "network-vif-plugged", "status": "completed", "tag": "08a79507-9f73-439a-8a5f-f0486ffc2075"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:20.024916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3dc25a18-b011-4b8d-b32a-7aeab8f0ef15 req-f3c7e26f-2dfd-40e7-8852-286cfd6a32dc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.025357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3dc25a18-b011-4b8d-b32a-7aeab8f0ef15 req-f3c7e26f-2dfd-40e7-8852-286cfd6a32dc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.040562 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3dc25a18-b011-4b8d-b32a-7aeab8f0ef15 req-f3c7e26f-2dfd-40e7-8852-286cfd6a32dc service nova] Creating event network-vif-plugged:08a79507-9f73-439a-8a5f-f0486ffc2075 for instance e30ca160-6726-48c7-803a-ab92978dc2db on nch2-master-1 Jun 04 20:56:20.046371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3dc25a18-b011-4b8d-b32a-7aeab8f0ef15 req-f3c7e26f-2dfd-40e7-8852-286cfd6a32dc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045041 Jun 04 20:56:20.047392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 500/971] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:20.074134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:56:20.147212 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01ec5639-e721-4e94-843f-e7a819cea2e2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.192482 Jun 04 20:56:20.148225 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 472/972] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Jun 4 20:56:19 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:20.159574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:20.160739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:20.168948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.169381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.170385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.170949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.239329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:20.240668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:20.251106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.251644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.252642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.253174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.263549 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d132f92d-5d2e-43c6-b5af-3ac42a3dc0b9 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 0 microversion: 2.1 time: 0.107300 Jun 04 20:56:20.269606 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 501/973] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:20 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:56:20.277240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:20.279048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:20.290172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.291574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.292753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.293561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.619409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:20.630024 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8ee1c94-ef90-431b-a0e6-7321464b630a tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1511 microversion: 2.1 time: 0.397457 Jun 04 20:56:20.635012 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 473/974] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:20 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1511 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:20.649560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:20.650159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:20.661681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.662140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.663011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.663529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.697502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f3586a67-9c61-4813-9b6b-8e82f19a44db tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1614 microversion: 2.1 time: 0.425498 Jun 04 20:56:20.702529 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 502/975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:20 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1614 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:20.709127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:20.709981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:20.725198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.725980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.726666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:20.727114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:20.987401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:20.996662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3cd0fc6-8bee-4150-9ebc-b9836080c746 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1325 microversion: 2.1 time: 0.359894 Jun 04 20:56:20.997297 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 474/976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:20 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1325 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:21.002641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:21.003563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:21.012134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.012904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.014111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.014702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.019705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:21.028821 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f2d741d-4e53-48c9-951c-48ae7c2774b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.323525 Jun 04 20:56:21.029672 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 503/977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:20 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:21.036151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-76437e41-e17f-4f6a-8c8c-bc0ea0130711 req-58c9774e-8a41-42c6-abd1-b60971962a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e678f271-2e46-42e1-84a0-10c25de10d33", "name": "network-vif-deleted", "tag": "2a2c345e-002b-4d98-8ce4-f9f7b6df43c4"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:21.045386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-76437e41-e17f-4f6a-8c8c-bc0ea0130711 req-58c9774e-8a41-42c6-abd1-b60971962a5b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.046292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-76437e41-e17f-4f6a-8c8c-bc0ea0130711 req-58c9774e-8a41-42c6-abd1-b60971962a5b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.058822 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-76437e41-e17f-4f6a-8c8c-bc0ea0130711 req-58c9774e-8a41-42c6-abd1-b60971962a5b service nova] Creating event network-vif-deleted:2a2c345e-002b-4d98-8ce4-f9f7b6df43c4 for instance e678f271-2e46-42e1-84a0-10c25de10d33 on nch2-master-1 Jun 04 20:56:21.064852 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-76437e41-e17f-4f6a-8c8c-bc0ea0130711 req-58c9774e-8a41-42c6-abd1-b60971962a5b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Jun 04 20:56:21.065680 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 504/978] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:21.180409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:21.186363 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d663414-087d-4bbd-be0c-89e7d1d2a44a tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1614 microversion: 2.1 time: 0.187787 Jun 04 20:56:21.187034 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 475/979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:20 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1614 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:21.204039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:21.209066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:21.214190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.215076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.216793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.219289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.319954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:56:21.393162 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2165ed49-c2bf-4f66-b426-7c4ed7af5a39 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2629 microversion: 2.1 time: 0.194020 Jun 04 20:56:21.394011 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 505/980] 10.222.0.18 () {58 vars in 1189 bytes} [Sat Jun 4 20:56:21 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2629 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:21.406972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:21.413376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:56:21.421664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.422125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.423007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.423447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.525629 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-515c9e25-07aa-4553-9bcf-e74db80a9373 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.123564 Jun 04 20:56:21.526585 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 476/981] 10.222.0.18 () {58 vars in 1195 bytes} [Sat Jun 4 20:56:21 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:21.537744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:21.538977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:21.546489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.546927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.547740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.548176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.624463 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce37f20c-bc66-43f3-86bd-9e7c8633ae44 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 0 microversion: 2.1 time: 0.090427 Jun 04 20:56:21.628385 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 506/982] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:21 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:56:21.634316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:21.635967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:21.643777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.644371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.646153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.647612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.656676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:21.656676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:21.663005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.666559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.667622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.668272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.706954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.707614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.708074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lazy-loading 'fault' on Instance uuid e678f271-2e46-42e1-84a0-10c25de10d33 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:21.741653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:21.742195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:21.742776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:21.743342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:21.743886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:21.762536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c42a1a43a21342fd9cbdd5a48b828485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e3eb86f0f143ff9186ebfd23f098d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:21.774704 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09ae1256-90ad-4006-b92a-bfdf66f8624e tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 200 len: 1306 microversion: 2.1 time: 0.124321 Jun 04 20:56:21.775608 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 507/983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:21 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:21.821389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:21.829136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.829685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.830540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.831025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.860569 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40b3216c-b2cc-4f12-b3f0-cbefeb9f5971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 1067 microversion: 2.1 time: 0.230447 Jun 04 20:56:21.861930 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 477/984] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:21 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 1067 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 04 20:56:21.883862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:21.885301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:21.902141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.902719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:21.904141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:21.904754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.016170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:22.016464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:22.025647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.026370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.027259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.028230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.150529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:22.159780 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-25b17561-0b98-4e33-b593-47b201e69cee tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.283847 Jun 04 20:56:22.160365 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 508/985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:21 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:22.165187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:22.165796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:22.173828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.174925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.176529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.177264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.226583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:22.238392 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d32ec8e-d68e-4113-b3ce-306241133fd7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1522 microversion: 2.1 time: 0.226902 Jun 04 20:56:22.239704 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 478/986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:22 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:22.249434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ff6c921e-2e48-4184-a6bd-7abd9f934441 req-e6fe7e06-ea35-460f-a2ff-97ddc0c191a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e680a2-7857-43ab-bb59-3c7ddb5ef666", "name": "network-vif-plugged", "status": "completed", "tag": "36ac5132-5332-4755-bb63-e4be93fabd3d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:22.262299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ff6c921e-2e48-4184-a6bd-7abd9f934441 req-e6fe7e06-ea35-460f-a2ff-97ddc0c191a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.263039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ff6c921e-2e48-4184-a6bd-7abd9f934441 req-e6fe7e06-ea35-460f-a2ff-97ddc0c191a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.282458 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ff6c921e-2e48-4184-a6bd-7abd9f934441 req-e6fe7e06-ea35-460f-a2ff-97ddc0c191a4 service nova] Creating event network-vif-plugged:36ac5132-5332-4755-bb63-e4be93fabd3d for instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 on nch1-master-1 Jun 04 20:56:22.290168 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ff6c921e-2e48-4184-a6bd-7abd9f934441 req-e6fe7e06-ea35-460f-a2ff-97ddc0c191a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048021 Jun 04 20:56:22.291387 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 479/987] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:22.298346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:22.299095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:22.308498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.309384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.310249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.310679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.380543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:22.388959 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-28dd97f7-00b6-47c3-9ca2-0dbf8638b6b8 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.227268 Jun 04 20:56:22.389587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 509/988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:22 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:22.478792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:22.487148 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77347e39-e805-4e41-a457-6f6cf949fcf0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1522 microversion: 2.1 time: 0.194015 Jun 04 20:56:22.487799 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 480/989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:22 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:22.505122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2141022393"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:22.507378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:22.514875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.516021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.517181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.517605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.549488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:22.793306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:22.794948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] [instance: e678f271-2e46-42e1-84a0-10c25de10d33] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:22.801778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.802034 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b5a46fd9-f64c-4490-b511-1d2acf4fe93b tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db/action" status: 202 len: 0 microversion: 2.1 time: 0.300338 Jun 04 20:56:22.802449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.803305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:22.803837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:22.804188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 510/990] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:22 2022] POST /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 20:56:22.817317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-362f4da4-b959-43c3-a0a3-9cdda2bb838d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '.version_select at 0x7f2d023404c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:22.822201 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] HTTP exception thrown: Instance e678f271-2e46-42e1-84a0-10c25de10d33 could not be found. Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Request method failure captured: Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 HTTP/1.1 Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8be9gkFE5FaxXowLNA0Ppfjkvt6-uqJb1DBiIUzrlEssvNNrVGHci4dlJr-IKeTzc3uJY-skfL-DycDFLScleD9kFDp4U1rQg8dBvQAp-5gKPb61JWEglevCTzad0tAxC18m611u_B6k52n_vCQrjlMdOlfC1ft2E8KWvQHsWLLGgg Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d7e3eb86f0f143ff9186ebfd23f098d8 Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerAddressesTestJSON-1691170690 Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:22.824131 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7e3eb86f0f143ff9186ebfd23f098d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7e3eb86f0f143ff9186ebfd23f098d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7e3eb86f0f143ff9186ebfd23f098d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7e3eb86f0f143ff9186ebfd23f098d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerAddressesTestJSON-1691170690 Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d7e3eb86f0f143ff9186ebfd23f098d8 Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1691170690 Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerAddressesTestJSON-1691170690-project Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c42a1a43a21342fd9cbdd5a48b828485 Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerAddressesTestJSON-1691170690-project Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e678f271-2e46-42e1-84a0-10c25de10d33 could not be found. Jun 04 20:56:22.825814 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e678f271-2e46-42e1-84a0-10c25de10d33'} Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e678f271-2e46-42e1-84a0-10c25de10d33 could not be found. Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:22.826630 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e678f271-2e46-42e1-84a0-10c25de10d33 could not be found. Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e678f271-2e46-42e1-84a0-10c25de10d33 could not be found. Jun 04 20:56:22.828005 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:22.831438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] Returning 404 to user: Instance e678f271-2e46-42e1-84a0-10c25de10d33 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:22.832685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6a2680d-1410-4cb7-9d8c-9791ad0ba01b tempest-ServerAddressesTestJSON-1691170690 tempest-ServerAddressesTestJSON-1691170690-project] 10.222.0.18 "GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33" status: 404 len: 111 microversion: 2.1 time: 0.043500 Jun 04 20:56:22.833789 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 481/991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:22 2022] GET /compute/v2.1/servers/e678f271-2e46-42e1-84a0-10c25de10d33 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:56:23.007071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-362f4da4-b959-43c3-a0a3-9cdda2bb838d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278" status: 204 len: 0 microversion: 2.1 time: 0.196558 Jun 04 20:56:23.007889 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 511/992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:22 2022] DELETE /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 20:56:23.018352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ed7ad6b-43bc-4796-9b0e-7cf11f00a282 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '.version_select at 0x7f2d02423b80>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:23.048547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8ed7ad6b-43bc-4796-9b0e-7cf11f00a282 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Image not found. Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ed7ad6b-43bc-4796-9b0e-7cf11f00a282 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278 HTTP/1.1 Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:23.070126 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '66458e58-e885-46db-a0f3-5a035b759278'} Jun 04 20:56:23.071799 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 20:56:23.072808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 66458e58-e885-46db-a0f3-5a035b759278 Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 20:56:23.074492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66458e58-e885-46db-a0f3-5a035b759278 could not be found. Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:23.076768 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:23.078166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ed7ad6b-43bc-4796-9b0e-7cf11f00a282 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:23.079392 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ed7ad6b-43bc-4796-9b0e-7cf11f00a282 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278" status: 404 len: 62 microversion: 2.1 time: 0.059266 Jun 04 20:56:23.079392 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 482/993] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 20:56:23 2022] GET /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:56:23.084846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:23.085988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:23.098283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.098748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.099572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.100131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.185446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:23.186267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:23.194641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.195368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.196428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.197185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.416680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:23.426048 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fec98241-6825-4313-ab06-69d1599a6a5f tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1534 microversion: 2.1 time: 0.345104 Jun 04 20:56:23.427372 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 512/994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:23 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1534 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:23.432601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:23.433113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:23.433275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:23.443653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.443979 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e376bd5-3c5f-470b-aa16-74753a9ed157 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.265939 Jun 04 20:56:23.444132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.444856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.445450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.454748 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 483/995] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:23 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:23.632017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:23.660318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20cddb4d-dfdd-4813-b113-f82cde56f84f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1316 microversion: 2.1 time: 0.224772 Jun 04 20:56:23.660318 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 513/996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:23 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:23.732197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:23.733640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:23.740151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.740610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.741408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.741839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.897624 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-91b0e3a6-a959-464c-917e-3fafed76c4e5 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1690 microversion: 2.1 time: 0.170829 Jun 04 20:56:23.898228 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 484/997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:23 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:23.914297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:23.915530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:23.922321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.922814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.923771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:23.924252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:23.951076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lazy-loading 'flavor' on Instance uuid f8d7e4b8-0a2f-475c-b7e4-4c82582b189b {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:23.964431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Going to try to live migrate instance to nch2-master-1 {{(pid=137229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:56:24.134980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Calling method '.version_select at 0x7f2d022cfb80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:24.137093 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:24.137093 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:24.138632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.139181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.173317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.174044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.187672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.188121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.195277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9d93f50-f1d7-4c9b-99f9-428be84b3853 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.351425 Jun 04 20:56:24.201649 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 514/998] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:24.494471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7558dd68-eff7-4a1d-8764-d917f3c3c54e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Calling method '.version_select at 0x7f2d020fedc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:24.496505 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:24.496505 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:24.498938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7558dd68-eff7-4a1d-8764-d917f3c3c54e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd5244c98165049c3a24e59ddc5b6a48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2459671dcd194f3f8400703776836775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7558dd68-eff7-4a1d-8764-d917f3c3c54e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Request method failure captured: Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8b20ECNZ_UlfBXgqSOpjExDQZlZVVnTbmc3GHIH00IrwyyWxNBUOXCoBJ-vuga123V3TI4iSNq0NUFiwY6h5fxq-4S3O5zxMaK9mh8hVifRx-vlU4asaie65FajAdHS9U5NSNnpRaLdv7k_ERr7nQwwhyYO6G0m429zaCtEnU-Zbck Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2459671dcd194f3f8400703776836775 Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-808412676 Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:24.500754 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2459671dcd194f3f8400703776836775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2459671dcd194f3f8400703776836775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2459671dcd194f3f8400703776836775"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2459671dcd194f3f8400703776836775"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-808412676 Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2459671dcd194f3f8400703776836775 Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-808412676 Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-808412676-project Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d5244c98165049c3a24e59ddc5b6a48b Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-808412676-project Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 04 20:56:24.502597 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'nch2-master-1'} Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:56:24.503811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 04 20:56:24.506865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:24.513773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7558dd68-eff7-4a1d-8764-d917f3c3c54e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:24.513773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7558dd68-eff7-4a1d-8764-d917f3c3c54e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.299520 Jun 04 20:56:24.513773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 515/999] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 20:56:24 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:24.513773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:24.513773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:24.520934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.521390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.522372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.522824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.713804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:24.725746 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ea9e9ff-d202-470d-b7e1-5f0059fff4a2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1540 microversion: 2.1 time: 0.221717 Jun 04 20:56:24.726378 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 516/1000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:24 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1540 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:24.734573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:24.735201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:24.742533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.743020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.743855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.744539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.916411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:24.926072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99902ed8-ce22-4785-8921-f983c0117838 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.196021 Jun 04 20:56:24.926751 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 517/1001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:24 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:24.941589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Calling method '.version_select at 0x7f2d0215a0d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:24.942836 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:24.942836 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:24.944391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.945121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.953101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Request method failure captured: Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8b3XrXyt7DFx1zteP51XYVvQy6sDF035LrFLgwb-dqav9vmBdjiHGotXlOu-5QzPqiEsREFKfPm9NndfEkpYP3R_5SB-WoUCRaVKUsPzCyLj2UHUg2jNmy2C2UOCr6JkVIC22jyHvGTX81DLzVAhWHIpT6qOC-kMD7TXkWhxw5hQN0 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 225197a0bf7546bf99003d78b50bd8d8 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1346160527 Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:56:24.955433 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1346160527 Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 225197a0bf7546bf99003d78b50bd8d8 Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1346160527 Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 987b847386a34a68862603b720c7fd9c Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 04 20:56:24.957132 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:24.958099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:24.959685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b15d9cb-c700-4404-b07d-7e40493261fd tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.030630 Jun 04 20:56:24.961440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 518/1002] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 20:56:24 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:24.973870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:24.974486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:24.982574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.983026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:24.983946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:24.984388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.142278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:25.150379 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d383c607-d7ac-40e2-8f99-b160570e245d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1465 microversion: 2.1 time: 0.180984 Jun 04 20:56:25.151019 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 519/1003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:24 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:25.162700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Calling method '.version_select at 0x7f2d0215a9d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:25.163626 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:25.163626 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:25.165062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.165685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.187652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.188708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.201599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.202780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.210506 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-afc24425-b538-4a64-84dd-45ee87f0be1c tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058544 Jun 04 20:56:25.211137 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 520/1004] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 20:56:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:25.216167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:25.217047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:25.223170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.223669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.224458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.224927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.362638 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-994854c7-8c1f-4379-ac9f-efaaa99622e1 tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1616 microversion: 2.1 time: 0.150165 Jun 04 20:56:25.363279 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 521/1005] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:25 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1616 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:25.368922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3f8f932-fb1b-41d1-885b-47a3657e485e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Calling method '.version_select at 0x7f2d020fe5e0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:25.369879 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:56:25.369879 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:56:25.371125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e3f8f932-fb1b-41d1-885b-47a3657e485e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd5244c98165049c3a24e59ddc5b6a48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2459671dcd194f3f8400703776836775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3f8f932-fb1b-41d1-885b-47a3657e485e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Request method failure captured: Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8b20ECNZ_UlfBXgqSOpjExDQZlZVVnTbmc3GHIH00IrwyyWxNBUOXCoBJ-vuga123V3TI4iSNq0NUFiwY6h5fxq-4S3O5zxMaK9mh8hVifRx-vlU4asaie65FajAdHS9U5NSNnpRaLdv7k_ERr7nQwwhyYO6G0m429zaCtEnU-Zbck Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2459671dcd194f3f8400703776836775 Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-808412676 Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:25.377646 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2459671dcd194f3f8400703776836775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2459671dcd194f3f8400703776836775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2459671dcd194f3f8400703776836775"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2459671dcd194f3f8400703776836775"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-808412676 Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2459671dcd194f3f8400703776836775 Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-808412676 Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-808412676-project Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d5244c98165049c3a24e59ddc5b6a48b Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-808412676-project Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1'} Jun 04 20:56:25.379361 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:56:25.380948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 04 20:56:25.382394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:25.384087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3f8f932-fb1b-41d1-885b-47a3657e485e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:25.384087 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3f8f932-fb1b-41d1-885b-47a3657e485e tempest-HypervisorAdminNegativeUnderV252Test-808412676 tempest-HypervisorAdminNegativeUnderV252Test-808412676-project] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015092 Jun 04 20:56:25.384907 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 522/1006] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:56:25 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:25.397035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Calling method '.version_select at 0x7f2d0262f940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:25.399956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.400634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.412349 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] HTTP exception thrown: No hypervisor matching '1fe23a8c-51fc-4bad-aa94-105f87bce935' could be found. Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Request method failure captured: Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-hypervisors/1fe23a8c-51fc-4bad-aa94-105f87bce935/servers HTTP/1.1 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8b3XrXyt7DFx1zteP51XYVvQy6sDF035LrFLgwb-dqav9vmBdjiHGotXlOu-5QzPqiEsREFKfPm9NndfEkpYP3R_5SB-WoUCRaVKUsPzCyLj2UHUg2jNmy2C2UOCr6JkVIC22jyHvGTX81DLzVAhWHIpT6qOC-kMD7TXkWhxw5hQN0 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 225197a0bf7546bf99003d78b50bd8d8 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1346160527 Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:56:25.414720 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/225197a0bf7546bf99003d78b50bd8d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1346160527 Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 225197a0bf7546bf99003d78b50bd8d8 Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1346160527 Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 987b847386a34a68862603b720c7fd9c Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: exception: No hypervisor matching '1fe23a8c-51fc-4bad-aa94-105f87bce935' could be found. Jun 04 20:56:25.416177 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1fe23a8c-51fc-4bad-aa94-105f87bce935'} Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1fe23a8c-51fc-4bad-aa94-105f87bce935' could be found. Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:25.416919 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:25.418057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:25.418057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:25.418057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:25.418057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:25.418057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1fe23a8c-51fc-4bad-aa94-105f87bce935' could be found. Jun 04 20:56:25.418057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:25.420223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] Returning 404 to user: No hypervisor matching '1fe23a8c-51fc-4bad-aa94-105f87bce935' could be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:25.421982 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3be08e1d-8942-47a4-8203-a77fb8c81305 tempest-HypervisorAdminNegativeUnderV252Test-1346160527 tempest-HypervisorAdminNegativeUnderV252Test-1346160527-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors/1fe23a8c-51fc-4bad-aa94-105f87bce935/servers" status: 404 len: 123 microversion: 2.1 time: 0.030168 Jun 04 20:56:25.427679 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 523/1007] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 20:56:25 2022] GET /compute/v2.1/os-hypervisors/1fe23a8c-51fc-4bad-aa94-105f87bce935/servers => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:25.503746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-927863791", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2d5dd136-9cec-4923-9c8c-2ba3024d18cc"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:25.573966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:25.838791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:25.839286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:25.840113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:25.840911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:25.841426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:25.863214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.863694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.865358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:25.867707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:25.892543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:25.901811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Getting quotas for user 3eef1a5b965a4d26adaed7af3344e7c9 and project 007f08ee799d431fb8d18c31dd5991e0. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:25.940062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:25.943380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:26.022337 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45b7af82-6934-48f7-9784-586105ede8b2 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524408 Jun 04 20:56:26.028280 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 524/1008] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:56:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:56:26.030763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:26.031866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:26.040720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:26.041186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:26.042470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:26.044054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:26.332344 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-46fccd0a-2e5b-4625-85c9-7e3bb6d4898e tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/action" status: 202 len: 0 microversion: 2.1 time: 2.421068 Jun 04 20:56:26.334700 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 485/1009] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:23 2022] POST /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/action => generated 0 bytes in 2425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:56:26.347149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:26.350061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:26.383994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:26.384842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:26.385979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:26.386776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:26.665329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:26.680376 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb276b18-40a9-4aa0-97aa-8752818ddec7 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1535 microversion: 2.1 time: 0.650826 Jun 04 20:56:26.681224 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 525/1010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:26 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1535 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:26.691896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac15e1db-f392-4e59-b905-37161ed3c0ad tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:26.692899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ac15e1db-f392-4e59-b905-37161ed3c0ad tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:26.804591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac15e1db-f392-4e59-b905-37161ed3c0ad tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:26.813334 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ac15e1db-f392-4e59-b905-37161ed3c0ad tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1216 microversion: 2.1 time: 0.130709 Jun 04 20:56:26.817000 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 526/1011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:26 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1216 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:26.821915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:26.829487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:26.837183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:26.842151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:26.842628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:26.843413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:26.843894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:26.856715 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-555fafc2-9fee-48b1-b897-af71fbe2e62a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.514766 Jun 04 20:56:26.871698 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 486/1012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:26 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:27.057322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:27.067531 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6b56e9d-4b4b-4dfd-af31-59235b9922aa tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.249211 Jun 04 20:56:27.068427 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 527/1013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:26 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:27.393849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-790243600", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "54824340-b802-4813-aa09-dd71e10af730"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:27.459245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] validate_networks() for [('54824340-b802-4813-aa09-dd71e10af730', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:27.701709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:27.703668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:27.717313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:27.718356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:27.720021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:27.720466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.264793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:28.284156 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8215d2d-8855-455c-bc17-b37398fa6d30 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1522 microversion: 2.1 time: 0.587556 Jun 04 20:56:28.286440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 528/1014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:27 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:28.304658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:28.308604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:28.321838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.323362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.325294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.327022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.493791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:28.508385 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f306291-4257-4497-b681-bdd9315837ea tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1274 microversion: 2.1 time: 0.219830 Jun 04 20:56:28.509859 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 529/1015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:28 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1274 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:28.516263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:28.517219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:28.526400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.527260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.528412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.529338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.589469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:28.590746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:28.591753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:28.593026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:28.593838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:28.604672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=27 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:28.607368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.608239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.609387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.610785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.624470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=15 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:28.638327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Getting quotas for project 6332536fbe7047baa8b71c64fc9a5c3b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:28.645547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Getting quotas for user 52294b4889cc4fd389b166c4150942c0 and project 6332536fbe7047baa8b71c64fc9a5c3b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:28.662445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:28.666205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:28.728745 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20a196f8-04b0-490e-b9e4-63a38adbb4fa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492094 Jun 04 20:56:28.730366 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 487/1016] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:56:28.735858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:28.737175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:28.745056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.746065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.747541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.748671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.801508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:28.812777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb797cad-73fc-4b17-940a-e0d2eb0d6f8a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.300937 Jun 04 20:56:28.814244 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 530/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:28 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:28.820157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-239010a8-1d05-4738-829e-bc1eb0edcbca req-29c01240-e520-4263-b48d-9278cebd00fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30ca160-6726-48c7-803a-ab92978dc2db", "name": "network-vif-plugged", "status": "completed", "tag": "08a79507-9f73-439a-8a5f-f0486ffc2075"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:28.833510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-239010a8-1d05-4738-829e-bc1eb0edcbca req-29c01240-e520-4263-b48d-9278cebd00fa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.834338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-239010a8-1d05-4738-829e-bc1eb0edcbca req-29c01240-e520-4263-b48d-9278cebd00fa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.850256 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-239010a8-1d05-4738-829e-bc1eb0edcbca req-29c01240-e520-4263-b48d-9278cebd00fa service nova] Creating event network-vif-plugged:08a79507-9f73-439a-8a5f-f0486ffc2075 for instance e30ca160-6726-48c7-803a-ab92978dc2db on nch2-master-1 Jun 04 20:56:28.859649 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-239010a8-1d05-4738-829e-bc1eb0edcbca req-29c01240-e520-4263-b48d-9278cebd00fa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043774 Jun 04 20:56:28.861197 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 531/1018] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:28.870976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:28.872052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:28.885180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.886811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.888725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:28.889364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:28.929581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:28.933561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:29.085335 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-74e6ff7d-223a-4440-938f-5f9a87c30038 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 204 len: 0 microversion: 2.1 time: 0.221753 Jun 04 20:56:29.089356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:29.090661 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 532/1019] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:28 2022] DELETE /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:29.097596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b37393d0-2c92-44e4-96be-0d03d683a0aa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:29.098438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b37393d0-2c92-44e4-96be-0d03d683a0aa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:29.107181 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f45db6d8-3b00-4fc2-b3da-1ddf817d4314 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.370556 Jun 04 20:56:29.108704 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 488/1020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:28 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:29.117113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:29.118138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:29.132365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:29.133239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:29.134328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:29.135022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:29.214971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b37393d0-2c92-44e4-96be-0d03d683a0aa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:29.226530 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b37393d0-2c92-44e4-96be-0d03d683a0aa tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1224 microversion: 2.1 time: 0.133571 Jun 04 20:56:29.227931 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 533/1021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:29 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:29.429094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:29.439610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-978c0e20-b4dc-4809-a3db-1933cff5d534 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1528 microversion: 2.1 time: 0.329461 Jun 04 20:56:29.440331 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 489/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:29 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1528 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:29.528561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:29.530341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:29.539371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:29.540248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:29.541512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:29.542421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:29.741347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:29.758549 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15c02cb5-19be-4f86-b34d-08a65e0fb64e tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.234772 Jun 04 20:56:29.766215 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 534/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:29 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:29.830760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:29.832600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:29.839305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:29.839801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:29.840854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:29.855255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:29.867311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b152f633-f6ec-4142-b4d1-d7b1a99d14c9 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Action: 'create', calling method: .version_select at 0x7f2d0219a160>, body: {"keypair": {"name": "tempest-keypair-218385221", "type": "ssh", "user_id": "544fec03e8964fa0becc1fafe72a9cef", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOd1xicoaZ6xh0OZ/QaBAKw3m/AA0PF6LClrlNk5+Z35LNKN/v4WUPMy4hiY8R3bgiP/LB2p/PQc3kkP8RqwfbOkKPvrmYPeLu0shKDtmft/XjrlBVJzdjKKKpkwOZAYpQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:29.901871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b152f633-f6ec-4142-b4d1-d7b1a99d14c9 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Getting quotas for project 9afafb8dc0014c4aa6f7e836e8423fae. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:29.908887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b152f633-f6ec-4142-b4d1-d7b1a99d14c9 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Getting quotas for user 97364a47c3af4ccdb51474ebc159a989 and project 9afafb8dc0014c4aa6f7e836e8423fae. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:29.941044 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b152f633-f6ec-4142-b4d1-d7b1a99d14c9 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.240124 Jun 04 20:56:29.942987 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 490/1024] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 20:56:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 243 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 20:56:29.959817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35697e51-6379-4987-864e-cbc1e44f0cec tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Action: 'create', calling method: .version_select at 0x7f2d021f63a0>, body: {"keypair": {"name": "tempest-keypair-803445868", "type": "ssh", "user_id": "544fec03e8964fa0becc1fafe72a9cef", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhHlnHvlhYMCW3Wxlskbon73uy6KENkwdCKMmalw149eQefGOWM9bSdoCv15qp7MqG7g0hhcitWsj5cwkg+DMxMeAT5i9jVnJVsaVtIbdcjC9gg+Mk2OBuiJpF1/7Be/A=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:29.976004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-35697e51-6379-4987-864e-cbc1e44f0cec tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Getting quotas for project 9afafb8dc0014c4aa6f7e836e8423fae. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:29.983635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-35697e51-6379-4987-864e-cbc1e44f0cec tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Getting quotas for user 97364a47c3af4ccdb51474ebc159a989 and project 9afafb8dc0014c4aa6f7e836e8423fae. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:30.013581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:30.025318 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-35697e51-6379-4987-864e-cbc1e44f0cec tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.071093 Jun 04 20:56:30.026058 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 491/1025] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 20:56:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 20:56:30.036363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8a8ff5c-3487-443a-888e-93b41113d6f6 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Calling method '.version_select at 0x7f2d021ae700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.044725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:30.045174 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8a8ff5c-3487-443a-888e-93b41113d6f6 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-218385221?user_id=544fec03e8964fa0becc1fafe72a9cef" status: 200 len: 511 microversion: 2.10 time: 0.012218 Jun 04 20:56:30.045757 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 492/1026] 10.222.0.18 () {60 vars in 1336 bytes} [Sat Jun 4 20:56:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-218385221?user_id=544fec03e8964fa0becc1fafe72a9cef => generated 511 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:56:30.054424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6cbac3bb-8af6-48b1-82a9-91832ccd5ff2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.227222 Jun 04 20:56:30.055753 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 535/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:29 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:30.059360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40272f2f-02d6-48fe-a928-9a5ea010eab2 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Action: 'create', calling method: .version_select at 0x7f2d021ae8b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1550788105", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi5ZfXdLwfRoBEx3ov07lZjtIchOM9ypyBhkMyhV4T49TL08giq1ejyWaEisEZzc4SQR1BwO4jGtlEvBYdxo/KmVCe7Xjmv8ufvKckUj6GatH5NflFVJ650nBm9zCF77Q=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:30.076383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-40272f2f-02d6-48fe-a928-9a5ea010eab2 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Getting quotas for project 9afafb8dc0014c4aa6f7e836e8423fae. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:30.084108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-40272f2f-02d6-48fe-a928-9a5ea010eab2 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Getting quotas for user 97364a47c3af4ccdb51474ebc159a989 and project 9afafb8dc0014c4aa6f7e836e8423fae. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:30.114219 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40272f2f-02d6-48fe-a928-9a5ea010eab2 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.059330 Jun 04 20:56:30.115679 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 493/1028] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 20:56:30 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 04 20:56:30.127493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8bcaa16b-d679-4a8c-bf4e-f1effc3a4292 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Calling method '.version_select at 0x7f2d02144af0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.128896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.129672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:30.131467 ncdv-master-1 devstack@n-api.service[137229]: WARNING oslo_db.sqlalchemy.utils [None req-8bcaa16b-d679-4a8c-bf4e-f1effc3a4292 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 04 20:56:30.139924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.140321 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8bcaa16b-d679-4a8c-bf4e-f1effc3a4292 tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "GET /compute/v2.1/os-keypairs?user_id=544fec03e8964fa0becc1fafe72a9cef" status: 200 len: 724 microversion: 2.10 time: 0.018648 Jun 04 20:56:30.140491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.141257 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 494/1029] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Jun 4 20:56:30 2022] GET /compute/v2.1/os-keypairs?user_id=544fec03e8964fa0becc1fafe72a9cef => generated 724 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:56:30.141374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.141788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.152168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0756fc75-ee45-4711-8c59-606b55cab7fa tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Calling method '.version_select at 0x7f2d02292c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.176056 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0756fc75-ee45-4711-8c59-606b55cab7fa tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1550788105" status: 204 len: 0 microversion: 2.10 time: 0.027528 Jun 04 20:56:30.180827 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 495/1030] 10.222.0.18 () {60 vars in 1324 bytes} [Sat Jun 4 20:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1550788105 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 20:56:30.187102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c28ff207-ee1c-4829-adcd-b8a0b3779eff tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Calling method '.version_select at 0x7f2d021ae820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.217700 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c28ff207-ee1c-4829-adcd-b8a0b3779eff tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803445868?user_id=544fec03e8964fa0becc1fafe72a9cef" status: 204 len: 0 microversion: 2.10 time: 0.032823 Jun 04 20:56:30.218662 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 496/1031] 10.222.0.18 () {60 vars in 1339 bytes} [Sat Jun 4 20:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803445868?user_id=544fec03e8964fa0becc1fafe72a9cef => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 20:56:30.228103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2fe26c84-6004-4248-a485-5d2f53531efe tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] Calling method '.version_select at 0x7f2d0219a280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.249989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2fe26c84-6004-4248-a485-5d2f53531efe tempest-KeyPairsV210TestJSON-182185113 tempest-KeyPairsV210TestJSON-182185113-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-218385221?user_id=544fec03e8964fa0becc1fafe72a9cef" status: 204 len: 0 microversion: 2.10 time: 0.026644 Jun 04 20:56:30.250808 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 497/1032] 10.222.0.18 () {60 vars in 1339 bytes} [Sat Jun 4 20:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-218385221?user_id=544fec03e8964fa0becc1fafe72a9cef => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 20:56:30.257548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.258302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:30.271648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.272167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.272966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.274777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.387535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:30.403705 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-326005e8-63c4-45cd-bf3f-1b9b6284ebda tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.280829 Jun 04 20:56:30.407079 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 536/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:30 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:30.460350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:30.466148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.467313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:30.481069 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ccfb7359-9b2d-41b7-bd20-3f617b1df4c6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1276 microversion: 2.1 time: 0.229214 Jun 04 20:56:30.492872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.493532 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 498/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:30 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:30.494296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.495265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.495873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.780325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:30.785038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:30.785966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:30.796787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-baa5fe24-d92e-4f53-bd33-45a06bc6db47 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1528 microversion: 2.1 time: 0.339867 Jun 04 20:56:30.798123 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 537/1035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:30 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1528 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:30.820456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.821012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.822061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.822258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.892385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-98177aed-b596-4ef5-9b26-621b8979d8e6 req-8f29c93d-5104-4b1a-ad89-3ec44069b53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30ca160-6726-48c7-803a-ab92978dc2db", "name": "network-vif-unplugged", "status": "completed", "tag": "08a79507-9f73-439a-8a5f-f0486ffc2075"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:30.914166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-98177aed-b596-4ef5-9b26-621b8979d8e6 req-8f29c93d-5104-4b1a-ad89-3ec44069b53c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:30.920781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-98177aed-b596-4ef5-9b26-621b8979d8e6 req-8f29c93d-5104-4b1a-ad89-3ec44069b53c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:30.946996 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-98177aed-b596-4ef5-9b26-621b8979d8e6 req-8f29c93d-5104-4b1a-ad89-3ec44069b53c service nova] Creating event network-vif-unplugged:08a79507-9f73-439a-8a5f-f0486ffc2075 for instance e30ca160-6726-48c7-803a-ab92978dc2db on nch2-master-1 Jun 04 20:56:30.956044 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-98177aed-b596-4ef5-9b26-621b8979d8e6 req-8f29c93d-5104-4b1a-ad89-3ec44069b53c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069775 Jun 04 20:56:30.961845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 538/1036] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:31.076584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:31.077928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:31.082121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:31.091170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:31.091788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:31.092621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:31.093067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:31.227686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:31.244557 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a23d35f1-da67-45b1-93f6-477d50e157be tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.463379 Jun 04 20:56:31.247598 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 499/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:30 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:31.402768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:31.418102 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ca361d03-fef0-4180-ba4b-a3bc55d8c331 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.347988 Jun 04 20:56:31.428533 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 539/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:31 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:31.435396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:31.436428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:31.445508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:31.446812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:31.448178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:31.448726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:31.456305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:31.499752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:31.500872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:31.509069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:31.509595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:31.510527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:31.511017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:31.961963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:31.973735 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a18bd16-5d0e-4e9a-83e0-144a1c5209e2 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1282 microversion: 2.1 time: 0.477900 Jun 04 20:56:31.992524 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 540/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:31 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1282 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:31.998239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:31.999010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:32.006809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.007556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.009306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.009306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.058672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.059584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.060606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lazy-loading 'fault' on Instance uuid e30ca160-6726-48c7-803a-ab92978dc2db {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:32.204330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:32.205747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:32.219929 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d8e7802-d2f5-4891-9acc-bf4ef2223fff tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.801861 Jun 04 20:56:32.222115 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 500/1040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:31 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:32.229303 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff877cd3-ed39-4de7-8f81-7bff67ca8935 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1315 microversion: 2.1 time: 0.235518 Jun 04 20:56:32.229942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 541/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:31 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:32.246951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-31be5fc2-1d21-428a-960b-7bbcf7acd28b req-71ce3b97-f3fa-4a80-8d11-c5acbe30a972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30ca160-6726-48c7-803a-ab92978dc2db", "name": "network-vif-deleted", "tag": "08a79507-9f73-439a-8a5f-f0486ffc2075"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:32.268076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:32.268769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:32.282332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-31be5fc2-1d21-428a-960b-7bbcf7acd28b req-71ce3b97-f3fa-4a80-8d11-c5acbe30a972 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.282784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-31be5fc2-1d21-428a-960b-7bbcf7acd28b req-71ce3b97-f3fa-4a80-8d11-c5acbe30a972 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.286021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.286514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.287538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.288083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.316911 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-31be5fc2-1d21-428a-960b-7bbcf7acd28b req-71ce3b97-f3fa-4a80-8d11-c5acbe30a972 service nova] Creating event network-vif-deleted:08a79507-9f73-439a-8a5f-f0486ffc2075 for instance e30ca160-6726-48c7-803a-ab92978dc2db on nch2-master-1 Jun 04 20:56:32.332119 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-31be5fc2-1d21-428a-960b-7bbcf7acd28b req-71ce3b97-f3fa-4a80-8d11-c5acbe30a972 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103656 Jun 04 20:56:32.333297 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 501/1042] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:32.437058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:32.437779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:32.450102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.451624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.452868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.454092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.722635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:32.739590 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9799a1df-b2a0-4a70-9546-c98c23562419 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.476199 Jun 04 20:56:32.741016 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 542/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:32 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:32.749790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-15ac503c-f39a-4325-8f2c-fdd2a734e315 req-b3768c98-fdb6-4793-a3cb-b70fa52f770e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de116be-c0cd-4bb2-8804-3331867fceda", "tag": "329aff47-c005-4580-bded-ef74616918a3"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:32.767842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-15ac503c-f39a-4325-8f2c-fdd2a734e315 req-b3768c98-fdb6-4793-a3cb-b70fa52f770e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:32.768570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-15ac503c-f39a-4325-8f2c-fdd2a734e315 req-b3768c98-fdb6-4793-a3cb-b70fa52f770e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:32.786367 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-15ac503c-f39a-4325-8f2c-fdd2a734e315 req-b3768c98-fdb6-4793-a3cb-b70fa52f770e service nova] Creating event network-changed:329aff47-c005-4580-bded-ef74616918a3 for instance 0de116be-c0cd-4bb2-8804-3331867fceda on nch2-master-1 Jun 04 20:56:32.792829 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-15ac503c-f39a-4325-8f2c-fdd2a734e315 req-b3768c98-fdb6-4793-a3cb-b70fa52f770e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050001 Jun 04 20:56:32.794688 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 543/1044] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:32.801016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:32.819579 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5487febd-c762-4d26-85f8-df271b131c30 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.386678 Jun 04 20:56:32.821130 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 502/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:32 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:33.001284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:33.002291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:33.009520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.010624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.011536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.013170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.241498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:33.243707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:33.244698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:33.252933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.253500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.254232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.254673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.256861 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b4d7dc1-8fcc-459d-953e-c411e2234d0d tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.260494 Jun 04 20:56:33.257456 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 544/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:32 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:33.276903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:33.277503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:33.286054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.286487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.287950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.288586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.328984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.329712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.330327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lazy-loading 'fault' on Instance uuid e30ca160-6726-48c7-803a-ab92978dc2db {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:33.399398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:33.411461 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5a5dc06d-2e69-45a7-845c-08b484ca3183 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 200 len: 1315 microversion: 2.1 time: 0.139431 Jun 04 20:56:33.412886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 545/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:33 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:33.452853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:33.465075 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc682094-fdd0-4ec0-87f2-04b07c3ac99c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.225002 Jun 04 20:56:33.466587 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 503/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:33 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:33.758969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:33.759798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:33.767009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.767842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.769029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.769691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.839167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:33.841834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:33.850142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.850693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.851706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:33.852239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:33.985834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:33.993929 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-86e85e7f-541f-4a42-9861-5d8d4cb9552a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.239358 Jun 04 20:56:33.999622 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 546/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:33 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:34.035474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:34.043370 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c70d9a3-7ee1-46ef-acd9-72b39b6514e1 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.208761 Jun 04 20:56:34.044243 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 504/1050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:33 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:34.274861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:34.276200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:34.286046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.286505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.287294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.290749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.368783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-039e146a-acfb-41ae-ae3f-8bb4b0575241 req-e3252bc0-a508-4ad5-a741-ea435d159abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec15628d-01db-4dd6-9c72-41a6aa37bc30", "tag": "052409e4-5992-4f1b-93ba-756271ff96c4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:34.377962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-039e146a-acfb-41ae-ae3f-8bb4b0575241 req-e3252bc0-a508-4ad5-a741-ea435d159abf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.378794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-039e146a-acfb-41ae-ae3f-8bb4b0575241 req-e3252bc0-a508-4ad5-a741-ea435d159abf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.394414 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-039e146a-acfb-41ae-ae3f-8bb4b0575241 req-e3252bc0-a508-4ad5-a741-ea435d159abf service nova] Creating event network-changed:052409e4-5992-4f1b-93ba-756271ff96c4 for instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 on nch1-master-1 Jun 04 20:56:34.401440 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-039e146a-acfb-41ae-ae3f-8bb4b0575241 req-e3252bc0-a508-4ad5-a741-ea435d159abf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037989 Jun 04 20:56:34.402784 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 505/1051] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:34.432990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:34.433685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:34.441049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.441494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.442262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.442692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.458274 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db HTTP/1.1 Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:34.460077 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:34.461529 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e30ca160-6726-48c7-803a-ab92978dc2db'} Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:34.462400 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:34.463867 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:34.466218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:34.467536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-362adbaa-50e3-435b-9c22-3da82c4a36e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 404 len: 111 microversion: 2.1 time: 0.038949 Jun 04 20:56:34.468469 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 506/1052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:34 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:56:34.486083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:34.486711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:34.501780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.502029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.503126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:34.503606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:34.704931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:34.713014 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b40c0cae-b830-4967-ae4d-5a66f1e48e6a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.442600 Jun 04 20:56:34.714080 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 547/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:34 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:34.720859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-115001025", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:34.781366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] validate_networks() for [('1397b8c1-156c-4d89-baa3-b4b97df18a8a', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:35.014081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:35.023488 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c406067b-3fc0-4e62-ac27-b8f0bb7b294f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.544417 Jun 04 20:56:35.024236 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 507/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:34 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:35.040352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:35.041131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:35.048894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.049572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.050872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.051502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.461043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:35.475452 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e1d1202-fdab-41b8-b309-c7de1537025d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.449748 Jun 04 20:56:35.476378 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 508/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:35 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:35.488055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:35.489195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:35.497433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.498111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.499708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.500366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.790987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:35.792016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:35.793037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:35.793930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:35.794815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:35.795400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:35.800304 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cadd9936-75f2-42fb-b53d-0f66cfdaef8f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.322629 Jun 04 20:56:35.801144 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 509/1056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:35 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:35.806593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:35.807406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:35.814157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.814847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.815619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.816059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.822696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.824100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.825752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:35.826627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:35.851961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for project 84c448aaa2a549c8a333b029ea89b104. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:35.858609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Getting quotas for user 598884c9d0964ad6992f79eaf770507d and project 84c448aaa2a549c8a333b029ea89b104. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:35.880722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:35.883258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:35.942836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-065ab8f0-4bbc-4aa9-a020-7af6d8e19470 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.227005 Jun 04 20:56:35.944041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 548/1057] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:56:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:56:35.959725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-600ee1ba-6216-4a92-aa63-fc27959c1be2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:35.960864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-600ee1ba-6216-4a92-aa63-fc27959c1be2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:36.000423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:36.009557 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c21115b3-1420-4b24-a246-ecc0f36a30c8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.207382 Jun 04 20:56:36.023318 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 510/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:35 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:36.043499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:36.044813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:36.050623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-600ee1ba-6216-4a92-aa63-fc27959c1be2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:36.055346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.055766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:36.056581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.058055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:36.058921 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-600ee1ba-6216-4a92-aa63-fc27959c1be2 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1224 microversion: 2.1 time: 0.106190 Jun 04 20:56:36.060022 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 549/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:35 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:36.209818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:36.220409 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e0b5df6-57a3-45b3-9db0-d0824d33bbdc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.182474 Jun 04 20:56:36.226222 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 511/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:36 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:36.419044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f912a84b-14d9-4d7b-8d5c-d319e39d2df1 req-3b8b9121-aca7-47b4-b248-11112652217d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d7e4b8-0a2f-475c-b7e4-4c82582b189b", "name": "network-vif-unplugged", "status": "completed", "tag": "dfa86e07-8d1c-4846-80e1-da35a0f8beb8"}, {"name": "network-changed", "server_uuid": "f8d7e4b8-0a2f-475c-b7e4-4c82582b189b", "tag": "dfa86e07-8d1c-4846-80e1-da35a0f8beb8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:36.428874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f912a84b-14d9-4d7b-8d5c-d319e39d2df1 req-3b8b9121-aca7-47b4-b248-11112652217d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.429445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f912a84b-14d9-4d7b-8d5c-d319e39d2df1 req-3b8b9121-aca7-47b4-b248-11112652217d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:36.441354 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f912a84b-14d9-4d7b-8d5c-d319e39d2df1 req-3b8b9121-aca7-47b4-b248-11112652217d service nova] Creating event network-vif-unplugged:dfa86e07-8d1c-4846-80e1-da35a0f8beb8 for instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b on nch1-master-1 Jun 04 20:56:36.441937 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f912a84b-14d9-4d7b-8d5c-d319e39d2df1 req-3b8b9121-aca7-47b4-b248-11112652217d service nova] Creating event network-changed:dfa86e07-8d1c-4846-80e1-da35a0f8beb8 for instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b on nch1-master-1 Jun 04 20:56:36.447223 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f912a84b-14d9-4d7b-8d5c-d319e39d2df1 req-3b8b9121-aca7-47b4-b248-11112652217d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.033242 Jun 04 20:56:36.447974 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 550/1061] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:36.495725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:36.496760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:36.504704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.505462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:36.506368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.506802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:36.646451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:36.655256 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df63e87c-d313-4acf-866e-c65bd7a93f7f tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.164929 Jun 04 20:56:36.656018 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 512/1062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:36 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:36.819013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:36.819894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:36.827281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.827706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:36.828484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:36.828915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.032528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:37.033738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:37.041550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.042417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.044719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.047488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.052796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:37.056466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:37.063319 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f2829113-e4af-45db-b78d-182eff39d2ca tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1471 microversion: 2.1 time: 0.249859 Jun 04 20:56:37.064305 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 551/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:36 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:37.076544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:37.077165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:37.084974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.085357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.086252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.086563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.189892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:37.218605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73f9403a-5dd0-431e-a661-d73ecd5aaaa1 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1276 microversion: 2.1 time: 0.146757 Jun 04 20:56:37.230265 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 552/1064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:37 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:37.243884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:37.244501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:37.258125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.258574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.259349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.259803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.280258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:37.290246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14713098-5d06-43e8-88bb-715e9d8c93d4 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.266441 Jun 04 20:56:37.292189 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 513/1065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:37 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:37.619965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:37.630015 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4400ddcb-877c-4292-9efe-33592f57d227 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.390444 Jun 04 20:56:37.630538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 553/1066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:37 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:37.673390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:37.674192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:37.681379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.681915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.682797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:37.683272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:37.692334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1555360641", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1e56980c-95ca-4182-ba01-f6d8494d4447"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:37.756493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] validate_networks() for [('1e56980c-95ca-4182-ba01-f6d8494d4447', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:56:38.382763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:38.394127 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05047e7d-a588-41e6-b9b6-c7107097f280 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.724037 Jun 04 20:56:38.394937 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 554/1067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:37 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:38.402958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:38.403819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:38.416016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:38.417239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:38.419107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:38.420001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:38.631346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:38.736333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:38.754511 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3250642-1959-4d0d-99f2-ec0f30307503 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.355956 Jun 04 20:56:38.756876 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 555/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:38 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:38.765961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:38.767227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:38.776879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:38.777874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:38.779673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:38.780451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:38.944914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:38.953604 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-024e1ba2-3149-4fec-86a3-39d49feae6c8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1282 microversion: 2.1 time: 0.195112 Jun 04 20:56:38.954160 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 556/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:38 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:38.963740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:38.964600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:38.971398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:38.971889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:38.972671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:38.973134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.031372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:39.031980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:39.032302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:39.032768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:39.033205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:39.042919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.043543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.045207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.045629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.063208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:39.068481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for user e25328c90d26437a85d8d5509437ed99 and project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:39.081663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:56:39.083918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:56:39.133348 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60c89f74-96a6-4f77-a41d-9e4c326c0b93 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.562323 Jun 04 20:56:39.134078 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 514/1070] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 20:56:39.144298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:39.144910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:39.161325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.162416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.163394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.164060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.183157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:39.196849 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e816002-bb35-4c05-a2f0-cf81e5bd639c tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.241339 Jun 04 20:56:39.198474 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 557/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:38 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:39.205484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7df4c6bc-f2c0-4d10-a2fb-15bdbadea422 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:39.206258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7df4c6bc-f2c0-4d10-a2fb-15bdbadea422 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:39.320466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7df4c6bc-f2c0-4d10-a2fb-15bdbadea422 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:39.330101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7df4c6bc-f2c0-4d10-a2fb-15bdbadea422 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:39.331835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7df4c6bc-f2c0-4d10-a2fb-15bdbadea422 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:39.335133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7df4c6bc-f2c0-4d10-a2fb-15bdbadea422 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1262 microversion: 2.25 time: 0.133149 Jun 04 20:56:39.336375 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 558/1072] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:39 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1262 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:39.412945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:39.413575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:39.420872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.421524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.422650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.423242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.452988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:39.462406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ad4f6c0-e368-4fed-b863-a5fb31b0b396 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.321903 Jun 04 20:56:39.468665 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 515/1073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:39 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:39.669862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:39.678538 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6359764d-c8a0-417b-9f94-447fb49a52de tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.270252 Jun 04 20:56:39.679428 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 559/1074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:39 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:39.716638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e06b5b5e-3556-4d37-8d19-14ad4e46dd6a"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:39.717831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:39.726753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.727211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.728032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.728470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.774505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:39.775219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:39.788193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.788885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:39.789902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:39.790497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.112054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:40.127770 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-08f7b68f-31c4-4a95-8de3-8cc647dd6d9e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.358966 Jun 04 20:56:40.128956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 560/1075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:39 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:40.135425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:40.136355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:40.147908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.149104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.150457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.157346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.169330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ad34577-6680-4050-a56d-e54b7f1d4c64 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "POST /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456898 Jun 04 20:56:40.174847 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 516/1076] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 20:56:39 2022] POST /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:40.193673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5fff07dc-7348-4111-a857-f594b95af7e6 req-bfbb29dc-81fa-4c4e-8d83-7ec8e0f78b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de116be-c0cd-4bb2-8804-3331867fceda", "name": "network-vif-plugged", "status": "completed", "tag": "329aff47-c005-4580-bded-ef74616918a3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:40.210806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5fff07dc-7348-4111-a857-f594b95af7e6 req-bfbb29dc-81fa-4c4e-8d83-7ec8e0f78b95 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.211630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5fff07dc-7348-4111-a857-f594b95af7e6 req-bfbb29dc-81fa-4c4e-8d83-7ec8e0f78b95 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.227402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5fff07dc-7348-4111-a857-f594b95af7e6 req-bfbb29dc-81fa-4c4e-8d83-7ec8e0f78b95 service nova] Creating event network-vif-plugged:329aff47-c005-4580-bded-ef74616918a3 for instance 0de116be-c0cd-4bb2-8804-3331867fceda on nch2-master-1 Jun 04 20:56:40.239009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5fff07dc-7348-4111-a857-f594b95af7e6 req-bfbb29dc-81fa-4c4e-8d83-7ec8e0f78b95 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065868 Jun 04 20:56:40.240384 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 517/1077] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:40.246253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:40.247433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:40.255413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.256219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.257281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.258091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.738748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:40.747245 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bfb57c77-80ed-433a-825f-a453907524d9 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.617048 Jun 04 20:56:40.747872 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 561/1078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:40 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:40.752813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:40.753904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:40.757563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:40.762047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.763197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.763746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:40.764874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.765583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.775924 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b20451bb-2dea-4a32-a258-06bbb7b45781 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.533723 Jun 04 20:56:40.776636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 518/1079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:40 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:40.782493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:40.783193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:40.806689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.808773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.813176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.813882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.909379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:40.919551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:40.920878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:40.922218 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ea47f87f-0c91-4319-824b-4d4090566f65 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1332 microversion: 2.25 time: 0.173241 Jun 04 20:56:40.923267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 562/1080] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:40 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:40.928273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:40.928896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:40.935312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.935794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:40.936725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:40.937166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.170189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:41.180032 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78f01e1e-9186-4d1b-a728-0fb6b90c9614 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.401745 Jun 04 20:56:41.189855 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 519/1081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:40 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:41.195208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:41.196097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:41.203010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.203779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.204761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.205375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.339076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:41.353336 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6112dfe5-a4ce-4eff-89e7-052ae01e3559 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1316 microversion: 2.1 time: 0.428237 Jun 04 20:56:41.354343 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 563/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:40 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:41.361664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-93153fb8-cdfe-43fe-99ad-d6395ac97faf req-cf2fd29a-bb63-4c62-b01a-70c59e52e1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1788492-5d5e-47ac-a351-c17c0052f6ce", "tag": "a3e07c18-b8dc-4026-847d-1b52a92f20d6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:41.388786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-93153fb8-cdfe-43fe-99ad-d6395ac97faf req-cf2fd29a-bb63-4c62-b01a-70c59e52e1c8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.388786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-93153fb8-cdfe-43fe-99ad-d6395ac97faf req-cf2fd29a-bb63-4c62-b01a-70c59e52e1c8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.401310 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-93153fb8-cdfe-43fe-99ad-d6395ac97faf req-cf2fd29a-bb63-4c62-b01a-70c59e52e1c8 service nova] Creating event network-changed:a3e07c18-b8dc-4026-847d-1b52a92f20d6 for instance f1788492-5d5e-47ac-a351-c17c0052f6ce on nch2-master-1 Jun 04 20:56:41.407080 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-93153fb8-cdfe-43fe-99ad-d6395ac97faf req-cf2fd29a-bb63-4c62-b01a-70c59e52e1c8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049153 Jun 04 20:56:41.408068 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 564/1083] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:41.494522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:41.503374 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d28dc745-29f7-4475-a4a0-3b3d3fc27cc2 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.311927 Jun 04 20:56:41.504114 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 520/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:41 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:41.767627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:41.768239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:41.775982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.776437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.777261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.777963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.794220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:41.794850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:41.802370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.803017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:41.804713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:41.805375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.404168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:42.412438 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ece37731-a8dc-48c8-83fe-1b72acbe9a68 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.650949 Jun 04 20:56:42.413143 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 565/1085] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:41 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:42.418548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:42.419588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:42.419736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:42.427172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.428040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.428946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.429522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.430832 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bfa54d7c-5701-4401-9816-a59ef74f7459 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.641606 Jun 04 20:56:42.432069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 521/1086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:41 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:42.441454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:42.442462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:42.450628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.451318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.452345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.452775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.839754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:42.848682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:42.850535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:42.851713 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-69aa925b-fa92-4ad5-a7af-cdc2a0010cdf tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.437470 Jun 04 20:56:42.852527 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 566/1087] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:42 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:42.864257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-aeb6320c-4f87-4b67-ac35-006537e9e502 req-2a56fc3c-ed06-4293-b17b-85f0598f6005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec15628d-01db-4dd6-9c72-41a6aa37bc30", "name": "network-vif-plugged", "status": "completed", "tag": "052409e4-5992-4f1b-93ba-756271ff96c4"}, {"server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "name": "network-vif-unplugged", "status": "completed", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:42.868964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aeb6320c-4f87-4b67-ac35-006537e9e502 req-2a56fc3c-ed06-4293-b17b-85f0598f6005 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.869398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aeb6320c-4f87-4b67-ac35-006537e9e502 req-2a56fc3c-ed06-4293-b17b-85f0598f6005 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.881235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:42.885663 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-aeb6320c-4f87-4b67-ac35-006537e9e502 req-2a56fc3c-ed06-4293-b17b-85f0598f6005 service nova] Creating event network-vif-plugged:052409e4-5992-4f1b-93ba-756271ff96c4 for instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 on nch1-master-1 Jun 04 20:56:42.886328 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-aeb6320c-4f87-4b67-ac35-006537e9e502 req-2a56fc3c-ed06-4293-b17b-85f0598f6005 service nova] Creating event network-vif-unplugged:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:56:42.892163 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-311279bc-419f-4a9c-814b-0ed4f57a5b5c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.458318 Jun 04 20:56:42.893334 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 522/1088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:42 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:42.894332 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-aeb6320c-4f87-4b67-ac35-006537e9e502 req-2a56fc3c-ed06-4293-b17b-85f0598f6005 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.040625 Jun 04 20:56:42.899017 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 567/1089] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:42.902358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:42.903201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:42.905592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:42.906506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:42.911298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.911880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.912732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.913230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.915489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.916154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:42.917146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:42.917893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.377069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:43.385718 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d851d276-c767-43ff-9afa-48f805a7373a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1465 microversion: 2.1 time: 0.491196 Jun 04 20:56:43.386509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 523/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:42 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1465 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:43.404534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:43.405220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:43.412636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.413083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.413882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.414435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.419630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:43.431111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7dd6ce8d-80f6-4327-874f-10102c390a36 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.530583 Jun 04 20:56:43.432689 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 568/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:42 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:43.438535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:43.439561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:43.449488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.450522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.451286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.451828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.791662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-80b9a996-e9a8-4bf1-9b90-de0508434d6a tempest-ServersOnMultiNodesTest-704257852 tempest-ServersOnMultiNodesTest-704257852-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1616 microversion: 2.1 time: 0.391445 Jun 04 20:56:43.796230 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 524/1092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:43 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1616 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:43.801674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:43.803189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:43.809516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:43.810840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.811291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.812105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.812544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.818111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5422c098-abb8-44d4-bede-40f8bd773595 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.384078 Jun 04 20:56:43.828190 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 569/1093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:43 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:43.833100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:43.834105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:43.841165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.841855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.842493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.843107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.870809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:43.877666 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4f551a1-0e41-4e30-9d93-4586ce017d82 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048381 Jun 04 20:56:43.878441 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 570/1094] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:56:43 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:43.890227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:43.891085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:43.898554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.898988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.899820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:43.900261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:43.930691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:44.021243 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bc0de16-b401-4f16-88cc-5ac49e5249f0 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 204 len: 0 microversion: 2.1 time: 0.135781 Jun 04 20:56:44.021855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 571/1095] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:43 2022] DELETE /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:44.030478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:44.031200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:44.037129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.037503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.037976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.038745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.039186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.046815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6fb04044-0d8d-4d7e-9c63-f1148cca8045 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1324 microversion: 2.1 time: 0.249178 Jun 04 20:56:44.047571 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 525/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:43 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:44.052501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:44.052918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:44.056292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:44.061096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.061546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.062329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.062759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.203854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lazy-loading 'services' on Instance uuid f86e3ca0-740c-47ff-a635-ebbabc3609e4 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:44.238065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.247385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.249566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.251399 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17b846b1-c324-484c-96d9-a4549ee87763 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.225333 Jun 04 20:56:44.256287 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 572/1097] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:44 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:44.269240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:44.270007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:44.278759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.279228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.280054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.280499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.330884 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-398227a9-f69d-4d2e-9066-5ef202fef928 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments/e06b5b5e-3556-4d37-8d19-14ad4e46dd6a" status: 202 len: 0 microversion: 2.1 time: 0.281879 Jun 04 20:56:44.331497 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 526/1098] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 20:56:44 2022] DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments/e06b5b5e-3556-4d37-8d19-14ad4e46dd6a => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:56:44.336814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:44.337405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:44.344838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.345284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.346042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.346477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.530541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.539244 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-25d47b1c-9f1f-4101-ae1d-a8ed5b76c15f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.281481 Jun 04 20:56:44.539871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 573/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:44 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:44.549226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3da91392-fc66-4d48-a712-ead9a0923539 req-3ec45f8f-f908-4298-b532-433cea19ed07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7b6b65-2659-4310-b317-0de0ef27ae4f", "tag": "eae0c7d0-b5b1-4b5a-a0cd-a7245b049763"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:44.557711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3da91392-fc66-4d48-a712-ead9a0923539 req-3ec45f8f-f908-4298-b532-433cea19ed07 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.558133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3da91392-fc66-4d48-a712-ead9a0923539 req-3ec45f8f-f908-4298-b532-433cea19ed07 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.561856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.569549 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0587c112-5397-483b-98b0-5840fd7ec6ac tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1471 microversion: 2.1 time: 0.236883 Jun 04 20:56:44.570669 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 527/1100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:44 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:44.570823 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3da91392-fc66-4d48-a712-ead9a0923539 req-3ec45f8f-f908-4298-b532-433cea19ed07 service nova] Creating event network-changed:eae0c7d0-b5b1-4b5a-a0cd-a7245b049763 for instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f on nch2-master-1 Jun 04 20:56:44.574856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:44.575473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:44.581732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.582193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.582962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.583090 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3da91392-fc66-4d48-a712-ead9a0923539 req-3ec45f8f-f908-4298-b532-433cea19ed07 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041702 Jun 04 20:56:44.583405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.583972 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 574/1101] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:44.721488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:44.729437 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c87c2943-0d27-40ca-b50a-fd1abea55996 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.158355 Jun 04 20:56:44.730023 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 528/1102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:44 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:44.839170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:44.840038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:44.844662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:44.850212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.850883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.852103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:44.852643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:44.994580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.005076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f7a8d655-629b-4c0f-9511-e7ed2faf0055 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.172601 Jun 04 20:56:45.005875 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 575/1103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:44 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:45.064150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.066184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.073336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.073785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.074624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.075199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.190064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-34ca8484-6aba-4306-bacd-c9b9f2ea4179 req-c92793d7-77b7-4f99-9d88-7a5b0a87544f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "name": "network-vif-plugged", "status": "completed", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:45.199301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-34ca8484-6aba-4306-bacd-c9b9f2ea4179 req-c92793d7-77b7-4f99-9d88-7a5b0a87544f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.200457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-34ca8484-6aba-4306-bacd-c9b9f2ea4179 req-c92793d7-77b7-4f99-9d88-7a5b0a87544f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.213000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-34ca8484-6aba-4306-bacd-c9b9f2ea4179 req-c92793d7-77b7-4f99-9d88-7a5b0a87544f service nova] Creating event network-vif-plugged:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:56:45.218464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.218741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-34ca8484-6aba-4306-bacd-c9b9f2ea4179 req-c92793d7-77b7-4f99-9d88-7a5b0a87544f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032362 Jun 04 20:56:45.219280 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 576/1104] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:45.227498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d8335979-abd3-4611-8a95-1b5b64246806 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1522 microversion: 2.1 time: 0.168216 Jun 04 20:56:45.239223 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 529/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:45.245323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.245910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.252546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.252994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.253773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.254210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.275017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.275699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.277929 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] HTTP exception thrown: Instance is not a member of specified network Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Request method failure captured: Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30/ips/invalid HTTP/1.1 Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8b6gHzRRGYDLxWcubHHzxZESZmtNZj6u_6FW6gic8OroOzhx60eDEjueMuG9WDkI86eGuy8orKutzaysIoq_l--GGc2936Wa9_iNsqX4n3d_z3-lzRQ66iOQYwy-yQ_4mpOP8wxXokC6j1ETqpiPLwsBJSZqroWngeJR9R4sQo2_aw Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6332536fbe7047baa8b71c64fc9a5c3b Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:45.279628 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6332536fbe7047baa8b71c64fc9a5c3b Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerAddressesNegativeTestJSON-996332819-project Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 52294b4889cc4fd389b166c4150942c0 Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-996332819-project Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance is not a member of specified network Jun 04 20:56:45.281207 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': 'ec15628d-01db-4dd6-9c72-41a6aa37bc30', 'id': 'invalid'} Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jun 04 20:56:45.282074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.285418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Returning 404 to user: Instance is not a member of specified network {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:45.285418 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9c2aa013-fdb3-4bea-8a69-ae8e04da1e5a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.040157 Jun 04 20:56:45.285418 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 577/1106] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30/ips/invalid => generated 91 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:56:45.286106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.286106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.286106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.286106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.295914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02d4f8b6-4f8c-4bce-a524-ccccabde692b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.296282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-02d4f8b6-4f8c-4bce-a524-ccccabde692b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Failed to fetch instance by id 999 {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 20:56:45.297347 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-02d4f8b6-4f8c-4bce-a524-ccccabde692b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] HTTP exception thrown: Instance 999 could not be found. Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02d4f8b6-4f8c-4bce-a524-ccccabde692b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Request method failure captured: Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8b6gHzRRGYDLxWcubHHzxZESZmtNZj6u_6FW6gic8OroOzhx60eDEjueMuG9WDkI86eGuy8orKutzaysIoq_l--GGc2936Wa9_iNsqX4n3d_z3-lzRQ66iOQYwy-yQ_4mpOP8wxXokC6j1ETqpiPLwsBJSZqroWngeJR9R4sQo2_aw Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6332536fbe7047baa8b71c64fc9a5c3b Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:45.299592 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6332536fbe7047baa8b71c64fc9a5c3b Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerAddressesNegativeTestJSON-996332819-project Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 52294b4889cc4fd389b166c4150942c0 Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-996332819-project Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 999 could not be found. Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '999'} Jun 04 20:56:45.301218 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:45.302204 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:45.303820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02d4f8b6-4f8c-4bce-a524-ccccabde692b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Returning 404 to user: Instance 999 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:45.305138 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-02d4f8b6-4f8c-4bce-a524-ccccabde692b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016154 Jun 04 20:56:45.305768 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 578/1107] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 20:56:45.315721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.316613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.324155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.324739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.325687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.326081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.356112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:45.448209 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2473289-56ba-4571-8993-e8e817b021b5 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 204 len: 0 microversion: 2.1 time: 0.136054 Jun 04 20:56:45.449230 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 579/1108] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:45 2022] DELETE /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:45.452948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.458356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.459236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.461438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.463033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.464440 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0dc31cbd-dabc-472f-a79d-414592868265 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.194096 Jun 04 20:56:45.466135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.466696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.467481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.467951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.475016 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 530/1109] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:56:45.560701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.561378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.567839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.568291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.569114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.569560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.618340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.627076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5fb12d1d-434f-41f2-82f4-1cc02af2dec0 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1528 microversion: 2.1 time: 0.173001 Jun 04 20:56:45.627873 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 580/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1528 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:45.646795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.647405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.654495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.655119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.656387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.656860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.740379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.749631 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-726e6400-ffe5-4dcd-b050-77b68476f2cc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.195306 Jun 04 20:56:45.750230 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 531/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:45.761398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:45.762155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:45.768847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.769548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.770878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:45.771305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:45.824310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.833413 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e17fa5d7-1b67-4e3b-8bcd-c51903a98f1c tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1471 microversion: 2.1 time: 0.191737 Jun 04 20:56:45.833993 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 581/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:45.921142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:45.930196 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-596f1e58-a24b-4c45-a10c-df3447f77079 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.172680 Jun 04 20:56:45.931222 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 532/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:45 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:46.023839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:46.025276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:46.027875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:46.036179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.037027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.038232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.038674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.176996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:46.186024 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f9cd9f2-3832-43eb-b6e7-5f379943be14 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.167068 Jun 04 20:56:46.186615 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 582/1114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:46 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:46.483228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:46.483868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:46.492815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.493536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.494519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.495112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.559021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:46.560326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:46.566794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.567243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.568080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.568521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.603204 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66d272f7-6b43-48ec-8477-b5674994d0df tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048111 Jun 04 20:56:46.603902 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 583/1115] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:56:46 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:46.651166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:46.651906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:46.659015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.659741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.660650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.661085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.900944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:46.909950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:46.911685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:46.912967 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-07b8e0ba-452a-412b-af2f-e290d4c10270 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.434735 Jun 04 20:56:46.913590 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 533/1116] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:46 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:46.927907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:46.928579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:46.935002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.935550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:46.936392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:46.936890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:47.381157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:47.389912 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20e3f99d-65ca-4312-b4bc-6c5727e15e7b tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1528 microversion: 2.1 time: 0.742848 Jun 04 20:56:47.391800 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 584/1117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:46 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1528 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:47.398033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:47.398919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:47.408265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:47.408901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:47.409819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:47.410741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:47.738107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:47.745113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:47.755912 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4cc2bdbb-3146-4fe5-8c6e-e52f5a503e81 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.831334 Jun 04 20:56:47.767556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 534/1118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:46 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:47.773662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:47.774357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:47.781182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:47.781698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:47.782534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:47.783026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:47.905113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:47.915839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7aebd003-ede0-4ef3-9c5b-48cd07af13f4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1471 microversion: 2.1 time: 0.522115 Jun 04 20:56:47.917610 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 585/1119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:47 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1471 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:47.924637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:47.928721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:47.936552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:47.937012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:47.937857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:47.938624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.318812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:48.328733 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e4b9e7b5-b071-4be8-83f3-a03ca67bce86 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.559502 Jun 04 20:56:48.341100 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 535/1120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:47 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:48.347252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:48.348607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:48.356334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.357077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.364658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.365385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.410500 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc41c46e-7c7d-47ee-bd11-43e79021f8fb tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067181 Jun 04 20:56:48.411123 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 536/1121] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:56:48 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:48.421462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:48.422024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:48.429584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.431066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.431066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.431430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.472331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:48.481281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:48.487787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bccde0cb-89d1-4e98-9929-0ff56f2b2d1d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.568096 Jun 04 20:56:48.489782 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 586/1122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:47 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:48.494755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b2f2ebb6-d218-4302-8c50-0770ef4d4ef7 req-63382f7d-1614-4ac7-a9d5-e5fc292001c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1788492-5d5e-47ac-a351-c17c0052f6ce", "name": "network-vif-plugged", "status": "completed", "tag": "a3e07c18-b8dc-4026-847d-1b52a92f20d6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:48.505575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b2f2ebb6-d218-4302-8c50-0770ef4d4ef7 req-63382f7d-1614-4ac7-a9d5-e5fc292001c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.506462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b2f2ebb6-d218-4302-8c50-0770ef4d4ef7 req-63382f7d-1614-4ac7-a9d5-e5fc292001c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.533923 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b2f2ebb6-d218-4302-8c50-0770ef4d4ef7 req-63382f7d-1614-4ac7-a9d5-e5fc292001c4 service nova] Creating event network-vif-plugged:a3e07c18-b8dc-4026-847d-1b52a92f20d6 for instance f1788492-5d5e-47ac-a351-c17c0052f6ce on nch2-master-1 Jun 04 20:56:48.540425 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b2f2ebb6-d218-4302-8c50-0770ef4d4ef7 req-63382f7d-1614-4ac7-a9d5-e5fc292001c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050124 Jun 04 20:56:48.547359 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 587/1123] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:48.561480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ca470e79-2287-4463-9662-8168945ea020 req-1f8a334d-0480-429d-ac14-8b179ac8e574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec15628d-01db-4dd6-9c72-41a6aa37bc30", "name": "network-vif-deleted", "tag": "052409e4-5992-4f1b-93ba-756271ff96c4"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:48.576214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ca470e79-2287-4463-9662-8168945ea020 req-1f8a334d-0480-429d-ac14-8b179ac8e574 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.576675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ca470e79-2287-4463-9662-8168945ea020 req-1f8a334d-0480-429d-ac14-8b179ac8e574 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.590537 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ca470e79-2287-4463-9662-8168945ea020 req-1f8a334d-0480-429d-ac14-8b179ac8e574 service nova] Creating event network-vif-deleted:052409e4-5992-4f1b-93ba-756271ff96c4 for instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 on nch1-master-1 Jun 04 20:56:48.598476 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ca470e79-2287-4463-9662-8168945ea020 req-1f8a334d-0480-429d-ac14-8b179ac8e574 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047708 Jun 04 20:56:48.600070 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 588/1124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:48.608222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1466a8af-a6db-44ba-80fb-33f0e4122340 req-66e561e1-83fc-493d-900d-337d7c2357b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de116be-c0cd-4bb2-8804-3331867fceda", "name": "network-vif-deleted", "tag": "329aff47-c005-4580-bded-ef74616918a3"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:48.617666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1466a8af-a6db-44ba-80fb-33f0e4122340 req-66e561e1-83fc-493d-900d-337d7c2357b5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.618105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1466a8af-a6db-44ba-80fb-33f0e4122340 req-66e561e1-83fc-493d-900d-337d7c2357b5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.634631 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1466a8af-a6db-44ba-80fb-33f0e4122340 req-66e561e1-83fc-493d-900d-337d7c2357b5 service nova] Creating event network-vif-deleted:329aff47-c005-4580-bded-ef74616918a3 for instance 0de116be-c0cd-4bb2-8804-3331867fceda on nch2-master-1 Jun 04 20:56:48.640829 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1466a8af-a6db-44ba-80fb-33f0e4122340 req-66e561e1-83fc-493d-900d-337d7c2357b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038616 Jun 04 20:56:48.641611 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 589/1125] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:48.650679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:48.651540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:48.662435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.662980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.664095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.664383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.712801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:48.725553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:48.727916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:48.731949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c79fae2-b3fa-4cb7-867c-1920e7bab256 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.314360 Jun 04 20:56:48.732912 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 537/1126] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:48 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:48.740385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:48.742475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:48.754257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.755807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.757249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:48.758715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.759688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.769081 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26940a85-9c9e-4f7a-ac86-c2368f8eaaf6 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1486 microversion: 2.1 time: 0.125871 Jun 04 20:56:48.781211 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 590/1127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:48 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1486 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:48.786630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:48.787631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:48.795233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.795741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.796546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.797041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.809733 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-999dd644-09f0-4b2b-94cd-831b561420a6 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075092 Jun 04 20:56:48.811372 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 538/1128] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:56:48 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:48.885552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:48.886372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:48.903362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.903925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.904634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:48.905063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:48.954148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:49.055490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:49.079897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=23 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:49.080429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.084948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e18758b-e851-4b9b-be82-1e9c8d1e77cc tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 204 len: 0 microversion: 2.1 time: 0.204165 Jun 04 20:56:49.091471 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 539/1129] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:48 2022] DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:49.093133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-472e3d3e-b690-40ce-ab61-455326e19ce0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.310017 Jun 04 20:56:49.094254 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 591/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:48 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:49.099580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:49.100242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:49.100823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:49.101680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:49.109159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.110000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.111659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.112369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.113132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.113777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.114847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.115395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.248827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.261342 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d80c1470-c5ca-485d-9f59-7beea6b1e3ec tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 200 len: 1429 microversion: 2.1 time: 0.167853 Jun 04 20:56:49.262113 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 540/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:49 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 1429 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:49.325505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=22 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:49.352619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:49.353683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:49.365418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.366254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.368205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.369590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.383387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.393915 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cef92844-a53b-4d76-a74e-eb135f6fd448 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1681 microversion: 2.1 time: 0.298373 Jun 04 20:56:49.394947 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 592/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:49 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:49.504651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:49.505320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:49.512565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.512565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.513170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.513611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.540574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.549684 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-41ae39f5-5848-40eb-9a49-abcc6d176c3d tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1477 microversion: 2.1 time: 0.204174 Jun 04 20:56:49.550662 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 541/1133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:49 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1477 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:49.655925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.664127 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1d546f79-528f-41e8-8af8-4b0b994992d5 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.163487 Jun 04 20:56:49.664742 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 593/1134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:49 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:49.756475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:49.757035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:49.765459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.765914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.766826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.767147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.787754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:49.788380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:49.795079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.795531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.796345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.796803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.829983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:49.830407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:49.830885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lazy-loading 'fault' on Instance uuid ec15628d-01db-4dd6-9c72-41a6aa37bc30 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:49.885701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.895176 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed0d8e3a-cfaa-47c3-90ca-16b0cf35e943 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1314 microversion: 2.1 time: 0.111290 Jun 04 20:56:49.896240 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 594/1135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:49 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:49.972132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.984835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.986642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:49.987833 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ba12ffe1-684d-44ed-8aea-46c7734edf40 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.237134 Jun 04 20:56:49.998246 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 542/1136] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:49 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:50.113659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.114417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.124253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.124808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.125846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.126484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.273050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:50.278333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.278933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0de116be-c0cd-4bb2-8804-3331867fceda] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.281931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ca5c78b-2578-4e11-a8bf-77275ee07ade tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.174073 Jun 04 20:56:50.282519 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 595/1137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:50 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:50.285564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.286017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.286846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.287317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.302391 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance 0de116be-c0cd-4bb2-8804-3331867fceda could not be found. Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda HTTP/1.1 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:50.304104 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 0de116be-c0cd-4bb2-8804-3331867fceda could not be found. Jun 04 20:56:50.305688 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '0de116be-c0cd-4bb2-8804-3331867fceda'} Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de116be-c0cd-4bb2-8804-3331867fceda could not be found. Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:50.306613 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de116be-c0cd-4bb2-8804-3331867fceda could not be found. Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de116be-c0cd-4bb2-8804-3331867fceda could not be found. Jun 04 20:56:50.308453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:50.309898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance 0de116be-c0cd-4bb2-8804-3331867fceda could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:50.309898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f4f8b24-0f55-4a89-96de-5f4b20f481cf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda" status: 404 len: 111 microversion: 2.1 time: 0.031970 Jun 04 20:56:50.309898 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 543/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:50 2022] GET /compute/v2.1/servers/0de116be-c0cd-4bb2-8804-3331867fceda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:50.315342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.315882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.322230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.322691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.323471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.323950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.351310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:50.415926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.416725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.423434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.424764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.425581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.426188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.448121 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9a939d9-6570-4ebf-874d-6eea97a296bf tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 204 len: 0 microversion: 2.1 time: 0.136399 Jun 04 20:56:50.449067 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 596/1139] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:50 2022] DELETE /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:50.458202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.458999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.465573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.466275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.467070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.467538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.752208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:50.757837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:50.760512 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f96d1d2a-76b5-451c-8a32-dfe47586cc1c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1681 microversion: 2.1 time: 0.348829 Jun 04 20:56:50.761514 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 544/1140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:50 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1681 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:50.766509 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fbae023f-9068-449c-9347-4f630702c045 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1471 microversion: 2.1 time: 0.312469 Jun 04 20:56:50.766751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.767221 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 597/1141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:50 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:50.775094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:50.775094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.775381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:50.784492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.784947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.785830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.786383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.791983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.792437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:50.793379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:50.793822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.063868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.073036 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23015267-d1a4-47de-ac7b-307a2df4e770 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1463 microversion: 2.1 time: 0.310700 Jun 04 20:56:51.073632 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 545/1142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:50 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:51.078791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:51.079407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.085577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.086090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.087088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.087501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.087790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.096313 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-29c3bc83-1fc8-4152-9ed2-c8b2051f833a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1324 microversion: 2.1 time: 0.327866 Jun 04 20:56:51.097123 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 598/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:50 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:51.101937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:51.102707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.109784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.110216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.111192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.111825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.130019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.130495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.131492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lazy-loading 'fault' on Instance uuid ec15628d-01db-4dd6-9c72-41a6aa37bc30 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:51.192152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.200274 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bef39b69-38e6-49f9-88fd-4d3f88f4242f tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1314 microversion: 2.1 time: 0.125557 Jun 04 20:56:51.200797 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 546/1144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1314 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:51.205377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:51.205951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.212593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.213039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.213824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.214257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.407056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.416075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.417604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.418861 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-49ed3c96-bbce-42ba-bbcd-d67d017d41f2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.320469 Jun 04 20:56:51.429097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 599/1145] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:51.434099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:51.434709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.441657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.442124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.442893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.443715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.457567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.466590 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52ecf63c-d2c5-4242-a12c-ed401098c852 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1463 microversion: 2.1 time: 0.264767 Jun 04 20:56:51.467437 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 547/1146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1463 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:51.483610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:51.485197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.492112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.492545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.493339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.493808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.585569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:56:51.585991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:56:51.586459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:56:51.586864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:56:51.587272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:56:51.604095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.614514 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dac24b36-c222-4669-a3ec-9057360882bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1549 microversion: 2.1 time: 0.184304 Jun 04 20:56:51.615618 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 600/1147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:51.646063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:51.661260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.667930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.668674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.670073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.670521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.699545 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da338bfd-25e5-4f98-8dc2-f6928e285f23 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 1067 microversion: 2.1 time: 0.220237 Jun 04 20:56:51.702000 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 548/1148] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:56:51 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 1067 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 04 20:56:51.715649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:51.716303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.723960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.724573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.725352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.725967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.778467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:51.779375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:51.788252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.788715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.789767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:51.790199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:51.976470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:51.989466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6caefbc-9157-442d-8dc1-e5a2df046252 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.278001 Jun 04 20:56:51.990682 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 601/1149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.004431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.005016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.007885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.011343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.011912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.012690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.013124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.016116 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f48f6a2-dfcc-4c13-a6ea-9e696337dcaf tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1681 microversion: 2.1 time: 0.242249 Jun 04 20:56:52.016701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 549/1150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.114319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.114980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.122285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.122738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.123602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.124166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.158532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.163274 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e23aefc-3db9-4a31-b2dc-cba57e5b35d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1471 microversion: 2.1 time: 0.162614 Jun 04 20:56:52.163886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 602/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:51 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.217425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.218035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.224508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.224968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.225753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.226183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.242681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:52.258628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.263499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.263969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.264421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lazy-loading 'fault' on Instance uuid ec15628d-01db-4dd6-9c72-41a6aa37bc30 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:52.267420 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a833a5a-50e4-4760-ba89-a5e0d9680ae4 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1520 microversion: 2.1 time: 0.157399 Jun 04 20:56:52.268241 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 550/1152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.289651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.290148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.296671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.297116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.297897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.298328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.312634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.320608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3c7a17d5-0d84-4dbe-ab6c-ab77f1753e24 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1314 microversion: 2.1 time: 0.107402 Jun 04 20:56:52.321285 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 603/1153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1314 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:52.326934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:52.407837 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-633c928d-454b-46f7-9689-b54e58d9d7e8 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 204 len: 0 microversion: 2.1 time: 0.121627 Jun 04 20:56:52.409003 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 551/1154] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:52 2022] DELETE /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:52.417249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.418211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.424492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.425019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.425873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.426305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.437862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.439034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.446260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.447484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.448582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.449124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.617641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.626812 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ff22ed0-0878-4834-9ce4-df1289f7dff0 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1526 microversion: 2.1 time: 0.213379 Jun 04 20:56:52.627866 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 604/1155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.632888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.633595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.640441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.641252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.642122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.642618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.651605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.660214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.661704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.662811 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ccf69934-468e-4ca1-a90e-c881b8ac9de4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.229893 Jun 04 20:56:52.663371 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 552/1156] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:52.792460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:52.802206 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e8e089a2-c25e-443e-a27c-7e5fc510dd13 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1539 microversion: 2.1 time: 0.173028 Jun 04 20:56:52.802786 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 605/1157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1539 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.819863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc889780-ef51-4b78-8165-d07a301fb2fe tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '.version_select at 0x7f2d021ab040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.823574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc889780-ef51-4b78-8165-d07a301fb2fe tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.824224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc889780-ef51-4b78-8165-d07a301fb2fe tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.837368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc889780-ef51-4b78-8165-d07a301fb2fe tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.022501 Jun 04 20:56:52.838298 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 553/1158] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:52.850815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:52.851430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:52.857876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.858324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.859098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:52.859537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:52.992686 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b26c3973-3d2e-4c7d-92d0-2ab2b15107e2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1690 microversion: 2.1 time: 0.145470 Jun 04 20:56:52.993322 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 606/1159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:52 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1690 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:53.009041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.009665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.012681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.013340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.019211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.019702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.020835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.021082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.021279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.021826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.022785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.023340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.233286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.237911 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-80f69c24-bf27-4cc3-b50b-32bf141f2912 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1690 microversion: 2.1 time: 0.232700 Jun 04 20:56:53.238486 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 554/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:53.241398 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-350588c8-6000-4796-9214-a68ec408cc4f tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.232634 Jun 04 20:56:53.243156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.243671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.244090 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 607/1161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:53.252446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.252932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.254308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.254840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.256401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.256976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.259466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.259936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.260716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.261147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.466095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.468786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.474046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6e170c0-bc47-4aef-9fc7-8aa82eb7aa9c tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1681 microversion: 2.1 time: 0.234517 Jun 04 20:56:53.474636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 555/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:53.480910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.481196 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2c60d0e9-27ae-4bf6-9821-b56933fbd76a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1471 microversion: 2.1 time: 0.235818 Jun 04 20:56:53.481623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.481809 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 608/1163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:53.490788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.490788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.490788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.490788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.491220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.491220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.498326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.498776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.499555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.500010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.534862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.535371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.535853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lazy-loading 'fault' on Instance uuid ec15628d-01db-4dd6-9c72-41a6aa37bc30 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:53.579044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lazy-loading 'services' on Instance uuid f8d7e4b8-0a2f-475c-b7e4-4c82582b189b {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:53.580144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52294b4889cc4fd389b166c4150942c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6332536fbe7047baa8b71c64fc9a5c3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.587761 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ca54012-e0a1-460d-96d8-6e24cd74043a tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 200 len: 1314 microversion: 2.1 time: 0.104918 Jun 04 20:56:53.588410 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 609/1164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 1314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:53.644702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.645729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.654227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.655026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.656253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.657348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.663498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14c501ad-c086-4c47-b7cf-559a5f93ceed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments/94b159b1-5ff2-48ce-8547-8af2ac101852" status: 202 len: 0 microversion: 2.1 time: 0.187444 Jun 04 20:56:53.664629 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 556/1165] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 20:56:53 2022] DELETE /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments/94b159b1-5ff2-48ce-8547-8af2ac101852 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:56:53.674095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.675676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.683576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.684834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.685650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.686166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.720985 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d01fcd7-ec41-48de-810c-ddcb5a5d9efb tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052033 Jun 04 20:56:53.721769 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 557/1166] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:53.726386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:53.726992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:53.735493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.736571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.738954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:53.739825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:53.854236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.862578 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55cadee4-a5c3-409c-94dc-fb7e06214111 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1526 microversion: 2.1 time: 0.221894 Jun 04 20:56:53.863331 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 610/1167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:53.984890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.993369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.994871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:53.995982 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae3267ae-c127-4339-a2e5-ed4eb0e18e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.273426 Jun 04 20:56:53.996784 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 558/1168] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:53 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:54.258682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:54.259279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:54.267550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:54.268004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:54.269017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:54.269463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:54.493732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:54.495249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:54.503733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:54.504566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:54.505922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:54.506711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:54.896786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:54.912364 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2247ea3f-ce53-4054-bc83-a74db646ac93 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.657726 Jun 04 20:56:54.912971 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 611/1169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:54 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:54.925439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:54.926752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:54.934562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:54.935258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:54.936242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:54.936824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.004984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.005714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.006566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lazy-loading 'fault' on Instance uuid d1e680a2-7857-43ab-bb59-3c7ddb5ef666 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:55.012896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:55.027682 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7de5c3b2-ed73-4091-bced-3de081beb5db tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1681 microversion: 2.1 time: 0.539929 Jun 04 20:56:55.028170 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 559/1170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:54 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1681 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:55.032918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:55.044992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] [instance: ec15628d-01db-4dd6-9c72-41a6aa37bc30] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:55.051688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.052133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.053088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.053525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.068438 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] HTTP exception thrown: Instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 could not be found. Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Request method failure captured: Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 HTTP/1.1 Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8b6gHzRRGYDLxWcubHHzxZESZmtNZj6u_6FW6gic8OroOzhx60eDEjueMuG9WDkI86eGuy8orKutzaysIoq_l--GGc2936Wa9_iNsqX4n3d_z3-lzRQ66iOQYwy-yQ_4mpOP8wxXokC6j1ETqpiPLwsBJSZqroWngeJR9R4sQo2_aw Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6332536fbe7047baa8b71c64fc9a5c3b Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:55.070505 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6332536fbe7047baa8b71c64fc9a5c3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6332536fbe7047baa8b71c64fc9a5c3b Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-996332819 Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerAddressesNegativeTestJSON-996332819-project Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 52294b4889cc4fd389b166c4150942c0 Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-996332819-project Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 could not be found. Jun 04 20:56:55.072094 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ec15628d-01db-4dd6-9c72-41a6aa37bc30'} Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 could not be found. Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:55.072968 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 could not be found. Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 could not be found. Jun 04 20:56:55.074291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:55.077557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] Returning 404 to user: Instance ec15628d-01db-4dd6-9c72-41a6aa37bc30 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:55.080978 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e883d92d-ead0-4f8a-824f-d2c4f3dbfbe8 tempest-ServerAddressesNegativeTestJSON-996332819 tempest-ServerAddressesNegativeTestJSON-996332819-project] 10.222.0.18 "GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30" status: 404 len: 111 microversion: 2.1 time: 0.049401 Jun 04 20:56:55.082030 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 560/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:55 2022] GET /compute/v2.1/servers/ec15628d-01db-4dd6-9c72-41a6aa37bc30 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:55.087023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8af30afc-e67f-4558-a933-bb81d2cdc54d req-fde91e6d-8cdd-4aff-a1b3-a927fe3c9f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1e680a2-7857-43ab-bb59-3c7ddb5ef666", "name": "network-vif-deleted", "tag": "36ac5132-5332-4755-bb63-e4be93fabd3d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:55.097175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8af30afc-e67f-4558-a933-bb81d2cdc54d req-fde91e6d-8cdd-4aff-a1b3-a927fe3c9f7a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.098090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8af30afc-e67f-4558-a933-bb81d2cdc54d req-fde91e6d-8cdd-4aff-a1b3-a927fe3c9f7a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.111233 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8af30afc-e67f-4558-a933-bb81d2cdc54d req-fde91e6d-8cdd-4aff-a1b3-a927fe3c9f7a service nova] Creating event network-vif-deleted:36ac5132-5332-4755-bb63-e4be93fabd3d for instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 on nch1-master-1 Jun 04 20:56:55.117538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8af30afc-e67f-4558-a933-bb81d2cdc54d req-fde91e6d-8cdd-4aff-a1b3-a927fe3c9f7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034175 Jun 04 20:56:55.118834 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 561/1172] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:55.127213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:55.129511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:55.132741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:55.137533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.138270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.139255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.139903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.148209 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f63a0a3f-5a2c-4e4b-b144-242a1fa63a14 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 200 len: 1306 microversion: 2.1 time: 0.234125 Jun 04 20:56:55.151486 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 612/1173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:54 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:55.162830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:55.163454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:55.183717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.184709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6138f2fa-b18a-4c01-bea6-cc2d082f2975 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063596 Jun 04 20:56:55.185630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.186201 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 562/1174] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:56:55 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:56:55.187250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.187913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.191694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:55.193476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:55.201994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.203135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.204177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.205271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.749101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:55.759313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:55.760851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:55.762236 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa6e2441-22f1-4892-b2b5-36fbe648354a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.574677 Jun 04 20:56:55.769515 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 563/1175] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:55 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:55.778200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '598884c9d0964ad6992f79eaf770507d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c448aaa2a549c8a333b029ea89b104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:55.785346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b6f60db2-a27b-4747-8b8b-31ad38f99a90 req-95deab19-7c21-431b-8857-f8c8239f7e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7b6b65-2659-4310-b317-0de0ef27ae4f", "name": "network-vif-plugged", "status": "completed", "tag": "eae0c7d0-b5b1-4b5a-a0cd-a7245b049763"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:55.787188 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9bec50d-ae9f-4cfe-949a-b5122502ef55 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 200 len: 1526 microversion: 2.1 time: 0.633427 Jun 04 20:56:55.804529 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 613/1176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:55 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 1526 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:55.806287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b6f60db2-a27b-4747-8b8b-31ad38f99a90 req-95deab19-7c21-431b-8857-f8c8239f7e29 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.807206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b6f60db2-a27b-4747-8b8b-31ad38f99a90 req-95deab19-7c21-431b-8857-f8c8239f7e29 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.823554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b6f60db2-a27b-4747-8b8b-31ad38f99a90 req-95deab19-7c21-431b-8857-f8c8239f7e29 service nova] Creating event network-vif-plugged:eae0c7d0-b5b1-4b5a-a0cd-a7245b049763 for instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f on nch2-master-1 Jun 04 20:56:55.837948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b6f60db2-a27b-4747-8b8b-31ad38f99a90 req-95deab19-7c21-431b-8857-f8c8239f7e29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066992 Jun 04 20:56:55.845182 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 564/1177] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:55.932160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:55.932788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:55.946485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.947425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.948264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:55.950035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:55.992327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7825d994-8294-4144-b467-cf6ff3d2a4f3 req-7b6bef65-5a5e-41e8-8f50-48702118e683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1788492-5d5e-47ac-a351-c17c0052f6ce", "name": "network-vif-deleted", "tag": "a3e07c18-b8dc-4026-847d-1b52a92f20d6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:56.008936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7825d994-8294-4144-b467-cf6ff3d2a4f3 req-7b6bef65-5a5e-41e8-8f50-48702118e683 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.010528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7825d994-8294-4144-b467-cf6ff3d2a4f3 req-7b6bef65-5a5e-41e8-8f50-48702118e683 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.019081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:56.034700 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7825d994-8294-4144-b467-cf6ff3d2a4f3 req-7b6bef65-5a5e-41e8-8f50-48702118e683 service nova] Creating event network-vif-deleted:a3e07c18-b8dc-4026-847d-1b52a92f20d6 for instance f1788492-5d5e-47ac-a351-c17c0052f6ce on nch2-master-1 Jun 04 20:56:56.041519 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7825d994-8294-4144-b467-cf6ff3d2a4f3 req-7b6bef65-5a5e-41e8-8f50-48702118e683 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054470 Jun 04 20:56:56.043712 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 565/1178] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:56:56.064428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:56.067048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:56.087763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.089489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.090696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.092006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.254238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:56.269336 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-435519ea-9dc8-48f7-9bf6-5058251c0b73 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.342769 Jun 04 20:56:56.279707 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 614/1179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:55 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:56.284656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:56.285285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: d1e680a2-7857-43ab-bb59-3c7ddb5ef666] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:56.299430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.299921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.300714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.301160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.332773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 could not be found. Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 HTTP/1.1 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:56.335077 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 could not be found. Jun 04 20:56:56.336631 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd1e680a2-7857-43ab-bb59-3c7ddb5ef666'} Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 could not be found. Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:56.337418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 could not be found. Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 could not be found. Jun 04 20:56:56.338627 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:56.341826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance d1e680a2-7857-43ab-bb59-3c7ddb5ef666 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:56.341826 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-468f8d3c-d99f-4ad6-8773-073f188ddeca tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666" status: 404 len: 111 microversion: 2.1 time: 0.055806 Jun 04 20:56:56.348593 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 615/1180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:56 2022] GET /compute/v2.1/servers/d1e680a2-7857-43ab-bb59-3c7ddb5ef666 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:56.357843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:56.358415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:56.372203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:56.373871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.374343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.376136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.376883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.418577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:56:56.524377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:56.537968 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b3984e8-eac8-4c0f-bc0e-c0a6c84b41b8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1681 microversion: 2.1 time: 0.489435 Jun 04 20:56:56.554530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 566/1181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:56 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1681 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:56.570479 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3266b923-7818-4973-87c3-ab8e2d16a91b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 204 len: 0 microversion: 2.1 time: 0.220316 Jun 04 20:56:56.571763 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 616/1182] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:56 2022] DELETE /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:56:56.580345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:56.581403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:56.587180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.587689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.588610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.589216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.784493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:56.785844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:56.806156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.807669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:56.814256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:56.816735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.016167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:57.032543 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9707e249-78cb-46b3-ba79-c161cb84a339 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1472 microversion: 2.1 time: 0.456702 Jun 04 20:56:57.049382 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 567/1183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:56 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1472 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:57.060835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.063354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: f1788492-5d5e-47ac-a351-c17c0052f6ce] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:57.074319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:57.080506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.081043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.082180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.082940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.103200 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance f1788492-5d5e-47ac-a351-c17c0052f6ce could not be found. Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce HTTP/1.1 Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:57.104909 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f1788492-5d5e-47ac-a351-c17c0052f6ce could not be found. Jun 04 20:56:57.106755 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f1788492-5d5e-47ac-a351-c17c0052f6ce'} Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1788492-5d5e-47ac-a351-c17c0052f6ce could not be found. Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:57.107562 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1788492-5d5e-47ac-a351-c17c0052f6ce could not be found. Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1788492-5d5e-47ac-a351-c17c0052f6ce could not be found. Jun 04 20:56:57.108793 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.111695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance f1788492-5d5e-47ac-a351-c17c0052f6ce could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:57.112783 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e515599-35dd-4a45-b400-664a59a9660d tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce" status: 404 len: 111 microversion: 2.1 time: 0.060225 Jun 04 20:56:57.113540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 568/1184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:57 2022] GET /compute/v2.1/servers/f1788492-5d5e-47ac-a351-c17c0052f6ce => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:57.124038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d053505c-904d-4d35-b18e-2fe2d72c0975 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '.version_select at 0x7f2d01fcff70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.147209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:57.164623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:57.166519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:57.167883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b7d19e3-7cf3-43b7-a3ba-f23aea815754 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1362 microversion: 2.25 time: 0.390782 Jun 04 20:56:57.179011 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 617/1185] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:56 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:56:57.205721 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-d053505c-904d-4d35-b18e-2fe2d72c0975 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Image not found. Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d053505c-904d-4d35-b18e-2fe2d72c0975 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278 HTTP/1.1 Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:57.207486 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '66458e58-e885-46db-a0f3-5a035b759278'} Jun 04 20:56:57.208918 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 66458e58-e885-46db-a0f3-5a035b759278 to delete Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.210355 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 66458e58-e885-46db-a0f3-5a035b759278 could not be found. Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:57.211943 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d053505c-904d-4d35-b18e-2fe2d72c0975 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:57.214446 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d053505c-904d-4d35-b18e-2fe2d72c0975 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278" status: 404 len: 62 microversion: 2.1 time: 0.090354 Jun 04 20:56:57.215745 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 569/1186] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:57 2022] DELETE /compute/v2.1/images/66458e58-e885-46db-a0f3-5a035b759278 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 20:56:57.218373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.218875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:57.226656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.227106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.228392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.229285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.233894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:56:57.247905 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db HTTP/1.1 Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:57.249988 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.251641 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e30ca160-6726-48c7-803a-ab92978dc2db'} Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:57.252464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.253694 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.256560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:57.257738 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6475b888-2aa4-4fdc-ac58-1e1c22f8173e tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 404 len: 111 microversion: 2.1 time: 0.043547 Jun 04 20:56:57.259004 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 618/1187] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:57 2022] DELETE /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:57.268238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.269016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: e30ca160-6726-48c7-803a-ab92978dc2db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:57.279084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.279577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.280664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.281187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.305626 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db HTTP/1.1 Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:56:57.307395 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.309209 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e30ca160-6726-48c7-803a-ab92978dc2db'} Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:57.310124 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. Jun 04 20:56:57.311762 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:56:57.313447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance e30ca160-6726-48c7-803a-ab92978dc2db could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:57.313552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.313678 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22f9a818-5b0c-4561-994c-7feac870c1eb tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db" status: 404 len: 111 microversion: 2.1 time: 0.047366 Jun 04 20:56:57.313678 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 570/1188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:57 2022] GET /compute/v2.1/servers/e30ca160-6726-48c7-803a-ab92978dc2db => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:56:57.314641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:57.321606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72c85ec1-fe65-4924-8eee-bd5b5708535a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '.version_select at 0x7f2d0209ee50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.340613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.341628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.342747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.343424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.352524 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72c85ec1-fe65-4924-8eee-bd5b5708535a tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338783525" status: 202 len: 0 microversion: 2.1 time: 0.035400 Jun 04 20:56:57.353713 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 571/1189] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 20:56:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1338783525 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:56:57.570787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:57.571396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:57.587577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:57.591477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.591962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.592885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:57.597081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:57.599400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b68af060-f956-4ea1-9166-97a779e8ed8c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.316856 Jun 04 20:56:57.604361 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 619/1190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:57 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:57.795115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e45a1e351c47bc8d9c9f317a7d915e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6707eb81235a4370a48c97279b7cfd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:57.805815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b2f9e84a-f7b9-438e-a330-dcdaa16605b5 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 200 len: 1613 microversion: 2.1 time: 0.238885 Jun 04 20:56:57.816945 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 572/1191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:57 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 1613 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:56:58.055491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:58.063017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-406fda5c-6a16-4a30-acf7-4ba55b2e80c1 req-54e7bbc5-8236-4918-af4a-f4fd466e3d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86e3ca0-740c-47ff-a635-ebbabc3609e4", "name": "network-vif-deleted", "tag": "f922a9a4-5b23-461e-befb-4b0ac1ffd77d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:58.068703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:58.085490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.086712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.092252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.093554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-406fda5c-6a16-4a30-acf7-4ba55b2e80c1 req-54e7bbc5-8236-4918-af4a-f4fd466e3d4c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.094446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.095191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-406fda5c-6a16-4a30-acf7-4ba55b2e80c1 req-54e7bbc5-8236-4918-af4a-f4fd466e3d4c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.130813 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-406fda5c-6a16-4a30-acf7-4ba55b2e80c1 req-54e7bbc5-8236-4918-af4a-f4fd466e3d4c service nova] Creating event network-vif-deleted:f922a9a4-5b23-461e-befb-4b0ac1ffd77d for instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 on nch1-master-1 Jun 04 20:56:58.136827 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-406fda5c-6a16-4a30-acf7-4ba55b2e80c1 req-54e7bbc5-8236-4918-af4a-f4fd466e3d4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078295 Jun 04 20:56:58.137782 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 573/1192] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:56:58.188473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:58.189468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:58.203792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.205436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.206295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.206729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.435641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:58.456290 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f191516e-08e5-4a49-aba1-d1fbf69c140a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1472 microversion: 2.1 time: 0.406028 Jun 04 20:56:58.457408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 620/1193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:58 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:58.545591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e04e9957-5e5c-44cd-be57-0794f718fe79 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '.version_select at 0x7f2d02276dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:58.581911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:58.583004 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e04e9957-5e5c-44cd-be57-0794f718fe79 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Image not found. Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e04e9957-5e5c-44cd-be57-0794f718fe79 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/images/d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78 HTTP/1.1 Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:58.589037 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd8ef1a51-15ae-45e3-ac5e-3caa80dc3a78'} Jun 04 20:56:58.591357 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78 to delete Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:58.592377 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78 could not be found. Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:58.593825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 20:56:58.595240 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.596266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:58.596266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:58.596266 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66351d2d-492a-481a-ad85-788234a1aba0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1559 microversion: 2.25 time: 0.411073 Jun 04 20:56:58.596561 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 574/1194] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:58 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1559 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:56:58.597726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e04e9957-5e5c-44cd-be57-0794f718fe79 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:58.598889 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e04e9957-5e5c-44cd-be57-0794f718fe79 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/images/d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78" status: 404 len: 62 microversion: 2.1 time: 0.058242 Jun 04 20:56:58.599965 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 621/1195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:58 2022] DELETE /compute/v2.1/images/d8ef1a51-15ae-45e3-ac5e-3caa80dc3a78 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:56:58.618192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:58.618701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:58.652544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.659053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.661361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.662172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.694821 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 HTTP/1.1 Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:58.696565 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:58.697918 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61'} Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:58.698705 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:58.700398 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:58.702668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:58.702668 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e651118-ebc2-4d56-bc1d-aef83bbf6e05 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 404 len: 111 microversion: 2.1 time: 0.089468 Jun 04 20:56:58.702668 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 622/1196] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:56:58 2022] DELETE /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:58.717089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:58.722827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:58.738645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.741991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.743286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:58.743918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:58.995150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:58.995946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:59.012399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.012879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.014108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.016015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.150741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:59.162416 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-86e94995-1f42-4af2-b2da-b9223633b8e4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.461141 Jun 04 20:56:59.163005 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 623/1197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:58 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:59.178350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.179273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] [instance: 8450d7af-48da-41c7-ae02-87f6e2f11e61] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:59.193022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.193751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.195111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.196033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.213516 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] HTTP exception thrown: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Request method failure captured: Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 HTTP/1.1 Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8axP8lhWUx3uWdlaYnSJvjL8UBdQjuhbFIq_-q6NZRiS0_IysLD6hr9LdUSydApAotPaLaEw_950rSxtkFvewidasmPSJ9tAlTiun7iZ9ptWH6h9N3ukf7uBi3Kiml-VQlq9KBArE-7mQVs3-mnMddpLHnaUzKhBBQ6pCWmHg15H9w Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:59.215720 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/84c448aaa2a549c8a333b029ea89b104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 84c448aaa2a549c8a333b029ea89b104 Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373 Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 598884c9d0964ad6992f79eaf770507d Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1577242373-project Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:59.217093 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8450d7af-48da-41c7-ae02-87f6e2f11e61'} Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:59.217825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. Jun 04 20:56:59.219120 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.220260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] Returning 404 to user: Instance 8450d7af-48da-41c7-ae02-87f6e2f11e61 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:59.220260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17ae6590-1a11-4713-ab7b-7463cfe9c487 tempest-ImagesOneServerNegativeTestJSON-1577242373 tempest-ImagesOneServerNegativeTestJSON-1577242373-project] 10.222.0.18 "GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61" status: 404 len: 111 microversion: 2.1 time: 0.044554 Jun 04 20:56:59.221968 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 624/1198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:59 2022] GET /compute/v2.1/servers/8450d7af-48da-41c7-ae02-87f6e2f11e61 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:59.226881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.227520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:59.234296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.234751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.235797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.236397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.258075 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] HTTP exception thrown: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Request method failure captured: Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 HTTP/1.1 Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Z-CsEx31AD_vF3vg02w5OhWRmMQnwZkYw1JUeAeq0gLHiEyTKeQ8m5sITta6Jl3vbGAa2pXe-MBLkCxQyh2_SxIoYacZAE9FJnJSa_-CV5YC7kgZ-JUY8fbilHPF6mfT1_r1EHJ0uAQNB6S_IQUn7-U6ak3W-QhvtLXmkDi12Q3_Y Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6707eb81235a4370a48c97279b7cfd21 Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:56:59.260726 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6707eb81235a4370a48c97279b7cfd21 Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachSCSIVolumeTestJSON-2115443469-project Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 39e45a1e351c47bc8d9c9f317a7d915e Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2115443469-project Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:56:59.262578 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f86e3ca0-740c-47ff-a635-ebbabc3609e4'} Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:56:59.263521 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:56:59.264974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:56:59.267803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Returning 404 to user: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:56:59.269728 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fde22b56-7529-4f70-87f1-039172dd4f63 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 404 len: 111 microversion: 2.1 time: 0.046236 Jun 04 20:56:59.271132 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 625/1199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:59 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:56:59.282283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bf045ad1-0de5-4b1d-9f59-39efeb7ecfd8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '.version_select at 0x7f2d0209fd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.311503 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bf045ad1-0de5-4b1d-9f59-39efeb7ecfd8 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815918993" status: 202 len: 0 microversion: 2.1 time: 0.035388 Jun 04 20:56:59.313072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 626/1200] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 20:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815918993 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:56:59.433978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53d53fcc-8681-42f9-8871-b6515a1bed12 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Action: 'create', calling method: .version_select at 0x7f2d0bf85280>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:56:59.456968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-53d53fcc-8681-42f9-8871-b6515a1bed12 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Getting quotas for project acfa17945c2047fb99c3ad72a4854343. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:59.470636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-53d53fcc-8681-42f9-8871-b6515a1bed12 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Getting quotas for user 7cd8c77ab6374489bcddb296fffcecb7 and project acfa17945c2047fb99c3ad72a4854343. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:59.511402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 0b7b6b65-2659-4310-b317-0de0ef27ae4f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:56:59.554194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-53d53fcc-8681-42f9-8871-b6515a1bed12 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Getting quotas for project acfa17945c2047fb99c3ad72a4854343. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:56:59.568680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-53d53fcc-8681-42f9-8871-b6515a1bed12 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Getting quotas for user 7cd8c77ab6374489bcddb296fffcecb7 and project acfa17945c2047fb99c3ad72a4854343. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:56:59.570495 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df48607e-b206-416e-a0b1-6922bdc42145 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 2052 microversion: 2.25 time: 0.962588 Jun 04 20:56:59.583831 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 575/1201] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:58 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 2052 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:56:59.589893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.590528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:59.598386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.599343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.600558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.601879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.616153 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53d53fcc-8681-42f9-8871-b6515a1bed12 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.295608 Jun 04 20:56:59.617549 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 627/1202] 10.222.0.18 () {62 vars in 1213 bytes} [Sat Jun 4 20:56:59 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:56:59.624984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.627652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:56:59.636787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.638257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.639407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:56:59.640113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:56:59.821338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:56:59.829807 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b03a786-03e1-4baa-ba8f-e82466ebfe1a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 200 len: 1430 microversion: 2.1 time: 0.244609 Jun 04 20:56:59.834688 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 576/1203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:56:59 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 1430 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:56:59.850558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da38d747-f329-4a0a-beb6-d7e156d9d990 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.890371 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da38d747-f329-4a0a-beb6-d7e156d9d990 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.053698 Jun 04 20:56:59.891650 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 577/1204] 10.222.0.18 () {60 vars in 1192 bytes} [Sat Jun 4 20:56:59 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:56:59.902719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76d22811-5b72-4c4d-90e8-0105916881d9 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.918638 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76d22811-5b72-4c4d-90e8-0105916881d9 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551" status: 200 len: 235 microversion: 2.64 time: 0.020186 Jun 04 20:56:59.925334 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 578/1205] 10.222.0.18 () {60 vars in 1303 bytes} [Sat Jun 4 20:56:59 2022] GET /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551 => generated 235 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 20:56:59.935830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c72df57-f704-43dd-8937-87055c6ce9c1 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:56:59.988155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 0b7b6b65-2659-4310-b317-0de0ef27ae4f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:00.022179 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c72df57-f704-43dd-8937-87055c6ce9c1 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551" status: 204 len: 0 microversion: 2.64 time: 0.095310 Jun 04 20:57:00.023084 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 579/1206] 10.222.0.18 () {60 vars in 1306 bytes} [Sat Jun 4 20:56:59 2022] DELETE /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 20:57:00.049598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a4e2a5b-9e6e-44de-9914-66ec285d47a3 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:00.077194 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0a4e2a5b-9e6e-44de-9914-66ec285d47a3 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] HTTP exception thrown: Instance group 13305725-8a3d-46e0-9819-45da5fac9551 could not be found. Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a4e2a5b-9e6e-44de-9914-66ec285d47a3 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Request method failure captured: Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551 HTTP/1.1 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8cbbDslwVWwbOEuVMuAB_aFi3q3YjIv-47S38I3q3uaNpiRQTVnaKuXaVYNokj9we5My3KKDyYnNFRfGofVCrpWTbeFrzzFb4Dqoy_xflokY5bLwkiLPwEaLp_Ci1XXxVfp7P2BkqZVeMuNibUo5mHMGDqOv3YA0hN5jFabj-08EBA Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.64 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: acfa17945c2047fb99c3ad72a4854343 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerGroup264TestJSON-1657191162 Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:00.080057 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_acfa17945c2047fb99c3ad72a4854343"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/acfa17945c2047fb99c3ad72a4854343"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/acfa17945c2047fb99c3ad72a4854343"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/acfa17945c2047fb99c3ad72a4854343"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerGroup264TestJSON-1657191162 Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: acfa17945c2047fb99c3ad72a4854343 Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1657191162 Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerGroup264TestJSON-1657191162-project Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 7cd8c77ab6374489bcddb296fffcecb7 Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerGroup264TestJSON-1657191162-project Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance group 13305725-8a3d-46e0-9819-45da5fac9551 could not be found. Jun 04 20:57:00.081588 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '13305725-8a3d-46e0-9819-45da5fac9551'} Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 13305725-8a3d-46e0-9819-45da5fac9551 could not be found. Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:00.082425 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 13305725-8a3d-46e0-9819-45da5fac9551 could not be found. Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 13305725-8a3d-46e0-9819-45da5fac9551 could not be found. Jun 04 20:57:00.083654 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.084714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a4e2a5b-9e6e-44de-9914-66ec285d47a3 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] Returning 404 to user: Instance group 13305725-8a3d-46e0-9819-45da5fac9551 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:00.084881 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a4e2a5b-9e6e-44de-9914-66ec285d47a3 tempest-ServerGroup264TestJSON-1657191162 tempest-ServerGroup264TestJSON-1657191162-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551" status: 404 len: 117 microversion: 2.64 time: 0.056493 Jun 04 20:57:00.090043 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 580/1207] 10.222.0.18 () {60 vars in 1306 bytes} [Sat Jun 4 20:57:00 2022] DELETE /compute/v2.1/os-server-groups/13305725-8a3d-46e0-9819-45da5fac9551 => generated 117 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:57:00.091134 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f22be7d4-fb92-42e7-9420-8d0d093a3f5c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 2052 microversion: 2.25 time: 0.472266 Jun 04 20:57:00.109002 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 628/1208] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:56:59 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 2052 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:00.128573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a6ef650-c1be-484f-b4c7-a0081610c479 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:00.131265 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:57:00.131265 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:57:00.133523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a6ef650-c1be-484f-b4c7-a0081610c479 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.134469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a6ef650-c1be-484f-b4c7-a0081610c479 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.136197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a6ef650-c1be-484f-b4c7-a0081610c479 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.137088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a6ef650-c1be-484f-b4c7-a0081610c479 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.171904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-27e25ce8-41a4-46e4-8fb8-6a909a4cd846 req-86ec1160-a50f-42c2-a995-2c1901b0840f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d163cd0-9337-433d-8d26-eff631b67b79", "name": "network-vif-deleted", "tag": "a498e472-baac-49e3-82b9-1a52ea85b732"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:00.187211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-27e25ce8-41a4-46e4-8fb8-6a909a4cd846 req-86ec1160-a50f-42c2-a995-2c1901b0840f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.191408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-27e25ce8-41a4-46e4-8fb8-6a909a4cd846 req-86ec1160-a50f-42c2-a995-2c1901b0840f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.228472 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-27e25ce8-41a4-46e4-8fb8-6a909a4cd846 req-86ec1160-a50f-42c2-a995-2c1901b0840f service nova] Creating event network-vif-deleted:a498e472-baac-49e3-82b9-1a52ea85b732 for instance 0d163cd0-9337-433d-8d26-eff631b67b79 on nch1-master-1 Jun 04 20:57:00.246483 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-27e25ce8-41a4-46e4-8fb8-6a909a4cd846 req-86ec1160-a50f-42c2-a995-2c1901b0840f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078700 Jun 04 20:57:00.252398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 629/1209] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:00.258740 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a6ef650-c1be-484f-b4c7-a0081610c479 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.134593 Jun 04 20:57:00.260729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:00.262017 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 581/1210] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Jun 4 20:57:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:57:00.271764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:00.280203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:00.282171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:00.291759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.294985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.295943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.296969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.299142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.299598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.300553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.301466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.348987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'flavor' on Instance uuid 0b7b6b65-2659-4310-b317-0de0ef27ae4f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:00.368571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Going to try to live migrate instance to nch1-master-1 {{(pid=137229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:57:00.879437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:00.894826 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a30585a-c705-4da7-bbe5-51dafe5b9971 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.638981 Jun 04 20:57:00.899731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 630/1211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:00 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:00.923861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:00.935746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0d163cd0-9337-433d-8d26-eff631b67b79] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:00.958772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.959635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.960933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:00.961617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:00.979180 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance 0d163cd0-9337-433d-8d26-eff631b67b79 could not be found. Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 HTTP/1.1 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:00.983983 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 0d163cd0-9337-433d-8d26-eff631b67b79 could not be found. Jun 04 20:57:00.985726 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0d163cd0-9337-433d-8d26-eff631b67b79'} Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d163cd0-9337-433d-8d26-eff631b67b79 could not be found. Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:00.986665 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d163cd0-9337-433d-8d26-eff631b67b79 could not be found. Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d163cd0-9337-433d-8d26-eff631b67b79 could not be found. Jun 04 20:57:00.988177 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:00.991466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance 0d163cd0-9337-433d-8d26-eff631b67b79 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:00.992886 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14e28b98-2c64-4724-94ba-73e2bc1cdcce tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79" status: 404 len: 111 microversion: 2.1 time: 0.079453 Jun 04 20:57:00.994461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 631/1212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:00 2022] GET /compute/v2.1/servers/0d163cd0-9337-433d-8d26-eff631b67b79 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:01.004880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:01.006007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:01.017004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:01.018947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:01.018947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:01.019725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:01.062751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:01.312049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fa0d4454-c730-4d9e-b5d9-12a0af9337c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a" status: 204 len: 0 microversion: 2.1 time: 0.313348 Jun 04 20:57:01.312835 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 632/1213] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:00 2022] DELETE /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 20:57:01.326599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:01.328518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:01.342404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:01.343968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:01.345585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:01.347303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:01.424040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:01.714901 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ca833de-7019-4c91-b237-860b5d69445b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 204 len: 0 microversion: 2.1 time: 0.396258 Jun 04 20:57:01.716285 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 633/1214] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:01 2022] DELETE /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 20:57:01.752172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:01.753081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:01.785088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:01.788534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:01.795457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:01.796429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:02.194473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:02.208943 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7519bb6a-5122-49a6-9765-2572c28f4441 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a" status: 200 len: 1473 microversion: 2.1 time: 0.478669 Jun 04 20:57:02.209851 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 634/1215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:01 2022] GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a => generated 1473 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:02.231347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:02.232115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:02.269000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:02.269469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:02.274125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:02.274988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:02.518437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:02.531609 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd0bfd4d-8b49-4b23-a8e9-b090bac8cac3 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.316701 Jun 04 20:57:02.532368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 635/1216] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:02 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:03.229290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:03.229905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:03.242187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:03.244252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:03.247201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:03.248060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:03.541342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:03.552175 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a5e2207c-d94c-4953-bd58-1d712839ce36 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a" status: 200 len: 1431 microversion: 2.1 time: 0.327896 Jun 04 20:57:03.556770 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 636/1217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:03 2022] GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a => generated 1431 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:57:03.570998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "726addd0-8ade-4bdb-9f22-f610d44a32e9"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:03.572836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:03.595202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:03.595995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:03.596788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:03.597220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:04.131774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:04.390776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-669d0c97-6f2b-4910-abfa-f75b879981c0 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f/action" status: 202 len: 0 microversion: 2.25 time: 4.116053 Jun 04 20:57:04.391495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 582/1218] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 20:57:00 2022] POST /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f/action => generated 0 bytes in 4117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:04.417747 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4fe6a645-f871-497e-bc1f-36d7d07361ed tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "POST /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859472 Jun 04 20:57:04.418806 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 637/1219] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 20:57:03 2022] POST /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:04.429685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:04.430751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:04.441030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:04.441716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:04.442741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:04.443529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:04.840594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1af2b68d-6137-4635-80be-9e8fa42c08f7 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Action: 'create', calling method: .version_select at 0x7f2d020c8dc0>, body: {"keypair": {"name": "tempest-keypair-2055789437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4WRPhwTJEUiGCQ/dz7PUwQhbHDCvbBzwmNnry873n0T3ig1yIGhkfTplzUBJ0PQzzs7849l++e0HbLOuXpTJGSYXBSOV5LJvvEKZkT0caHtOWpUukKTDsTZWZrhPwWHQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:04.859122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-1af2b68d-6137-4635-80be-9e8fa42c08f7 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:04.865209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-1af2b68d-6137-4635-80be-9e8fa42c08f7 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for user 17e02e3197f64817820be68827a61f89 and project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:04.909662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1af2b68d-6137-4635-80be-9e8fa42c08f7 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.511871 Jun 04 20:57:04.911461 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 583/1220] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:57:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:04.917404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e874edcb-42a0-4fee-9c4e-12354a295763 req-c79c27e1-e3ed-432f-8939-6aa14991641e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68670f7a-f4d6-40da-ba98-48ee00bd5d3a", "name": "network-vif-deleted", "tag": "316e977d-ddf0-45c2-96fd-3ed95fb29fbe"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:04.933173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e874edcb-42a0-4fee-9c4e-12354a295763 req-c79c27e1-e3ed-432f-8939-6aa14991641e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:04.933994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:04.935080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e874edcb-42a0-4fee-9c4e-12354a295763 req-c79c27e1-e3ed-432f-8939-6aa14991641e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:04.948989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70c97900-43e1-43bd-8c80-9232de45db97 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.528630 Jun 04 20:57:04.950431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 638/1221] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:04 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:04.959678 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e874edcb-42a0-4fee-9c4e-12354a295763 req-c79c27e1-e3ed-432f-8939-6aa14991641e service nova] Creating event network-vif-deleted:316e977d-ddf0-45c2-96fd-3ed95fb29fbe for instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a on nch2-master-1 Jun 04 20:57:04.962068 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e874edcb-42a0-4fee-9c4e-12354a295763 req-c79c27e1-e3ed-432f-8939-6aa14991641e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048193 Jun 04 20:57:04.963592 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 584/1222] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:04.973165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:04.973738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 68670f7a-f4d6-40da-ba98-48ee00bd5d3a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:04.978727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:04.983425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:04.983905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:04.984884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:04.985835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:04.986366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.001807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.003168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.004209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.007909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.008844 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a could not be found. Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a HTTP/1.1 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:05.013524 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a could not be found. Jun 04 20:57:05.014993 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '68670f7a-f4d6-40da-ba98-48ee00bd5d3a'} Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a could not be found. Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:05.015920 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a could not be found. Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a could not be found. Jun 04 20:57:05.017175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.019482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance 68670f7a-f4d6-40da-ba98-48ee00bd5d3a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:05.019482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c59c3ed5-bbb4-47f2-98a1-7842deea0cf6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a" status: 404 len: 111 microversion: 2.1 time: 0.050411 Jun 04 20:57:05.020302 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 585/1223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:04 2022] GET /compute/v2.1/servers/68670f7a-f4d6-40da-ba98-48ee00bd5d3a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:05.030446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.031065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:05.038747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.039288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.040695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.041774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.067777 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] HTTP exception thrown: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Request method failure captured: Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 HTTP/1.1 Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8Z-CsEx31AD_vF3vg02w5OhWRmMQnwZkYw1JUeAeq0gLHiEyTKeQ8m5sITta6Jl3vbGAa2pXe-MBLkCxQyh2_SxIoYacZAE9FJnJSa_-CV5YC7kgZ-JUY8fbilHPF6mfT1_r1EHJ0uAQNB6S_IQUn7-U6ak3W-QhvtLXmkDi12Q3_Y Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6707eb81235a4370a48c97279b7cfd21 Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:05.071754 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6707eb81235a4370a48c97279b7cfd21 Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachSCSIVolumeTestJSON-2115443469-project Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 39e45a1e351c47bc8d9c9f317a7d915e Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2115443469-project Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.073304 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f86e3ca0-740c-47ff-a635-ebbabc3609e4'} Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:05.074101 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.075980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.077198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Returning 404 to user: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:05.077198 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-884b94d8-bd10-4b44-969a-1c2f50809603 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 404 len: 111 microversion: 2.1 time: 0.049023 Jun 04 20:57:05.078821 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 586/1224] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:05 2022] DELETE /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:05.087185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18697421-aa9f-4729-8441-9c8d5d748886 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d01fcf550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.098494 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-18697421-aa9f-4729-8441-9c8d5d748886 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-2055789437" status: 200 len: 497 microversion: 2.1 time: 0.017649 Jun 04 20:57:05.101313 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 587/1225] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 20:57:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2055789437 => generated 497 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:05.108835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.110284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:05.120305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.121665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.123182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.125126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.456623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:05.471427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:05.477286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:05.486806 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a017042-b29b-49dd-96b8-3fb9037bc72b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.517825 Jun 04 20:57:05.487957 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 639/1226] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:04 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:05.500411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.501929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] [instance: f86e3ca0-740c-47ff-a635-ebbabc3609e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:05.508143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:05.512359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.516211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.518192 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5bcd0e5-3c1e-4c5e-9036-a1b4b5753348 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 200 len: 1472 microversion: 2.1 time: 0.415119 Jun 04 20:57:05.521170 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 588/1227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:05 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:05.521730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:05.524409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:05.540101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4d88dfd2-a095-48b3-a9c8-0de1c5092514 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d0298d280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.584289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4d88dfd2-a095-48b3-a9c8-0de1c5092514 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055789437" status: 202 len: 0 microversion: 2.1 time: 0.049277 Jun 04 20:57:05.591922 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 589/1228] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 20:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2055789437 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:05.598630 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] HTTP exception thrown: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.603137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-425e1108-8e8d-4905-b0d9-df554967d2ce tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Action: 'create', calling method: .version_select at 0x7f2d0209e3a0>, body: {"keypair": {"name": "tempest-keypair-484865515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIA0uBoWjF9BD6UJ/EfpcQghvYfwuzZMbfzXiWTltsDx/cS1N+lXHhw1jd2N2878J5AvKNKDO38qGgpbc96NBQFXRfk2u2YjR5F6san7ftwiuk/mILbpqPg3q9nOh4Jwg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Request method failure captured: Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 HTTP/1.1 Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8Z-CsEx31AD_vF3vg02w5OhWRmMQnwZkYw1JUeAeq0gLHiEyTKeQ8m5sITta6Jl3vbGAa2pXe-MBLkCxQyh2_SxIoYacZAE9FJnJSa_-CV5YC7kgZ-JUY8fbilHPF6mfT1_r1EHJ0uAQNB6S_IQUn7-U6ak3W-QhvtLXmkDi12Q3_Y Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6707eb81235a4370a48c97279b7cfd21 Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:05.612114 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6707eb81235a4370a48c97279b7cfd21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6707eb81235a4370a48c97279b7cfd21 Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2115443469 Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachSCSIVolumeTestJSON-2115443469-project Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 39e45a1e351c47bc8d9c9f317a7d915e Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2115443469-project Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.613709 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f86e3ca0-740c-47ff-a635-ebbabc3609e4'} Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:05.614478 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. Jun 04 20:57:05.615727 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:05.617171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] Returning 404 to user: Instance f86e3ca0-740c-47ff-a635-ebbabc3609e4 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:05.617171 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-411c5a7f-ad40-41b7-a2ac-5f1ae579cb43 tempest-AttachSCSIVolumeTestJSON-2115443469 tempest-AttachSCSIVolumeTestJSON-2115443469-project] 10.222.0.18 "GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4" status: 404 len: 111 microversion: 2.1 time: 0.123995 Jun 04 20:57:05.620810 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 640/1229] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:05 2022] GET /compute/v2.1/servers/f86e3ca0-740c-47ff-a635-ebbabc3609e4 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:05.641512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-425e1108-8e8d-4905-b0d9-df554967d2ce tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:05.652151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-425e1108-8e8d-4905-b0d9-df554967d2ce tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for user 17e02e3197f64817820be68827a61f89 and project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:05.713620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-425e1108-8e8d-4905-b0d9-df554967d2ce tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120349 Jun 04 20:57:05.714504 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 590/1230] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:57:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:57:05.725379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-80e73481-63f4-4472-a9d0-45be9cf425a3 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d0beaad30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.754991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-80e73481-63f4-4472-a9d0-45be9cf425a3 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-484865515" status: 202 len: 0 microversion: 2.1 time: 0.034286 Jun 04 20:57:05.756272 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 641/1231] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 20:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-484865515 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:05.765358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e5203fee-20a8-4863-934d-1e1072f78d59 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Action: 'create', calling method: .version_select at 0x7f2d02170040>, body: {"keypair": {"name": "tempest-keypair-826962793", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:05.803561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e5203fee-20a8-4863-934d-1e1072f78d59 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:05.816581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e5203fee-20a8-4863-934d-1e1072f78d59 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for user 17e02e3197f64817820be68827a61f89 and project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:05.877748 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e5203fee-20a8-4863-934d-1e1072f78d59 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.116593 Jun 04 20:57:05.881290 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 591/1232] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:57:05 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:05.891583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e53db9f2-a505-4314-8bc3-ed4992dbfb65 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d0be9f550>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.925424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e53db9f2-a505-4314-8bc3-ed4992dbfb65 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826962793" status: 202 len: 0 microversion: 2.1 time: 0.037051 Jun 04 20:57:05.926434 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 642/1233] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 20:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826962793 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:05.945484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4d1177e-fd40-4f01-8437-adeb031f29bf tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Action: 'create', calling method: .version_select at 0x7f2d01fc5d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2078072012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoFk3yHg7Hj7wg3Sp7CzYdD+P0ZCW/qBBSiMu49Soaz9TOMKgx+6dYZDux8+ziB+/G2jX6PXjRATkc6MDpSEujgYUuxdTqGWY1b8KFXAPkIsmlL2bBiUSEOqY3YNP95eQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:05.968231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:05.968951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:06.006970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b4d1177e-fd40-4f01-8437-adeb031f29bf tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:06.036082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b4d1177e-fd40-4f01-8437-adeb031f29bf tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for user 17e02e3197f64817820be68827a61f89 and project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:06.145067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:06.158083 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4d1177e-fd40-4f01-8437-adeb031f29bf tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.223364 Jun 04 20:57:06.164187 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 592/1234] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:57:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:06.186229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2dd191ce-d6cf-4a10-adca-eab8f50cbf46 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Action: 'create', calling method: .version_select at 0x7f2d02109280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-636206444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjTW1m/msOls/GhoSaFjLyj8WvNMSgi1H//dZnja+xAXxvYEQMUL/3H18oQ+rcsZPlLUNenXFZ39BrI+igQjYQzBMlge1o2/7XsGrfhRDyjEYgcUZ1fAXZpkAsNpiLW8w=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:06.240411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2dd191ce-d6cf-4a10-adca-eab8f50cbf46 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:06.257087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2dd191ce-d6cf-4a10-adca-eab8f50cbf46 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for user 17e02e3197f64817820be68827a61f89 and project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:06.319754 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2dd191ce-d6cf-4a10-adca-eab8f50cbf46 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.148721 Jun 04 20:57:06.320519 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 593/1235] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:57:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 20:57:06.342299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-96d50f1b-f55d-4f10-a48a-84c9a392b94a tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Action: 'create', calling method: .version_select at 0x7f2d02109af0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1039139217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjmyCeJla+jLWg6Qa1iDgCP+Q3hnSnYFVP9AB8c8LQRKroQsMp74zCPtZZYdRwHHR0ubVpGCtD330t0xgt6aNouVDuhPHHmxTfFre8C/qaKJW1jLRBWsIz023qWLakvBA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:06.416675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-96d50f1b-f55d-4f10-a48a-84c9a392b94a tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:06.433922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-96d50f1b-f55d-4f10-a48a-84c9a392b94a tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Getting quotas for user 17e02e3197f64817820be68827a61f89 and project ca038463eed94fa3aea2cf4eaa374e39. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:06.492820 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-96d50f1b-f55d-4f10-a48a-84c9a392b94a tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.162757 Jun 04 20:57:06.497173 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 594/1236] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:57:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:06.504622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3572ebd7-ab05-46f7-9263-82980672a436 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d0209e820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:06.545515 ncdv-master-1 devstack@n-api.service[137229]: WARNING oslo_db.sqlalchemy.utils [None req-3572ebd7-ab05-46f7-9263-82980672a436 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 04 20:57:06.576871 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3572ebd7-ab05-46f7-9263-82980672a436 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.073948 Jun 04 20:57:06.579095 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 595/1237] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:57:06 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:06.595971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:06.597475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:06.609406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:06.610134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:06.611095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:06.611766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:06.692722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:06.703892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:06.704642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:06.719051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:06.719778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.089206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:07.101119 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-16aa684c-f609-4931-b6a8-7ec4462da467 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 1.137959 Jun 04 20:57:07.102034 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 643/1238] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:05 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:07.117925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.118937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: c10eef31-7d50-4c80-8203-81f58c19cd76] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:07.128050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.128825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.130110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.130941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.149651 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance c10eef31-7d50-4c80-8203-81f58c19cd76 could not be found. Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 HTTP/1.1 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:07.151457 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c10eef31-7d50-4c80-8203-81f58c19cd76 could not be found. Jun 04 20:57:07.152982 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c10eef31-7d50-4c80-8203-81f58c19cd76'} Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10eef31-7d50-4c80-8203-81f58c19cd76 could not be found. Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:07.153859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10eef31-7d50-4c80-8203-81f58c19cd76 could not be found. Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10eef31-7d50-4c80-8203-81f58c19cd76 could not be found. Jun 04 20:57:07.155100 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:07.159541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance c10eef31-7d50-4c80-8203-81f58c19cd76 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:07.160702 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-302aba29-4854-4710-87e1-e37528ce9401 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76" status: 404 len: 111 microversion: 2.1 time: 0.047442 Jun 04 20:57:07.161524 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 644/1239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:07 2022] GET /compute/v2.1/servers/c10eef31-7d50-4c80-8203-81f58c19cd76 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:07.167129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dceb61fb-2de0-4826-a682-81c8098e8105 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d0beaaee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.191105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:07.208539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:07.209548 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dceb61fb-2de0-4826-a682-81c8098e8105 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1039139217" status: 202 len: 0 microversion: 2.1 time: 0.044046 Jun 04 20:57:07.215526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 645/1240] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Jun 4 20:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1039139217 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:07.219739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:07.222028 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7df67a4-740b-4f00-94dc-3b14cbc21a44 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.639428 Jun 04 20:57:07.222978 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 596/1241] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:06 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:07.228491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4254eafc-743e-4426-b4ed-80b5b4d107ae req-403efec5-dbde-4565-bf27-9c9ef1c6824e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10eef31-7d50-4c80-8203-81f58c19cd76", "name": "network-vif-deleted", "tag": "eb4f0d5b-fffa-4e1c-ad51-9e68da3264a9"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:07.260099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4254eafc-743e-4426-b4ed-80b5b4d107ae req-403efec5-dbde-4565-bf27-9c9ef1c6824e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.261474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4254eafc-743e-4426-b4ed-80b5b4d107ae req-403efec5-dbde-4565-bf27-9c9ef1c6824e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.291123 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4254eafc-743e-4426-b4ed-80b5b4d107ae req-403efec5-dbde-4565-bf27-9c9ef1c6824e service nova] Creating event network-vif-deleted:eb4f0d5b-fffa-4e1c-ad51-9e68da3264a9 for instance c10eef31-7d50-4c80-8203-81f58c19cd76 on nch1-master-1 Jun 04 20:57:07.304102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-672924684", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:07.305390 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4254eafc-743e-4426-b4ed-80b5b4d107ae req-403efec5-dbde-4565-bf27-9c9ef1c6824e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080903 Jun 04 20:57:07.311852 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 597/1242] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:07.317550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-512553da-74a9-4464-a9fa-d378ea7a5e7a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.383790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-512553da-74a9-4464-a9fa-d378ea7a5e7a tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/94a540cc-d991-40e7-8c5d-ccd28f9106d0" status: 204 len: 0 microversion: 2.1 time: 0.069991 Jun 04 20:57:07.384775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 598/1243] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 20:57:07 2022] DELETE /compute/v2.1/os-server-groups/94a540cc-d991-40e7-8c5d-ccd28f9106d0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:07.389894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] validate_networks() for [('31a5d5ca-537c-4658-8272-4b04850fbd97', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:07.397829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac58b4e4-46d9-43c8-9dbd-f8eb0c311c88 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d02170160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.437579 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac58b4e4-46d9-43c8-9dbd-f8eb0c311c88 tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-636206444" status: 202 len: 0 microversion: 2.1 time: 0.050011 Jun 04 20:57:07.439263 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 599/1244] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-636206444 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:07.446002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-65d9b6e7-db73-4417-b501-01a08f214319 req-d2e32f9d-9b71-4c80-9f18-3c0943820c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7b6b65-2659-4310-b317-0de0ef27ae4f", "name": "network-vif-unplugged", "status": "completed", "tag": "eae0c7d0-b5b1-4b5a-a0cd-a7245b049763"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:07.460112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-65d9b6e7-db73-4417-b501-01a08f214319 req-d2e32f9d-9b71-4c80-9f18-3c0943820c7d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.460466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-65d9b6e7-db73-4417-b501-01a08f214319 req-d2e32f9d-9b71-4c80-9f18-3c0943820c7d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.525861 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-65d9b6e7-db73-4417-b501-01a08f214319 req-d2e32f9d-9b71-4c80-9f18-3c0943820c7d service nova] Creating event network-vif-unplugged:eae0c7d0-b5b1-4b5a-a0cd-a7245b049763 for instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f on nch2-master-1 Jun 04 20:57:07.547555 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-65d9b6e7-db73-4417-b501-01a08f214319 req-d2e32f9d-9b71-4c80-9f18-3c0943820c7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105481 Jun 04 20:57:07.549973 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 600/1245] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:07.563218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.563883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:07.576286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.577166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.578761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.579394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.614124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:07.686931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:07.745106 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-efd632aa-28a5-4ef2-8db4-3a96053c38d6 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 204 len: 0 microversion: 2.1 time: 0.192838 Jun 04 20:57:07.746409 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 601/1246] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:07 2022] DELETE /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:07.755384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a66824b-e292-489f-825e-3fbab86b292d tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] Calling method '.version_select at 0x7f2d01fc7700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.814375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a66824b-e292-489f-825e-3fbab86b292d tempest-KeyPairsV2TestJSON-1772448232 tempest-KeyPairsV2TestJSON-1772448232-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2078072012" status: 202 len: 0 microversion: 2.1 time: 0.066179 Jun 04 20:57:07.815353 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 602/1247] 10.222.0.18 () {58 vars in 1277 bytes} [Sat Jun 4 20:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2078072012 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:07.832129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:07.832791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:07.854453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.860511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.861502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:07.862238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:07.932024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:08.129251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97210732-4fb3-4dcd-814f-bab3bff0e946 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 204 len: 0 microversion: 2.1 time: 0.312306 Jun 04 20:57:08.130826 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 603/1248] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:07 2022] DELETE /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:08.146366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:08.149549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:08.164749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.165151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.166061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.166800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.304931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:08.306077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:08.306727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:08.310007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:08.310693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:08.334125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.334817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.337613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.340009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.387856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Getting quotas for project f75f1e8eef91443294369c0972b330eb. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:08.394753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Getting quotas for user 99c2a174b33c40f9a419cf7eacf01796 and project f75f1e8eef91443294369c0972b330eb. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:08.415091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:08.418151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:08.469186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:08.480937 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cccf59c7-bbb6-49aa-b621-d4d782d9a386 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262731 Jun 04 20:57:08.482466 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 646/1249] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:57:08.488646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:08.489261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:08.499610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.500395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.501377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.501989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.531790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95041c7d-d828-47b2-a880-7ddfc4f5f385 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.380269 Jun 04 20:57:08.532489 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 604/1250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:08 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:08.538695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:08.539326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:08.556258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.557754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:08.563633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:08.564705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.201664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:09.220789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:09.221239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:09.222818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:09.224088 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e281c712-a9bc-45bf-a99b-672f8bb49f9f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.690553 Jun 04 20:57:09.224755 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 605/1251] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:08 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:09.240976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:09.241902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:09.244150 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c3950bc5-0998-47af-b70c-33877e028017 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 200 len: 1474 microversion: 2.1 time: 0.759796 Jun 04 20:57:09.246119 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 647/1252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:08 2022] GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 1474 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:09.249019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:09.249702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.250671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:09.251282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.444575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:09.458213 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7ce0e9b7-5f6f-4742-abbc-07308949e34e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1227 microversion: 2.1 time: 0.222041 Jun 04 20:57:09.459105 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 606/1253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:09 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1227 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:09.550487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:09.551112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:09.558969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:09.559536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.562419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:09.563459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.624938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8546cdae-52bd-4d46-869b-ce3b1a01f33a"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:09.626082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:09.639553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:09.639757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.641454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:09.647025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:09.934877 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] HTTP exception thrown: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. Jun 04 20:57:09.946979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Request method failure captured: Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments/726addd0-8ade-4bdb-9f22-f610d44a32e9 HTTP/1.1 Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 74 Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8bFFaX9Pzm7kFaG36JvBnp6Dd9-Pl-_G8kAJRHhjGJ8y_5VOx6-7m5v68UGANCewHIwobrARoPp7F8iZQYyEYWpBGrV5fTXvmY9ZuOIUZOXyu0JmODvCCDz_9m8xAXpoh-VuySiyRjEtdPpW29MOCWheGcdQCg9wQIdVpxF-HNOibI Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7df2a8ee35b644258b36388d425322ab Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesAdminNegativeTest-983077096 Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:57:09.948676 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7df2a8ee35b644258b36388d425322ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7df2a8ee35b644258b36388d425322ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7df2a8ee35b644258b36388d425322ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7df2a8ee35b644258b36388d425322ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesAdminNegativeTest-983077096 Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7df2a8ee35b644258b36388d425322ab Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-983077096 Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesAdminNegativeTest-983077096-project-admin Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 858dec3e74964fd290e3bc622cd0dab2 Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesAdminNegativeTest-983077096-project-admin Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: {"volumeAttachment": {"volumeId": "8546cdae-52bd-4d46-869b-ce3b1a01f33a"}} Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:09.950535 ncdv-master-1 devstack@n-api.service[137228]: exception: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '0d54c244-5d4f-4346-a5d9-83eea81ff576', 'id': '726addd0-8ade-4bdb-9f22-f610d44a32e9', 'body': {'volumeAttachment': {'volumeId': '8546cdae-52bd-4d46-869b-ce3b1a01f33a'}}} Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 20:57:09.951739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. (HTTP 404) (Request-ID: req-90faeda3-c676-4731-8293-3bde3bf40e8d) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 20:57:09.953504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:09.954999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. Jun 04 20:57:09.956476 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:09.960256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Returning 400 to user: Volume 8546cdae-52bd-4d46-869b-ce3b1a01f33a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:09.961400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-313fd15a-050a-4006-99aa-6a4509768a88 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments/726addd0-8ade-4bdb-9f22-f610d44a32e9" status: 400 len: 107 microversion: 2.1 time: 0.713872 Jun 04 20:57:09.962180 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 648/1254] 10.222.0.18 () {60 vars in 1432 bytes} [Sat Jun 4 20:57:09 2022] PUT /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments/726addd0-8ade-4bdb-9f22-f610d44a32e9 => generated 107 bytes in 716 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:57:09.975036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5941b657-56ce-42fc-b172-9e915eecf65a req-eaff30c0-69d1-41e2-96dd-6c87a46133e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7b6b65-2659-4310-b317-0de0ef27ae4f", "tag": "eae0c7d0-b5b1-4b5a-a0cd-a7245b049763"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:09.979697 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f346df7-4fce-4ea3-ade7-aea54aaa7e52 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.432500 Jun 04 20:57:09.983237 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 607/1255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:09 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:10.015458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5941b657-56ce-42fc-b172-9e915eecf65a req-eaff30c0-69d1-41e2-96dd-6c87a46133e6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.016647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5941b657-56ce-42fc-b172-9e915eecf65a req-eaff30c0-69d1-41e2-96dd-6c87a46133e6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.044211 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5941b657-56ce-42fc-b172-9e915eecf65a req-eaff30c0-69d1-41e2-96dd-6c87a46133e6 service nova] Creating event network-changed:eae0c7d0-b5b1-4b5a-a0cd-a7245b049763 for instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f on nch2-master-1 Jun 04 20:57:10.056523 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5941b657-56ce-42fc-b172-9e915eecf65a req-eaff30c0-69d1-41e2-96dd-6c87a46133e6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087523 Jun 04 20:57:10.058591 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 649/1256] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:10.080453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:10.081097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:10.095179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.095766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.098599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.099384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.154670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:10.245155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:10.245909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:10.272974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.273743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.274832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.277369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.318903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lazy-loading 'services' on Instance uuid 0d54c244-5d4f-4346-a5d9-83eea81ff576 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:10.552084 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a4bb679-a54c-411d-847b-f89813126c54 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments/726addd0-8ade-4bdb-9f22-f610d44a32e9" status: 202 len: 0 microversion: 2.1 time: 0.473642 Jun 04 20:57:10.554405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 608/1257] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 20:57:10 2022] DELETE /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments/726addd0-8ade-4bdb-9f22-f610d44a32e9 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 20:57:10.586917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:10.594487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:10.614058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.614617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.615559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.619920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.678036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:10.688611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:10.690336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:10.691588 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72edcd69-fec4-4fc5-a86e-c6b375c18682 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.451495 Jun 04 20:57:10.692692 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 650/1258] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:10 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:10.698019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:10.698898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:10.725111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.725871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:10.729359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:10.730326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:11.179982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:11.221963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87fbb9a0-f52d-4b56-9e56-251792bef207 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1281 microversion: 2.1 time: 0.527237 Jun 04 20:57:11.225032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 651/1259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:10 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1281 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:11.244236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:11.250432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:11.269909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:11.270380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:11.271557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:11.272006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:11.342791 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd40d733-65d3-40c5-a6c0-a7e36540fa6c tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115450 Jun 04 20:57:11.345743 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 652/1260] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:57:11 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:11.357018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:11.358663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:11.373434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:11.373434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:11.373434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:11.373434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:11.899489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:11.917630 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5c3388f-d967-4bcc-a976-4cf02202f19b tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 200 len: 1474 microversion: 2.1 time: 1.344335 Jun 04 20:57:11.918676 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 609/1261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:10 2022] GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 1474 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:11.958900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:11.962376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:11.976869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:11.977360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:11.978200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:11.978641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:12.080913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:12.091177 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-34a86c56-18e3-43c7-96b4-eb58f704d099 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.741741 Jun 04 20:57:12.092868 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 653/1262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:11 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:12.246483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:12.247260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:12.273500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:12.274108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:12.275282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:12.276118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:12.510531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:12.552184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:12.555752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:12.559802 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf559b69-2969-4033-8d6f-0b81481a2d77 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.617615 Jun 04 20:57:12.562640 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 610/1263] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:11 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:12.568577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:12.569617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:12.594972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:12.596554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:12.599035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:12.599488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:12.606241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:12.627217 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f3ad5ab-4d69-4e4b-a7e0-a21c25d87ad8 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1281 microversion: 2.1 time: 0.381119 Jun 04 20:57:12.643987 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 654/1264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:12 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1281 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:57:12.660907 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f31dfbe2-acdf-4607-9f4d-c83605582622 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096222 Jun 04 20:57:12.663659 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 611/1265] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 20:57:12 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:57:12.953895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:12.969886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:12.993207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:12.993669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:13.000440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1753601963", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "52b403b7-892f-41aa-92f1-2e90876421b7"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:13.005766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:13.006599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:13.117101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] validate_networks() for [('52b403b7-892f-41aa-92f1-2e90876421b7', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:13.504327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:13.515618 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5429b2c5-f8a4-4c20-875f-e14f6f2b1bbc tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 200 len: 1432 microversion: 2.1 time: 0.580164 Jun 04 20:57:13.533598 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 655/1266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:12 2022] GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 1432 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:13.539081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:13.540164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:13.559850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:13.560506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:13.561467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:13.562030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.113115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:14.124610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d8abedea-c0d4-403a-bae4-ad8b545e5002 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.589353 Jun 04 20:57:14.127460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 656/1267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:13 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:14.135311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-42523fd2-8c00-429a-b15a-2c24de635f47 req-fa6ddfe8-9fb5-4b54-825c-9af848877f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e371596-f73e-48de-aab1-77cbf45388e4", "name": "network-vif-deleted", "tag": "7ea111fa-e59f-4092-8352-7af47d7965ee"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:14.162032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-42523fd2-8c00-429a-b15a-2c24de635f47 req-fa6ddfe8-9fb5-4b54-825c-9af848877f3a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.162799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-42523fd2-8c00-429a-b15a-2c24de635f47 req-fa6ddfe8-9fb5-4b54-825c-9af848877f3a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.213449 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-42523fd2-8c00-429a-b15a-2c24de635f47 req-fa6ddfe8-9fb5-4b54-825c-9af848877f3a service nova] Creating event network-vif-deleted:7ea111fa-e59f-4092-8352-7af47d7965ee for instance 0e371596-f73e-48de-aab1-77cbf45388e4 on nch2-master-1 Jun 04 20:57:14.222963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-42523fd2-8c00-429a-b15a-2c24de635f47 req-fa6ddfe8-9fb5-4b54-825c-9af848877f3a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093628 Jun 04 20:57:14.223886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 657/1268] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:14.239647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:14.242054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:14.276876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.277778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.278876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.279608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.726815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:14.752280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:14.753980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:14.761049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d0a34267-4f09-48d2-b55e-85da47de2a35 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.526456 Jun 04 20:57:14.764081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 658/1269] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:14 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:14.775131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:14.776342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:14.785539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.786195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.787836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.788510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.872212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:14.872866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:14.873263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:14.874789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:14.875695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:14.910539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.918827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.919884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:14.925833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:14.985746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Getting quotas for project a23b90f117684cff9d0ffccf630d8307. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:15.010212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Getting quotas for user 71d29871def3409f89efcda0e82a4ad3 and project a23b90f117684cff9d0ffccf630d8307. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:15.055288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:15.065545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:15.081664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:15.110680 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8159edb1-aa7a-42b4-af9b-3da63620b6e0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1323 microversion: 2.1 time: 0.343254 Jun 04 20:57:15.114970 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 659/1270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:14 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1323 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:15.131437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5182c041-4d56-4d97-9a90-a7f9d89bdb9f req-08f9aa84-f9c6-46e5-bfdf-6fcd662fd9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87206a05-9a22-451a-9215-ab44a3fbd388", "name": "network-vif-deleted", "tag": "eb4a45ef-67fc-4c08-9e57-4ae0953af300"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:15.180562 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c128aeb9-f7b7-41ef-96a7-33bc6d35e53a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.185003 Jun 04 20:57:15.185285 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 612/1271] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 20:57:15.191082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5182c041-4d56-4d97-9a90-a7f9d89bdb9f req-08f9aa84-f9c6-46e5-bfdf-6fcd662fd9fc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.192754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.193782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5182c041-4d56-4d97-9a90-a7f9d89bdb9f req-08f9aa84-f9c6-46e5-bfdf-6fcd662fd9fc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.194733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 0e371596-f73e-48de-aab1-77cbf45388e4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:15.231063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.234855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.238526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.239915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.260244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:15.264440 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5182c041-4d56-4d97-9a90-a7f9d89bdb9f req-08f9aa84-f9c6-46e5-bfdf-6fcd662fd9fc service nova] Creating event network-vif-deleted:eb4a45ef-67fc-4c08-9e57-4ae0953af300 for instance 87206a05-9a22-451a-9215-ab44a3fbd388 on nch2-master-1 Jun 04 20:57:15.275073 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5182c041-4d56-4d97-9a90-a7f9d89bdb9f req-08f9aa84-f9c6-46e5-bfdf-6fcd662fd9fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156915 Jun 04 20:57:15.281989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance 0e371596-f73e-48de-aab1-77cbf45388e4 could not be found. Jun 04 20:57:15.282391 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 660/1272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 HTTP/1.1 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:15.284961 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 0e371596-f73e-48de-aab1-77cbf45388e4 could not be found. Jun 04 20:57:15.286673 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '0e371596-f73e-48de-aab1-77cbf45388e4'} Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e371596-f73e-48de-aab1-77cbf45388e4 could not be found. Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:15.287732 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e371596-f73e-48de-aab1-77cbf45388e4 could not be found. Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e371596-f73e-48de-aab1-77cbf45388e4 could not be found. Jun 04 20:57:15.289371 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.292347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance 0e371596-f73e-48de-aab1-77cbf45388e4 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:15.293665 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd7d19f7-3b33-4814-9184-ebac3278c8c3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4" status: 404 len: 111 microversion: 2.1 time: 0.106898 Jun 04 20:57:15.294433 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 613/1273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:15 2022] GET /compute/v2.1/servers/0e371596-f73e-48de-aab1-77cbf45388e4 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:15.302457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-474740e3-f19f-4c41-a78e-d3db37458671 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.303596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-474740e3-f19f-4c41-a78e-d3db37458671 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:15.305855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.309302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:15.314045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=5,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:15.342253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.345840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.348869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.349387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.548491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-474740e3-f19f-4c41-a78e-d3db37458671 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:15.557363 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-474740e3-f19f-4c41-a78e-d3db37458671 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1218 microversion: 2.1 time: 0.261403 Jun 04 20:57:15.579876 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 614/1274] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:15 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1218 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:15.589929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.590827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 87206a05-9a22-451a-9215-ab44a3fbd388] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:15.599178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.600066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.601095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.602342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.619058 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance 87206a05-9a22-451a-9215-ab44a3fbd388 could not be found. Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 HTTP/1.1 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:15.621433 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 87206a05-9a22-451a-9215-ab44a3fbd388 could not be found. Jun 04 20:57:15.622828 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '87206a05-9a22-451a-9215-ab44a3fbd388'} Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87206a05-9a22-451a-9215-ab44a3fbd388 could not be found. Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:15.623632 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87206a05-9a22-451a-9215-ab44a3fbd388 could not be found. Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87206a05-9a22-451a-9215-ab44a3fbd388 could not be found. Jun 04 20:57:15.624865 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:15.628629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance 87206a05-9a22-451a-9215-ab44a3fbd388 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:15.629762 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5fa44d05-36a8-4a71-bf5e-0e8ab232e15d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388" status: 404 len: 111 microversion: 2.1 time: 0.047762 Jun 04 20:57:15.630567 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 615/1275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:15 2022] GET /compute/v2.1/servers/87206a05-9a22-451a-9215-ab44a3fbd388 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:15.639635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5186532e-a2c3-4361-ae9d-d9ed104822a3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.675407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5186532e-a2c3-4361-ae9d-d9ed104822a3 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/932e20d9-0edf-44f8-acb6-b6bf58404713" status: 204 len: 0 microversion: 2.1 time: 0.040337 Jun 04 20:57:15.677238 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 616/1276] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 20:57:15 2022] DELETE /compute/v2.1/os-server-groups/932e20d9-0edf-44f8-acb6-b6bf58404713 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:15.687829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.689317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:15.699750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.700903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.702763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.703708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.744526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:15.885995 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ccecccb-af73-47b9-a1df-cd76088363e4 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 204 len: 0 microversion: 2.1 time: 0.203430 Jun 04 20:57:15.890039 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 617/1277] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:15 2022] DELETE /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:15.902318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:15.911875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:15.923930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.924955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:15.926148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:15.926819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:16.354450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:16.370181 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-170a66f7-be4e-4f21-994c-b5fae2d8bed9 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 1.083708 Jun 04 20:57:16.378907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:16.386143 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 661/1278] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:15 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:16.393565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:16.395095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:16.406507 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4d374fe-a135-4758-86ab-e2829226437d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.514636 Jun 04 20:57:16.416220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:16.419537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:16.428037 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 618/1279] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:15 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:16.450613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:16.452553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:16.463412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:16.463939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:16.464816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:16.465339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:16.490881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:16.492963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:16.499524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:16.500088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:16.529574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:16.897054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:16.908455 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4185b13-fd59-46c7-bcae-157e11edede9 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1473 microversion: 2.1 time: 0.509008 Jun 04 20:57:16.909076 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 662/1280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:16 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1473 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:16.918391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:16.928294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:16.942309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:16.942789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:16.943875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:16.944195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:17.165658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:17.184205 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bfe7b9b5-dc9d-4bd0-a6fe-674cff5a6aa0 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1323 microversion: 2.1 time: 0.746283 Jun 04 20:57:17.185317 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 619/1281] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:16 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1323 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:17.194209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:17.210469 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-27cdcc94-0d00-41d3-bc89-291226f7a95d tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1222 microversion: 2.1 time: 0.300295 Jun 04 20:57:17.214636 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 663/1282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:16 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1222 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:17.391269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:17.391762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:17.399737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:17.400608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:17.401654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:17.402403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:17.424643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:17.425901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:17.433769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:17.440231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:17.444929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:17.445737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:18.357047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:18.403901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:18.433449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:18.438493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:18.454243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:18.457211 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec529857-e3fe-4b82-8018-6ee8b99b9ff7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 1.070712 Jun 04 20:57:18.459151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:18.460524 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 620/1283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:17 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:18.463561 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79048db7-a3b6-4616-bb4e-099f9c2e5c6a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 1.042939 Jun 04 20:57:18.468176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-81450029-f527-4907-aec6-d2aa6b24bc92 req-bf741ade-0047-4fce-b25c-9a8643650d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82bbf254-9aa6-46cd-ade6-043ffd04d57d", "tag": "56969f54-5442-44aa-a731-15a574b35e78"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:18.469408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 664/1284] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:17 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:57:18.475904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:18.481245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:18.490562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-81450029-f527-4907-aec6-d2aa6b24bc92 req-bf741ade-0047-4fce-b25c-9a8643650d63 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:18.493944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-81450029-f527-4907-aec6-d2aa6b24bc92 req-bf741ade-0047-4fce-b25c-9a8643650d63 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:18.498765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:18.499680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:18.503445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:18.504195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:18.533375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-81450029-f527-4907-aec6-d2aa6b24bc92 req-bf741ade-0047-4fce-b25c-9a8643650d63 service nova] Creating event network-changed:56969f54-5442-44aa-a731-15a574b35e78 for instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d on nch1-master-1 Jun 04 20:57:18.547809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-81450029-f527-4907-aec6-d2aa6b24bc92 req-bf741ade-0047-4fce-b25c-9a8643650d63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080216 Jun 04 20:57:18.549262 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 621/1285] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:18.563356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:18.564679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:18.584382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:18.588332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:18.589397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:18.590699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:19.621554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:19.632162 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60f4164b-b44d-4dd0-855f-07f477bc4b9d tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1473 microversion: 2.1 time: 1.160766 Jun 04 20:57:19.638092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:19.647757 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 665/1286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:18 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1473 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:19.650680 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5d2eaa4b-a226-448c-ab76-2bc94c8527df tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1323 microversion: 2.1 time: 1.097360 Jun 04 20:57:19.663498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:19.664158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:19.667540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 622/1287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:18 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1323 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:19.672577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:19.673200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:19.688577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:19.689037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:19.689854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:19.690275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:19.706013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:19.706593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:19.707497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:19.707987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:20.041313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:20.054755 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e0807ee3-cf00-4d2f-b607-8d51a1839525 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1276 microversion: 2.1 time: 0.405823 Jun 04 20:57:20.061194 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 666/1288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:19 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1276 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:20.074852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:20.078349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:20.106739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:20.107917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:20.109946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:20.113301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:20.267702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:20.278952 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-06073067-5ed1-4855-b559-6b5e1780080a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.610147 Jun 04 20:57:20.286498 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 623/1289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:19 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:20.661123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:20.662023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:20.674558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:20.675316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:20.678894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:20.679717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:20.839438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:20.849187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:20.857385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:20.859589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cc334900-47df-47a8-a581-a9fcece7885e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1569 microversion: 2.25 time: 0.796152 Jun 04 20:57:20.861724 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 667/1290] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:20 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1569 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:20.871414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:20.875672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:20.908655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:20.909169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:20.910223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:20.910671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.104492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eef1a5b965a4d26adaed7af3344e7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '007f08ee799d431fb8d18c31dd5991e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:21.120214 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a3312b2-a845-4501-82aa-2ee7c3053bf5 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 200 len: 1431 microversion: 2.1 time: 0.463179 Jun 04 20:57:21.123878 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 624/1291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:20 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 1431 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:57:21.133302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b0f53328-5b58-4178-8173-e4e747331ca2 req-b24cebbd-f59c-42c5-b801-3ba311f1c11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5dd136-9cec-4923-9c8c-2ba3024d18cc", "name": "network-vif-deleted", "tag": "5b5bb7b6-3eee-4ee7-9679-d6b8686b2545"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:21.167306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b0f53328-5b58-4178-8173-e4e747331ca2 req-b24cebbd-f59c-42c5-b801-3ba311f1c11e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.171071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b0f53328-5b58-4178-8173-e4e747331ca2 req-b24cebbd-f59c-42c5-b801-3ba311f1c11e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.201945 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b0f53328-5b58-4178-8173-e4e747331ca2 req-b24cebbd-f59c-42c5-b801-3ba311f1c11e service nova] Creating event network-vif-deleted:5b5bb7b6-3eee-4ee7-9679-d6b8686b2545 for instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc on nch2-master-1 Jun 04 20:57:21.216591 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b0f53328-5b58-4178-8173-e4e747331ca2 req-b24cebbd-f59c-42c5-b801-3ba311f1c11e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091115 Jun 04 20:57:21.218130 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 625/1292] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:21.223874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:21.224890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:21.233777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.234450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.235422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.236026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.459450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:21.473059 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-24a1554d-89db-4c56-8ebe-80e00a8d6940 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1276 microversion: 2.1 time: 0.253325 Jun 04 20:57:21.473931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 626/1293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:21 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1276 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:21.479924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:21.480937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:21.488566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.489528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.490480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.491157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.826390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:21.843083 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-074f41a5-e366-4bde-a37c-02fdcd8de50c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1323 microversion: 2.1 time: 0.977114 Jun 04 20:57:21.862437 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 668/1294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:20 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1323 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:21.881128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:21.881751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:21.897044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.897606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:21.898487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:21.899088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.284220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:22.299453 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-24a9d2ed-1715-4149-bb7c-c24c2f63ba1e tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 0.824182 Jun 04 20:57:22.329096 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 627/1295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:21 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:22.352648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:22.353453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] [instance: 2d5dd136-9cec-4923-9c8c-2ba3024d18cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:22.398363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.410525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.412143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.412816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.441275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] HTTP exception thrown: Instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc could not be found. Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Request method failure captured: Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc HTTP/1.1 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZvRq_z0PVycXhJtG5N9dGjahQKB-Rs2Yk35Sgq2jC6Q4EjGUjHvAv_bXiuAqr43oyg0OrVze1zUl3e_HsuNIvppEKRp7gLMCbf9vVb9qB4-lIULYQvm-6GeqyXB7TY9TS0I1YhohCpiCx_EVHKIqobna1uz2it-2KJT61hSYf9Kt8 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:22.443486 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/007f08ee799d431fb8d18c31dd5991e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 007f08ee799d431fb8d18c31dd5991e0 Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1281958629 Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3eef1a5b965a4d26adaed7af3344e7c9 Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersOnMultiNodesTest-1281958629-project Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc could not be found. Jun 04 20:57:22.445140 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '2d5dd136-9cec-4923-9c8c-2ba3024d18cc'} Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc could not be found. Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:22.446049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc could not be found. Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc could not be found. Jun 04 20:57:22.447560 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:22.449428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] Returning 404 to user: Instance 2d5dd136-9cec-4923-9c8c-2ba3024d18cc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:22.450869 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb53b009-96b0-4c0b-81d9-804408166447 tempest-ServersOnMultiNodesTest-1281958629 tempest-ServersOnMultiNodesTest-1281958629-project] 10.222.0.18 "GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc" status: 404 len: 111 microversion: 2.1 time: 0.119596 Jun 04 20:57:22.452223 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 628/1296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:22 2022] GET /compute/v2.1/servers/2d5dd136-9cec-4923-9c8c-2ba3024d18cc => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:22.497086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:22.505708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:22.533569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.534132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.551821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.552448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.640078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:22.661471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:22.662958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:22.688407 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d3fba04-8ae4-450e-92c7-c2610c130b5f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1559 microversion: 2.25 time: 0.810183 Jun 04 20:57:22.699569 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 669/1297] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:21 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1559 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:22.710128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f6cdc79-838d-4794-b439-9c06a1cd9517 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '.version_select at 0x7f2d0222c8b0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:22.717366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f6cdc79-838d-4794-b439-9c06a1cd9517 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.717819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f6cdc79-838d-4794-b439-9c06a1cd9517 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.765933 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f6cdc79-838d-4794-b439-9c06a1cd9517 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.062072 Jun 04 20:57:22.766568 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 670/1298] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Jun 4 20:57:22 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:57:22.786675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:22.787300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:22.832104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.832558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:22.833422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:22.833796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:23.121916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:23.135414 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae4aa141-3303-4681-a771-a4e324a45797 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 0.648833 Jun 04 20:57:23.148517 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 629/1299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:22 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:57:23.160696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:23.164147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:23.183388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:23.189470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:23.190311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:23.190831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:23.829098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 0b7b6b65-2659-4310-b317-0de0ef27ae4f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:23.850232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e9c3074-db9c-46cb-a47c-8d043ac52e79 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 2052 microversion: 2.25 time: 1.071311 Jun 04 20:57:23.863950 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 671/1300] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:22 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 2052 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:23.863950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:23.863950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:23.868048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:23.869056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:23.870078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:23.870827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:23.910561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:23.923779 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc39955a-9a5b-4180-8cf9-efd4b160b585 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1323 microversion: 2.1 time: 0.771734 Jun 04 20:57:23.927841 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 630/1301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:23 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:24.273469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-500984135", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:24.378013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] validate_networks() for [('51b1cca8-5cd7-48be-bf24-582020121ccd', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:24.952212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:25.072002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:25.099226 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e706ab25-85ea-4df7-bb0c-83f1f825efd7 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1472 microversion: 2.1 time: 1.246759 Jun 04 20:57:25.104719 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 672/1302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:23 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1472 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:25.122102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-aa1d8610-0ad6-41b9-ad7c-04c376d5c5ea req-41aa7f71-a2b4-47ea-aa20-5084fa80c235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bbf254-9aa6-46cd-ade6-043ffd04d57d", "name": "network-vif-plugged", "status": "completed", "tag": "56969f54-5442-44aa-a731-15a574b35e78"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:25.139498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aa1d8610-0ad6-41b9-ad7c-04c376d5c5ea req-41aa7f71-a2b4-47ea-aa20-5084fa80c235 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:25.140244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aa1d8610-0ad6-41b9-ad7c-04c376d5c5ea req-41aa7f71-a2b4-47ea-aa20-5084fa80c235 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:25.157519 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-aa1d8610-0ad6-41b9-ad7c-04c376d5c5ea req-41aa7f71-a2b4-47ea-aa20-5084fa80c235 service nova] Creating event network-vif-plugged:56969f54-5442-44aa-a731-15a574b35e78 for instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d on nch1-master-1 Jun 04 20:57:25.166125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-aa1d8610-0ad6-41b9-ad7c-04c376d5c5ea req-41aa7f71-a2b4-47ea-aa20-5084fa80c235 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058613 Jun 04 20:57:25.167795 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 673/1303] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:25.175143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-744879569", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1e56980c-95ca-4182-ba01-f6d8494d4447"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:25.281613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] validate_networks() for [('1e56980c-95ca-4182-ba01-f6d8494d4447', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:25.557255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=32 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:26.612651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:26.614208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:26.614857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:26.615414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:26.616010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:26.644145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:26.645165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:26.648545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:26.651179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:26.672814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:26.681544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for user be44957fa2304f52a8d34bdac9eaca4f and project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:26.700293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:26.703536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:26.804265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e4f9dcc-7148-490f-bae0-f0494080f6c6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.873367 Jun 04 20:57:26.806980 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 631/1304] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:57:26.820476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:26.822089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:26.838741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:26.841173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:26.845175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:26.845900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:27.893534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:27.894574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:27.895972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:27.896763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:27.897543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:27.912549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:27.913654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:27.915470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:27.916254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:27.961715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:27.988413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for user e25328c90d26437a85d8d5509437ed99 and project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:28.051100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:28.057020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:28.144028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70eb1bdf-c936-43d4-8438-c3e579986b85 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.974682 Jun 04 20:57:28.150870 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 674/1305] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 20:57:28.152041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:28.152799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:28.162484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:28.163041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:28.164148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:28.164657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:28.627333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:28.638803 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb76fb64-c1ca-4ecb-b3cc-3cbc7a539b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 1.830092 Jun 04 20:57:28.641759 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 632/1306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:26 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:28.665263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:28.666025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:28.685404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:28.685858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:28.687367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:28.689171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:28.937037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:28.950552 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cc80c8e2-9385-4a12-aa3e-7f76b73cc12e tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1323 microversion: 2.1 time: 0.803963 Jun 04 20:57:28.961041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 675/1307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:28 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1323 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:28.966330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:28.967178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:28.975068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:28.975818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:28.976766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:28.977358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:29.303855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:29.317430 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a5fed6a-14bb-4e59-9f89-cdf278e9a818 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1291 microversion: 2.1 time: 0.354831 Jun 04 20:57:29.318050 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 676/1308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:28 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1291 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:29.340109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d0a42a8e-0f49-4ac1-9b5d-709a1af2c791 req-463ec393-101b-4edf-9bb9-e10a5a4bb9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c140f60-4608-4471-a143-948533f3a13d", "tag": "3c879740-9690-49ef-90a5-918fe0f2877c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:29.364357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d0a42a8e-0f49-4ac1-9b5d-709a1af2c791 req-463ec393-101b-4edf-9bb9-e10a5a4bb9b7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:29.365231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d0a42a8e-0f49-4ac1-9b5d-709a1af2c791 req-463ec393-101b-4edf-9bb9-e10a5a4bb9b7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:29.388423 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d0a42a8e-0f49-4ac1-9b5d-709a1af2c791 req-463ec393-101b-4edf-9bb9-e10a5a4bb9b7 service nova] Creating event network-changed:3c879740-9690-49ef-90a5-918fe0f2877c for instance 6c140f60-4608-4471-a143-948533f3a13d on nch2-master-1 Jun 04 20:57:29.405603 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d0a42a8e-0f49-4ac1-9b5d-709a1af2c791 req-463ec393-101b-4edf-9bb9-e10a5a4bb9b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077844 Jun 04 20:57:29.410584 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 677/1309] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:29.419798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:29.424564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:29.444304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:29.445131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:29.446309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:29.447065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:29.452970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:29.464141 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c1260c1-4256-456f-a6cc-8fa4fc658db0 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1478 microversion: 2.1 time: 0.810604 Jun 04 20:57:29.464985 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 633/1310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:28 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1478 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:29.600618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:29.609140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1890463737", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:29.634267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:29.647952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:29.649257 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e0691b15-0645-4b42-851d-2a4544fc3b7f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1257 microversion: 2.25 time: 0.237034 Jun 04 20:57:29.658376 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 678/1311] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:29 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1257 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:29.664237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:29.664859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:29.686061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:29.691926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:29.693551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:29.694520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:29.695986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:30.636088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] validate_networks() for [('51b1cca8-5cd7-48be-bf24-582020121ccd', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:31.408168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:31.412720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:31.419035 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc8efb64-b151-46d5-876a-78c6a03f3646 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 1.759894 Jun 04 20:57:31.431062 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 679/1312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:29 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:31.436944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:31.437865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:31.450093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:31.452489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:31.456659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:31.458995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:32.251313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:32.272528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a0c044a-7be3-466d-a77d-f1e69e804f99 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1518 microversion: 2.1 time: 0.839944 Jun 04 20:57:32.273132 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 680/1313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:31 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1518 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:32.278132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-dd38994e-9fa1-4a38-bf5e-a042327f2d9a req-b73ffea3-49c1-4ed1-b0e6-d9668157785e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "name": "network-vif-unplugged", "status": "completed", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:32.291913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dd38994e-9fa1-4a38-bf5e-a042327f2d9a req-b73ffea3-49c1-4ed1-b0e6-d9668157785e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:32.292683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dd38994e-9fa1-4a38-bf5e-a042327f2d9a req-b73ffea3-49c1-4ed1-b0e6-d9668157785e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:32.318180 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dd38994e-9fa1-4a38-bf5e-a042327f2d9a req-b73ffea3-49c1-4ed1-b0e6-d9668157785e service nova] Creating event network-vif-unplugged:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:57:32.331696 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-dd38994e-9fa1-4a38-bf5e-a042327f2d9a req-b73ffea3-49c1-4ed1-b0e6-d9668157785e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057045 Jun 04 20:57:32.332925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 681/1314] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:32.340854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:32.342984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:32.370295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:32.371184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:32.372078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:32.372676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:32.738208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:32.739379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:32.740033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:32.740482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:32.740891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:32.762748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:32.763189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:32.764267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:32.764889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:32.799187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:32.810782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for user be44957fa2304f52a8d34bdac9eaca4f and project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:32.841457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:32.845880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:32.872310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:32.903234 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a822712f-4969-42d7-84e4-81288719c7de tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1478 microversion: 2.1 time: 0.566677 Jun 04 20:57:32.904696 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 682/1315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:32 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1478 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:32.987950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a517a4f-67aa-47ae-b96d-f81cdfaf27ff tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.394007 Jun 04 20:57:32.991405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 634/1316] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:57:33.008211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.009569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:33.016753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.029203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.032234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.033067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.387376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-611a7781-3434-4bcc-81b5-213e956cc784 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.390222 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:57:33.390222 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:57:33.392721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-611a7781-3434-4bcc-81b5-213e956cc784 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.393455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-611a7781-3434-4bcc-81b5-213e956cc784 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.396619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-611a7781-3434-4bcc-81b5-213e956cc784 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.400013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-611a7781-3434-4bcc-81b5-213e956cc784 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.430428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:33.444899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:33.449037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:33.453652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff60d546-9543-43a9-bbe8-f71f024b99ee tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1361 microversion: 2.25 time: 0.456962 Jun 04 20:57:33.454755 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 635/1317] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:32 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:33.469164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.469878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:33.478322 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-611a7781-3434-4bcc-81b5-213e956cc784 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.570581 Jun 04 20:57:33.492184 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 683/1318] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:57:32 2022] GET /compute/v2.1/os-services => generated 947 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:33.497522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.497971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.498894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.499227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.503330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-367c2092-14dc-42df-b971-451c8ed29280 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-754240130", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-367c2092-14dc-42df-b971-451c8ed29280 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 242 Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:33.511594 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:57:33.513283 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-754240130", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-754240130', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '31a5d5ca-537c-4658-8272-4b04850fbd97'}]}}} Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:57:33.514099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:33.515458 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:33.519561 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.535799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-367c2092-14dc-42df-b971-451c8ed29280 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:33.539649 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-367c2092-14dc-42df-b971-451c8ed29280 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.043452 Jun 04 20:57:33.540900 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 684/1319] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:33 2022] POST /compute/v2.1/servers => generated 175 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:57:33.554220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5f01492e-06d2-41a3-b93f-ff2c6d699262 req-cd81eb0e-da43-4c02-ae88-cc554e569d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733596ac-52ff-421c-8693-fb08a213ca15", "tag": "3af2fa06-745e-409f-9676-ffd6b6ffa5ca"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:33.581459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5f01492e-06d2-41a3-b93f-ff2c6d699262 req-cd81eb0e-da43-4c02-ae88-cc554e569d32 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.582004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5f01492e-06d2-41a3-b93f-ff2c6d699262 req-cd81eb0e-da43-4c02-ae88-cc554e569d32 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.612371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5f01492e-06d2-41a3-b93f-ff2c6d699262 req-cd81eb0e-da43-4c02-ae88-cc554e569d32 service nova] Creating event network-changed:3af2fa06-745e-409f-9676-ffd6b6ffa5ca for instance 733596ac-52ff-421c-8693-fb08a213ca15 on nch2-master-1 Jun 04 20:57:33.629690 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5f01492e-06d2-41a3-b93f-ff2c6d699262 req-cd81eb0e-da43-4c02-ae88-cc554e569d32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086988 Jun 04 20:57:33.636949 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 685/1320] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:33.656757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b6b1ea6-e780-4884-9473-0dc82d22a4c2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.663020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8b6b1ea6-e780-4884-9473-0dc82d22a4c2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:33.792459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8b6b1ea6-e780-4884-9473-0dc82d22a4c2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:33.818275 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8b6b1ea6-e780-4884-9473-0dc82d22a4c2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1222 microversion: 2.1 time: 0.176687 Jun 04 20:57:33.821134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 686/1321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:33 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:33.857880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a838701-75d6-418e-9e5b-1d7bb7296cc7 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.862452 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:57:33.862452 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:57:33.866966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a838701-75d6-418e-9e5b-1d7bb7296cc7 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.868263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a838701-75d6-418e-9e5b-1d7bb7296cc7 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.869714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a838701-75d6-418e-9e5b-1d7bb7296cc7 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.870337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a838701-75d6-418e-9e5b-1d7bb7296cc7 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.918878 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a838701-75d6-418e-9e5b-1d7bb7296cc7 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.085342 Jun 04 20:57:33.920488 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 687/1322] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Jun 4 20:57:33 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:33.927097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f07b0def-5e3d-4a09-900d-8d8287a03976 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.927912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f07b0def-5e3d-4a09-900d-8d8287a03976 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: e0a38c62-6f8a-4b1b-8adf-135c3340b055] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:33.934790 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f07b0def-5e3d-4a09-900d-8d8287a03976 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] HTTP exception thrown: Instance e0a38c62-6f8a-4b1b-8adf-135c3340b055 could not be found. Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f07b0def-5e3d-4a09-900d-8d8287a03976 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e0a38c62-6f8a-4b1b-8adf-135c3340b055/metadata HTTP/1.1 Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:33.937766 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e0a38c62-6f8a-4b1b-8adf-135c3340b055 could not be found. Jun 04 20:57:33.939204 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': 'e0a38c62-6f8a-4b1b-8adf-135c3340b055'} Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0a38c62-6f8a-4b1b-8adf-135c3340b055 could not be found. Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:33.940047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0a38c62-6f8a-4b1b-8adf-135c3340b055 could not be found. Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0a38c62-6f8a-4b1b-8adf-135c3340b055 could not be found. Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:33.941337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f07b0def-5e3d-4a09-900d-8d8287a03976 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 404 to user: Instance e0a38c62-6f8a-4b1b-8adf-135c3340b055 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:33.948223 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f07b0def-5e3d-4a09-900d-8d8287a03976 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/e0a38c62-6f8a-4b1b-8adf-135c3340b055/metadata" status: 404 len: 111 microversion: 2.1 time: 0.017328 Jun 04 20:57:33.948223 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 688/1323] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:57:33 2022] GET /compute/v2.1/servers/e0a38c62-6f8a-4b1b-8adf-135c3340b055/metadata => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:33.957172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:33.963628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:33.972437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.973153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:33.974220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:33.974843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.290597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:34.336511 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5bd529e-d72f-445f-ad30-9afc65dc0119 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 0.879888 Jun 04 20:57:34.338592 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 636/1324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:33 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:34.345187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eaaded4f-e54f-4541-a606-c9e1a406a648 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:34.347623 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:57:34.347623 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:57:34.351997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaaded4f-e54f-4541-a606-c9e1a406a648 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.352951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaaded4f-e54f-4541-a606-c9e1a406a648 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.355310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaaded4f-e54f-4541-a606-c9e1a406a648 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.366246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaaded4f-e54f-4541-a606-c9e1a406a648 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.402609 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eaaded4f-e54f-4541-a606-c9e1a406a648 tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061932 Jun 04 20:57:34.403775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 637/1325] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:57:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:34.416913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-657b15c1-977a-4885-b148-cc88b2eac40c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1199814642", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-657b15c1-977a-4885-b148-cc88b2eac40c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 499 Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:34.422080 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:34.423991 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:57:34.424642 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1199814642", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} Jun 04 20:57:34.424642 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:34.424642 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.424642 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1199814642', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '31a5d5ca-537c-4658-8272-4b04850fbd97'}]}}} Jun 04 20:57:34.424642 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:34.424642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:34.425235 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:57:34.426346 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:57:34.427261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:57:34.428881 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.428881 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.430114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-657b15c1-977a-4885-b148-cc88b2eac40c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:34.432013 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-657b15c1-977a-4885-b148-cc88b2eac40c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018710 Jun 04 20:57:34.433289 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 638/1326] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:34 2022] POST /compute/v2.1/servers => generated 687 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:57:34.439892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a71ffff2-f083-4057-832e-42488143254a req-1c8fc459-2b0d-4d9a-8a64-22fac7afc739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "name": "network-vif-plugged", "status": "completed", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:34.456422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a71ffff2-f083-4057-832e-42488143254a req-1c8fc459-2b0d-4d9a-8a64-22fac7afc739 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.458486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a71ffff2-f083-4057-832e-42488143254a req-1c8fc459-2b0d-4d9a-8a64-22fac7afc739 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.475396 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a71ffff2-f083-4057-832e-42488143254a req-1c8fc459-2b0d-4d9a-8a64-22fac7afc739 service nova] Creating event network-vif-plugged:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:57:34.487809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a71ffff2-f083-4057-832e-42488143254a req-1c8fc459-2b0d-4d9a-8a64-22fac7afc739 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052085 Jun 04 20:57:34.488772 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 639/1327] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:34.496003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f7538130-89ba-421c-a870-dec4e4b79e2c tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:34.498284 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:57:34.498284 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 20:57:34.500331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7538130-89ba-421c-a870-dec4e4b79e2c tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.501221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7538130-89ba-421c-a870-dec4e4b79e2c tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.505262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7538130-89ba-421c-a870-dec4e4b79e2c tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.506022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f7538130-89ba-421c-a870-dec4e4b79e2c tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.541899 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f7538130-89ba-421c-a870-dec4e4b79e2c tempest-ServicesAdminTestJSON-1049883961 tempest-ServicesAdminTestJSON-1049883961-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.051605 Jun 04 20:57:34.542997 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 640/1328] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 20:57:34 2022] GET /compute/v2.1/os-services => generated 947 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:34.557874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:34.560085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:34.568762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.569622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.570666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.571709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.821474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:34.852619 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4010abcb-9fc8-40ac-b343-cd9e3133cc02 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1478 microversion: 2.1 time: 0.894146 Jun 04 20:57:34.853355 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 689/1329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:33 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1478 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:34.876925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16e33702-7bf6-4864-a264-0f37a6a948ef tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-677280190", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16e33702-7bf6-4864-a264-0f37a6a948ef tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 499 Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:34.889135 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:34.891743 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:57:34.892883 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-677280190", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} Jun 04 20:57:34.892883 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:34.892883 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.892883 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-677280190', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '31a5d5ca-537c-4658-8272-4b04850fbd97'}]}}} Jun 04 20:57:34.892883 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:34.892883 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:34.893681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:57:34.895228 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:57:34.899803 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:57:34.903256 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:34.903256 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:34.903256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16e33702-7bf6-4864-a264-0f37a6a948ef tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:34.905079 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-16e33702-7bf6-4864-a264-0f37a6a948ef tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.031379 Jun 04 20:57:34.905079 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 690/1330] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:34 2022] POST /compute/v2.1/servers => generated 689 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:57:34.925074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:34.926083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:34.945672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.946136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:34.946939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:34.963384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:35.202740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:35.217909 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-96b849cd-2a17-43df-b29e-5a256b42dc04 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1274 microversion: 2.1 time: 0.325272 Jun 04 20:57:35.218411 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 691/1331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:34 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:35.232845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77b5a16b-8193-4b52-b0d3-9be190b70985 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-941957680", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77b5a16b-8193-4b52-b0d3-9be190b70985 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 753 Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:35.242497 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:35.244186 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:57:35.244935 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-941957680", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} Jun 04 20:57:35.244935 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:35.244935 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-941957680', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '31a5d5ca-537c-4658-8272-4b04850fbd97'}]}}} Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:57:35.245218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:35.245931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:57:35.247160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:57:35.248440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:57:35.249163 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.249163 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.250735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77b5a16b-8193-4b52-b0d3-9be190b70985 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:35.253830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-77b5a16b-8193-4b52-b0d3-9be190b70985 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029072 Jun 04 20:57:35.255638 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 692/1332] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:35 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 04 20:57:35.390766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:35.396808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:35.436641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:35.437993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:35.454502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:35.455477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:35.623671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:35.634518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:35.636676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:35.638224 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ee81e9e-08ce-4443-ad2f-f6ba93d7a4a4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1361 microversion: 2.25 time: 1.086055 Jun 04 20:57:35.651066 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 641/1333] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:34 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1361 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:35.658663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f81ed20c-c565-4ffb-8a98-2fc4819b780c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1399862615", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f81ed20c-c565-4ffb-8a98-2fc4819b780c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 1266 Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:35.663290 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:35.664806 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:57:35.665456 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1399862615", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "31a5d5ca-537c-4658-8272-4b04850fbd97"}]}} Jun 04 20:57:35.665456 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1399862615', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '31a5d5ca-537c-4658-8272-4b04850fbd97'}]}}} Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.665642 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:57:35.666759 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:57:35.668628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 04 20:57:35.668628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.673146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f81ed20c-c565-4ffb-8a98-2fc4819b780c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:35.674336 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f81ed20c-c565-4ffb-8a98-2fc4819b780c tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021403 Jun 04 20:57:35.680459 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 642/1334] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Jun 4 20:57:35 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 04 20:57:35.704706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25a9bef5-6f39-4d76-867c-be44209784a6 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:35.705932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25a9bef5-6f39-4d76-867c-be44209784a6 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 3ba66602-9f28-48c5-840f-17c4ef4192d8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:35.709403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:35.716566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-25a9bef5-6f39-4d76-867c-be44209784a6 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] HTTP exception thrown: Instance 3ba66602-9f28-48c5-840f-17c4ef4192d8 could not be found. Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25a9bef5-6f39-4d76-867c-be44209784a6 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/3ba66602-9f28-48c5-840f-17c4ef4192d8/metadata/test2 HTTP/1.1 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 3ba66602-9f28-48c5-840f-17c4ef4192d8 could not be found. Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': '3ba66602-9f28-48c5-840f-17c4ef4192d8', 'id': 'test2'} Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ba66602-9f28-48c5-840f-17c4ef4192d8 could not be found. Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ba66602-9f28-48c5-840f-17c4ef4192d8 could not be found. Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:35.724717 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:35.728873 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:35.728873 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:35.728873 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ba66602-9f28-48c5-840f-17c4ef4192d8 could not be found. Jun 04 20:57:35.728873 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:35.731039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25a9bef5-6f39-4d76-867c-be44209784a6 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 404 to user: Instance 3ba66602-9f28-48c5-840f-17c4ef4192d8 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:35.740306 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25a9bef5-6f39-4d76-867c-be44209784a6 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/3ba66602-9f28-48c5-840f-17c4ef4192d8/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.039081 Jun 04 20:57:35.742600 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 643/1335] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 20:57:35 2022] GET /compute/v2.1/servers/3ba66602-9f28-48c5-840f-17c4ef4192d8/metadata/test2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 20:57:35.763436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:35.764403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:35.776093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:35.783875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:35.785227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:35.785911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:35.797901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:35.846342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:36.067363 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5d7223d-82bb-4d33-b1ea-ccdb5ad39127 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 204 len: 0 microversion: 2.1 time: 0.314275 Jun 04 20:57:36.068275 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 644/1336] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:35 2022] DELETE /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 20:57:36.080976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:36.082553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:36.099245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:36.100220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:36.102069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:36.104936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:36.360290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:36.373340 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad27e251-6003-4100-8251-90c73878e270 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 1.018582 Jun 04 20:57:36.378299 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 693/1337] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:35 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:57:36.396319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:36.407822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:36.425869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:36.429040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:36.430180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:36.432491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.310008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:37.321573 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aa3c02ec-cdf1-4813-97a4-c960216e4291 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1478 microversion: 2.1 time: 1.251869 Jun 04 20:57:37.334206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 645/1338] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:36 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1478 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:37.347486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:37.348568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:37.366751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.369897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.373734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.375626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.506778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:37.518461 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e573b3f-7293-4aab-a829-9403ba1184ea tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1524 microversion: 2.1 time: 1.129822 Jun 04 20:57:37.519029 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 694/1339] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:36 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1524 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:37.540921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:37.542599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:37.558376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.559284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.560336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.561034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.567051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:37.584771 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4252cbb6-6066-428e-ac78-c6cca6b434c3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1280 microversion: 2.1 time: 0.248065 Jun 04 20:57:37.586016 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 646/1340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:37 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:37.604178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-aa312740-d0ed-4e77-9e59-afa2da6eb26f req-5df8fa2c-13f3-4e93-b987-cb066c5f88c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c140f60-4608-4471-a143-948533f3a13d", "name": "network-vif-plugged", "status": "completed", "tag": "3c879740-9690-49ef-90a5-918fe0f2877c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:37.636445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-aa312740-d0ed-4e77-9e59-afa2da6eb26f req-5df8fa2c-13f3-4e93-b987-cb066c5f88c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.637361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-aa312740-d0ed-4e77-9e59-afa2da6eb26f req-5df8fa2c-13f3-4e93-b987-cb066c5f88c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.658772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-aa312740-d0ed-4e77-9e59-afa2da6eb26f req-5df8fa2c-13f3-4e93-b987-cb066c5f88c6 service nova] Creating event network-vif-plugged:3c879740-9690-49ef-90a5-918fe0f2877c for instance 6c140f60-4608-4471-a143-948533f3a13d on nch2-master-1 Jun 04 20:57:37.684428 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-aa312740-d0ed-4e77-9e59-afa2da6eb26f req-5df8fa2c-13f3-4e93-b987-cb066c5f88c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096758 Jun 04 20:57:37.690921 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 647/1341] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:37.767907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:37.773608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:37.844843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.846673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:37.848822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:37.849629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:38.974236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:38.992952 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c0f37ddf-1f66-4b3a-bfb6-fa94585eabfa tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 1.269921 Jun 04 20:57:39.009439 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 648/1342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:37 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:39.017746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a865b2ff-6941-4393-97bf-296f37fc70b4 req-a51efd9a-a481-41e7-87ec-08c3e65421ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "952e6198-f88b-4266-bc51-a737275da8b2", "tag": "0a786854-5e4e-4a5c-9153-816eca07b370"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:39.036331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a865b2ff-6941-4393-97bf-296f37fc70b4 req-a51efd9a-a481-41e7-87ec-08c3e65421ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:39.037146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a865b2ff-6941-4393-97bf-296f37fc70b4 req-a51efd9a-a481-41e7-87ec-08c3e65421ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:39.069570 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a865b2ff-6941-4393-97bf-296f37fc70b4 req-a51efd9a-a481-41e7-87ec-08c3e65421ca service nova] Creating event network-changed:0a786854-5e4e-4a5c-9153-816eca07b370 for instance 952e6198-f88b-4266-bc51-a737275da8b2 on nch2-master-1 Jun 04 20:57:39.077738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a865b2ff-6941-4393-97bf-296f37fc70b4 req-a51efd9a-a481-41e7-87ec-08c3e65421ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066648 Jun 04 20:57:39.084791 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 649/1343] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:39.093971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:39.094722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:39.117273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:39.122878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:39.123285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:39.124274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:39.124579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:39.132760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:39.133193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:39.170692 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8272bf2f-fc72-4284-b8e7-339f1aa26b8f tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1361 microversion: 2.25 time: 1.648813 Jun 04 20:57:39.171645 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 695/1344] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:37 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1361 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:39.190830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:39.195847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:39.227067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:39.232395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:39.233667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:39.234444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:39.945452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:39.979890 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e30c6a97-b86f-4927-9a9a-d4006a3301fa tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1463 microversion: 2.1 time: 0.888969 Jun 04 20:57:39.980784 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 650/1345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:39 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1463 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:40.007882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:40.009065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:40.019202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:40.020068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:40.021520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:40.022123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:40.181051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:40.198640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ae62e1d-7f9b-4fd7-9c86-d589211e323a tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1524 microversion: 2.1 time: 1.021974 Jun 04 20:57:40.212289 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 696/1346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:39 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1524 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:40.234268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:40.235160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:40.245867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:40.247780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:40.248852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:40.250135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:40.798917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:40.822887 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-37c091df-657f-4e5b-bd7b-91804426cca7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1322 microversion: 2.1 time: 0.839915 Jun 04 20:57:40.833680 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 651/1347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:39 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1322 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:40.851401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:40.857436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:40.893242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:40.904647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:40.905730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:40.910181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:40.978008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:40.996582 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-748a768a-7d78-4770-a797-544a651b3263 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1318 microversion: 2.1 time: 0.768107 Jun 04 20:57:41.006562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 697/1348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:40 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1318 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:41.012821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:41.013615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:41.024872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.029012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.030103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.030709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.092674 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f1beddf-74b2-4690-87b5-5614cce5117c tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 0 microversion: 2.1 time: 0.256201 Jun 04 20:57:41.093630 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 652/1349] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:57:40 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:41.098751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-987ee2ba-c245-4645-9da1-efe10644d966 req-37b21e78-e857-4add-aeff-fcbb9c8b6ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733596ac-52ff-421c-8693-fb08a213ca15", "name": "network-vif-plugged", "status": "completed", "tag": "3af2fa06-745e-409f-9676-ffd6b6ffa5ca"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:41.118105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-987ee2ba-c245-4645-9da1-efe10644d966 req-37b21e78-e857-4add-aeff-fcbb9c8b6ad8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.118684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-987ee2ba-c245-4645-9da1-efe10644d966 req-37b21e78-e857-4add-aeff-fcbb9c8b6ad8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.151446 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-987ee2ba-c245-4645-9da1-efe10644d966 req-37b21e78-e857-4add-aeff-fcbb9c8b6ad8 service nova] Creating event network-vif-plugged:3af2fa06-745e-409f-9676-ffd6b6ffa5ca for instance 733596ac-52ff-421c-8693-fb08a213ca15 on nch2-master-1 Jun 04 20:57:41.159450 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-987ee2ba-c245-4645-9da1-efe10644d966 req-37b21e78-e857-4add-aeff-fcbb9c8b6ad8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064066 Jun 04 20:57:41.161721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 653/1350] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:41.173509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-622f303d-ec8b-4b47-a087-7865f72d5cd2 req-e904d226-da42-4a83-afda-16ddc79cc469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7907307f-3aab-444e-a6ab-d0988fd26463", "tag": "49322108-2953-4067-a051-dd150b181db1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:41.198683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-622f303d-ec8b-4b47-a087-7865f72d5cd2 req-e904d226-da42-4a83-afda-16ddc79cc469 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.199921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-622f303d-ec8b-4b47-a087-7865f72d5cd2 req-e904d226-da42-4a83-afda-16ddc79cc469 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.222977 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-622f303d-ec8b-4b47-a087-7865f72d5cd2 req-e904d226-da42-4a83-afda-16ddc79cc469 service nova] Creating event network-changed:49322108-2953-4067-a051-dd150b181db1 for instance 7907307f-3aab-444e-a6ab-d0988fd26463 on nch1-master-1 Jun 04 20:57:41.235962 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-622f303d-ec8b-4b47-a087-7865f72d5cd2 req-e904d226-da42-4a83-afda-16ddc79cc469 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071466 Jun 04 20:57:41.237275 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 654/1351] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:41.244374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:41.245601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:41.253373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.254074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.255307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.256123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.322177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.323016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.323804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lazy-loading 'fault' on Instance uuid 224b7274-0065-4e26-806c-ec0195ff3260 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:41.645308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:41.658156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:41.661360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:41.663164 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3d9a9e4-3557-42c3-abce-40286ef46ca7 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1361 microversion: 2.25 time: 0.655216 Jun 04 20:57:41.664757 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 698/1352] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:41 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1361 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:41.675249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-50f74a80-0eee-4db6-82d0-5d246a5bfe8f req-a937d129-9145-4865-a7b6-73f9329e8260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82bbf254-9aa6-46cd-ade6-043ffd04d57d", "name": "network-vif-deleted", "tag": "56969f54-5442-44aa-a731-15a574b35e78"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:41.690090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-50f74a80-0eee-4db6-82d0-5d246a5bfe8f req-a937d129-9145-4865-a7b6-73f9329e8260 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.690782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-50f74a80-0eee-4db6-82d0-5d246a5bfe8f req-a937d129-9145-4865-a7b6-73f9329e8260 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.708974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-50f74a80-0eee-4db6-82d0-5d246a5bfe8f req-a937d129-9145-4865-a7b6-73f9329e8260 service nova] Creating event network-vif-deleted:56969f54-5442-44aa-a731-15a574b35e78 for instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d on nch1-master-1 Jun 04 20:57:41.717090 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-50f74a80-0eee-4db6-82d0-5d246a5bfe8f req-a937d129-9145-4865-a7b6-73f9329e8260 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050671 Jun 04 20:57:41.718415 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 699/1353] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:41.727150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:41.729218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:41.741149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.741671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.742583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.743391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.809132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed9155c0-a863-412f-9be0-ab06d7f54be7 tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1597 microversion: 2.1 time: 0.570170 Jun 04 20:57:41.820369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.823147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.823805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lazy-loading 'fault' on Instance uuid 82bbf254-9aa6-46cd-ade6-043ffd04d57d {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:41.829833 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 655/1354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:41 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1597 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:41.850227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:41.851997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:41.870718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.872363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.876744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.878228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.927607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99c2a174b33c40f9a419cf7eacf01796', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75f1e8eef91443294369c0972b330eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:41.938818 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3924e38c-8862-4f28-b8de-ed8e305c4234 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 200 len: 1313 microversion: 2.1 time: 0.217797 Jun 04 20:57:41.940998 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 700/1355] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:41 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:41.955468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:41.956537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:41.971848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.972654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:41.974387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:41.975070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.066997 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-59d0dc8f-806f-4b2f-8d7f-f761512fc2bf tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action" status: 202 len: 0 microversion: 2.1 time: 0.230595 Jun 04 20:57:42.071833 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 656/1356] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:57:41 2022] POST /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:57:42.078418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:42.080608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:42.097059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.099929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.100926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.104470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.383104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:42.392698 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d40f3f54-8f4c-482e-aed1-a389525e9615 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1322 microversion: 2.1 time: 0.449282 Jun 04 20:57:42.393304 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 701/1357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:41 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:42.400435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:42.401275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:42.408734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.409176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.409973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.410411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.500148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:42.509345 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0bc4fc70-d41e-465c-9966-9d13a76ba443 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1506 microversion: 2.1 time: 0.436131 Jun 04 20:57:42.510512 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 657/1358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:42 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:42.684256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:42.685001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:42.698410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.699721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.702528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.703465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.732667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:42.768753 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb4d6237-0c57-436d-9524-d449d84f9e2f tempest-ServersAdminTestJSON-2010864619 tempest-ServersAdminTestJSON-2010864619-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1614 microversion: 2.1 time: 0.374160 Jun 04 20:57:42.774402 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 702/1359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:42 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1614 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:42.792039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:42.793232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:42.799696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.800582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.801522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:42.802111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:42.826176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:42.833948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:42.919183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:43.108375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-40f5123e-74ba-44ef-a857-cbeb65c81041 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 204 len: 0 microversion: 2.1 time: 0.320441 Jun 04 20:57:43.111538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 703/1360] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:42 2022] DELETE /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:43.131309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:43.132440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] [instance: 82bbf254-9aa6-46cd-ade6-043ffd04d57d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:43.162481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:43.172728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:43.173203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:43.178983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:43.179493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:43.184118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:43.186956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:43.202456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90f96131-9e24-46e6-8fcd-fb295c17304e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1361 microversion: 2.25 time: 0.523381 Jun 04 20:57:43.208104 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 658/1361] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:42 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:57:43.217915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:43.247909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:43.260478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:43.262550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:43.267441 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] HTTP exception thrown: Instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d could not be found. Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Request method failure captured: Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d HTTP/1.1 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ci4xZzvtjGWvJ6YWTya1ZSHHODXtahPC7n8wQObdvTbJcnQz-BEid83k25WNsjI50x_zNbvQyn5kCk1ieJNgmjUzUPOjkikqoOArSPzYR8_ydRJ6xhVBANSXs-hEG5wh6rqoxTRzvHLUsJiPM6HqAy0R9taa-eaT7QfTPzFUmPeYc Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f75f1e8eef91443294369c0972b330eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f75f1e8eef91443294369c0972b330eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f75f1e8eef91443294369c0972b330eb Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1878871928 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 99c2a174b33c40f9a419cf7eacf01796 Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1878871928-project Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d could not be found. Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '82bbf254-9aa6-46cd-ade6-043ffd04d57d'} Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d could not be found. Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d could not be found. Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:43.269297 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d could not be found. Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] Returning 404 to user: Instance 82bbf254-9aa6-46cd-ade6-043ffd04d57d could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1087411-6a62-4f9c-9b69-0dbefe184107 tempest-ServerMetadataNegativeTestJSON-1878871928 tempest-ServerMetadataNegativeTestJSON-1878871928-project] 10.222.0.18 "GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d" status: 404 len: 111 microversion: 2.1 time: 0.157905 Jun 04 20:57:43.276115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 704/1362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:43 2022] GET /compute/v2.1/servers/82bbf254-9aa6-46cd-ade6-043ffd04d57d => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:43.282982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:43.284002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:43.411999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:43.413172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:43.430885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:43.434612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:43.437247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:43.438196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:43.804745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:43.878465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:44.415714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:44.429091 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5813282-9fb9-4120-8d76-93716601433a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1469 microversion: 2.1 time: 1.215079 Jun 04 20:57:44.429853 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 659/1363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:43 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1469 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:44.491887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:44.509581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-958f5de6-1fc4-4c32-9fb5-5345d35ceb1d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1322 microversion: 2.1 time: 1.100945 Jun 04 20:57:44.520230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:44.543305 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 705/1364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:43 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1322 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:57:44.566343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:44.568713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:44.587740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:44.591003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:44.595215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:44.596264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:44.792229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ba88f0af-3f49-4d48-b13a-3dbf5d415a9c tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d021aeaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1830119386", "description": "tempest-description-1563875615"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:45.217246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:45.231314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:45.233608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:45.234147 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c70edcec-7155-425c-acd9-80f9afe00790 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1557 microversion: 2.25 time: 0.689317 Jun 04 20:57:45.234735 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 706/1365] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:44 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1557 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:45.252490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1265fb5b-83d5-4326-aba2-c668a0d9be63"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:45.253235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:45.260026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:45.260487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:45.261343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:45.261790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:45.366797 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] HTTP exception thrown: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Request method failure captured: Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d/os-volume_attachments/d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 HTTP/1.1 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 74 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8bFFaX9Pzm7kFaG36JvBnp6Dd9-Pl-_G8kAJRHhjGJ8y_5VOx6-7m5v68UGANCewHIwobrARoPp7F8iZQYyEYWpBGrV5fTXvmY9ZuOIUZOXyu0JmODvCCDz_9m8xAXpoh-VuySiyRjEtdPpW29MOCWheGcdQCg9wQIdVpxF-HNOibI Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 7df2a8ee35b644258b36388d425322ab Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesAdminNegativeTest-983077096 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7df2a8ee35b644258b36388d425322ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7df2a8ee35b644258b36388d425322ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7df2a8ee35b644258b36388d425322ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7df2a8ee35b644258b36388d425322ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesAdminNegativeTest-983077096 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 7df2a8ee35b644258b36388d425322ab Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-983077096 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesAdminNegativeTest-983077096-project-admin Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 858dec3e74964fd290e3bc622cd0dab2 Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesAdminNegativeTest-983077096-project-admin Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: {"volumeAttachment": {"volumeId": "1265fb5b-83d5-4326-aba2-c668a0d9be63"}} Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: exception: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '6c140f60-4608-4471-a143-948533f3a13d', 'id': 'd89ba6a1-d341-4f3c-bfea-c3eccc8cba64', 'body': {'volumeAttachment': {'volumeId': '1265fb5b-83d5-4326-aba2-c668a0d9be63'}}} Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. (HTTP 404) (Request-ID: req-3cb18228-f854-41ef-b66f-d9a2756ec420) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 20:57:45.369350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. Jun 04 20:57:45.380974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:57:45.392879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] Returning 404 to user: Volume d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:45.392879 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-098a51bc-3b76-40ac-a7a2-731e7c388367 tempest-VolumesAdminNegativeTest-983077096 tempest-VolumesAdminNegativeTest-983077096-project-admin] 10.222.0.18 "PUT /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d/os-volume_attachments/d89ba6a1-d341-4f3c-bfea-c3eccc8cba64" status: 404 len: 109 microversion: 2.1 time: 0.139876 Jun 04 20:57:45.392879 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 707/1366] 10.222.0.18 () {60 vars in 1432 bytes} [Sat Jun 4 20:57:45 2022] PUT /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d/os-volume_attachments/d89ba6a1-d341-4f3c-bfea-c3eccc8cba64 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:45.404521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1431536861", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1c9de366-78f1-4170-a48a-3f63d1e5098e"}], "block_device_mapping_v2": [{"uuid": "7b6358b5-f2c7-4f84-93be-b0746120aafa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:45.528820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] validate_networks() for [('1c9de366-78f1-4170-a48a-3f63d1e5098e', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:45.739042 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ba88f0af-3f49-4d48-b13a-3dbf5d415a9c tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.304283 Jun 04 20:57:45.740069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 660/1367] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:57:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:45.749855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5479f0f1-5838-4256-890c-4b3357445ecd req-fa8be785-2003-4f32-9db1-9f257875d7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952e6198-f88b-4266-bc51-a737275da8b2", "name": "network-vif-plugged", "status": "completed", "tag": "0a786854-5e4e-4a5c-9153-816eca07b370"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:45.767710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5479f0f1-5838-4256-890c-4b3357445ecd req-fa8be785-2003-4f32-9db1-9f257875d7c3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:45.769379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5479f0f1-5838-4256-890c-4b3357445ecd req-fa8be785-2003-4f32-9db1-9f257875d7c3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:45.803585 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5479f0f1-5838-4256-890c-4b3357445ecd req-fa8be785-2003-4f32-9db1-9f257875d7c3 service nova] Creating event network-vif-plugged:0a786854-5e4e-4a5c-9153-816eca07b370 for instance 952e6198-f88b-4266-bc51-a737275da8b2 on nch2-master-1 Jun 04 20:57:45.819964 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5479f0f1-5838-4256-890c-4b3357445ecd req-fa8be785-2003-4f32-9db1-9f257875d7c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078336 Jun 04 20:57:45.820618 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 661/1368] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:45.838705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:45.843332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:45.865819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:45.867058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:45.867929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:45.868382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.477010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 733596ac-52ff-421c-8693-fb08a213ca15 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:46.504685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66d003cc-0ed1-44ae-ac7b-ebfb8dfbba47 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 2049 microversion: 2.25 time: 0.677113 Jun 04 20:57:46.508228 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 662/1369] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:45 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 2049 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:46.524885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:46.536179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:46.545271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:46.546051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.547232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:46.548165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.754896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:46.767095 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-604e3963-1541-44f0-b1c6-ed7eda31355c tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 200 len: 1427 microversion: 2.1 time: 0.257292 Jun 04 20:57:46.783569 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 663/1370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:46 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 1427 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:46.795073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:46.795964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:46.806979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:46.807927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.809042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:46.809804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.848786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:46.849975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:46.850785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:46.852383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:46.853020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:46.874914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:46.877547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.880216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:46.881707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:46.908032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:46.916014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Getting quotas for user ac8ef83fa94e4c9db70a0115cc867dfc and project 0aeb9ab07bf8476082d5add829aec29f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:47.054855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:47.078166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b6358b5-f2c7-4f84-93be-b0746120aafa',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:47.159869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:47.181479 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-681f7b8f-3ae0-44a2-ad05-5084249e8df1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1322 microversion: 2.1 time: 0.395811 Jun 04 20:57:47.194301 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 664/1371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:46 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:47.204246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c589a67-367c-4bda-9bca-00973cb9feea tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d022db280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-185058888", "description": "tempest-description-581701694"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:47.471774 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05bfb250-85d5-4d31-b413-f63901a62204 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.074564 Jun 04 20:57:47.478826 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 708/1372] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:57:47.514523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:47.518591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:47.548364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:47.549316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:47.550369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:47.560556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:47.646545 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c589a67-367c-4bda-9bca-00973cb9feea tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.450239 Jun 04 20:57:47.658698 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 665/1373] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:57:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:47.674711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:47.679982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:47.704623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:47.705314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:47.711815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:47.713537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:47.810310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:47.973117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 733596ac-52ff-421c-8693-fb08a213ca15 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:48.005078 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-48fb86d9-fc93-417d-8d5b-38b5fea3c3dd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 2049 microversion: 2.25 time: 0.524550 Jun 04 20:57:48.006065 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 709/1374] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:47 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 2049 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:48.012028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-aed835c6-dae4-4a84-abbf-e142d9c0eb08 req-5c80bfe0-3bbf-4193-bc93-3a7692926f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "035c612b-2d06-4d52-a27d-c917714c1b39", "name": "network-vif-deleted", "tag": "dfeaa60f-c871-4ada-9f0d-e029f1ce9898"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:48.022493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aed835c6-dae4-4a84-abbf-e142d9c0eb08 req-5c80bfe0-3bbf-4193-bc93-3a7692926f4a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:48.023335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aed835c6-dae4-4a84-abbf-e142d9c0eb08 req-5c80bfe0-3bbf-4193-bc93-3a7692926f4a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:48.038547 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-aed835c6-dae4-4a84-abbf-e142d9c0eb08 req-5c80bfe0-3bbf-4193-bc93-3a7692926f4a service nova] Creating event network-vif-deleted:dfeaa60f-c871-4ada-9f0d-e029f1ce9898 for instance 035c612b-2d06-4d52-a27d-c917714c1b39 on nch1-master-1 Jun 04 20:57:48.046682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-aed835c6-dae4-4a84-abbf-e142d9c0eb08 req-5c80bfe0-3bbf-4193-bc93-3a7692926f4a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039096 Jun 04 20:57:48.048044 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 710/1375] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:48.067810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d167b5e5-5444-47c4-984b-fd9adc749d16 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:48.070406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d167b5e5-5444-47c4-984b-fd9adc749d16 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:48.075717 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-56f54a57-c541-4649-874c-8439610b4dec tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 204 len: 0 microversion: 2.1 time: 0.414827 Jun 04 20:57:48.078588 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 666/1376] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:47 2022] DELETE /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:48.095321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:48.097443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 035c612b-2d06-4d52-a27d-c917714c1b39] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:48.115667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:48.118978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:48.120317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:48.121329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:48.147074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d167b5e5-5444-47c4-984b-fd9adc749d16 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:48.149471 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] HTTP exception thrown: Instance 035c612b-2d06-4d52-a27d-c917714c1b39 could not be found. Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Request method failure captured: Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 HTTP/1.1 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8a3mcFoffxwvFsVNp2EDkE3zTOaYKzSNGhmiq95N1h8jESEXBVgp-QU3cui20cIFeYtYj7g4CO2e9tVO-QBzJtQPdHwqux3lrwNaY9Tt-RjWrIEYFp_AB03ZpzBC3sNTnSu6iMmtPt7t_hZxoUeyW5EYyZQxc54zsjs26X7v9qY4Oo Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 9fa1452a653049abab26a782a7d36583 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fa1452a653049abab26a782a7d36583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fa1452a653049abab26a782a7d36583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fa1452a653049abab26a782a7d36583"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fa1452a653049abab26a782a7d36583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 9fa1452a653049abab26a782a7d36583 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersAdminTestJSON-1215860886-project Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 246c32bb6dfc4692beeac1675dd13293 Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersAdminTestJSON-1215860886-project Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 035c612b-2d06-4d52-a27d-c917714c1b39 could not be found. Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '035c612b-2d06-4d52-a27d-c917714c1b39'} Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 035c612b-2d06-4d52-a27d-c917714c1b39 could not be found. Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 035c612b-2d06-4d52-a27d-c917714c1b39 could not be found. Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:48.152574 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 035c612b-2d06-4d52-a27d-c917714c1b39 could not be found. Jun 04 20:57:48.156817 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:48.157263 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d167b5e5-5444-47c4-984b-fd9adc749d16 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1053 microversion: 2.1 time: 0.106893 Jun 04 20:57:48.160544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Returning 404 to user: Instance 035c612b-2d06-4d52-a27d-c917714c1b39 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:48.161650 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c540ddd2-f669-441f-8a26-68917baa98ed tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39" status: 404 len: 111 microversion: 2.1 time: 0.080206 Jun 04 20:57:48.165315 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 667/1377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:48 2022] GET /compute/v2.1/servers/035c612b-2d06-4d52-a27d-c917714c1b39 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:48.167807 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 711/1378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:48 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1053 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:48.171648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bd8f389d-d3c9-4c69-a475-99b45c527c42 req-24816c9b-5152-453b-9625-0939f1ae2350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7907307f-3aab-444e-a6ab-d0988fd26463", "name": "network-vif-plugged", "status": "completed", "tag": "49322108-2953-4067-a051-dd150b181db1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:48.174351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1184173627", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "59a06a30-086d-4d1c-8273-8f8f1dc9656c"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:48.196650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bd8f389d-d3c9-4c69-a475-99b45c527c42 req-24816c9b-5152-453b-9625-0939f1ae2350 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:48.197103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bd8f389d-d3c9-4c69-a475-99b45c527c42 req-24816c9b-5152-453b-9625-0939f1ae2350 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:48.212805 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bd8f389d-d3c9-4c69-a475-99b45c527c42 req-24816c9b-5152-453b-9625-0939f1ae2350 service nova] Creating event network-vif-plugged:49322108-2953-4067-a051-dd150b181db1 for instance 7907307f-3aab-444e-a6ab-d0988fd26463 on nch1-master-1 Jun 04 20:57:48.219865 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bd8f389d-d3c9-4c69-a475-99b45c527c42 req-24816c9b-5152-453b-9625-0939f1ae2350 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055724 Jun 04 20:57:48.221102 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 668/1379] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:48.249789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] validate_networks() for [('59a06a30-086d-4d1c-8273-8f8f1dc9656c', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:48.580082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2147172932", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "d13de28a-5d75-4dd4-a643-af6e82d2a36d"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:48.693800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] validate_networks() for [('d13de28a-5d75-4dd4-a643-af6e82d2a36d', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:57:49.061918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:49.062987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:49.063659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:49.064236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:49.064836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:49.078050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.078912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.080223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.080935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.105722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Getting quotas for project 89428fdfbe7748018280e169ceebc0df. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:49.112383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Getting quotas for user fb5163967e1f4f14b64ed72ffbf64db8 and project 89428fdfbe7748018280e169ceebc0df. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:49.126109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:49.131222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:49.142383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:49.238187 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5cb9d74c-2d8e-45bb-9023-750879230cfe tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.068806 Jun 04 20:57:49.241280 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 712/1380] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:57:49.250597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-76883feb-569e-4c69-99f8-2b8cfd584c42 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:49.254064 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:57:49.254064 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:57:49.256225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76883feb-569e-4c69-99f8-2b8cfd584c42 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.257038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76883feb-569e-4c69-99f8-2b8cfd584c42 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.258127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76883feb-569e-4c69-99f8-2b8cfd584c42 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.258920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76883feb-569e-4c69-99f8-2b8cfd584c42 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.294989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-76883feb-569e-4c69-99f8-2b8cfd584c42 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051125 Jun 04 20:57:49.295990 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 713/1381] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Jun 4 20:57:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:57:49.310643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:49.312721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:49.323170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.323921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.324776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.325226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.384991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:49.385374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:49.385572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:49.386531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:49.387141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:49.405836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.406584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.407749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.408355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.442504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Getting quotas for project 5f72194d8a044e81a3a48e7716a1395f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:49.457701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Getting quotas for user c80f5171e36f498cb2601ae92861a94a and project 5f72194d8a044e81a3a48e7716a1395f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:49.490833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:49.502222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:49.583916 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c78c9676-f256-4d40-815e-06802227ea2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360966 Jun 04 20:57:49.585339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 669/1382] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:57:49.598779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:49.600990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:49.602091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:49.612536 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d4cb14f-53df-445a-872a-ec7e1b81e353 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1512 microversion: 2.1 time: 0.315065 Jun 04 20:57:49.626079 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 714/1383] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:49 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:49.631703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.638682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:49.639835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:49.648878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.649520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.649990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.651080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.651467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.673790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:49.676162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:49.769898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:49.943885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:49.956991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dc294845-c739-4c88-bf37-c20bfacf2142 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1322 microversion: 2.1 time: 0.329759 Jun 04 20:57:49.963296 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 715/1384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:49 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:50.048034 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa40cf66-34bf-478d-b106-f70875ee69bb tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 204 len: 0 microversion: 2.1 time: 0.460932 Jun 04 20:57:50.050127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 670/1385] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:49 2022] DELETE /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:50.064334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:50.069003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:50.078018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.079044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.080948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.081689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.251007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:50.263210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bc7114c1-acf5-46ac-bfc7-43dfce49ee07 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1151 microversion: 2.1 time: 0.208529 Jun 04 20:57:50.264526 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 671/1386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:50 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1151 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:50.270357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:50.271412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:50.281585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.282039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.282944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.283880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.412265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1006727800", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": "none"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:50.531822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:50.533022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:50.533802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:50.534481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:50.535066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:50.562193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.562646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.563445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.563909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.587363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:50.608923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Getting quotas for project cf5eb8af4980464f85c99b9986abf8cb. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:50.612215 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1cb96b8d-9dba-4ecc-a083-189ac3ca62ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1220 microversion: 2.1 time: 0.345971 Jun 04 20:57:50.613211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 672/1387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:50 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1220 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:50.618710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Getting quotas for user 93597ab23b2a41db94d09d78de7659d2 and project cf5eb8af4980464f85c99b9986abf8cb. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:50.626144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:50.627024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:50.644134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.644594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.645401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.646190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.660048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:50.670974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:50.794885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b291d42-e269-4d5d-be5a-11e7c6a2be1d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.830245 Jun 04 20:57:50.804293 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 716/1388] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 20:57:50.828833 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4b51db28-e1df-451c-94b6-61dbeaa222f3 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15/action" status: 202 len: 0 microversion: 2.25 time: 0.210526 Jun 04 20:57:50.829827 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 673/1389] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 20:57:50 2022] POST /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:50.830228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:50.832236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:50.847713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.848575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.853621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.854654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.859100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:50.859976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:50.928480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.932569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:50.937656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:50.938847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.019766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:51.052562 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-955de1ee-9f33-4396-8ac6-29818c336834 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1228 microversion: 2.1 time: 0.245303 Jun 04 20:57:51.060579 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 717/1390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:50 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1228 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:51.088436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:51.089399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:51.111495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.113103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.117803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.127870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.374303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:51.386940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fcf987f1-8dad-433d-852c-440f5e2c651b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 200 len: 1470 microversion: 2.1 time: 0.324757 Jun 04 20:57:51.391946 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 718/1391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:51 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:51.489537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:51.507898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-596dca5a-6e5c-4e2a-836b-3769dabd9a29 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1468 microversion: 2.1 time: 0.672888 Jun 04 20:57:51.511325 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 674/1392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:50 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1468 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:51.526528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c26790a3-6f7a-40e9-bd9a-2fa5b445bab3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:51.531424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c26790a3-6f7a-40e9-bd9a-2fa5b445bab3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:51.633072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-977dd4d4-ca7b-4130-913e-17acbedbf485 req-07858b91-f16e-40de-b623-0daebe0b4a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c140f60-4608-4471-a143-948533f3a13d", "name": "network-vif-deleted", "tag": "3c879740-9690-49ef-90a5-918fe0f2877c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:51.651396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-977dd4d4-ca7b-4130-913e-17acbedbf485 req-07858b91-f16e-40de-b623-0daebe0b4a92 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.654764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-977dd4d4-ca7b-4130-913e-17acbedbf485 req-07858b91-f16e-40de-b623-0daebe0b4a92 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.682898 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-977dd4d4-ca7b-4130-913e-17acbedbf485 req-07858b91-f16e-40de-b623-0daebe0b4a92 service nova] Creating event network-vif-deleted:3c879740-9690-49ef-90a5-918fe0f2877c for instance 6c140f60-4608-4471-a143-948533f3a13d on nch2-master-1 Jun 04 20:57:51.695478 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-977dd4d4-ca7b-4130-913e-17acbedbf485 req-07858b91-f16e-40de-b623-0daebe0b4a92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299728 Jun 04 20:57:51.696902 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 719/1393] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:51.702462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:51.703438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:51.705560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c26790a3-6f7a-40e9-bd9a-2fa5b445bab3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:51.714031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c26790a3-6f7a-40e9-bd9a-2fa5b445bab3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:51.715705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.715848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c26790a3-6f7a-40e9-bd9a-2fa5b445bab3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:51.716251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.719173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.720838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.731738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c26790a3-6f7a-40e9-bd9a-2fa5b445bab3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4" status: 200 len: 1278 microversion: 2.47 time: 0.216488 Jun 04 20:57:51.732355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 675/1394] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:51 2022] GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:51.771209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:51.771907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:51.803685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.804675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.806011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:51.806559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:51.824204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:52.108518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 733596ac-52ff-421c-8693-fb08a213ca15 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:52.157657 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9bf807b0-707e-4fbc-b071-1c9b76c9578c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 2034 microversion: 2.25 time: 0.457193 Jun 04 20:57:52.158645 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 720/1395] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:51 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 2034 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:52.170043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:52.170621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:52.193575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.194315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.197028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.197659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.345673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:52.372682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:52.394353 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-524f5a2c-cbe2-4d5e-bc10-3c927d148519 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1169 microversion: 2.1 time: 0.234495 Jun 04 20:57:52.396242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db5f8ca1-ffb6-4add-8748-22402a5097a8 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1516 microversion: 2.1 time: 0.637023 Jun 04 20:57:52.400368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 721/1396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:52 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1169 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:52.408741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:52.413836 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 676/1397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:51 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1516 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:52.414425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:52.430806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.432273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.433763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.435189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.437590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-229896267", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": "none"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:52.459685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:52.578805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:52.579688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:52.580291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:52.580758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:52.581452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:52.600774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:52.613137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37f14c64-5790-42f6-af12-35f87e154972 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1286 microversion: 2.1 time: 0.207456 Jun 04 20:57:52.613842 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 722/1398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:52 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:52.623868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.626468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.627493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.627970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.629972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:52.631412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:52.649138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.661448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.666905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.668618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.694478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Getting quotas for project cf5eb8af4980464f85c99b9986abf8cb. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:57:52.712468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Getting quotas for user 93597ab23b2a41db94d09d78de7659d2 and project cf5eb8af4980464f85c99b9986abf8cb. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:57:52.763134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:57:52.767115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:57:52.815217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:52.824467 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fe92328e-edf3-4344-b856-5ebf9e98d476 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1284 microversion: 2.1 time: 0.207227 Jun 04 20:57:52.828441 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 723/1399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:52 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:52.837410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:52.841084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:52.853786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.854693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.855848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:52.856533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:52.928762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'flavor' on Instance uuid 733596ac-52ff-421c-8693-fb08a213ca15 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:52.939340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:52.961583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Going to try to live migrate instance to nch1-master-1 {{(pid=137228) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:57:52.969790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5832d959-c49b-46a7-9624-aef1796f3fb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.552284 Jun 04 20:57:52.970471 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 677/1400] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 20:57:53.000800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:53.001431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 6c140f60-4608-4471-a143-948533f3a13d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:53.062440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:53.062889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:53.073143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:53.073982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:53.118167 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] HTTP exception thrown: Instance 6c140f60-4608-4471-a143-948533f3a13d could not be found. Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Request method failure captured: Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d HTTP/1.1 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8avOD1P9Pu3mIUG5LD4cMsGTS-9CxTFNbHmp9N_jLN9sSHoMTWPXXhXVISxrzekNhqnABBVjxWrS-KfJdB7H2NlNTQptdqdGPELiV1aHChSeS9V6j6aKvZRtoG1xSB2icnzfERjWYiB9RkhQVpMwLSLBHVRGN_zKcFpH0g2Zpvfjqc Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a23b90f117684cff9d0ffccf630d8307 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesAdminNegativeTest-685027402 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesAdminNegativeTest-685027402 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a23b90f117684cff9d0ffccf630d8307 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-685027402 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesAdminNegativeTest-685027402-project Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 71d29871def3409f89efcda0e82a4ad3 Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesAdminNegativeTest-685027402-project Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 6c140f60-4608-4471-a143-948533f3a13d could not be found. Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6c140f60-4608-4471-a143-948533f3a13d'} Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c140f60-4608-4471-a143-948533f3a13d could not be found. Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c140f60-4608-4471-a143-948533f3a13d could not be found. Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:53.120026 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c140f60-4608-4471-a143-948533f3a13d could not be found. Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Returning 404 to user: Instance 6c140f60-4608-4471-a143-948533f3a13d could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:53.125581 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6233adc5-7d77-4e4e-b484-4409ff393575 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d" status: 404 len: 111 microversion: 2.1 time: 0.147106 Jun 04 20:57:53.131334 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 678/1401] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:52 2022] GET /compute/v2.1/servers/6c140f60-4608-4471-a143-948533f3a13d => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:53.153256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:53.156776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:53.179894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:53.180567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:53.182728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:53.187031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:53.273470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'flavor' on Instance uuid 7907307f-3aab-444e-a6ab-d0988fd26463 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:57:53.711893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac6d5630-77a3-44e1-947a-ae14677f0b7d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action" status: 200 len: 32 microversion: 2.1 time: 0.575705 Jun 04 20:57:53.721438 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 679/1402] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:57:53 2022] POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action => generated 32 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:57:53.740711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:53.742670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:53.760000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:53.761758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:53.762924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:53.765640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:53.933757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:53.963210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ec38263-3aaf-4000-b8e1-f4016ed53d22 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 200 len: 1426 microversion: 2.1 time: 0.226317 Jun 04 20:57:53.965723 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 680/1403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:53 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 1426 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:53.977882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0e2c464-9939-4d91-a247-d380885990f8 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:53.993174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0e2c464-9939-4d91-a247-d380885990f8 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:54.131098 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0e2c464-9939-4d91-a247-d380885990f8 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "PUT /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 991 microversion: 2.47 time: 0.158869 Jun 04 20:57:54.136485 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 681/1404] 10.222.0.18 () {62 vars in 1296 bytes} [Sat Jun 4 20:57:53 2022] PUT /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 991 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:57:54.159484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:54.162046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:54.190302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:54.190750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:54.191559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:54.192001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:54.667051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:54.677370 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a59b236c-bab2-4c6e-8268-c139d6a5b707 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.539435 Jun 04 20:57:54.677972 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 682/1405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:54 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:54.685534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:54.686485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:54.703272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:54.704058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:54.705117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:54.706131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:54.821380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:54.831477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3e74239-3e4b-4b8b-972b-acdb4ceeac68 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1274 microversion: 2.1 time: 0.152209 Jun 04 20:57:54.842512 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 683/1406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:54 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:54.848603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:54.849556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:54.858076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:54.860124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:54.861316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:54.862141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.074273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:55.084048 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0af79358-90e9-4bd4-9924-706b510c4067 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.239579 Jun 04 20:57:55.084777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 684/1407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:54 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:55.094359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:55.095382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:55.103177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.103857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.105048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.105730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.227411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:55.249089 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-539cfe89-6573-432c-8a7d-a29b774e5ce8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1282 microversion: 2.1 time: 0.162955 Jun 04 20:57:55.262026 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 685/1408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:55 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:55.268803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8a5aacda-79ca-4c7b-805a-787c38a7dbc3 req-531c2365-d077-4c3c-bd6e-e791e961cf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d253f1-151b-4060-b7c3-d197cda87dc1", "name": "network-vif-deleted", "tag": "7459fa5e-384a-47b2-90a4-9184bda4ea84"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:55.279963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8a5aacda-79ca-4c7b-805a-787c38a7dbc3 req-531c2365-d077-4c3c-bd6e-e791e961cf42 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.280409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8a5aacda-79ca-4c7b-805a-787c38a7dbc3 req-531c2365-d077-4c3c-bd6e-e791e961cf42 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.295173 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8a5aacda-79ca-4c7b-805a-787c38a7dbc3 req-531c2365-d077-4c3c-bd6e-e791e961cf42 service nova] Creating event network-vif-deleted:7459fa5e-384a-47b2-90a4-9184bda4ea84 for instance b7d253f1-151b-4060-b7c3-d197cda87dc1 on nch2-master-1 Jun 04 20:57:55.301419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8a5aacda-79ca-4c7b-805a-787c38a7dbc3 req-531c2365-d077-4c3c-bd6e-e791e961cf42 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037522 Jun 04 20:57:55.302310 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 686/1409] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:55.309893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:55.310705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:55.324513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.325401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.326556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.327053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.498676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:55.515002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:55.517076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:55.518144 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8c817b6-64f3-45ce-976e-918afe544463 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1337 microversion: 2.47 time: 0.214465 Jun 04 20:57:55.518716 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 687/1410] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:55 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1337 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:55.524589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:55.525392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:55.545851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.546750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.547838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.548583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.621862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:55.744630 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-13a79c27-f9bc-46a7-8331-8e97ade22c97 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 204 len: 0 microversion: 2.1 time: 0.224232 Jun 04 20:57:55.746770 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 688/1411] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:55 2022] DELETE /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:55.756005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:55.756786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: b7d253f1-151b-4060-b7c3-d197cda87dc1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:55.764699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.764897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.766349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.766349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.782028 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] HTTP exception thrown: Instance b7d253f1-151b-4060-b7c3-d197cda87dc1 could not be found. Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Request method failure captured: Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 HTTP/1.1 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8a3mcFoffxwvFsVNp2EDkE3zTOaYKzSNGhmiq95N1h8jESEXBVgp-QU3cui20cIFeYtYj7g4CO2e9tVO-QBzJtQPdHwqux3lrwNaY9Tt-RjWrIEYFp_AB03ZpzBC3sNTnSu6iMmtPt7t_hZxoUeyW5EYyZQxc54zsjs26X7v9qY4Oo Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 9fa1452a653049abab26a782a7d36583 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fa1452a653049abab26a782a7d36583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fa1452a653049abab26a782a7d36583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fa1452a653049abab26a782a7d36583"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fa1452a653049abab26a782a7d36583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 9fa1452a653049abab26a782a7d36583 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersAdminTestJSON-1215860886-project Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 246c32bb6dfc4692beeac1675dd13293 Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersAdminTestJSON-1215860886-project Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b7d253f1-151b-4060-b7c3-d197cda87dc1 could not be found. Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b7d253f1-151b-4060-b7c3-d197cda87dc1'} Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d253f1-151b-4060-b7c3-d197cda87dc1 could not be found. Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d253f1-151b-4060-b7c3-d197cda87dc1 could not be found. Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:57:55.784232 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d253f1-151b-4060-b7c3-d197cda87dc1 could not be found. Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Returning 404 to user: Instance b7d253f1-151b-4060-b7c3-d197cda87dc1 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc7aadd6-5549-4a55-81a7-7125d043e983 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1" status: 404 len: 111 microversion: 2.1 time: 0.037959 Jun 04 20:57:55.789532 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 689/1412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:55 2022] GET /compute/v2.1/servers/b7d253f1-151b-4060-b7c3-d197cda87dc1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:57:55.852570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8d194965-c504-4e95-84c6-f58835e3539a req-ba20b03c-6857-41ca-9c73-96499ce0bf75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1a9e76-c12d-438e-94a5-391bf478dd9f", "tag": "d9de457e-c9e8-46f6-be69-d7586ca79501"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:55.861616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8d194965-c504-4e95-84c6-f58835e3539a req-ba20b03c-6857-41ca-9c73-96499ce0bf75 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.862063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8d194965-c504-4e95-84c6-f58835e3539a req-ba20b03c-6857-41ca-9c73-96499ce0bf75 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.874604 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8d194965-c504-4e95-84c6-f58835e3539a req-ba20b03c-6857-41ca-9c73-96499ce0bf75 service nova] Creating event network-changed:d9de457e-c9e8-46f6-be69-d7586ca79501 for instance db1a9e76-c12d-438e-94a5-391bf478dd9f on nch1-master-1 Jun 04 20:57:55.879848 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8d194965-c504-4e95-84c6-f58835e3539a req-ba20b03c-6857-41ca-9c73-96499ce0bf75 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092432 Jun 04 20:57:55.880432 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 690/1413] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:55.885708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:55.886425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:55.893073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.893527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:55.894327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:55.894791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.392175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:56.400705 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c76e7f86-00b6-401f-b0a4-161b246d8257 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.518947 Jun 04 20:57:56.401303 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 691/1414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:55 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:56.413085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:56.413761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:56.421376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.421829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.422613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.423045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.599289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:56.607871 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-21a363d5-9bd6-417f-b6df-16d32f4b9def tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1679 microversion: 2.1 time: 0.204582 Jun 04 20:57:56.608488 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 692/1415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:56 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:56.620784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:56.621301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:56.628659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.629122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.629931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.630376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.650843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:56.660544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:57:56.755046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e040fdb6-ac13-4d21-b52d-8886eace681a tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "DELETE /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 204 len: 0 microversion: 2.1 time: 0.145052 Jun 04 20:57:56.755745 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 693/1416] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:57:56 2022] DELETE /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:57:56.762986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:56.763757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:56.771172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.772609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.773678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.774109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.934111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:56.942713 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cef643b9-9b91-4f85-a331-67187770eaf1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.185695 Jun 04 20:57:56.943543 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 694/1417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:56 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:56.953156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:56.953954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:56.961640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.962233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:56.963140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:56.963654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.122847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.133623 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d8e9f84-d711-415a-832f-e43138c7292c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.188075 Jun 04 20:57:57.134322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 695/1418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:56 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:57.139057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:57.139692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:57.150493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.151074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.151998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.152566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.304250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.324039 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f3e1008-e73e-42e4-a82e-115746a7c629 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.188143 Jun 04 20:57:57.334282 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 696/1419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:57 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:57.339569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:57.340209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:57.355107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.356383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.363458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.363458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.452226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.461972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.463477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.464852 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3790a46-a282-43db-8855-c3c6abc0303e tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1335 microversion: 2.47 time: 0.129370 Jun 04 20:57:57.465400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 697/1420] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:57 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:57.470360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:57.470980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:57.479301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.480090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.481023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.481461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.645463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.654263 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a1c166f-74c7-43d8-a1b2-0d30566896f4 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1469 microversion: 2.1 time: 0.187811 Jun 04 20:57:57.654854 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 698/1421] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:57 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:57.659682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c2e8cf3a-4661-4e2f-a223-b1ed8e9bb57f req-178b6be2-b657-409f-9255-09f2457dde1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:57.668413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c2e8cf3a-4661-4e2f-a223-b1ed8e9bb57f req-178b6be2-b657-409f-9255-09f2457dde1a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.668864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c2e8cf3a-4661-4e2f-a223-b1ed8e9bb57f req-178b6be2-b657-409f-9255-09f2457dde1a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.682202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c2e8cf3a-4661-4e2f-a223-b1ed8e9bb57f req-178b6be2-b657-409f-9255-09f2457dde1a service nova] Creating event network-changed:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:57:57.687696 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c2e8cf3a-4661-4e2f-a223-b1ed8e9bb57f req-178b6be2-b657-409f-9255-09f2457dde1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031393 Jun 04 20:57:57.688320 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 699/1422] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:57:57.694123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:57.694840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:57.702738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.703298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.704166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.704611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.855341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:57.863999 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5dc1f398-1552-4937-a0ca-46af1f36d7ab tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.174206 Jun 04 20:57:57.864615 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 700/1423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:57 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:57.869810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:57.870476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:57.877066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.877716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:57.878518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:57.878922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.074235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.082896 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85f22bc0-fc1d-4290-9623-b7758862cc45 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1679 microversion: 2.1 time: 0.217225 Jun 04 20:57:58.083499 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 701/1424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:57 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:58.088153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:58.088743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:58.096150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.096612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.097399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.097832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.243153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.252237 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d8278ed4-18f0-45a6-8529-810d58cac27a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.167607 Jun 04 20:57:58.253049 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 702/1425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:58 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:58.257798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:58.258413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:58.265484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.266000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.266765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.267196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.415338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.424141 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74209867-c93e-4d26-8e78-b6758daaf1c0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.170248 Jun 04 20:57:58.424732 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 703/1426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:58 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:58.429225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:58.429902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:58.438147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.438542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.439327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.439789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.590545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.599484 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-707965dd-87fc-46ac-822a-605cad61e597 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.173659 Jun 04 20:57:58.600269 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 704/1427] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:58 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:58.605231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:58.605858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:58.612636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.613090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.613889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.614333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.687638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.696273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.697714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.699026 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-99fe29ed-431f-445c-8a0d-7d9071975797 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1356 microversion: 2.47 time: 0.097798 Jun 04 20:57:58.699649 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 705/1428] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:58 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:58.704434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:58.705067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:58.712566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.713285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.713840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.714635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.869324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:58.878058 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-602eccf4-906c-42b2-9d00-a6cb1b43c926 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1469 microversion: 2.1 time: 0.177302 Jun 04 20:57:58.878669 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 706/1429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:58 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:58.885019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:57:58.886899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:58.894724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.895225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.896518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:58.896991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:58.980002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:57:58.980403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:57:58.980876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:57:58.981279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:57:58.981688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:57:59.032149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:59.049836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:59.057487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.057965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.058869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.059316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.090364 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5fe2e08-defe-4056-b6f7-fa0adb907a3d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "POST /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804/action" status: 202 len: 1078 microversion: 2.47 time: 0.209614 Jun 04 20:57:59.091348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 707/1430] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 20:57:58 2022] POST /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804/action => generated 1078 bytes in 212 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 04 20:57:59.096725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:59.097343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:59.108373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.108813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.109641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.110098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.255429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:59.263942 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1efadedf-6036-4821-ac9f-c2d28e532ecc tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.171496 Jun 04 20:57:59.264760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 708/1431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:59 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:59.269868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:59.270486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:59.273831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:59.278671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.279131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.280015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.280433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.433624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:59.441642 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-80895939-11cd-41c0-8cf9-68aed9fc1c2b tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1679 microversion: 2.1 time: 0.175923 Jun 04 20:57:59.442255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 709/1432] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:59 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:59.446716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:59.447312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:59.454045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.454504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.455316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.455824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.528890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:59.537655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:59.539202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:59.540445 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5318739-33a9-48cc-9cca-9be6adc8a70a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.097296 Jun 04 20:57:59.541018 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 710/1433] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:57:59 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:57:59.546678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:59.547304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:59.554142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.554622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.555473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.555936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.733660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:57:59.743227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9759184b-9fcb-42b3-8f06-5eaafeabb7ac tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.201060 Jun 04 20:57:59.746659 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 711/1434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:59 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:57:59.752847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:57:59.753827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:57:59.761634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.762096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:57:59.762964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:57:59.763338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.269519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:00.280731 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-245d05bf-1b40-44da-a46a-5906316c5e69 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.531999 Jun 04 20:58:00.282153 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 712/1435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:57:59 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:00.287079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:00.288300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:00.295567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.296624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.297909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.297909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.583690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:00.637476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:00.646788 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83526a52-704d-4fc2-9191-9de5d916d055 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.363121 Jun 04 20:58:00.648067 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 713/1436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:00 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:00.653284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-f92ae9ba-c0d8-42f3-a4fe-808d8e862752 req-40b95e10-9944-458a-9061-335df01cab4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22dde75e-3edf-4266-9c1b-698d37dbd5e3", "tag": "8eaa5fdb-e707-4814-be8f-863044de9255"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:00.659337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=20 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:00.663686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f92ae9ba-c0d8-42f3-a4fe-808d8e862752 req-40b95e10-9944-458a-9061-335df01cab4c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.664400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f92ae9ba-c0d8-42f3-a4fe-808d8e862752 req-40b95e10-9944-458a-9061-335df01cab4c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.677987 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-f92ae9ba-c0d8-42f3-a4fe-808d8e862752 req-40b95e10-9944-458a-9061-335df01cab4c service nova] Creating event network-changed:8eaa5fdb-e707-4814-be8f-863044de9255 for instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 on nch1-master-1 Jun 04 20:58:00.683764 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b83eec8-a712-43c0-b640-94ea1e89ae6b tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15/action" status: 202 len: 0 microversion: 2.25 time: 7.853888 Jun 04 20:58:00.684133 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-f92ae9ba-c0d8-42f3-a4fe-808d8e862752 req-40b95e10-9944-458a-9061-335df01cab4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 Jun 04 20:58:00.685258 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 724/1437] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 20:57:52 2022] POST /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15/action => generated 0 bytes in 7856 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:58:00.687258 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 714/1438] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:00.694588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:00.694861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:00.695831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:00.696192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:00.705959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.713009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.714429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.714889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.715108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.715832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:00.717349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:00.718208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.057993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.069381 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b9720300-b615-4ec3-953b-d3dfc375e474 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.380546 Jun 04 20:58:01.091703 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 715/1439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:00 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:01.109952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:01.115829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:01.124937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.130891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.132647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.133430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.188012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.197720 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f3b6399e-819e-412e-8438-1bd969458367 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1469 microversion: 2.1 time: 0.510996 Jun 04 20:58:01.199553 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 725/1440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:00 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1469 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:01.205362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:01.208957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:01.219308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.220256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.221800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.222485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.472603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.498769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.504155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.508931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d387f01-ab00-489d-be30-79b3f2c70624 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.304829 Jun 04 20:58:01.510021 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 726/1441] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:01 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:01.524806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:01.525538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:01.532528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.535573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.536419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.537759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.538288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.543003 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da2d29bf-add9-426c-973b-b3221c38b397 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1679 microversion: 2.1 time: 0.449588 Jun 04 20:58:01.544933 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 716/1442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:01 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1679 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:01.549846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:01.550688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:01.566708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.567658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.568884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.569672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.775027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.782227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.795107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.797926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1246b8f8-a6ab-421f-8af0-6b28d6ddaf0b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.251874 Jun 04 20:58:01.809285 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 717/1443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:01 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:01.815695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:01.817338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4d240df6-b6e4-4264-b493-f0afe8bb1dc2 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.305834 Jun 04 20:58:01.817564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8ed34f49-36fe-4708-8779-32e0e46e0f6e req-2344b274-cee5-40a5-99b6-ac5ac433bd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b7274-0065-4e26-806c-ec0195ff3260", "name": "network-vif-deleted", "tag": "fd3b3002-f94c-4b04-91e9-89077c505952"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:01.831613 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 727/1444] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:01 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:01.832043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8ed34f49-36fe-4708-8779-32e0e46e0f6e req-2344b274-cee5-40a5-99b6-ac5ac433bd5b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.832043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8ed34f49-36fe-4708-8779-32e0e46e0f6e req-2344b274-cee5-40a5-99b6-ac5ac433bd5b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.841835 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8ed34f49-36fe-4708-8779-32e0e46e0f6e req-2344b274-cee5-40a5-99b6-ac5ac433bd5b service nova] Creating event network-vif-deleted:fd3b3002-f94c-4b04-91e9-89077c505952 for instance 224b7274-0065-4e26-806c-ec0195ff3260 on nch1-master-1 Jun 04 20:58:01.847578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:01.848227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:01.851240 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8ed34f49-36fe-4708-8779-32e0e46e0f6e req-2344b274-cee5-40a5-99b6-ac5ac433bd5b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Jun 04 20:58:01.852258 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 718/1445] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:01.856746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.857218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.858080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.858490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.859325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:01.860140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:01.867811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.868363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:01.869275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:01.869806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.078811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.089782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e728ab0f-099d-46fe-883f-d3b7a31eafc9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.266181 Jun 04 20:58:02.090505 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 728/1446] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:01 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:02.095825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:02.096702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:02.103879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.104996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.106560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.107214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.118683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.137401 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-51dd6e76-7ed9-45b8-b63c-123dc0366083 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.282305 Jun 04 20:58:02.139009 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 719/1447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:01 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:02.217075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:02.217812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:02.225015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.225553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.226431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.226931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.285625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.296770 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dbaffd67-0a5d-4637-9015-d689f4af82da tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.204888 Jun 04 20:58:02.308939 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 729/1448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:02 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:02.366582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246c32bb6dfc4692beeac1675dd13293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa1452a653049abab26a782a7d36583', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.398508 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63f92704-7f3f-455b-91f5-f4c04f7105b8 tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 200 len: 1298 microversion: 2.1 time: 0.184894 Jun 04 20:58:02.400568 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 720/1449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:02 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 1298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:58:02.533957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:02.535018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:02.549852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.549852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.549852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.550482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.564954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:02.566717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:02.590745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.593546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.596517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.597614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.644745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.645495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.646403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lazy-loading 'fault' on Instance uuid 0d54c244-5d4f-4346-a5d9-83eea81ff576 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:02.666857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.680017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:02.692511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.697310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.700278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:02.700748 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da9f58c8-2172-41ab-b706-36551f08e30c tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.174447 Jun 04 20:58:02.703021 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 730/1450] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:02 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:02.720900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e10588a4-829e-41fd-aa25-e2cd548a2658 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1331 microversion: 2.1 time: 0.162229 Jun 04 20:58:02.722621 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 721/1451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:02 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1331 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:02.816445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:02.817082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:02.832145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.832896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.834344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.835078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.843631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:02.844591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:02.847256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:02.864237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.864688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:02.865517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:02.866551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.169873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.175264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.188304 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a7bb870-9ef0-44b7-aae3-e269091a9000 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.375606 Jun 04 20:58:03.191890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.193269 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 731/1452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:02 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:03.196322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.197742 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78cb0153-47b5-46ca-8f94-e71207c8cbc3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.358480 Jun 04 20:58:03.201960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-175ef386-be3b-40b5-b04c-f5b6ec0b9cbb req-d3165fcf-d066-4ac3-9f75-22dfe159cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d54c244-5d4f-4346-a5d9-83eea81ff576", "name": "network-vif-deleted", "tag": "3443b767-f8e9-4dca-b30b-375569064aa6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:03.203861 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 722/1453] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:02 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:58:03.242174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:03.246877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:03.257246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-175ef386-be3b-40b5-b04c-f5b6ec0b9cbb req-d3165fcf-d066-4ac3-9f75-22dfe159cbb4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.258103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-175ef386-be3b-40b5-b04c-f5b6ec0b9cbb req-d3165fcf-d066-4ac3-9f75-22dfe159cbb4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.258517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.259077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.259913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.260420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.309911 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-175ef386-be3b-40b5-b04c-f5b6ec0b9cbb req-d3165fcf-d066-4ac3-9f75-22dfe159cbb4 service nova] Creating event network-vif-deleted:3443b767-f8e9-4dca-b30b-375569064aa6 for instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 on nch1-master-1 Jun 04 20:58:03.325227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-175ef386-be3b-40b5-b04c-f5b6ec0b9cbb req-d3165fcf-d066-4ac3-9f75-22dfe159cbb4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130595 Jun 04 20:58:03.326160 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 732/1454] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:03.335226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:03.336250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:03.344053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.344805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.345875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.346315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.551143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.558781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.559685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87eda241-f45b-4d9f-865e-22ae102d4f43 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.333463 Jun 04 20:58:03.560297 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 723/1455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:03 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:03.564985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:03.566111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:03.566959 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-321b5804-5e53-424d-b711-441d4476de2e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.236498 Jun 04 20:58:03.568403 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 733/1456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:03 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:03.572130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.572666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.573796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.573914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:03.574539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] [instance: 224b7274-0065-4e26-806c-ec0195ff3260] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:03.574693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.581121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.581573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.582360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.582798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.597677 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] HTTP exception thrown: Instance 224b7274-0065-4e26-806c-ec0195ff3260 could not be found. Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Request method failure captured: Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 HTTP/1.1 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8a3mcFoffxwvFsVNp2EDkE3zTOaYKzSNGhmiq95N1h8jESEXBVgp-QU3cui20cIFeYtYj7g4CO2e9tVO-QBzJtQPdHwqux3lrwNaY9Tt-RjWrIEYFp_AB03ZpzBC3sNTnSu6iMmtPt7t_hZxoUeyW5EYyZQxc54zsjs26X7v9qY4Oo Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 9fa1452a653049abab26a782a7d36583 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9fa1452a653049abab26a782a7d36583"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fa1452a653049abab26a782a7d36583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9fa1452a653049abab26a782a7d36583"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9fa1452a653049abab26a782a7d36583"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 9fa1452a653049abab26a782a7d36583 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminTestJSON-1215860886 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminTestJSON-1215860886-project Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 246c32bb6dfc4692beeac1675dd13293 Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminTestJSON-1215860886-project Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 224b7274-0065-4e26-806c-ec0195ff3260 could not be found. Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '224b7274-0065-4e26-806c-ec0195ff3260'} Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 224b7274-0065-4e26-806c-ec0195ff3260 could not be found. Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 224b7274-0065-4e26-806c-ec0195ff3260 could not be found. Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:03.599405 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 224b7274-0065-4e26-806c-ec0195ff3260 could not be found. Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] Returning 404 to user: Instance 224b7274-0065-4e26-806c-ec0195ff3260 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8cc1f968-e9d3-4216-9f08-76662caff9ff tempest-ServersAdminTestJSON-1215860886 tempest-ServersAdminTestJSON-1215860886-project] 10.222.0.18 "GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260" status: 404 len: 111 microversion: 2.1 time: 0.031528 Jun 04 20:58:03.603610 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 734/1457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:03 2022] GET /compute/v2.1/servers/224b7274-0065-4e26-806c-ec0195ff3260 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:03.721594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:03.722191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:03.729746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.730184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.731233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.731789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.732614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.738897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:03.748016 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8beea60d-a146-4e48-9f0c-3844f8228d6d tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.186260 Jun 04 20:58:03.749152 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 724/1458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:03 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:03.760730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:03.762000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:03.769611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.770073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.771205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.771998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.801679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.809346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:03.809799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:03.810268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lazy-loading 'fault' on Instance uuid 0d54c244-5d4f-4346-a5d9-83eea81ff576 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:03.811552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.813306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.814482 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4064fd57-b647-4872-8e3f-6eee0495c11b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.096802 Jun 04 20:58:03.815802 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 735/1459] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:03 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:58:03.853663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71d29871def3409f89efcda0e82a4ad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23b90f117684cff9d0ffccf630d8307', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:03.866916 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34f05cbe-eb3f-46ec-bf9d-cbbcdd9d387a tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 200 len: 1331 microversion: 2.1 time: 0.115870 Jun 04 20:58:03.871638 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 725/1460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:03 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:04.214724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:04.220670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:04.226292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:04.227277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:04.236705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.238746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.239486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.240633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.240761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.241419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.243644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.244303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.545478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:04.546776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:04.554274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:04.556081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:04.558069 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a760a60-86d9-471b-bab0-ad00d6988e57 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.339674 Jun 04 20:58:04.559299 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 726/1461] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:04 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 20:58:04.569892 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1657e4fe-5a53-48fe-a98f-23d0062a9a0f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.349586 Jun 04 20:58:04.569892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 736/1462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:04 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:04.578544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:04.579357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:04.586592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:04.587222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:04.587772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.588231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.589197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.589710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.595359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.595359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.596087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.596534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.856238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:04.860921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:04.865176 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19eb3a2d-3752-4626-8501-44150f4ffa38 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.282362 Jun 04 20:58:04.865815 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 737/1463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:04 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:58:04.870956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:04.872021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:04.874456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef6b4986-b620-4f62-85cc-55c9ee05c66a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.300694 Jun 04 20:58:04.875411 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 727/1464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:04 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:04.884225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.884771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.885655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.886047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.888112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:04.888909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:04.896212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.896703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.897682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:04.898104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:04.990091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.003874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.005457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.006926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-851cab41-e285-486a-9637-91d53b17e023 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.130319 Jun 04 20:58:05.007569 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 728/1465] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:04 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:05.013778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:05.014731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] [instance: 0d54c244-5d4f-4346-a5d9-83eea81ff576] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:05.022134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.022590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.023391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.023936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.041053 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] HTTP exception thrown: Instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 could not be found. Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Request method failure captured: Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 HTTP/1.1 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8avOD1P9Pu3mIUG5LD4cMsGTS-9CxTFNbHmp9N_jLN9sSHoMTWPXXhXVISxrzekNhqnABBVjxWrS-KfJdB7H2NlNTQptdqdGPELiV1aHChSeS9V6j6aKvZRtoG1xSB2icnzfERjWYiB9RkhQVpMwLSLBHVRGN_zKcFpH0g2Zpvfjqc Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: a23b90f117684cff9d0ffccf630d8307 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesAdminNegativeTest-685027402 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a23b90f117684cff9d0ffccf630d8307"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesAdminNegativeTest-685027402 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: a23b90f117684cff9d0ffccf630d8307 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-685027402 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesAdminNegativeTest-685027402-project Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 71d29871def3409f89efcda0e82a4ad3 Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesAdminNegativeTest-685027402-project Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 could not be found. Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '0d54c244-5d4f-4346-a5d9-83eea81ff576'} Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 could not be found. Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 could not be found. Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:05.043540 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 could not be found. Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Returning 404 to user: Instance 0d54c244-5d4f-4346-a5d9-83eea81ff576 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68a23983-9abd-4d9f-af44-9d6672099b31 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576" status: 404 len: 111 microversion: 2.1 time: 0.036227 Jun 04 20:58:05.047874 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 729/1466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:05 2022] GET /compute/v2.1/servers/0d54c244-5d4f-4346-a5d9-83eea81ff576 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:05.054277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a542113-0d97-4814-83a4-e0726378d596 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] Calling method '.version_select at 0x7f2d0bf5b9d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:05.078333 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a542113-0d97-4814-83a4-e0726378d596 tempest-VolumesAdminNegativeTest-685027402 tempest-VolumesAdminNegativeTest-685027402-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629363586" status: 202 len: 0 microversion: 2.1 time: 0.027768 Jun 04 20:58:05.078928 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 730/1467] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 20:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629363586 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:05.096208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.106457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d0a492e-f92f-40ce-9898-2d810dec27c5 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.239336 Jun 04 20:58:05.107097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 738/1468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:04 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:05.580905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:05.582314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:05.584839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:05.585609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:05.591446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.592610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.593867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.594568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.595933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.596394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.597204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.597654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.875049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.891142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.891653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.892712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:05.894043 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50f1e68b-26de-4d08-9679-276739648fb9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.319198 Jun 04 20:58:05.896692 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 731/1469] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:05 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:05.901824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:05.902680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:05.915725 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54d6232d-1f3f-4452-a5c7-2f1266bbd1ab tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.338456 Jun 04 20:58:05.916543 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 739/1470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:05 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:05.928633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:05.930465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.930914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.932581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.932581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.933675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:05.942030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.944333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:05.945570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:05.946828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.204090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:06.218347 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a4f75316-b832-4b4b-94be-736a3c3f83b2 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.320311 Jun 04 20:58:06.219287 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 732/1471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:05 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:06.224189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:06.224807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:06.241634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:06.244086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:06.250896 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0023ce13-08f3-4ce2-877e-fef9761c1ab6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.333475 Jun 04 20:58:06.251432 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 740/1472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:05 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:06.256114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.256612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.257440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.257870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.260172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:06.268410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:06.287264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.287760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.288571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.289009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.328180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:06.337677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:06.339257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:06.341435 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5c32e17-8434-460c-8420-bf460254e617 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.121135 Jun 04 20:58:06.342252 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 733/1473] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:06 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:06.536778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:06.548144 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f532536e-e52d-4b9e-ae21-28545938a0a0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.295547 Jun 04 20:58:06.549578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 741/1474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:06 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:06.562444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-90f2fcb3-020c-44b9-83f3-c64ce04ab8d0 req-079f74de-c31c-454a-975b-762bf83251c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "733596ac-52ff-421c-8693-fb08a213ca15", "name": "network-vif-unplugged", "status": "completed", "tag": "3af2fa06-745e-409f-9676-ffd6b6ffa5ca"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:06.577762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-90f2fcb3-020c-44b9-83f3-c64ce04ab8d0 req-079f74de-c31c-454a-975b-762bf83251c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.578210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-90f2fcb3-020c-44b9-83f3-c64ce04ab8d0 req-079f74de-c31c-454a-975b-762bf83251c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.608494 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-90f2fcb3-020c-44b9-83f3-c64ce04ab8d0 req-079f74de-c31c-454a-975b-762bf83251c4 service nova] Creating event network-vif-unplugged:3af2fa06-745e-409f-9676-ffd6b6ffa5ca for instance 733596ac-52ff-421c-8693-fb08a213ca15 on nch2-master-1 Jun 04 20:58:06.615266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-90f2fcb3-020c-44b9-83f3-c64ce04ab8d0 req-079f74de-c31c-454a-975b-762bf83251c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062839 Jun 04 20:58:06.616566 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 742/1475] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:06.658730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e6db6f3a-ecc9-4adc-b7ba-085f8f460cd9 req-2921551f-192a-4202-9965-0c9f76ed629e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22dde75e-3edf-4266-9c1b-698d37dbd5e3", "name": "network-vif-plugged", "status": "completed", "tag": "8eaa5fdb-e707-4814-be8f-863044de9255"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:06.669364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e6db6f3a-ecc9-4adc-b7ba-085f8f460cd9 req-2921551f-192a-4202-9965-0c9f76ed629e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.669805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e6db6f3a-ecc9-4adc-b7ba-085f8f460cd9 req-2921551f-192a-4202-9965-0c9f76ed629e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.685043 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e6db6f3a-ecc9-4adc-b7ba-085f8f460cd9 req-2921551f-192a-4202-9965-0c9f76ed629e service nova] Creating event network-vif-plugged:8eaa5fdb-e707-4814-be8f-863044de9255 for instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 on nch1-master-1 Jun 04 20:58:06.691398 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e6db6f3a-ecc9-4adc-b7ba-085f8f460cd9 req-2921551f-192a-4202-9965-0c9f76ed629e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291068 Jun 04 20:58:06.696536 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 734/1476] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:06.919988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:06.921108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:06.929090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.930210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.931362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.932070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.943603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:06.944759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:06.959450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.959951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:06.960731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:06.967026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.323194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.324053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.337108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.338268 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a26e2fed-decf-4071-bfb2-3fdfb5e67289 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1316 microversion: 2.1 time: 0.402129 Jun 04 20:58:07.341241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.341990 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 735/1477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:06 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:07.343716 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9b9b4195-cf3f-4717-9b5e-c49147ae0c1a tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.431448 Jun 04 20:58:07.345774 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 743/1478] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:06 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:07.348692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:07.349897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:07.356281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:07.363332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:07.370761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.371613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.372608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.373625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.375095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.375681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.376658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.377263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.693224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.696501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.702109 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2bbb3f29-0c27-4fcf-80f7-33dc7a907b09 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.358540 Jun 04 20:58:07.702966 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 736/1479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:07 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:07.707862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:07.708651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:07.714062 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-776ecdb6-cacf-4081-8599-44b555e0781f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.366850 Jun 04 20:58:07.714919 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 744/1480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:07 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:07.715541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.716011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.716817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.717223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.805435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.819461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.821937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:07.824012 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5b4231a-d446-41f6-acff-4f2d1e67278d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.119560 Jun 04 20:58:07.825113 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 737/1481] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:07 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:07.831922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:07.833218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:07.842558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.843345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.844448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:07.844878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:07.885289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-983611575", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:07.954315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:58:08.167801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:08.177947 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e268fe6-5ff3-42ee-a97d-c3d094d71c66 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.350832 Jun 04 20:58:08.182854 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 738/1482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:07 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:08.364765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:58:08.365797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:58:08.366592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:58:08.367113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:58:08.368584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:58:08.371448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:08.379428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:08.390264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.390720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.393036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.395333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.396458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.397115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.399703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.400443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.446213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Getting quotas for project fbf8c0a57b514a0f9b42a2fcfd3070bf. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:58:08.453443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Getting quotas for user d3508546117f459a9a0b21da6b4a07f1 and project fbf8c0a57b514a0f9b42a2fcfd3070bf. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:58:08.468048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:58:08.470535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:58:08.482124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:08.522750 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a76e5094-6366-489b-b9a7-2df1cba7a28f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797694 Jun 04 20:58:08.528870 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 745/1483] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:58:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:58:08.534267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:08.535037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:08.550688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.551327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.559709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.560826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.770616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:08.786518 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d2d2879d-ec00-4c43-897f-9b38b89f6aa6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1504 microversion: 2.1 time: 0.431955 Jun 04 20:58:08.787130 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 739/1484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:08 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:08.792567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c50cf1f4-38e2-4c6e-bc04-e31243a2c8aa tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:08.793791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c50cf1f4-38e2-4c6e-bc04-e31243a2c8aa tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:08.895366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c50cf1f4-38e2-4c6e-bc04-e31243a2c8aa tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:08.909751 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c50cf1f4-38e2-4c6e-bc04-e31243a2c8aa tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1213 microversion: 2.1 time: 0.120943 Jun 04 20:58:08.913060 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 740/1485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:08 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:08.914854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:08.920805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c7b2a00c-f930-48dd-9578-18c4dc997b16 req-4c1d220d-5a0a-42ee-9776-74d2103e5c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "733596ac-52ff-421c-8693-fb08a213ca15", "tag": "3af2fa06-745e-409f-9676-ffd6b6ffa5ca"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:08.928512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:08.930050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:08.931255 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f74e0a5e-1452-425a-8cee-7a47792e9a34 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.406419 Jun 04 20:58:08.938122 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 746/1486] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:08 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:08.943053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-74e58d41-f830-47d7-827f-eb7deb8be09f req-945fa91a-f3a8-4648-8369-99067ce1d821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1a9e76-c12d-438e-94a5-391bf478dd9f", "name": "network-vif-plugged", "status": "completed", "tag": "d9de457e-c9e8-46f6-be69-d7586ca79501"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:08.944578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c7b2a00c-f930-48dd-9578-18c4dc997b16 req-4c1d220d-5a0a-42ee-9776-74d2103e5c80 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.945358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c7b2a00c-f930-48dd-9578-18c4dc997b16 req-4c1d220d-5a0a-42ee-9776-74d2103e5c80 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.962110 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c7b2a00c-f930-48dd-9578-18c4dc997b16 req-4c1d220d-5a0a-42ee-9776-74d2103e5c80 service nova] Creating event network-changed:3af2fa06-745e-409f-9676-ffd6b6ffa5ca for instance 733596ac-52ff-421c-8693-fb08a213ca15 on nch2-master-1 Jun 04 20:58:08.962748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-74e58d41-f830-47d7-827f-eb7deb8be09f req-945fa91a-f3a8-4648-8369-99067ce1d821 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.963452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-74e58d41-f830-47d7-827f-eb7deb8be09f req-945fa91a-f3a8-4648-8369-99067ce1d821 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.968850 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c7b2a00c-f930-48dd-9578-18c4dc997b16 req-4c1d220d-5a0a-42ee-9776-74d2103e5c80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052340 Jun 04 20:58:08.969902 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 741/1487] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:08.977827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:08.979245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:08.987406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.988202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.989472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:08.990198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:08.994687 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-74e58d41-f830-47d7-827f-eb7deb8be09f req-945fa91a-f3a8-4648-8369-99067ce1d821 service nova] Creating event network-vif-plugged:d9de457e-c9e8-46f6-be69-d7586ca79501 for instance db1a9e76-c12d-438e-94a5-391bf478dd9f on nch1-master-1 Jun 04 20:58:09.002071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-74e58d41-f830-47d7-827f-eb7deb8be09f req-945fa91a-f3a8-4648-8369-99067ce1d821 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061454 Jun 04 20:58:09.003067 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 747/1488] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:09.009775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:09.011103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:09.041214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.041679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.043290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.043833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.337029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:09.353343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:09.356644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db9e8ca5-8982-40cf-adb0-144a9530b216 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.383241 Jun 04 20:58:09.358012 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 742/1489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:08 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:09.365289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1830119386"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:09.366506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:09.375170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.376260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.377540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.378307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.379939 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-846c342e-551e-4628-88db-a7620c9eff14 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.375507 Jun 04 20:58:09.380654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 748/1490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:09 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:09.386163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:09.386943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:09.393717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.394596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.396704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.397391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.499027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:09.508097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:09.509859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:09.511276 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eba75feb-ce42-49b6-81e5-cba007999e15 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.129538 Jun 04 20:58:09.512149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 749/1491] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:09 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:09.517117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:09.517686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:09.525195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.525649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.527069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.527642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.680063 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Adding security group 9c3a8960-bd08-455b-a085-653f3fa93396 to port 8eaa5fdb-e707-4814-be8f-863044de9255 Jun 04 20:58:09.795386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:09.807242 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1fc2b588-0b8e-4b40-a8a6-d59b86a3169c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1199 microversion: 2.1 time: 0.293978 Jun 04 20:58:09.819412 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 750/1492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:09 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1199 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:09.929962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:09.931315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:09.943248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.947440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:09.949271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:09.952100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:10.504494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:10.517975 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d330bcac-7278-441d-93de-cfbdc0fe1176 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1273 microversion: 2.1 time: 0.589250 Jun 04 20:58:10.525102 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 751/1493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:09 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1273 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:58:10.535418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:10.535418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:10.543713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:10.544280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:10.545807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:10.546272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:10.786353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:10.806656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:10.808708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:10.810647 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26529e2a-b0c9-495a-a21b-d8941821775b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.283658 Jun 04 20:58:10.811309 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 752/1494] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:10 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:10.816466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:10.817338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:10.826075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:10.826626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:10.827490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:10.828061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:10.878375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09432c42-4fe5-4f49-8b8f-59980239ef8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3/action" status: 202 len: 0 microversion: 2.1 time: 1.518844 Jun 04 20:58:10.884120 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 743/1495] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:09 2022] POST /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3/action => generated 0 bytes in 1525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:10.890218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:10.891100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:10.898950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:10.899782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:10.900963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:10.901935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.213316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:11.218271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:11.232255 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2ee77f5-69a2-49b7-b8ed-f9e13e9094a7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.418568 Jun 04 20:58:11.232525 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a272c68-93fb-47b8-80d4-6cb59132e994 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.346954 Jun 04 20:58:11.233044 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 744/1496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:10 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:11.241303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:11.242192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:11.254670 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 753/1497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:10 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:11.263932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.264662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.265740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.266708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.268402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:11.269254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:11.287953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.288747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.290271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.291050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.310094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:11.431741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:11.444856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:11.446453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:11.454458 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e708bd8-e101-4ede-af1c-a472c785afb1 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.213527 Jun 04 20:58:11.455653 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 745/1498] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:11 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:11.460985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-185058888"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:11.465980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:11.480626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.481191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.482088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.482565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.750359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:11.765449 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d382eb4c-d702-415a-ac70-9ba445bbdeee tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1382 microversion: 2.1 time: 0.509058 Jun 04 20:58:11.780384 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 754/1499] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:11 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1382 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:11.785678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4113a0c2-f2cb-4f9c-b750-57ba6773b33c req-a17174cd-2bfd-47bd-92fc-685525cf948b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22dde75e-3edf-4266-9c1b-698d37dbd5e3", "tag": "8eaa5fdb-e707-4814-be8f-863044de9255"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:11.794592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4113a0c2-f2cb-4f9c-b750-57ba6773b33c req-a17174cd-2bfd-47bd-92fc-685525cf948b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.795337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4113a0c2-f2cb-4f9c-b750-57ba6773b33c req-a17174cd-2bfd-47bd-92fc-685525cf948b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.809567 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4113a0c2-f2cb-4f9c-b750-57ba6773b33c req-a17174cd-2bfd-47bd-92fc-685525cf948b service nova] Creating event network-changed:8eaa5fdb-e707-4814-be8f-863044de9255 for instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 on nch1-master-1 Jun 04 20:58:11.815149 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4113a0c2-f2cb-4f9c-b750-57ba6773b33c req-a17174cd-2bfd-47bd-92fc-685525cf948b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033223 Jun 04 20:58:11.816406 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 755/1500] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:11.821950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-81e1618c-c452-4bb9-827a-e2e8894cfff2 req-cee49e03-362f-49ac-a0a4-605354fc3d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "name": "network-vif-plugged", "status": "completed", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:11.831286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-81e1618c-c452-4bb9-827a-e2e8894cfff2 req-cee49e03-362f-49ac-a0a4-605354fc3d49 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.831769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-81e1618c-c452-4bb9-827a-e2e8894cfff2 req-cee49e03-362f-49ac-a0a4-605354fc3d49 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.845784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-81e1618c-c452-4bb9-827a-e2e8894cfff2 req-cee49e03-362f-49ac-a0a4-605354fc3d49 service nova] Creating event network-vif-plugged:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:58:11.851012 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-81e1618c-c452-4bb9-827a-e2e8894cfff2 req-cee49e03-362f-49ac-a0a4-605354fc3d49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Jun 04 20:58:11.852185 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 756/1501] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:11.858424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:11.859211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:11.865977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.866437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:11.867235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:11.867717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:12.094283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:12.110913 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2b19a8dd-709b-4eba-881b-d19cce8e3344 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1271 microversion: 2.1 time: 0.257086 Jun 04 20:58:12.111743 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 757/1502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:11 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:12.113042 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Adding security group 3eb33528-ea67-40f1-87fb-a1e1fcaaa65e to port 8eaa5fdb-e707-4814-be8f-863044de9255 Jun 04 20:58:12.124755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:12.125665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:12.132429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:12.133189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:12.134557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:12.135169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:12.587396 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17ef0e6d-8871-4572-9251-840508098793 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1533 microversion: 2.1 time: 0.474394 Jun 04 20:58:12.588985 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 758/1503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:12 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1533 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:12.595635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:12.596526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:12.605340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:12.606059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:12.607152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:12.607925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.050552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.059970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.061483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.062675 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c00ced28-5865-40e4-9cf5-ec94efc9d571 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.472473 Jun 04 20:58:13.063234 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 759/1504] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:12 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:13.077796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:13.078538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:13.085428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.085878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.086821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.087265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.503094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-900d19f4-8f36-4adf-a2cd-085ebd25f158 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3/action" status: 202 len: 0 microversion: 2.1 time: 2.046052 Jun 04 20:58:13.503801 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 746/1505] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:11 2022] POST /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3/action => generated 0 bytes in 2047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:13.513491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:13.514129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:13.542396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.543922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.545441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.546205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.551088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.555466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:13.577493 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3739a462-2bc9-4e9c-a97d-34fa4931b33d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.506817 Jun 04 20:58:13.587449 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 760/1506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:13 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:13.606532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:13.608712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:13.621030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.621265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.622067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.622510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.748380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.758087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.760049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:13.763224 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ceeff9c8-0466-4041-bb47-ed32e79f9058 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.174359 Jun 04 20:58:13.775167 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 761/1507] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:13 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:13.780111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:13.780739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:13.790254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.790708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:13.791500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:13.798631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.095470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:14.106721 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c896a3d9-ee01-4162-bb1d-d3365bb52a80 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1324 microversion: 2.1 time: 0.598525 Jun 04 20:58:14.107984 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 747/1508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:13 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1324 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:14.113543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:14.114401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:14.123682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.124453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.125616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.126216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.307159 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f753d16-e89d-433e-a010-ad8e17d390f8 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1533 microversion: 2.1 time: 0.537895 Jun 04 20:58:14.308531 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 762/1509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:13 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1533 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:14.325585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:14.326436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:14.333326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.333908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.334836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.335355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.409609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:14.417886 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-27bdda6e-e6fb-4f61-8c86-1b804fbefcc0 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1313 microversion: 2.1 time: 0.308576 Jun 04 20:58:14.427435 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 748/1510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:14 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:14.433062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:14.433935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:14.443173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.444082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.445305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.446170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.711380 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-039b102d-e01a-4fdd-b088-d0bfe4c77600 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.390771 Jun 04 20:58:14.712352 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 763/1511] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 20:58:14 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3/os-security-groups => generated 1157 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:14.717201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0230212d-b018-41c8-a964-fc60212a515b req-680c45c4-73c7-42f2-9960-8fe07c6fc9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22dde75e-3edf-4266-9c1b-698d37dbd5e3", "tag": "8eaa5fdb-e707-4814-be8f-863044de9255"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:14.737286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0230212d-b018-41c8-a964-fc60212a515b req-680c45c4-73c7-42f2-9960-8fe07c6fc9c7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.737750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0230212d-b018-41c8-a964-fc60212a515b req-680c45c4-73c7-42f2-9960-8fe07c6fc9c7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.758791 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0230212d-b018-41c8-a964-fc60212a515b req-680c45c4-73c7-42f2-9960-8fe07c6fc9c7 service nova] Creating event network-changed:8eaa5fdb-e707-4814-be8f-863044de9255 for instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 on nch1-master-1 Jun 04 20:58:14.764637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0230212d-b018-41c8-a964-fc60212a515b req-680c45c4-73c7-42f2-9960-8fe07c6fc9c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050940 Jun 04 20:58:14.765268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 764/1512] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:14.770386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2cafad22-15e8-46ff-ba72-e263d7de05da tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:14.772148 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:58:14.772148 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:58:14.773409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cafad22-15e8-46ff-ba72-e263d7de05da tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.773868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cafad22-15e8-46ff-ba72-e263d7de05da tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.774889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cafad22-15e8-46ff-ba72-e263d7de05da tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.775529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cafad22-15e8-46ff-ba72-e263d7de05da tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.803741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2cafad22-15e8-46ff-ba72-e263d7de05da tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036940 Jun 04 20:58:14.804989 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 765/1513] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 20:58:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:14.810037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:14.811062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:14.819237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.819799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.820637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:14.821127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:14.889416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:14.905129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:14.910744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:14.913890 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a8d477c-5875-4394-a862-26491d3f8659 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1567 microversion: 2.25 time: 0.485074 Jun 04 20:58:14.927800 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 749/1514] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:14 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1567 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:14.940471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bc3b426c-2251-4389-9ad5-36eb34d344da tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d0bf20ca0>, body: {"security_group": {"name": " tempest-securitygroup -502045287 ", "description": "tempest-description-47498625"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:15.095147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:15.105561 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-607217c0-5ec5-4c12-b7e7-57f689336279 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1522 microversion: 2.1 time: 0.299193 Jun 04 20:58:15.118273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 766/1515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:14 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:15.123802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:15.124509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:15.136256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.136721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.137742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.138339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.287589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:15.301178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:15.303351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:15.304826 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1defea30-bc40-4217-871c-b6c09a9a0e0d tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.185295 Jun 04 20:58:15.305401 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 767/1516] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:15 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:15.316235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:15.317734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:15.327585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.328303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.333262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.333711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.392761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lazy-loading 'flavor' on Instance uuid db1a9e76-c12d-438e-94a5-391bf478dd9f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:15.400285 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bc3b426c-2251-4389-9ad5-36eb34d344da tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.470504 Jun 04 20:58:15.403569 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 750/1517] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:14 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:15.413225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:15.414354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:15.422779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.425479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.426763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.429133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.452109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Going to try to live migrate instance to nch2-master-1 {{(pid=137228) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:58:15.717460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:15.730126 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-58187c5e-45d4-40fe-b71d-4b66228651cf tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1520 microversion: 2.1 time: 0.323366 Jun 04 20:58:15.741548 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 751/1518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:15 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:15.749020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b42fda7-a057-49f6-b03a-80bfba2bfe15 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d023b7160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:15.890837 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b42fda7-a057-49f6-b03a-80bfba2bfe15 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94" status: 200 len: 221 microversion: 2.1 time: 0.147777 Jun 04 20:58:15.893222 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 752/1519] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:15 2022] GET /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94 => generated 221 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:15.900756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:15.902231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:15.911153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.911978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:15.912982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:15.913605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:16.140087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:16.153793 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a91007ce-3410-4300-a04b-c20eb6b707ad tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1313 microversion: 2.1 time: 0.259251 Jun 04 20:58:16.154584 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 753/1520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:15 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:16.169475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4af3759-519a-43db-97eb-90653bf22d6f tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'create', calling method: .version_select at 0x7f2d021f6dc0>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:18.033161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4af3759-519a-43db-97eb-90653bf22d6f tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.863996 Jun 04 20:58:18.036106 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 754/1521] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:58:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:18.040086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebb5dcd6-a6df-4429-8ea5-47f295da5e10 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0bf2f820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:18.336757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebb5dcd6-a6df-4429-8ea5-47f295da5e10 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94" status: 202 len: 0 microversion: 2.1 time: 0.301096 Jun 04 20:58:18.340958 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 755/1522] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:18 2022] DELETE /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:18.343806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:18.345700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:18.361384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.372233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.373310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.373672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.463072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:18.511791 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f9edb58c-2e65-4443-bd81-d054963d6b36 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f/action" status: 202 len: 0 microversion: 2.1 time: 3.205060 Jun 04 20:58:18.512505 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 768/1523] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:15 2022] POST /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f/action => generated 0 bytes in 3206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:18.520905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:18.523200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:18.548528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.549321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.550419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.551137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.568389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.578858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.580426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.581611 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7506d911-ab45-485d-b83b-b94727b08960 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1542 microversion: 2.25 time: 0.242701 Jun 04 20:58:18.582556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 756/1524] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:18 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:18.588647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:18.589697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:18.603944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.604740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.605638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.606217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.727884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.739124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.740971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.746308 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-389e7df3-d9ad-456b-ab99-604aa820c62f tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.159811 Jun 04 20:58:18.747741 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 757/1525] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:18 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:18.762713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4fb4c546-e4e5-4b80-a123-0d84fc117ee2 req-5a131338-54bb-4746-a2c3-c4f176876352 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb2d225-8fcd-4a09-8770-ed502cd6dfe9", "tag": "3dc2e353-4db4-40a7-99bf-6045c3c453b5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:18.777202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4fb4c546-e4e5-4b80-a123-0d84fc117ee2 req-5a131338-54bb-4746-a2c3-c4f176876352 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.778024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4fb4c546-e4e5-4b80-a123-0d84fc117ee2 req-5a131338-54bb-4746-a2c3-c4f176876352 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.793948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4fb4c546-e4e5-4b80-a123-0d84fc117ee2 req-5a131338-54bb-4746-a2c3-c4f176876352 service nova] Creating event network-changed:3dc2e353-4db4-40a7-99bf-6045c3c453b5 for instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 on nch2-master-1 Jun 04 20:58:18.802751 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4fb4c546-e4e5-4b80-a123-0d84fc117ee2 req-5a131338-54bb-4746-a2c3-c4f176876352 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052166 Jun 04 20:58:18.803872 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 758/1526] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:18.814105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:18.815054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:18.824041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:18.828038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.828594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.829511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:18.830022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:18.908487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:18.977326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:18.986661 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-270bc3ba-a248-409f-bc08-1d8d17ee15dd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1502 microversion: 2.1 time: 0.469688 Jun 04 20:58:18.993800 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 769/1527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:18 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1502 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:19.000524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1182714036", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "d13de28a-5d75-4dd4-a643-af6e82d2a36d"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:19.071867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] validate_networks() for [('d13de28a-5d75-4dd4-a643-af6e82d2a36d', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:58:19.114095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:19.126568 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6ce7e9c-a124-458c-abe9-3a877c857883 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1313 microversion: 2.1 time: 0.320432 Jun 04 20:58:19.137795 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 759/1528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:18 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:19.148519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0bf2f550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:19.235552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:58:19.236175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:58:19.236708 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.236708 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94 HTTP/1.1 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f9b11803-9c30-4c8c-afc9-60f98e1d7f94'} Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:58:19.275689 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] Jun 04 20:58:19.281648 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:19.286766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:58:19.286766 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-7ae169d9-688d-4e58-9e8e-13bf137768a7'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:19.288869 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-be74fb56-fece-45a3-a334-c2cf439ef19a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94" status: 404 len: 194 microversion: 2.1 time: 0.148706 Jun 04 20:58:19.289959 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 760/1529] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:19 2022] GET /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94 => generated 194 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:19.296503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:19.297379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:19.306796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:19.307266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:19.308829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:19.309305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:19.652486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:19.669449 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9b46efd5-38bf-47b0-9df0-8b9a8bbc39f6 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.377902 Jun 04 20:58:19.679884 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 761/1530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:19 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:19.679884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff292657-2112-4e5c-bdf7-80e12f47656f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '.version_select at 0x7f2d025bba60>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:19.680643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff292657-2112-4e5c-bdf7-80e12f47656f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:19.680930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff292657-2112-4e5c-bdf7-80e12f47656f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:19.697033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff292657-2112-4e5c-bdf7-80e12f47656f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2782 microversion: 2.25 time: 0.024807 Jun 04 20:58:19.698322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 762/1531] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Jun 4 20:58:19 2022] GET /compute/v2.1/os-migrations => generated 2782 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:19.705386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:19.706206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:19.714797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:19.715342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:19.716348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:19.716907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:19.972991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:19.981048 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c51e2e87-3270-4f8e-89b9-d64b829cbbf5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1516 microversion: 2.1 time: 0.281135 Jun 04 20:58:19.982212 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 763/1532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:19 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:19.988062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f2c727b-4ddf-43b2-b2b4-4dc530ebc285 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d0bf3b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-327431192", "description": "tempest-description-1183101265"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:20.047223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:58:20.048370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:58:20.049065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:58:20.049527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:58:20.050043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:58:20.081456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.090715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.090715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.090715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.140060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Getting quotas for project 5f72194d8a044e81a3a48e7716a1395f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:58:20.149793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Getting quotas for user c80f5171e36f498cb2601ae92861a94a and project 5f72194d8a044e81a3a48e7716a1395f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:58:20.170421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:58:20.173104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:58:20.230552 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f2c727b-4ddf-43b2-b2b4-4dc530ebc285 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.246846 Jun 04 20:58:20.234078 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-96af53d9-fe62-4d3b-9dad-21e441c3f5ba tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245432 Jun 04 20:58:20.235297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 770/1533] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:58:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:58:20.240246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:20.241595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:20.250254 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 764/1534] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:20.252002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.252700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.254659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.255836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.262138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:20.262804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:20.280555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.283177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.284181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.284642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.385136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:20.405789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:20.407368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:20.408790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a3f0c118-07ee-4f60-927b-662be3f2e4f3 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.156395 Jun 04 20:58:20.421371 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 765/1535] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:20 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:20.427186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01bf9c1d-1245-4254-8ba4-1deda4d9d52d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:20.430492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-01bf9c1d-1245-4254-8ba4-1deda4d9d52d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 93931fb2-b187-4702-bbfe-f1e32c16491c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:20.440764 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-01bf9c1d-1245-4254-8ba4-1deda4d9d52d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Instance 93931fb2-b187-4702-bbfe-f1e32c16491c could not be found. Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01bf9c1d-1245-4254-8ba4-1deda4d9d52d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/93931fb2-b187-4702-bbfe-f1e32c16491c/action HTTP/1.1 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 14 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: {"rescue": {}} Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 93931fb2-b187-4702-bbfe-f1e32c16491c could not be found. Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '93931fb2-b187-4702-bbfe-f1e32c16491c', 'body': {'rescue': {}}} Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93931fb2-b187-4702-bbfe-f1e32c16491c could not be found. Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93931fb2-b187-4702-bbfe-f1e32c16491c could not be found. Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:20.449839 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:20.455704 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:20.455704 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:20.455704 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:20.455704 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:20.455704 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93931fb2-b187-4702-bbfe-f1e32c16491c could not be found. Jun 04 20:58:20.455704 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:20.457232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01bf9c1d-1245-4254-8ba4-1deda4d9d52d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 404 to user: Instance 93931fb2-b187-4702-bbfe-f1e32c16491c could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:20.458448 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01bf9c1d-1245-4254-8ba4-1deda4d9d52d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/93931fb2-b187-4702-bbfe-f1e32c16491c/action" status: 404 len: 111 microversion: 2.1 time: 0.035774 Jun 04 20:58:20.459597 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 766/1536] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:20 2022] POST /compute/v2.1/servers/93931fb2-b187-4702-bbfe-f1e32c16491c/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:20.470574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:20.473433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:20.488546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.489005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.490560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.491037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.529306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 733596ac-52ff-421c-8693-fb08a213ca15 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:20.566058 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-becac126-25b6-4003-b9a3-41e1b8b09dbd tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 2034 microversion: 2.25 time: 0.329324 Jun 04 20:58:20.566659 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 771/1537] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:20 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 2034 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:20.595815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-130d5d5c-5663-4e14-bcd1-7eacff14e813 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:20.596310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-130d5d5c-5663-4e14-bcd1-7eacff14e813 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:20.742957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-130d5d5c-5663-4e14-bcd1-7eacff14e813 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:20.754334 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-130d5d5c-5663-4e14-bcd1-7eacff14e813 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1224 microversion: 2.1 time: 0.181665 Jun 04 20:58:20.759929 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 772/1538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:20 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:20.767484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b6e33f2-ff1a-4954-a324-c20a8f791fc9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d026cedc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-157247115", "description": "tempest-description-1187801768"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:20.832748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:20.845932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eaea66a0-a9f9-4c87-8e87-10513336fa5c tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1313 microversion: 2.1 time: 0.384393 Jun 04 20:58:20.846525 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 767/1539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:20 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:20.855423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:20.859412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:20.872007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.872731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:20.874504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:20.874996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.006772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85b0c44b-1113-4458-8ac4-c5a1ca0d3c26 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.158773 Jun 04 20:58:21.007701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 768/1540] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:20 2022] POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:21.019098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:21.020462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:21.047104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.048096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.049150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.049811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.080670 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b6e33f2-ff1a-4954-a324-c20a8f791fc9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.321728 Jun 04 20:58:21.081301 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 773/1541] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:21.087551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-559957829", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1e56980c-95ca-4182-ba01-f6d8494d4447"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:21.201482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] validate_networks() for [('1e56980c-95ca-4182-ba01-f6d8494d4447', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:58:21.328670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:21.333122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:21.346528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c3741d08-4ed3-46c2-82f7-d289ceb3acad tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.337369 Jun 04 20:58:21.347814 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 769/1542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:21 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:21.353545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-89dfc0b4-7af7-4294-b56e-769d696a4958 req-a3c14e72-1b21-4cba-9574-3e3a51df6248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb2d225-8fcd-4a09-8770-ed502cd6dfe9", "name": "network-vif-plugged", "status": "completed", "tag": "3dc2e353-4db4-40a7-99bf-6045c3c453b5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:21.369310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-89dfc0b4-7af7-4294-b56e-769d696a4958 req-a3c14e72-1b21-4cba-9574-3e3a51df6248 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.370086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-89dfc0b4-7af7-4294-b56e-769d696a4958 req-a3c14e72-1b21-4cba-9574-3e3a51df6248 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.389027 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-89dfc0b4-7af7-4294-b56e-769d696a4958 req-a3c14e72-1b21-4cba-9574-3e3a51df6248 service nova] Creating event network-vif-plugged:3dc2e353-4db4-40a7-99bf-6045c3c453b5 for instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 on nch2-master-1 Jun 04 20:58:21.399033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-89dfc0b4-7af7-4294-b56e-769d696a4958 req-a3c14e72-1b21-4cba-9574-3e3a51df6248 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048919 Jun 04 20:58:21.403448 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 770/1543] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:21.410724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:21.411611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:21.421911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.422928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.423898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.424427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.681890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:21.697508 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a98d245d-3afd-4998-a429-2cc4507ce978 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1501 microversion: 2.1 time: 0.292686 Jun 04 20:58:21.709380 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 771/1544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:21 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:21.709380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4975efe1-9e0c-44fb-90ad-fe829f0ae52b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d0bf40af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1030665310", "description": "tempest-description-1518615700"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:21.895561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:58:21.896411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:58:21.897091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:58:21.897663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:58:21.898237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:58:21.918140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.918898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.919900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:21.920500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:21.958210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:58:21.966774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for user e25328c90d26437a85d8d5509437ed99 and project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:58:21.985202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:58:21.988480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:58:22.037290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4975efe1-9e0c-44fb-90ad-fe829f0ae52b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.337832 Jun 04 20:58:22.038720 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 772/1545] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:22.044991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:22.045447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.047474 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fcf995e6-80b9-493d-825b-e80b872ddcd1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.964886 Jun 04 20:58:22.048508 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 774/1546] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 20:58:22.052500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.053413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.054353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.054929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.057927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:22.061427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.070338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.071577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.072845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.075273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.111209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'flavor' on Instance uuid 952e6198-f88b-4266-bc51-a737275da8b2 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:22.141235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.152397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.153991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.155790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e5e554b-2911-4b1c-826b-ba459aa785cd tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.114808 Jun 04 20:58:22.157456 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 773/1547] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:22 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:22.162924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:22.163791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.173014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.173645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.174793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.175437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.232306 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Cannot 'rescue' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state paused Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action HTTP/1.1 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 14 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: {"rescue": {}} Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'rescue' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state paused Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '952e6198-f88b-4266-bc51-a737275da8b2', 'body': {'rescue': {}}} Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 952e6198-f88b-4266-bc51-a737275da8b2 in vm_state paused. Cannot rescue while the instance is in this state. Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state paused Jun 04 20:58:22.237693 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state paused Jun 04 20:58:22.242697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:22.247342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 409 to user: Cannot 'rescue' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state paused {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:22.248285 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-11e920d3-5530-448f-8719-340003eef04a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action" status: 409 len: 144 microversion: 2.1 time: 0.198606 Jun 04 20:58:22.249270 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 775/1548] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:22 2022] POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action => generated 144 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:58:22.256516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:22.257585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.265073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.265811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.266813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.267605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.311108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.319155 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0148e792-59e6-484e-9066-a817c7bc05ab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1294 microversion: 2.1 time: 0.160138 Jun 04 20:58:22.320632 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 774/1549] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:22 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:22.326523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b7849642-f7c0-4bfa-8a3f-2981906680a6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0bf3b160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:22.550082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.559374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e059ced-fb5e-464d-a618-66a24b88648f tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1313 microversion: 2.1 time: 0.308744 Jun 04 20:58:22.570650 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 776/1550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:22 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:22.576887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1044c88-5c47-481d-a3ec-b99eb233908d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:22.577806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1044c88-5c47-481d-a3ec-b99eb233908d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.592312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:22.672513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1044c88-5c47-481d-a3ec-b99eb233908d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.682163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1044c88-5c47-481d-a3ec-b99eb233908d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.683767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1044c88-5c47-481d-a3ec-b99eb233908d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:22.684895 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1044c88-5c47-481d-a3ec-b99eb233908d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1261 microversion: 2.25 time: 0.112556 Jun 04 20:58:22.690403 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 777/1551] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:22 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:22.695766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:22.696290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.709766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.710223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.711279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.711423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.797448 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b7849642-f7c0-4bfa-8a3f-2981906680a6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.473541 Jun 04 20:58:22.806369 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 775/1552] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:58:22 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:22.813682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:22.814656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:22.826257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.827069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.829444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:22.829866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:22.831837 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-985f5970-665d-456f-a803-d619e9583b68 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.140007 Jun 04 20:58:22.834321 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 778/1553] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:22 2022] POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:22.843079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f40ae0a-4041-4952-bdbd-3fe6f722dbae tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0be9adc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.067829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:23.080538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-03cc734e-dc0c-4720-a6ae-7c297b323705 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.272173 Jun 04 20:58:23.090172 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 776/1554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:22 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:23.094920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.095480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:23.110150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.110583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.111717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.112363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.142534 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f40ae0a-4041-4952-bdbd-3fe6f722dbae tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa" status: 202 len: 0 microversion: 2.1 time: 0.304752 Jun 04 20:58:23.145837 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 779/1555] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:22 2022] DELETE /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:23.354576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:23.357211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aee981d0-4df9-4162-bf12-c7a01e97c6e1 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d026ccaf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1758215620", "description": "tempest-description-285313635"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:23.368508 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-58314fea-6e13-4d05-b2ef-763f63efd77e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1508 microversion: 2.1 time: 0.285697 Jun 04 20:58:23.369350 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 777/1556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:23 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:23.375011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0be6f550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.409853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:58:23.410767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:58:23.411441 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.411441 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa HTTP/1.1 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a67f13aa-b039-4a5c-b1c0-c945bc83ebaa'} Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:58:23.413850 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-75fba7fd-b265-40df-9309-66b94b8bfd9f'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-88b8858c-1ab8-466a-ac06-7648192d7729 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa" status: 404 len: 194 microversion: 2.1 time: 0.045087 Jun 04 20:58:23.422150 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 778/1557] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:23 2022] GET /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:23.429985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.430598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:23.438903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.439273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.440141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.440577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.533239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:23.555610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:23.560372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:23.564582 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b33da497-75c7-436a-9177-9389da6655b2 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.145803 Jun 04 20:58:23.565975 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 779/1558] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:23 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:23.573762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.575144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:23.584832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.585714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.587215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.587917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.676966 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aee981d0-4df9-4162-bf12-c7a01e97c6e1 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.529489 Jun 04 20:58:23.677996 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 780/1559] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:23 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:23.688121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72530668-859e-4fd8-916e-8b05cdaf4909 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d02449670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.820191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:23.831802 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f637804b-2f29-4a1b-978a-9109b4ff9b86 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1324 microversion: 2.1 time: 0.264241 Jun 04 20:58:23.833047 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 780/1560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:23 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:23.838202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:23.839152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:23.846104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.846850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:23.848135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:23.848906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:24.183788 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72530668-859e-4fd8-916e-8b05cdaf4909 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466" status: 202 len: 0 microversion: 2.1 time: 0.503753 Jun 04 20:58:24.185595 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 781/1561] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:23 2022] DELETE /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:24.193009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54d4f0cd-9d3b-4f33-a50a-1fba740eb446 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0beaaca0>, body: {"security_group_rule": {"parent_group_id": "3cb18871-65b9-4d62-9e47-1d9bf3912205", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:24.219206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:24.229337 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c69bfac-f884-4039-b54c-f7c51c998427 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1462 microversion: 2.1 time: 0.394933 Jun 04 20:58:24.245245 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 781/1562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:23 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1462 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:24.251887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:24.252821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:24.262522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:24.263390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:24.264662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:24.265436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:24.361098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:24.371531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:24.373418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:24.374695 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac44430b-0441-43bf-8a38-a477f08fbccd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1313 microversion: 2.25 time: 0.127898 Jun 04 20:58:24.375333 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 782/1563] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:24 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1313 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:24.383210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:24.383973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:24.397362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:24.398214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:24.399147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:24.399661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:24.850529 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54d4f0cd-9d3b-4f33-a50a-1fba740eb446 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.663324 Jun 04 20:58:24.859757 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 782/1564] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 20:58:24 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:24.867762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d026cc160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:24.915178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:58:24.916181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group 8003143b-64f4-4d13-944f-5367f66e6466 not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:58:24.917434 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.917434 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466 HTTP/1.1 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8003143b-64f4-4d13-944f-5367f66e6466'} Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:58:24.924974 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] Jun 04 20:58:24.930504 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:24.935371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:58:24.935371 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-652864d5-9b77-4a50-9c1a-e0dec9e42df5'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:24.936444 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d87fc254-ebfb-4905-b25c-34abd6c126d9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466" status: 404 len: 194 microversion: 2.1 time: 0.075082 Jun 04 20:58:24.937509 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 783/1565] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:24 2022] GET /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:24.952926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:24.972634 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b4b193c-7eba-49dc-ae17-d841dd23638f tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.595859 Jun 04 20:58:24.983547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 783/1566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:24 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:24.985487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:24.986517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:24.994109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:24.994941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:24.996674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:24.997001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.159614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f059010a-3ea5-4ec1-b0fb-8353d2f09b6d tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Calling method '.version_select at 0x7f2d0bd8d1f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:25.170518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f059010a-3ea5-4ec1-b0fb-8353d2f09b6d tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.170969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f059010a-3ea5-4ec1-b0fb-8353d2f09b6d tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.188836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f059010a-3ea5-4ec1-b0fb-8353d2f09b6d tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.190146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f059010a-3ea5-4ec1-b0fb-8353d2f09b6d tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.210131 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f059010a-3ea5-4ec1-b0fb-8353d2f09b6d tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/fbf8c0a57b514a0f9b42a2fcfd3070bf?start=2022-06-03T20%3A58%3A24.240440&end=2022-06-05T20%3A58%3A24.240440" status: 200 len: 694 microversion: 2.1 time: 0.271334 Jun 04 20:58:25.211359 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 784/1567] 10.222.0.18 () {58 vars in 1411 bytes} [Sat Jun 4 20:58:24 2022] GET /compute/v2.1/os-simple-tenant-usage/fbf8c0a57b514a0f9b42a2fcfd3070bf?start=2022-06-03T20%3A58%3A24.240440&end=2022-06-05T20%3A58%3A24.240440 => generated 694 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:25.216716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:25.217821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:25.224586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.225036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.225820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.226252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.535862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:25.544664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:25.548709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:25.551360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:25.552870 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4a8b2305-339a-4f9e-a302-c2c8f1f68d64 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.340286 Jun 04 20:58:25.553690 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 785/1568] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:25 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:25.559755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a3491752-493a-42b1-b8a7-59cf4cf2cf40 req-b0dfe205-359a-4416-9ee4-9841ffe73fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34", "tag": "d5a456eb-1cbe-422f-934f-21b1dfae3264"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:25.571347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a3491752-493a-42b1-b8a7-59cf4cf2cf40 req-b0dfe205-359a-4416-9ee4-9841ffe73fda service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.572369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a3491752-493a-42b1-b8a7-59cf4cf2cf40 req-b0dfe205-359a-4416-9ee4-9841ffe73fda service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.586293 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a3491752-493a-42b1-b8a7-59cf4cf2cf40 req-b0dfe205-359a-4416-9ee4-9841ffe73fda service nova] Creating event network-changed:d5a456eb-1cbe-422f-934f-21b1dfae3264 for instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 on nch2-master-1 Jun 04 20:58:25.592147 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a3491752-493a-42b1-b8a7-59cf4cf2cf40 req-b0dfe205-359a-4416-9ee4-9841ffe73fda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036997 Jun 04 20:58:25.592954 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 786/1569] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:25.599573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:25.600279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:25.607408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.607885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.608665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:25.609099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:25.754023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:25.763031 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-17bd5c49-3b0b-44d4-9b3e-416b675de1c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1516 microversion: 2.1 time: 0.787277 Jun 04 20:58:25.763782 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 784/1570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:24 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1516 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:25.769041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1cb55a3f-9908-4f3e-a92f-e1cc13d07d8f tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0bf2bb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-242499087", "description": "tempest-description-21222929"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:25.988045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:25.999192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf18e744-d17d-4ffd-8bec-87392400ed74 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1324 microversion: 2.1 time: 0.404867 Jun 04 20:58:26.000120 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 787/1571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:25 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:26.004941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-745118d4-9d78-4930-90e8-04d8efae5848 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d026cc940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:26.334088 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1cb55a3f-9908-4f3e-a92f-e1cc13d07d8f tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.568696 Jun 04 20:58:26.334691 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 785/1572] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:25 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:26.343473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e1be521-31b2-44ee-a682-1f7eaa356540 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '.version_select at 0x7f2d0bf36c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:26.369617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e1be521-31b2-44ee-a682-1f7eaa356540 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.370386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e1be521-31b2-44ee-a682-1f7eaa356540 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.388863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e1be521-31b2-44ee-a682-1f7eaa356540 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.389378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e1be521-31b2-44ee-a682-1f7eaa356540 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.408003 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e1be521-31b2-44ee-a682-1f7eaa356540 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage/fbf8c0a57b514a0f9b42a2fcfd3070bf?start=2022-06-03T20%3A58%3A24.240440&end=2022-06-05T20%3A58%3A24.240440" status: 200 len: 694 microversion: 2.1 time: 0.071033 Jun 04 20:58:26.408667 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 786/1573] 10.222.0.18 () {58 vars in 1411 bytes} [Sat Jun 4 20:58:26 2022] GET /compute/v2.1/os-simple-tenant-usage/fbf8c0a57b514a0f9b42a2fcfd3070bf?start=2022-06-03T20%3A58%3A24.240440&end=2022-06-05T20%3A58%3A24.240440 => generated 694 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:26.413570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:26.414514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:26.421650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.422462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.423409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.424118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.585264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:26.601231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:26.604807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:26.606440 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c29bf90-aa4b-4fb0-ad45-72e6069cf808 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1319 microversion: 2.25 time: 0.196790 Jun 04 20:58:26.607308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 787/1574] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:26 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:26.613701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-383608e2-65c8-445b-bb3d-8562ecfe1c34 req-abb53c12-4243-4767-8cd8-916792f30d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1a9e76-c12d-438e-94a5-391bf478dd9f", "name": "network-vif-unplugged", "status": "completed", "tag": "d9de457e-c9e8-46f6-be69-d7586ca79501"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:26.624787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-383608e2-65c8-445b-bb3d-8562ecfe1c34 req-abb53c12-4243-4767-8cd8-916792f30d5a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.625591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-383608e2-65c8-445b-bb3d-8562ecfe1c34 req-abb53c12-4243-4767-8cd8-916792f30d5a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.642887 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-383608e2-65c8-445b-bb3d-8562ecfe1c34 req-abb53c12-4243-4767-8cd8-916792f30d5a service nova] Creating event network-vif-unplugged:d9de457e-c9e8-46f6-be69-d7586ca79501 for instance db1a9e76-c12d-438e-94a5-391bf478dd9f on nch1-master-1 Jun 04 20:58:26.649726 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-383608e2-65c8-445b-bb3d-8562ecfe1c34 req-abb53c12-4243-4767-8cd8-916792f30d5a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040722 Jun 04 20:58:26.650897 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 788/1575] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:26.658169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:26.659004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:26.666015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.666592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.667447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:26.669121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:26.716309 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-745118d4-9d78-4930-90e8-04d8efae5848 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673" status: 202 len: 0 microversion: 2.1 time: 0.714577 Jun 04 20:58:26.718232 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 788/1576] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:26 2022] DELETE /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673 => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:26.726088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-757e56ba-926f-4edb-9f38-b06cda02bc5a tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0bd8b820>, body: {"security_group_rule": {"parent_group_id": "5174eb56-1ddb-41b7-bcf9-c2e3f5d37626", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:27.099126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:27.107094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b349016-7a7d-4c17-b21a-e8a3c58585ed tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.455029 Jun 04 20:58:27.107739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 789/1577] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:26 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:27.113081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5cd6af3-220f-4548-9a5d-f2715cd53bd1 tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Calling method '.version_select at 0x7f2d0be6fdc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:27.123040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5cd6af3-220f-4548-9a5d-f2715cd53bd1 tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.123711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5cd6af3-220f-4548-9a5d-f2715cd53bd1 tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.144240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5cd6af3-220f-4548-9a5d-f2715cd53bd1 tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.145177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5cd6af3-220f-4548-9a5d-f2715cd53bd1 tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.239071 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5cd6af3-220f-4548-9a5d-f2715cd53bd1 tempest-TenantUsagesTestJSON-1453968989 tempest-TenantUsagesTestJSON-1453968989-project-admin] 10.222.0.18 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-03T20%3A58%3A24.240440&end=2022-06-05T20%3A58%3A24.240440&detailed=1" status: 200 len: 24334 microversion: 2.1 time: 0.130185 Jun 04 20:58:27.240072 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 790/1578] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Jun 4 20:58:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-03T20%3A58%3A24.240440&end=2022-06-05T20%3A58%3A24.240440&detailed=1 => generated 24334 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:58:27.252509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:27.253423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:27.261377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.261963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.262771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.263209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.384784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:27.399205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:27.401018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:27.404941 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a0aeb01-cbc9-44fc-a89c-5959926d3be5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.162640 Jun 04 20:58:27.405547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 791/1579] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:27 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:27.411053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0be78e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:27.491360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:58:27.491800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group 03158387-3950-4bce-a6c3-15ac8f7bf673 not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:58:27.492332 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.492332 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673 HTTP/1.1 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '03158387-3950-4bce-a6c3-15ac8f7bf673'} Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:58:27.494587 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] Jun 04 20:58:27.505808 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:27.508879 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-757e56ba-926f-4edb-9f38-b06cda02bc5a tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.778361 Jun 04 20:58:27.508879 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 789/1580] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 20:58:26 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:27.508879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:27.508879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:27.510430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:58:27.510430 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-c3968e53-e4e9-4e10-8613-0b1f63108380'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:27.511551 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34325349-b697-4be7-adce-d6fe17c66684 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673" status: 404 len: 194 microversion: 2.1 time: 0.104839 Jun 04 20:58:27.512146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 792/1581] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:27 2022] GET /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:27.518020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:27.519075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:27.524199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.528577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.529089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.529575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.530157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.530881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.531012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.531340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.556390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'flavor' on Instance uuid 952e6198-f88b-4266-bc51-a737275da8b2 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:27.577393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:27.645730 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a1f1746-affa-4a81-b6e9-325016e1f240 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action" status: 200 len: 32 microversion: 2.1 time: 0.132169 Jun 04 20:58:27.646781 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 793/1582] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:27 2022] POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action => generated 32 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 20:58:27.656510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:27.657500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:27.670146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.671591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.675132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:27.675613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:27.713187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:27.839587 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44ea7b96-427d-4dca-977c-2f7e95f167da tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "DELETE /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 204 len: 0 microversion: 2.1 time: 0.189313 Jun 04 20:58:27.845648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:27.846627 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 794/1583] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:58:27 2022] DELETE /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:58:27.854899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdeba22c-f403-45f9-bd5a-6403d22eb777 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0be6fc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1766446417", "description": "tempest-description-941431370"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:27.858204 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-834a67f3-91ad-4eb6-9725-eb8b96e66274 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1324 microversion: 2.1 time: 0.358480 Jun 04 20:58:27.869115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 790/1584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:27 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1324 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:27.875274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dcb36968-e346-44bb-9e5a-27637c6a8004 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0bd8de50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:28.301539 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdeba22c-f403-45f9-bd5a-6403d22eb777 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.452507 Jun 04 20:58:28.302365 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 795/1585] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:27 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:28.307826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:28.308950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:28.317114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.317483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.318225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.318647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.335243 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dcb36968-e346-44bb-9e5a-27637c6a8004 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.463825 Jun 04 20:58:28.336400 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 791/1586] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 20:58:27 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:28.349466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:28.349466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:28.358218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.361556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.362473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.362921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.658958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:28.661906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:28.670242 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ed41827-de33-4468-84c5-b3b4ee54db47 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.332037 Jun 04 20:58:28.670847 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 792/1587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:28 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:28.673718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:28.677999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:28.678271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:28.678828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:28.680082 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e785c142-7386-4246-acce-e3863991e4cc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.376554 Jun 04 20:58:28.681096 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 796/1588] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:28 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:28.686212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:28.687050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:28.688997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.689451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.690243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.690941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.695671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.696310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.697252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:28.697886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:28.896988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:28.901571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:28.905822 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54da2005-4889-4f9e-bc1c-af623ed46004 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1468 microversion: 2.1 time: 0.233501 Jun 04 20:58:28.906416 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 793/1589] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:28 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:28.910220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-105b6d3e-08d4-41f6-a911-03140acdb319 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.227922 Jun 04 20:58:28.910802 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 797/1590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:28 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:28.911042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e00d873d-b566-4e1b-ac38-78a19b38ea6a tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d026985e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1812148028", "description": "tempest-description-2008086305"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:28.919166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb376f54-691f-4d16-8c59-f954377d355b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d0bf3b160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-560392930", "description": "tempest-description-81291955"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:29.135932 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e00d873d-b566-4e1b-ac38-78a19b38ea6a tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.227764 Jun 04 20:58:29.137339 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 794/1591] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:29.144578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:29.145539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:29.153600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.154059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.154873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.155498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.166001 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb376f54-691f-4d16-8c59-f954377d355b tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.253657 Jun 04 20:58:29.167329 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 798/1592] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:28 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:29.181286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8f112e57-3666-4fd6-89da-88def4c52555 req-f24d6176-df8a-4e73-b000-8177726eab18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1a9e76-c12d-438e-94a5-391bf478dd9f", "tag": "d9de457e-c9e8-46f6-be69-d7586ca79501"}, {"name": "network-changed", "server_uuid": "a183ce72-70aa-487e-b90f-7a89e17720b3", "tag": "51a43abd-07c8-4b4a-9258-2f0b67574647"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:29.194737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8f112e57-3666-4fd6-89da-88def4c52555 req-f24d6176-df8a-4e73-b000-8177726eab18 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.195387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8f112e57-3666-4fd6-89da-88def4c52555 req-f24d6176-df8a-4e73-b000-8177726eab18 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.211407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8f112e57-3666-4fd6-89da-88def4c52555 req-f24d6176-df8a-4e73-b000-8177726eab18 service nova] Creating event network-changed:d9de457e-c9e8-46f6-be69-d7586ca79501 for instance db1a9e76-c12d-438e-94a5-391bf478dd9f on nch1-master-1 Jun 04 20:58:29.212066 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8f112e57-3666-4fd6-89da-88def4c52555 req-f24d6176-df8a-4e73-b000-8177726eab18 service nova] Creating event network-changed:51a43abd-07c8-4b4a-9258-2f0b67574647 for instance a183ce72-70aa-487e-b90f-7a89e17720b3 on nch2-master-1 Jun 04 20:58:29.220938 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8f112e57-3666-4fd6-89da-88def4c52555 req-f24d6176-df8a-4e73-b000-8177726eab18 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046465 Jun 04 20:58:29.221747 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 799/1593] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:29.227247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:29.228267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:29.236018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.236283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.237326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.237486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.242744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:29.253628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:29.255604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:29.257586 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85670e51-c965-473e-a5a7-d7d444d1498a tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.118509 Jun 04 20:58:29.259681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 795/1594] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:29 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:29.265614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e9c4dcd0-4843-426d-814e-b9426801c8d1 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0bd8d8b0>, body: {"security_group_rule": {"parent_group_id": "2b676f11-2461-45e3-b600-a5bd115386da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "399d0496-dcc3-4350-8b56-454ed68e55af"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:29.462963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:29.483455 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb928354-1ed5-4c25-b2a5-2027020fd7cc tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1324 microversion: 2.1 time: 0.260164 Jun 04 20:58:29.484107 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 800/1595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:29 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:29.489934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee5b3324-e89c-4639-89d5-9ff40da14e78 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d021f65e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1813761929", "description": "tempest-description-163335955"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:29.696925 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e9c4dcd0-4843-426d-814e-b9426801c8d1 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.435791 Jun 04 20:58:29.697641 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 796/1596] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 20:58:29 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:29.703616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:29.704855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:29.711343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.711941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.712996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.713833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.771480 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ee5b3324-e89c-4639-89d5-9ff40da14e78 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.283595 Jun 04 20:58:29.771480 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 801/1597] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:29.778404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:29.779027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:29.788634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.789151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.789977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:29.790417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:29.948786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:29.957094 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d647048-8dd5-4ffa-bdf4-66f0ade000d2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.257932 Jun 04 20:58:29.957817 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 797/1598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:29 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:29.962859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6749b253-6244-4781-a9e7-984a9e637472 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0beaae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1831271301", "description": "tempest-description-276430701"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:29.993615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.003753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.005591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.006958 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a65445a-003c-4711-8a02-9e0c32986e23 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.233116 Jun 04 20:58:30.007543 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 802/1599] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:29 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:30.017309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2066365439", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "59a06a30-086d-4d1c-8273-8f8f1dc9656c"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:30.073811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] validate_networks() for [('59a06a30-086d-4d1c-8273-8f8f1dc9656c', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:58:30.195976 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6749b253-6244-4781-a9e7-984a9e637472 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.236710 Jun 04 20:58:30.196585 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 798/1600] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:30.202323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:30.203383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:30.210473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.211111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.212329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.212916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.439985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.448867 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-575d6c28-6975-4d36-9f6c-01723e48934b tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1468 microversion: 2.1 time: 0.250053 Jun 04 20:58:30.448867 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 799/1601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:30 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1468 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:30.457115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:30.457826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:30.464753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.465298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.466073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.466500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.644200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:58:30.644768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:58:30.645348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:58:30.645857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:58:30.646959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:58:30.658516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.659043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.659931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.660946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.671380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.679817 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f7fe1fd5-2193-4cf4-ba70-e5665ef1373a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.230229 Jun 04 20:58:30.680072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Getting quotas for project 89428fdfbe7748018280e169ceebc0df. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:58:30.680727 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 800/1602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:30 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:30.687282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-381269e8-82b5-4a9a-a3b4-24464f2be851 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d026cc790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1042300167", "description": "tempest-description-277801701"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:30.691221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Getting quotas for user fb5163967e1f4f14b64ed72ffbf64db8 and project 89428fdfbe7748018280e169ceebc0df. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:58:30.706633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:58:30.709700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:58:30.769761 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc99031f-0a4c-4953-92b0-6fd874eabe23 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760930 Jun 04 20:58:30.776799 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 803/1603] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:58:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:58:30.783230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:30.784522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:30.794683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.795387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.796529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.797002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.906246 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-381269e8-82b5-4a9a-a3b4-24464f2be851 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.224238 Jun 04 20:58:30.906881 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 801/1604] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:30.911136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.924868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:30.925502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:30.931938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.932828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.933109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.933909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:30.934347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:30.934784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:30.936170 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5af66711-9f2c-41c1-ad26-7876af260cb9 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1365 microversion: 2.47 time: 0.157464 Jun 04 20:58:30.938010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 804/1605] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:30 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:30.949238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a64e3bcf-c72a-40f6-84f9-6b87aa812b6f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:30.950683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a64e3bcf-c72a-40f6-84f9-6b87aa812b6f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:31.032631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a64e3bcf-c72a-40f6-84f9-6b87aa812b6f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:31.040351 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a64e3bcf-c72a-40f6-84f9-6b87aa812b6f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1216 microversion: 2.1 time: 0.101297 Jun 04 20:58:31.040934 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 805/1606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:30 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1216 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:31.055298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-da9b6735-4e6f-43a8-b702-78bf6a2eddf9 req-f352c09a-cfb2-49d1-b706-68907e3b6d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34", "name": "network-vif-plugged", "status": "completed", "tag": "d5a456eb-1cbe-422f-934f-21b1dfae3264"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:31.066545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-da9b6735-4e6f-43a8-b702-78bf6a2eddf9 req-f352c09a-cfb2-49d1-b706-68907e3b6d75 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.067433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-da9b6735-4e6f-43a8-b702-78bf6a2eddf9 req-f352c09a-cfb2-49d1-b706-68907e3b6d75 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:31.080485 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-da9b6735-4e6f-43a8-b702-78bf6a2eddf9 req-f352c09a-cfb2-49d1-b706-68907e3b6d75 service nova] Creating event network-vif-plugged:d5a456eb-1cbe-422f-934f-21b1dfae3264 for instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 on nch2-master-1 Jun 04 20:58:31.085543 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-da9b6735-4e6f-43a8-b702-78bf6a2eddf9 req-f352c09a-cfb2-49d1-b706-68907e3b6d75 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036347 Jun 04 20:58:31.086676 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 806/1607] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:31.103932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd8a311f-d6cf-4614-8f8d-6e4ad252c77b tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0be35670>, body: {"security_group_rule": {"parent_group_id": "af9e9baa-34f8-497e-94fb-85884b445568", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:31.560956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:31.569439 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-41e3b742-60ae-4b12-9300-7428edfe84df tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1324 microversion: 2.1 time: 0.656641 Jun 04 20:58:31.570270 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 802/1608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:30 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1324 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:31.582057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:31.582700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:31.591211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.591711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:31.592504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.593123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:31.804196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:31.814744 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f74f3a88-3c1d-4676-b50a-59b55a8d1bd5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.242987 Jun 04 20:58:31.825245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 803/1609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:31 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:31.830316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:31.830933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:31.837525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.838392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:31.839461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.840183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:31.894317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd8a311f-d6cf-4614-8f8d-6e4ad252c77b tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.805138 Jun 04 20:58:31.902428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 807/1610] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 20:58:31 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:31.902428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:31.902428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:31.909223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.909839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:31.910704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:31.911200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.041239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.050071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.051888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.053084 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0391708e-9071-4abe-9a7e-96680763a01e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.226626 Jun 04 20:58:32.054095 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 804/1611] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:31 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:32.059644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:32.061089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:32.068153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.068844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.069680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.070271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.109296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.126332 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b5025be-37a6-4ec0-a2fe-35b7633c2f56 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1468 microversion: 2.1 time: 0.230085 Jun 04 20:58:32.127066 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 808/1612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:31 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1468 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:32.147253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79952f1f-9dc5-4960-92ad-39f4ce754dac tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d0be0c940>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:32.280755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.291978 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b3220189-956a-439d-906a-365cf412259c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.235914 Jun 04 20:58:32.296406 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 805/1613] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:32 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:32.301733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:32.302355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:32.309193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.309646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.310443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.310881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.412591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.422957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.425221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.426665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ed76967-9473-4925-89ee-b6c4344779ba tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1371 microversion: 2.47 time: 0.128950 Jun 04 20:58:32.427213 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 806/1614] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:32 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:32.432264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:32.433165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:32.439855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.440544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.441521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.441961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.496557 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79952f1f-9dc5-4960-92ad-39f4ce754dac tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b" status: 202 len: 0 microversion: 2.1 time: 0.357875 Jun 04 20:58:32.500270 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 809/1615] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:32 2022] DELETE /compute/v2.1/os-security-groups/704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:32.506594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-728ed444-cff8-4106-a00d-d1f1f3edb5b0 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d0be01f70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:32.525399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:32.543951 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd2581d5-3576-4229-ad99-8dadd1258469 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1274 microversion: 2.1 time: 0.115180 Jun 04 20:58:32.545257 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 807/1616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:32 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:32.576712 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-728ed444-cff8-4106-a00d-d1f1f3edb5b0 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/af9e9baa-34f8-497e-94fb-85884b445568" status: 200 len: 247 microversion: 2.1 time: 0.074662 Jun 04 20:58:32.577763 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 810/1617] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:32 2022] GET /compute/v2.1/os-security-groups/af9e9baa-34f8-497e-94fb-85884b445568 => generated 247 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:32.588892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:32.589697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:32.595939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.596756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.597979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:32.598610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d2c50c9-1315-401c-9ff6-c78a6c252423 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0be014c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-940452880", "description": "tempest-description-1525047190"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:32.598953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:32.677850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=16 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:33.023991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:33.033701 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d701dc2c-eb10-4535-82f2-3679c80af6e8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1324 microversion: 2.1 time: 0.450238 Jun 04 20:58:33.034280 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 808/1618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:32 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:33.040039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:33.040714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:33.049203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.049836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.050653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.051103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.171376 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d2c50c9-1315-401c-9ff6-c78a6c252423 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.583913 Jun 04 20:58:33.178650 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 811/1619] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:58:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:33.185033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:33.185904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:33.195175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.195534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.196342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.197135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.383073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:33.392507 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-91307d0c-f271-4651-ae7c-64cbe9e5f4b6 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.356833 Jun 04 20:58:33.393115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 809/1620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:33 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:33.398965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-78b09ce0-7f31-49ab-a227-20811ce84c22 req-4743497f-5b49-4558-a3a0-2b41080cbb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb2d225-8fcd-4a09-8770-ed502cd6dfe9", "name": "network-vif-unplugged", "status": "completed", "tag": "3dc2e353-4db4-40a7-99bf-6045c3c453b5"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:33.408759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-78b09ce0-7f31-49ab-a227-20811ce84c22 req-4743497f-5b49-4558-a3a0-2b41080cbb49 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.409998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-78b09ce0-7f31-49ab-a227-20811ce84c22 req-4743497f-5b49-4558-a3a0-2b41080cbb49 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.415235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:33.425225 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-78b09ce0-7f31-49ab-a227-20811ce84c22 req-4743497f-5b49-4558-a3a0-2b41080cbb49 service nova] Creating event network-vif-unplugged:3dc2e353-4db4-40a7-99bf-6045c3c453b5 for instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 on nch2-master-1 Jun 04 20:58:33.431292 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-78b09ce0-7f31-49ab-a227-20811ce84c22 req-4743497f-5b49-4558-a3a0-2b41080cbb49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036993 Jun 04 20:58:33.432532 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 810/1621] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:33.439425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:33.440293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:33.448523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.449546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.450507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.451111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.462375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:33.475317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:33.477600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:33.479217 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ad2d0a76-0e53-4792-8bc5-6d95cdc891e0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.299169 Jun 04 20:58:33.480217 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 812/1622] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:33 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:33.485126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1490f3a5-48c2-4696-8aac-6048f947a673 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0be0c280>, body: {"security_group_rule": {"parent_group_id": "9fef498e-c5e7-4bdb-a951-dda27d107e85", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:33.892055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3508546117f459a9a0b21da6b4a07f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbf8c0a57b514a0f9b42a2fcfd3070bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:33.914347 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ceba3d7-d96e-4b04-a066-6003f1647b4d tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 200 len: 1468 microversion: 2.1 time: 0.480259 Jun 04 20:58:33.914956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 811/1623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:33 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 1468 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:33.919907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:33.920539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:33.926936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.927389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:33.928200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:33.928635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.197017 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1490f3a5-48c2-4696-8aac-6048f947a673 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.712929 Jun 04 20:58:34.204427 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 813/1624] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 20:58:33 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:34.210362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:34.211080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:34.213638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:34.224882 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b78c30f4-1b2c-47d5-829b-e5ee292e24c0 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1392 microversion: 2.1 time: 0.308747 Jun 04 20:58:34.226075 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 812/1625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:33 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1392 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:34.232803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:34.233723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:34.240981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:34.242704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.243077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.243390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.244028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.244390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.244576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.245993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.246625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.389724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:34.402935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:34.404707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:34.406339 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-592d6728-701d-405c-9b90-8b6bca32f4ff tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1371 microversion: 2.47 time: 0.200291 Jun 04 20:58:34.407095 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 814/1626] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:34 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:34.411735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-830ca64d-0765-48b8-b6d2-8dab4ce26d0c req-49f3726c-9508-4e99-9572-c144fc481e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb2d225-8fcd-4a09-8770-ed502cd6dfe9", "name": "network-vif-deleted", "tag": "3dc2e353-4db4-40a7-99bf-6045c3c453b5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:34.420678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-830ca64d-0765-48b8-b6d2-8dab4ce26d0c req-49f3726c-9508-4e99-9572-c144fc481e7a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.421124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-830ca64d-0765-48b8-b6d2-8dab4ce26d0c req-49f3726c-9508-4e99-9572-c144fc481e7a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.435172 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-830ca64d-0765-48b8-b6d2-8dab4ce26d0c req-49f3726c-9508-4e99-9572-c144fc481e7a service nova] Creating event network-vif-deleted:3dc2e353-4db4-40a7-99bf-6045c3c453b5 for instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 on nch2-master-1 Jun 04 20:58:34.440153 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-830ca64d-0765-48b8-b6d2-8dab4ce26d0c req-49f3726c-9508-4e99-9572-c144fc481e7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Jun 04 20:58:34.440943 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 815/1627] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:34.447253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:34.448058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:34.458660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.459114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.460200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.460625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.507481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:34.517606 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f95e1af0-0859-4034-9f26-82d53d40b321 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1316 microversion: 2.1 time: 0.290424 Jun 04 20:58:34.518600 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 813/1628] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:34 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:34.524787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-53f2ad2c-57ae-49c6-9d60-6e201c4a3966 req-095adcd9-885a-402d-a2f1-f7f9ad7a8a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6a3d42-40e7-4607-a6b5-32cdf3d067f6", "tag": "49c5a420-94ab-4019-8435-00f01dd4c9db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:34.535370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-53f2ad2c-57ae-49c6-9d60-6e201c4a3966 req-095adcd9-885a-402d-a2f1-f7f9ad7a8a31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.535877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-53f2ad2c-57ae-49c6-9d60-6e201c4a3966 req-095adcd9-885a-402d-a2f1-f7f9ad7a8a31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.550251 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-53f2ad2c-57ae-49c6-9d60-6e201c4a3966 req-095adcd9-885a-402d-a2f1-f7f9ad7a8a31 service nova] Creating event network-changed:49c5a420-94ab-4019-8435-00f01dd4c9db for instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 on nch1-master-1 Jun 04 20:58:34.555991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-53f2ad2c-57ae-49c6-9d60-6e201c4a3966 req-095adcd9-885a-402d-a2f1-f7f9ad7a8a31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035841 Jun 04 20:58:34.556859 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 814/1629] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:34.564076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8932919c-b633-4577-b727-f7e4f82b3fe6 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Action: 'create', calling method: .version_select at 0x7f2d0bd49430>, body: {"security_group_rule": {"parent_group_id": "9fef498e-c5e7-4bdb-a951-dda27d107e85", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:34.678038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:34.686637 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-55c56709-6074-4d0b-ad5d-413081255319 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 200 len: 1521 microversion: 2.1 time: 0.244178 Jun 04 20:58:34.697815 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 816/1630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:34 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:34.697815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:34.697815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:34.706717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.707424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:34.708619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:34.709240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.038993 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8932919c-b633-4577-b727-f7e4f82b3fe6 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.479990 Jun 04 20:58:35.041074 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 815/1631] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 20:58:34 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:35.050615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:35.053863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:35.054261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:35.065531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.066123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.067071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.067674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.069582 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d58e3e15-9d0c-48a5-89eb-26feef5cb06f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.380710 Jun 04 20:58:35.070773 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 817/1632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:34 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:35.076349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'action', calling method: .version_select at 0x7f2d08ea5790>, body: {"addFloatingIp": {"address": "172.35.4.128"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:35.079288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:35.087262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.088094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.089577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.090028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.163550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Acquired lock "refresh_cache-d36797c0-2f7a-498a-90bc-8bc1e14f2090" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:58:35.189465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:35.445375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:35.457137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:35.460209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:35.461459 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae54fe66-1c28-46ed-b2b6-d81537e2656b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.417416 Jun 04 20:58:35.461980 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 816/1633] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:35 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:35.467191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:35.468405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] [instance: feb2d225-8fcd-4a09-8770-ed502cd6dfe9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:35.479322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.480185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.481442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.482524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.498447 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] HTTP exception thrown: Instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 could not be found. Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Request method failure captured: Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 HTTP/1.1 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8deRfMwLaANrn3r7pK9gAP9UmEv95Vk4OK1TYwPRjpNsw98GZqULaomFmPltHvcSrEw0Hb9fBM45txgyhOLD7lsFaKTVS3nteN1mlWbd397EEZnVOcY5tIiPeHw_feALJ0YqrX-vIHPbyGypNuuWIfF6qTOEAXHp6RSGkQNdWbymPY Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fbf8c0a57b514a0f9b42a2fcfd3070bf Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TenantUsagesTestJSON-91354028 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fbf8c0a57b514a0f9b42a2fcfd3070bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fbf8c0a57b514a0f9b42a2fcfd3070bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fbf8c0a57b514a0f9b42a2fcfd3070bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fbf8c0a57b514a0f9b42a2fcfd3070bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TenantUsagesTestJSON-91354028 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fbf8c0a57b514a0f9b42a2fcfd3070bf Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TenantUsagesTestJSON-91354028 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TenantUsagesTestJSON-91354028-project Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d3508546117f459a9a0b21da6b4a07f1 Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TenantUsagesTestJSON-91354028-project Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 could not be found. Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'feb2d225-8fcd-4a09-8770-ed502cd6dfe9'} Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 could not be found. Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 could not be found. Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:35.500185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 could not be found. Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] Returning 404 to user: Instance feb2d225-8fcd-4a09-8770-ed502cd6dfe9 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4409b50e-0631-4d88-b19c-1d7d47087457 tempest-TenantUsagesTestJSON-91354028 tempest-TenantUsagesTestJSON-91354028-project] 10.222.0.18 "GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9" status: 404 len: 111 microversion: 2.1 time: 0.038335 Jun 04 20:58:35.505407 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 817/1634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:35 2022] GET /compute/v2.1/servers/feb2d225-8fcd-4a09-8770-ed502cd6dfe9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:35.507895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5627cdef-95b4-46d3-a23f-91f6c88c2598 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d01b3d160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:35.641957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5627cdef-95b4-46d3-a23f-91f6c88c2598 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/9fef498e-c5e7-4bdb-a951-dda27d107e85" status: 200 len: 664 microversion: 2.1 time: 0.138038 Jun 04 20:58:35.650114 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 818/1635] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:58:35 2022] GET /compute/v2.1/os-security-groups/9fef498e-c5e7-4bdb-a951-dda27d107e85 => generated 664 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:35.650114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:35.651722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:35.659948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.661169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:35.662197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:35.662777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:36.031057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:36.039897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bedd89c1-faa1-49db-bcdd-6efb01b92337 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1382 microversion: 2.1 time: 0.394691 Jun 04 20:58:36.040578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 819/1636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:35 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1382 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:36.045120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:36.045759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:36.052695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:36.053130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:36.053947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:36.054386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:36.146760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:36.155811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:36.157324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:36.158513 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2c1815ef-f9e0-43e2-848b-fd990f2b8f46 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1356 microversion: 2.47 time: 0.117208 Jun 04 20:58:36.165466 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 820/1637] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:36 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1356 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:36.165466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:36.165466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:36.171553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:36.172137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:36.173350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:36.173791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:36.458987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:36.468477 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88e2dbda-a6c8-49af-8aaf-ac39c245b518 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1316 microversion: 2.1 time: 0.307564 Jun 04 20:58:36.479605 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 821/1638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:36 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:36.486219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f9e032c4-3c8d-41ab-87cd-ee57b66c545c tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d0bd8dc10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:37.174259 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f9e032c4-3c8d-41ab-87cd-ee57b66c545c tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/e5c69c82-8c14-4406-bc14-65027402e2b5" status: 202 len: 0 microversion: 2.1 time: 0.693081 Jun 04 20:58:37.176465 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 822/1639] 10.222.0.18 () {58 vars in 1286 bytes} [Sat Jun 4 20:58:36 2022] DELETE /compute/v2.1/os-security-group-rules/e5c69c82-8c14-4406-bc14-65027402e2b5 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:37.188543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-91d1f5cf-48ec-449a-bd03-375620291558 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '.version_select at 0x7f2d01b3d3a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:37.192696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91d1f5cf-48ec-449a-bd03-375620291558 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.193157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91d1f5cf-48ec-449a-bd03-375620291558 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.206068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-91d1f5cf-48ec-449a-bd03-375620291558 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.028243 Jun 04 20:58:37.207255 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 823/1640] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 20:58:37 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:37.225410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:37.226046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:37.236727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.237196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.238001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.238754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.446042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 20:58:37.466405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:37.471793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:37.485816 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-630f27c7-e14b-4f07-8789-582c23f6e5fb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.270492 Jun 04 20:58:37.487743 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 824/1641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:37 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:37.502365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:37.508566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:37.509787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Searching by: {'deleted': False, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 20:58:37.518367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.519124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.520130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.520740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.684471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 20:58:37.828519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:37.842141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.842141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.857053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:37.859663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:37.927608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1c2b24d6-0db4-40bf-b076-36e0db3ca1a5 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.438753 Jun 04 20:58:37.952398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 825/1642] 10.222.0.18 () {60 vars in 1186 bytes} [Sat Jun 4 20:58:37 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:37.957278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:37.958950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:37.965412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.966549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:37.966765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:37.967263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.312035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:38.331399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:38.338824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:38.342783 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e1f5b7c4-77f4-454e-9144-e09fadee922c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.388414 Jun 04 20:58:38.353081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 826/1643] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:37 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:38.357810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb469aca-d216-4922-ad34-10b5da7c8b09 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d0bd8d280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:38.436810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Updating instance_info_cache with network_info: [{"id": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb", "address": "fa:16:3e:d3:a1:aa", "network": {"id": "d13de28a-5d75-4dd4-a643-af6e82d2a36d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1122774834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5f72194d8a044e81a3a48e7716a1395f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcfb7ff8a-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 20:58:38.452149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Releasing lock "refresh_cache-d36797c0-2f7a-498a-90bc-8bc1e14f2090" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:58:38.454212 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cd5802af-c0e9-427e-b269-d7750e2caac3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action" status: 202 len: 0 microversion: 2.1 time: 3.382234 Jun 04 20:58:38.455785 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 818/1644] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:35 2022] POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action => generated 0 bytes in 3384 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 20:58:38.461826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:38.464774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:38.473633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.474308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.475455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.476560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.757210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4661f0b1-e322-4d89-82f8-1841b9f230d2 tempest-LiveMigrationTest-1887059151 tempest-LiveMigrationTest-1887059151-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1533 microversion: 2.1 time: 0.294699 Jun 04 20:58:38.773426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 819/1645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:38 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1533 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:38.785201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-66574380-6edb-439e-bc4f-d83214c93adb req-55ed8521-7582-4583-b275-46b27bb0f0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:38.789821 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb469aca-d216-4922-ad34-10b5da7c8b09 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9fef498e-c5e7-4bdb-a951-dda27d107e85" status: 202 len: 0 microversion: 2.1 time: 0.440761 Jun 04 20:58:38.790666 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 827/1646] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:38 2022] DELETE /compute/v2.1/os-security-groups/9fef498e-c5e7-4bdb-a951-dda27d107e85 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:38.799262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:38.800295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:38.806079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-66574380-6edb-439e-bc4f-d83214c93adb req-55ed8521-7582-4583-b275-46b27bb0f0f4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.809160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-66574380-6edb-439e-bc4f-d83214c93adb req-55ed8521-7582-4583-b275-46b27bb0f0f4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.825578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.826165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.830127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.831925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.838452 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-66574380-6edb-439e-bc4f-d83214c93adb req-55ed8521-7582-4583-b275-46b27bb0f0f4 service nova] Creating event network-changed:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:58:38.844192 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-66574380-6edb-439e-bc4f-d83214c93adb req-55ed8521-7582-4583-b275-46b27bb0f0f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068410 Jun 04 20:58:38.844891 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 820/1647] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:38.856365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:38.857258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:38.865546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.865911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.867084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:38.868201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:38.917779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:39.059624 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74266986-1dd0-4928-b749-605e1b287b3b tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 204 len: 0 microversion: 2.47 time: 0.208943 Jun 04 20:58:39.061581 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 821/1648] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 20:58:38 2022] DELETE /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 20:58:39.068807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.128"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:39.071314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:39.079424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:39.080737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.082082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.083954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.084850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.090427 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5364ce04-99e3-4e70-b1de-b27d0a54c410 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1316 microversion: 2.1 time: 0.298234 Jun 04 20:58:39.091335 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 828/1649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:38 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:39.096735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:39.097577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:39.106356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.107048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.108038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.108627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.125084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Acquired lock "refresh_cache-6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:58:39.458067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:39.469509 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-942ec628-3f36-494c-900c-72bb0e64249a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.376837 Jun 04 20:58:39.470734 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 829/1650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:39 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:39.477953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:39.478452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:39.485730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.486175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.486958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.487389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.518147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:39.637958 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6c1a6f08-8116-456e-abbd-9dbfc0288c1a tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 204 len: 0 microversion: 2.1 time: 0.163204 Jun 04 20:58:39.641667 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 830/1651] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:58:39 2022] DELETE /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:58:39.648124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d01aa2280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:39.725104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:58:39.727148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Neutron security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:58:39.730529 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] HTTP exception thrown: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.730529 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Request method failure captured: Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b HTTP/1.1 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8durjoLL6Nsjc3NHXRu48YgaVWrsITrWBt-R7fJ3v5s1uwlKs-sc2QotnDW7eZTR0LYBYi5srgbtAJnh_NARYFoQxetSjb_V5aKOQqt6WXcRGfFJVsLuAVWGxZx-nao_ME2CawLvWBXRdvJzvlXZCJRTjAqeW6vg4S7j5_eq-ZLY5w Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ca8653fe7077444c88c7be214c0ca8eb Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1126519314 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ca8653fe7077444c88c7be214c0ca8eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca8653fe7077444c88c7be214c0ca8eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ca8653fe7077444c88c7be214c0ca8eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ca8653fe7077444c88c7be214c0ca8eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1126519314 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ca8653fe7077444c88c7be214c0ca8eb Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1126519314 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupRulesTestJSON-1126519314-project Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5fb164815f7a4469a9c27fd3ad9212ca Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1126519314-project Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b'} Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:58:39.733796 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] Jun 04 20:58:39.739115 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:39.745749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Returning 404 to user: Security group 704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b does not exist Jun 04 20:58:39.745749 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6485ca44-488b-4803-83f8-18a8073d9725'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:39.747356 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d7e38c76-fec5-4f33-a4d7-fab540b662ff tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b" status: 404 len: 194 microversion: 2.1 time: 0.104153 Jun 04 20:58:39.748220 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 831/1652] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:39 2022] DELETE /compute/v2.1/os-security-groups/704aa2cc-4c2f-4cc9-ba29-3d13ff483a4b => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:39.757206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:39.758325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:39.767926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.768728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.769830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.771637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.814068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:39.874875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:39.886343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:39.888117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:39.889936 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-07b18bc8-38fc-4192-b101-3d2a3618c020 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 200 len: 1362 microversion: 2.47 time: 0.140373 Jun 04 20:58:39.890748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 832/1653] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:39 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:39.897054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:39.898048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:39.907396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.908432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:39.909553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:39.910256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:40.167366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:40.181515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:40.184024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:40.185315 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3bed791b-9abf-4b8c-849b-2fdcc420bd80 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.293222 Jun 04 20:58:40.186002 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 833/1654] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:39 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:40.191223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:40.193681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:40.201109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:40.202373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:40.204164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:40.204819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:40.499985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:40.511081 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db8082c6-fd2d-4255-aed5-932a2b030e41 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1388 microversion: 2.1 time: 0.323687 Jun 04 20:58:40.512190 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 834/1655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:40 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1388 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:40.519012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-189d57c6-d064-4360-93d9-58baacb0c9c7 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d01a92040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:40.672060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:40.965882 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-189d57c6-d064-4360-93d9-58baacb0c9c7 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/af9e9baa-34f8-497e-94fb-85884b445568" status: 202 len: 0 microversion: 2.1 time: 0.452105 Jun 04 20:58:40.966791 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 835/1656] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:40 2022] DELETE /compute/v2.1/os-security-groups/af9e9baa-34f8-497e-94fb-85884b445568 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:40.974726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:40.975717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:40.988889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:40.989429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:40.991762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:40.992321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:41.038412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:41.691984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:41.706349 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b158a1a-3709-48f7-a75d-2a9d804cf393 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1316 microversion: 2.1 time: 0.738097 Jun 04 20:58:41.706950 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 836/1657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:40 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1316 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:41.715093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:41.718527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:41.733982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:41.737834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:41.738807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:41.739253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:42.047077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:42.058182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8916be9d-ffbc-4f36-9a62-b681aa9c2bcd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.349084 Jun 04 20:58:42.058785 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 837/1658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:41 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:42.070161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4308aa94-1b02-4bec-8bd3-7d8985cf9b04 req-a33874d8-b3bf-4c3b-a4cf-871724726a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6a3d42-40e7-4607-a6b5-32cdf3d067f6", "name": "network-vif-plugged", "status": "completed", "tag": "49c5a420-94ab-4019-8435-00f01dd4c9db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:42.079345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4308aa94-1b02-4bec-8bd3-7d8985cf9b04 req-a33874d8-b3bf-4c3b-a4cf-871724726a56 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:42.080194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4308aa94-1b02-4bec-8bd3-7d8985cf9b04 req-a33874d8-b3bf-4c3b-a4cf-871724726a56 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:42.092955 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4308aa94-1b02-4bec-8bd3-7d8985cf9b04 req-a33874d8-b3bf-4c3b-a4cf-871724726a56 service nova] Creating event network-vif-plugged:49c5a420-94ab-4019-8435-00f01dd4c9db for instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 on nch1-master-1 Jun 04 20:58:42.099569 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4308aa94-1b02-4bec-8bd3-7d8985cf9b04 req-a33874d8-b3bf-4c3b-a4cf-871724726a56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Jun 04 20:58:42.101103 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 838/1659] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:42.108133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:42.109668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: b09c6c42-3f8f-4f6e-8dd4-0a3391773804] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:42.119655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:42.120741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:42.122018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:42.122628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:42.144927 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] HTTP exception thrown: Instance b09c6c42-3f8f-4f6e-8dd4-0a3391773804 could not be found. Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Request method failure captured: Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 HTTP/1.1 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dMhawGgbhemMDQhRbxklZpWmIVSU1122cosF4dYEEAFDKdg2OURXSk1-6INEKepk9gGQcz72JkS0CfrkNPGdF4DIvVrk8nmpgqrmlU_2ogGPgApYZj2GBqRpCiBlBEEfd-z4wD28LpwYAU3irz4hoMWd3Itur0W4ktHeKn_71HyU8 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.47 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: cf5eb8af4980464f85c99b9986abf8cb Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerShowV247Test-800591165 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerShowV247Test-800591165 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: cf5eb8af4980464f85c99b9986abf8cb Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerShowV247Test-800591165 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerShowV247Test-800591165-project Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 93597ab23b2a41db94d09d78de7659d2 Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerShowV247Test-800591165-project Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b09c6c42-3f8f-4f6e-8dd4-0a3391773804 could not be found. Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b09c6c42-3f8f-4f6e-8dd4-0a3391773804'} Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09c6c42-3f8f-4f6e-8dd4-0a3391773804 could not be found. Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09c6c42-3f8f-4f6e-8dd4-0a3391773804 could not be found. Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:42.163766 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09c6c42-3f8f-4f6e-8dd4-0a3391773804 could not be found. Jun 04 20:58:42.169506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:42.173187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Returning 404 to user: Instance b09c6c42-3f8f-4f6e-8dd4-0a3391773804 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:42.176000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84f8041f-4308-4cc3-962e-9ca7c0e40a25 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804" status: 404 len: 111 microversion: 2.47 time: 0.073116 Jun 04 20:58:42.177073 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 839/1660] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:42 2022] GET /compute/v2.1/servers/b09c6c42-3f8f-4f6e-8dd4-0a3391773804 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:58:42.186297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29327aff-a651-464d-a707-da16c0d037f6 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d026cc5e0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:42.477297 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.neutron [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] re-assign floating IP 172.35.4.128 from instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 Jun 04 20:58:42.561681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 20:58:42.768472 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-29327aff-a651-464d-a707-da16c0d037f6 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/399d0496-dcc3-4350-8b56-454ed68e55af" status: 202 len: 0 microversion: 2.1 time: 0.589820 Jun 04 20:58:42.769389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 840/1661] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:42 2022] DELETE /compute/v2.1/os-security-groups/399d0496-dcc3-4350-8b56-454ed68e55af => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:42.776818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:42.777904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:42.795416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:42.796188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:42.797239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:42.798697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.238042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:43.255742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:43.257627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:43.259066 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3579179f-b0fa-4f0e-9627-18558d04259d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.488455 Jun 04 20:58:43.260375 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 841/1662] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:42 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:43.267853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:43.270974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:43.284864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.285673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.288499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.289140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.401616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:43.418034 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e16f60d-c90b-4891-9bbb-55b13dad4f4c tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 200 len: 1184 microversion: 2.1 time: 0.156391 Jun 04 20:58:43.419257 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 842/1663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:43 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 1184 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:43.424252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:43.424760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:43.436336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:43.437919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.438367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.439155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.439622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.524589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:43.621308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Updating instance_info_cache with network_info: [{"id": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb", "address": "fa:16:3e:d3:a1:aa", "network": {"id": "d13de28a-5d75-4dd4-a643-af6e82d2a36d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1122774834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5f72194d8a044e81a3a48e7716a1395f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcfb7ff8a-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 20:58:43.638083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 20:58:43.749317 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5e35a168-768a-4811-b1ba-a253bd190313 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4" status: 204 len: 0 microversion: 2.47 time: 0.329155 Jun 04 20:58:43.754445 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 843/1664] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 20:58:43 2022] DELETE /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 20:58:43.763288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c04bfc35-f596-4bb3-b072-f27a6e1753f7 req-dc8ecc9b-30a1-4041-9ee6-526e1974d95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:43.788946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c04bfc35-f596-4bb3-b072-f27a6e1753f7 req-dc8ecc9b-30a1-4041-9ee6-526e1974d95b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.789610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c04bfc35-f596-4bb3-b072-f27a6e1753f7 req-dc8ecc9b-30a1-4041-9ee6-526e1974d95b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.837723 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c04bfc35-f596-4bb3-b072-f27a6e1753f7 req-dc8ecc9b-30a1-4041-9ee6-526e1974d95b service nova] Creating event network-changed:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:58:43.851586 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c04bfc35-f596-4bb3-b072-f27a6e1753f7 req-dc8ecc9b-30a1-4041-9ee6-526e1974d95b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096084 Jun 04 20:58:43.852575 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 844/1665] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:43.866905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:43.868748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:43.888161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.889721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:43.894823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:43.896618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:44.227065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:44.239787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b72403ac-1087-4370-9e17-bd5ed84be7ee tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1316 microversion: 2.1 time: 0.385625 Jun 04 20:58:44.252418 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 845/1666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:43 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:44.257676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fccb17d5-4667-4e8e-a153-f0ecfaa8a5ef tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d01ab4dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:44.804668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Updating instance_info_cache with network_info: [{"id": "d5a456eb-1cbe-422f-934f-21b1dfae3264", "address": "fa:16:3e:74:68:cc", "network": {"id": "d13de28a-5d75-4dd4-a643-af6e82d2a36d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1122774834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5f72194d8a044e81a3a48e7716a1395f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5a456eb-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 20:58:44.824429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Releasing lock "refresh_cache-6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:58:44.825645 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-82fb4f32-1745-47e7-8eae-6b04af5a8c54 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34/action" status: 202 len: 0 microversion: 2.1 time: 5.762429 Jun 04 20:58:44.826439 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 822/1667] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:39 2022] POST /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34/action => generated 0 bytes in 5764 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 20:58:44.833170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-33dcc8c8-fb92-4640-907e-1801fc2bfaf8 req-c61946ca-5c94-4ba2-9235-dc34c02568bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1a9e76-c12d-438e-94a5-391bf478dd9f", "name": "network-vif-deleted", "tag": "d9de457e-c9e8-46f6-be69-d7586ca79501"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:44.850693 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fccb17d5-4667-4e8e-a153-f0ecfaa8a5ef tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/2b676f11-2461-45e3-b600-a5bd115386da" status: 202 len: 0 microversion: 2.1 time: 0.606279 Jun 04 20:58:44.852318 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 846/1668] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:44 2022] DELETE /compute/v2.1/os-security-groups/2b676f11-2461-45e3-b600-a5bd115386da => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:44.859911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:44.860762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:44.860906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-33dcc8c8-fb92-4640-907e-1801fc2bfaf8 req-c61946ca-5c94-4ba2-9235-dc34c02568bf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:44.861521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-33dcc8c8-fb92-4640-907e-1801fc2bfaf8 req-c61946ca-5c94-4ba2-9235-dc34c02568bf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:44.870014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:44.870981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:44.873653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:44.874415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:44.902067 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-33dcc8c8-fb92-4640-907e-1801fc2bfaf8 req-c61946ca-5c94-4ba2-9235-dc34c02568bf service nova] Creating event network-vif-deleted:d9de457e-c9e8-46f6-be69-d7586ca79501 for instance db1a9e76-c12d-438e-94a5-391bf478dd9f on nch2-master-1 Jun 04 20:58:44.916073 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-33dcc8c8-fb92-4640-907e-1801fc2bfaf8 req-c61946ca-5c94-4ba2-9235-dc34c02568bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086302 Jun 04 20:58:44.919274 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 823/1669] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:44.935306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:44.936043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:44.978078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:44.981212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:44.983187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:44.984827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.138285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.152864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.154996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.157605 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22d1f944-d220-4694-8513-99d4d02baac6 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4" status: 200 len: 1363 microversion: 2.47 time: 0.236038 Jun 04 20:58:45.158715 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 824/1670] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:44 2022] GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:45.164177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-55f57f78-a38e-4477-9894-7f1a1acdd469 req-c733bbf2-aa24-49ca-900e-f55dedfd48bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a183ce72-70aa-487e-b90f-7a89e17720b3", "name": "network-vif-plugged", "status": "completed", "tag": "51a43abd-07c8-4b4a-9258-2f0b67574647"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:45.174543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-55f57f78-a38e-4477-9894-7f1a1acdd469 req-c733bbf2-aa24-49ca-900e-f55dedfd48bc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.175847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-55f57f78-a38e-4477-9894-7f1a1acdd469 req-c733bbf2-aa24-49ca-900e-f55dedfd48bc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.215364 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-55f57f78-a38e-4477-9894-7f1a1acdd469 req-c733bbf2-aa24-49ca-900e-f55dedfd48bc service nova] Creating event network-vif-plugged:51a43abd-07c8-4b4a-9258-2f0b67574647 for instance a183ce72-70aa-487e-b90f-7a89e17720b3 on nch2-master-1 Jun 04 20:58:45.218780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.233451 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-55f57f78-a38e-4477-9894-7f1a1acdd469 req-c733bbf2-aa24-49ca-900e-f55dedfd48bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073073 Jun 04 20:58:45.234414 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 825/1671] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:45.236013 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05e056cf-467a-4204-8353-562a705a4464 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.377095 Jun 04 20:58:45.244970 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 847/1672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:44 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:45.251700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:45.252945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:45.260204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.260882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:45.261112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.262055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.262821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.263463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: db1a9e76-c12d-438e-94a5-391bf478dd9f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:45.302925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.303526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.304387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.304828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.335161 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] HTTP exception thrown: Instance db1a9e76-c12d-438e-94a5-391bf478dd9f could not be found. Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Request method failure captured: Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f HTTP/1.1 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZiMhuPTqkbbUzmS8VCkMM8UR6AGe9WOt6z6z8aMMPiBf7RK9jjXJupaCSiksRguY7b_H7SRYhU18ktFVWFQdOYh6veKTBCP99sSkFLvgaxLyr1A5Uwl0s9ogEsI9r8_IosBOWJ1zQNgGpmtc7uzRQ8PBqoLTGWypNsk72iofYTR8I Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveMigrationTest-647686994 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveMigrationTest-647686994-project Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ac8ef83fa94e4c9db70a0115cc867dfc Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveMigrationTest-647686994-project Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance db1a9e76-c12d-438e-94a5-391bf478dd9f could not be found. Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'db1a9e76-c12d-438e-94a5-391bf478dd9f'} Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1a9e76-c12d-438e-94a5-391bf478dd9f could not be found. Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1a9e76-c12d-438e-94a5-391bf478dd9f could not be found. Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:45.342615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1a9e76-c12d-438e-94a5-391bf478dd9f could not be found. Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Returning 404 to user: Instance db1a9e76-c12d-438e-94a5-391bf478dd9f could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:45.347108 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a4000c6-6464-4a9e-9352-7706948a9694 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f" status: 404 len: 111 microversion: 2.1 time: 0.097927 Jun 04 20:58:45.364646 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 848/1673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:45 2022] GET /compute/v2.1/servers/db1a9e76-c12d-438e-94a5-391bf478dd9f => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:45.385844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'action', calling method: .version_select at 0x7f2d08ea65e0>, body: {"removeFloatingIp": {"address": "172.35.4.128"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:45.643666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.655697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.657514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:45.658915 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c444e0c-0582-43e6-9f5b-6a18e62eee03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1361 microversion: 2.25 time: 0.423183 Jun 04 20:58:45.659817 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 826/1674] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:45 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:45.664994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e5998ea-2956-4589-bf90-45a95822d136 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d0bd5f430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:45.759263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:45.767336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.772325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:45.775292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:45.777916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.148259 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e5998ea-2956-4589-bf90-45a95822d136 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/5174eb56-1ddb-41b7-bcf9-c2e3f5d37626" status: 202 len: 0 microversion: 2.1 time: 0.486591 Jun 04 20:58:46.151563 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 827/1675] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:45 2022] DELETE /compute/v2.1/os-security-groups/5174eb56-1ddb-41b7-bcf9-c2e3f5d37626 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:46.171108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:46.183496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:46.230040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.232641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.235124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.238215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.284522 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] HTTP exception thrown: Floating IP 172.35.4.128 is not associated with instance d36797c0-2f7a-498a-90bc-8bc1e14f2090. Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Request method failure captured: Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action HTTP/1.1 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 49 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dL9Z6XJWo8F2DpFN9er8b_LWirGda0TwkorKdmMaaeC6ckVLgrFeohlwhktwPT8tl2wNjXiOTDw92pdXGEdZBgmEX9IU5OMHv-zyxv24Nl5aP6DcA314FsOreveENgMxBoMbBTs4TZTSbgnsMz5VQTw1Tm8TtjtOKQ0Sdy5LomvQY Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c80f5171e36f498cb2601ae92861a94a Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: {"removeFloatingIp": {"address": "172.35.4.128"}} Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: exception: Floating IP 172.35.4.128 is not associated with instance d36797c0-2f7a-498a-90bc-8bc1e14f2090. Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd36797c0-2f7a-498a-90bc-8bc1e14f2090', 'body': {'removeFloatingIp': {'address': '172.35.4.128'}}} Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.128 is not associated with instance d36797c0-2f7a-498a-90bc-8bc1e14f2090. Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.128 is not associated with instance d36797c0-2f7a-498a-90bc-8bc1e14f2090. Jun 04 20:58:46.293674 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:46.303068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Returning 409 to user: Floating IP 172.35.4.128 is not associated with instance d36797c0-2f7a-498a-90bc-8bc1e14f2090. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:46.304376 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ef324cf-a285-4759-a25b-4d19e8fcba63 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action" status: 409 len: 146 microversion: 2.1 time: 0.938636 Jun 04 20:58:46.310713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 849/1676] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:45 2022] POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action => generated 146 bytes in 945 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:58:46.320997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b73df954-a4f3-4ec3-853a-aff55c829b32 req-c3903480-8f88-40b8-bdb0-acf69fbfd0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34", "tag": "d5a456eb-1cbe-422f-934f-21b1dfae3264"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:46.374671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b73df954-a4f3-4ec3-853a-aff55c829b32 req-c3903480-8f88-40b8-bdb0-acf69fbfd0f6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.375237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b73df954-a4f3-4ec3-853a-aff55c829b32 req-c3903480-8f88-40b8-bdb0-acf69fbfd0f6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.393548 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b73df954-a4f3-4ec3-853a-aff55c829b32 req-c3903480-8f88-40b8-bdb0-acf69fbfd0f6 service nova] Creating event network-changed:d5a456eb-1cbe-422f-934f-21b1dfae3264 for instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 on nch2-master-1 Jun 04 20:58:46.402857 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b73df954-a4f3-4ec3-853a-aff55c829b32 req-c3903480-8f88-40b8-bdb0-acf69fbfd0f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089291 Jun 04 20:58:46.404231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 850/1677] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:46.414066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d91eb13-cc58-4bd5-9278-8d5e187e93b3 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] Calling method '.version_select at 0x7f2d026cc790>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:46.584869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:46.599757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5836b4c-7741-4d57-b0b8-de7d1cbd23a0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1504 microversion: 2.1 time: 0.443969 Jun 04 20:58:46.600391 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 828/1678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:46 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1504 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:46.633370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:46.634200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:46.642994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.643855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.660069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.661900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.768510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:46.784635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:46.792140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93597ab23b2a41db94d09d78de7659d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5eb8af4980464f85c99b9986abf8cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:46.794801 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c535cfbd-b136-4aac-8ad4-bf6028f8f3c0 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4" status: 200 len: 1363 microversion: 2.47 time: 0.178964 Jun 04 20:58:46.806061 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 829/1679] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:46 2022] GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:46.806061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:46.806061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:46.811393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.811934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.812861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:46.813392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:46.991057 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d91eb13-cc58-4bd5-9278-8d5e187e93b3 tempest-SecurityGroupRulesTestJSON-1126519314 tempest-SecurityGroupRulesTestJSON-1126519314-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3cb18871-65b9-4d62-9e47-1d9bf3912205" status: 202 len: 0 microversion: 2.1 time: 0.581409 Jun 04 20:58:46.992764 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 851/1680] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:46 2022] DELETE /compute/v2.1/os-security-groups/3cb18871-65b9-4d62-9e47-1d9bf3912205 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:47.002192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.128"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:47.173501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:47.189079 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87c6f8cd-85ac-4331-b10b-d1a0f6527812 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.391613 Jun 04 20:58:47.190472 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 830/1681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:46 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:47.199445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-560392930"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:47.202392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:47.216950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:47.219138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:47.220214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:47.224071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:47.390386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:47.401178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:47.403057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:47.403958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:47.404402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:47.602293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:47.604515 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Adding security group 0cfffa36-c62e-487d-9037-03c6f9c958ef to port 49c5a420-94ab-4019-8435-00f01dd4c9db Jun 04 20:58:47.814715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:47.938352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Acquired lock "refresh_cache-6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:58:48.772720 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2850de9f-f82a-4985-b0ea-5eae65abef11 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6/action" status: 202 len: 0 microversion: 2.1 time: 1.580612 Jun 04 20:58:48.773758 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 831/1682] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:47 2022] POST /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6/action => generated 0 bytes in 1583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:48.782994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:48.784205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:48.809374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:48.810144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:48.812012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:48.813247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:48.902235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:49.005595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:49.123061 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff28b047-b48a-4e67-9779-628e99e83532 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 204 len: 0 microversion: 2.1 time: 0.347547 Jun 04 20:58:49.124900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 832/1683] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:58:48 2022] DELETE /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:58:49.141106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:49.144771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:49.158393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:49.158848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:49.160061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:49.160942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:49.456166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:49.467197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:49.468813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:49.476270 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bff5e755-fd55-45dc-9cc4-4973ae0f714e tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1558 microversion: 2.25 time: 0.349801 Jun 04 20:58:49.478796 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 833/1684] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:49 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1558 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:49.493734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Building network info cache for instance {{(pid=137228) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 20:58:49.995764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75e0c2a5-637c-4dda-b08b-a30313adc798 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Action: 'create', calling method: .version_select at 0x7f2d0be35430>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:50.322984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Updating instance_info_cache with network_info: [{"id": "d5a456eb-1cbe-422f-934f-21b1dfae3264", "address": "fa:16:3e:74:68:cc", "network": {"id": "d13de28a-5d75-4dd4-a643-af6e82d2a36d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1122774834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5f72194d8a044e81a3a48e7716a1395f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5a456eb-1c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137228) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 20:58:50.343086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Releasing lock "refresh_cache-6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:58:50.344497 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e417f4d-0972-47b4-82b1-9ee8ccd5c03b tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34/action" status: 202 len: 0 microversion: 2.1 time: 3.347238 Jun 04 20:58:50.346590 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 852/1685] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:46 2022] POST /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34/action => generated 0 bytes in 3350 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 20:58:50.361807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:50.362809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] [instance: 03328f8f-6635-42b8-811a-01141e98e3c4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:50.376755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:50.380153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:50.381312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:50.391028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:50.429558 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] HTTP exception thrown: Instance 03328f8f-6635-42b8-811a-01141e98e3c4 could not be found. Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Request method failure captured: Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4 HTTP/1.1 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dMhawGgbhemMDQhRbxklZpWmIVSU1122cosF4dYEEAFDKdg2OURXSk1-6INEKepk9gGQcz72JkS0CfrkNPGdF4DIvVrk8nmpgqrmlU_2ogGPgApYZj2GBqRpCiBlBEEfd-z4wD28LpwYAU3irz4hoMWd3Itur0W4ktHeKn_71HyU8 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.47 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: cf5eb8af4980464f85c99b9986abf8cb Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerShowV247Test-800591165 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cf5eb8af4980464f85c99b9986abf8cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerShowV247Test-800591165 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: cf5eb8af4980464f85c99b9986abf8cb Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerShowV247Test-800591165 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerShowV247Test-800591165-project Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 93597ab23b2a41db94d09d78de7659d2 Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerShowV247Test-800591165-project Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 03328f8f-6635-42b8-811a-01141e98e3c4 could not be found. Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '03328f8f-6635-42b8-811a-01141e98e3c4'} Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03328f8f-6635-42b8-811a-01141e98e3c4 could not be found. Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03328f8f-6635-42b8-811a-01141e98e3c4 could not be found. Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:50.437372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03328f8f-6635-42b8-811a-01141e98e3c4 could not be found. Jun 04 20:58:50.441936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:50.445617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] Returning 404 to user: Instance 03328f8f-6635-42b8-811a-01141e98e3c4 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:50.447018 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d65a6943-3a9b-4be2-a0cc-323f5a661059 tempest-ServerShowV247Test-800591165 tempest-ServerShowV247Test-800591165-project] 10.222.0.18 "GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4" status: 404 len: 111 microversion: 2.47 time: 0.099284 Jun 04 20:58:50.448414 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 853/1686] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:50 2022] GET /compute/v2.1/servers/03328f8f-6635-42b8-811a-01141e98e3c4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:58:50.458004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:50.459960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:50.467922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:50.468793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:50.469839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:50.470506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:50.515975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:51.001536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:51.016577 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d88aa361-4268-40bc-b5a6-52e73be3ca3b tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.566099 Jun 04 20:58:51.021603 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 854/1687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:50 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:51.032520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-718d4d60-82bb-41ca-bc98-bdf7aa2630ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01b4b9d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:51.318984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-718d4d60-82bb-41ca-bc98-bdf7aa2630ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use.", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:58:51.319771 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-718d4d60-82bb-41ca-bc98-bdf7aa2630ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.319771 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-718d4d60-82bb-41ca-bc98-bdf7aa2630ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef HTTP/1.1 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: exception: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0cfffa36-c62e-487d-9037-03c6f9c958ef'} Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:58:51.322419 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-718d4d60-82bb-41ca-bc98-bdf7aa2630ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 400 to user: Security Group 0cfffa36-c62e-487d-9037-03c6f9c958ef in use. Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-a359ae20-e3d9-451c-b6d9-ddb281c2d330'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:51.327784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-718d4d60-82bb-41ca-bc98-bdf7aa2630ba tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef" status: 400 len: 185 microversion: 2.1 time: 0.301302 Jun 04 20:58:51.331335 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 855/1688] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:58:51 2022] DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef => generated 185 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:58:51.339981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-45545f99-33d2-4494-8746-bc64c2697021 req-83a028f5-c316-4dfd-926e-c20a9e15ba2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6a3d42-40e7-4607-a6b5-32cdf3d067f6", "tag": "49c5a420-94ab-4019-8435-00f01dd4c9db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:51.368306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-45545f99-33d2-4494-8746-bc64c2697021 req-83a028f5-c316-4dfd-926e-c20a9e15ba2b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:51.368806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-45545f99-33d2-4494-8746-bc64c2697021 req-83a028f5-c316-4dfd-926e-c20a9e15ba2b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:51.405847 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-45545f99-33d2-4494-8746-bc64c2697021 req-83a028f5-c316-4dfd-926e-c20a9e15ba2b service nova] Creating event network-changed:49c5a420-94ab-4019-8435-00f01dd4c9db for instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 on nch1-master-1 Jun 04 20:58:51.419814 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-45545f99-33d2-4494-8746-bc64c2697021 req-83a028f5-c316-4dfd-926e-c20a9e15ba2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087772 Jun 04 20:58:51.420476 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 856/1689] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:51.448455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:51.450078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:51.461707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:51.462749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:51.465624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:51.466589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:51.922569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:51.943893 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e206f31e-3667-47e5-b32b-1aa42223d4bd tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 200 len: 1499 microversion: 2.1 time: 0.518391 Jun 04 20:58:51.945007 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 857/1690] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:51 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 1499 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:51.952555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:51.953276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:51.972412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:51.972986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:51.988126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:51.988863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:52.767033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:52.810102 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85defd51-ebd8-4153-a14a-7d5e6543cbad tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 2050 microversion: 2.25 time: 0.863784 Jun 04 20:58:52.835322 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 858/1691] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:58:51 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 2050 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:58:52.850143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:52.850609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:52.861333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:52.866399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:52.867491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:52.872450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:52.883623 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75e0c2a5-637c-4dda-b08b-a30313adc798 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.399506 Jun 04 20:58:52.893496 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 834/1692] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:58:49 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:52.901208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:52.902640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:52.910421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:52.911204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:52.917850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:52.918489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:52.933978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:53.016020 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-61bb05c1-e629-48dc-a74c-de6717d2a0cf tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6/action" status: 202 len: 0 microversion: 2.1 time: 0.119603 Jun 04 20:58:53.020098 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 835/1693] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:52 2022] POST /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:53.032211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-30513c6a-4fc2-4703-b092-68b3faade468 req-ef3d6554-2ceb-4a52-942e-34858ead27a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d7e4b8-0a2f-475c-b7e4-4c82582b189b", "name": "network-vif-deleted", "tag": "dfa86e07-8d1c-4846-80e1-da35a0f8beb8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:53.049498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-30513c6a-4fc2-4703-b092-68b3faade468 req-ef3d6554-2ceb-4a52-942e-34858ead27a1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.050693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-30513c6a-4fc2-4703-b092-68b3faade468 req-ef3d6554-2ceb-4a52-942e-34858ead27a1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.083563 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-30513c6a-4fc2-4703-b092-68b3faade468 req-ef3d6554-2ceb-4a52-942e-34858ead27a1 service nova] Creating event network-vif-deleted:dfa86e07-8d1c-4846-80e1-da35a0f8beb8 for instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b on nch2-master-1 Jun 04 20:58:53.101402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-30513c6a-4fc2-4703-b092-68b3faade468 req-ef3d6554-2ceb-4a52-942e-34858ead27a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075839 Jun 04 20:58:53.106094 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 836/1694] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:53.115403 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59cfb3eb-a9de-468b-a01a-0cb5983cf508 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 204 len: 0 microversion: 2.1 time: 0.278034 Jun 04 20:58:53.115657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:53.116510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:53.122109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 859/1695] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:58:52 2022] DELETE /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:58:53.127503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.128088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.129060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.129673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.136989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83534ec9-f931-4dac-a468-460eeac5a208 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:53.138567 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:58:53.138567 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 20:58:53.145652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83534ec9-f931-4dac-a468-460eeac5a208 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.145652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83534ec9-f931-4dac-a468-460eeac5a208 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.145652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83534ec9-f931-4dac-a468-460eeac5a208 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.145652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83534ec9-f931-4dac-a468-460eeac5a208 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.216781 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83534ec9-f931-4dac-a468-460eeac5a208 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.090233 Jun 04 20:58:53.218032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 860/1696] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Jun 4 20:58:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:58:53.223278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37fd2e81-8a8d-4d2a-aa97-4e8ac87ff72b tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Calling method '.version_select at 0x7f2d0be49b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:53.562584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:53.575893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c3eee055-03f1-402e-b377-d6d0bf2baf01 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1502 microversion: 2.1 time: 0.468339 Jun 04 20:58:53.577090 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 837/1697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:53 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1502 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:53.594759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:53.596980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f8d7e4b8-0a2f-475c-b7e4-4c82582b189b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:53.617843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.618307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.619291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.624847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.656055 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37fd2e81-8a8d-4d2a-aa97-4e8ac87ff72b tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/e9e9cf34-8379-4df8-9b8b-8b1e430a9182" status: 200 len: 142 microversion: 2.1 time: 0.436406 Jun 04 20:58:53.656654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 861/1698] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 20:58:53 2022] GET /compute/v2.1/os-floating-ips/e9e9cf34-8379-4df8-9b8b-8b1e430a9182 => generated 142 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:53.667912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:53.668295 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] HTTP exception thrown: Instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b could not be found. Jun 04 20:58:53.669214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Request method failure captured: Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b HTTP/1.1 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ZiMhuPTqkbbUzmS8VCkMM8UR6AGe9WOt6z6z8aMMPiBf7RK9jjXJupaCSiksRguY7b_H7SRYhU18ktFVWFQdOYh6veKTBCP99sSkFLvgaxLyr1A5Uwl0s9ogEsI9r8_IosBOWJ1zQNgGpmtc7uzRQ8PBqoLTGWypNsk72iofYTR8I Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-LiveMigrationTest-647686994 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-LiveMigrationTest-647686994-project Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ac8ef83fa94e4c9db70a0115cc867dfc Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-LiveMigrationTest-647686994-project Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b could not be found. Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f8d7e4b8-0a2f-475c-b7e4-4c82582b189b'} Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b could not be found. Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b could not be found. Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:53.670000 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b could not be found. Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Returning 404 to user: Instance f8d7e4b8-0a2f-475c-b7e4-4c82582b189b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:53.674380 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b94a942f-fef7-41a0-b191-1cccb937f625 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b" status: 404 len: 111 microversion: 2.1 time: 0.089979 Jun 04 20:58:53.678102 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 838/1699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:53 2022] GET /compute/v2.1/servers/f8d7e4b8-0a2f-475c-b7e4-4c82582b189b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:58:53.692223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.128"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:53.693781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:53.704604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.706476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.711822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.712394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.715567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.716772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.731008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:53.731909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:53.782684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Acquired lock "refresh_cache-d36797c0-2f7a-498a-90bc-8bc1e14f2090" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:58:54.336317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:54.349429 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc496536-b69c-45e6-a9e4-bb0f3c05a754 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1574 microversion: 2.1 time: 0.685842 Jun 04 20:58:54.360914 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 862/1700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:53 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1574 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:54.369257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b325e9bc-abfc-489a-a59b-f9b3dee65e5b req-e6299fc1-6608-407e-9c36-5ebdde99dcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34", "tag": "d5a456eb-1cbe-422f-934f-21b1dfae3264"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:54.381245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b325e9bc-abfc-489a-a59b-f9b3dee65e5b req-e6299fc1-6608-407e-9c36-5ebdde99dcd8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:54.381856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b325e9bc-abfc-489a-a59b-f9b3dee65e5b req-e6299fc1-6608-407e-9c36-5ebdde99dcd8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:54.409028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b325e9bc-abfc-489a-a59b-f9b3dee65e5b req-e6299fc1-6608-407e-9c36-5ebdde99dcd8 service nova] Creating event network-changed:d5a456eb-1cbe-422f-934f-21b1dfae3264 for instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 on nch2-master-1 Jun 04 20:58:54.416915 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b325e9bc-abfc-489a-a59b-f9b3dee65e5b req-e6299fc1-6608-407e-9c36-5ebdde99dcd8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053233 Jun 04 20:58:54.418067 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 863/1701] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:54.425572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57211fbb-e5c5-4cac-abe8-b47d9d3eac1e"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:54.427180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:54.434694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:54.436217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:54.437775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:54.438684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:54.468938 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Cannot 'attach_volume' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state rescued Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/os-volume_attachments HTTP/1.1 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 74 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: {"volumeAttachment": {"volumeId": "57211fbb-e5c5-4cac-abe8-b47d9d3eac1e"}} Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'attach_volume' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state rescued Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '952e6198-f88b-4266-bc51-a737275da8b2', 'body': {'volumeAttachment': {'volumeId': '57211fbb-e5c5-4cac-abe8-b47d9d3eac1e'}}} Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 952e6198-f88b-4266-bc51-a737275da8b2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 04 20:58:54.471763 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state rescued Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state rescued Jun 04 20:58:54.477191 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:58:54.480129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 409 to user: Cannot 'attach_volume' instance 952e6198-f88b-4266-bc51-a737275da8b2 while it is in vm_state rescued {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:58:54.481238 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a656222-9f61-4451-8cd7-f81c0f8820bb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061881 Jun 04 20:58:54.482038 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 864/1702] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 20:58:54 2022] POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 20:58:54.487112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0250f61c-da4a-4836-9063-10020148f775 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Calling method '.version_select at 0x7f2d01a92280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:55.562354 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0250f61c-da4a-4836-9063-10020148f775 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.078274 Jun 04 20:58:55.564027 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 865/1703] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 20:58:54 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:58:55.570662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:55.572458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:55.586896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:55.587926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:55.589561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:55.590188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:55.627535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:58:55.779735 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04f11a03-1539-4bab-95c8-4d44c5de723b tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 204 len: 0 microversion: 2.1 time: 0.213006 Jun 04 20:58:55.780463 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 866/1704] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:58:55 2022] DELETE /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:58:55.794906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:55.795793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:55.809001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:55.810779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:55.812345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:55.813001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:55.985835 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89909b06-4baa-407c-bf98-11e5022869c7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action" status: 202 len: 0 microversion: 2.1 time: 0.203212 Jun 04 20:58:55.991039 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 867/1705] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:55 2022] POST /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:56.000682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40e4e2d0-1a42-4e71-9df7-e2abd0414e4f", "device": "/dev/xvdb"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:58:56.003052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:56.011691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:56.012465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:56.013538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:56.015055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:56.508204 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-28358e06-9bbf-49a1-92f1-a7903388e997 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "POST /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.514117 Jun 04 20:58:56.508933 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 868/1706] 10.222.0.18 () {62 vars in 1363 bytes} [Sat Jun 4 20:58:55 2022] POST /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 20:58:56.538942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:56.541679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:56.568523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:56.569131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:56.569760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:56.574415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:57.131613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:57.141452 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d72fd84-309e-489c-ae5c-82f80b3c163a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1572 microversion: 2.1 time: 0.631472 Jun 04 20:58:57.142048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 869/1707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:56 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1572 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:58:57.170038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b68c62e-8403-4e92-8ed8-c0ed7faea51e tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Calling method '.version_select at 0x7f2d01a92280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:57.386521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 20:58:59.492339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Updating instance_info_cache with network_info: [{"id": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb", "address": "fa:16:3e:d3:a1:aa", "network": {"id": "d13de28a-5d75-4dd4-a643-af6e82d2a36d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1122774834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5f72194d8a044e81a3a48e7716a1395f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcfb7ff8a-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 20:58:59.516913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Releasing lock "refresh_cache-d36797c0-2f7a-498a-90bc-8bc1e14f2090" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:58:59.517875 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a84334c9-e9e5-4ccf-bdef-e56682ee0ead tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action" status: 202 len: 0 microversion: 2.1 time: 5.838395 Jun 04 20:58:59.519255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 839/1708] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:58:53 2022] POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action => generated 0 bytes in 5840 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 20:58:59.695314 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b68c62e-8403-4e92-8ed8-c0ed7faea51e tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/e9e9cf34-8379-4df8-9b8b-8b1e430a9182" status: 202 len: 0 microversion: 2.1 time: 2.536744 Jun 04 20:58:59.696016 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 870/1709] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:58:57 2022] DELETE /compute/v2.1/os-floating-ips/e9e9cf34-8379-4df8-9b8b-8b1e430a9182 => generated 0 bytes in 2553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:58:59.704288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:59.705335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:59.713537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:59.714265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:59.715479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:59.716128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:59.743276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:59.817427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:58:59.818466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:58:59.829928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:59.830976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:59.833038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:59.833709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:59.899149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:58:59.899863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:58:59.900990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lazy-loading 'fault' on Instance uuid 1874cbcd-e559-43ca-8100-8bae0571c90b {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:58:59.981406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac8ef83fa94e4c9db70a0115cc867dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aeb9ab07bf8476082d5add829aec29f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:59.989479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:58:59.998754 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-12d3fc0f-32cd-49be-8022-82c522c6cd89 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 200 len: 1301 microversion: 2.1 time: 0.469312 Jun 04 20:58:59.999401 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 840/1710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:59 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 1301 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:00.000910 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-56b61a4d-c973-4ee8-90da-170cd1ff4a6e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1510 microversion: 2.1 time: 0.303230 Jun 04 20:59:00.001965 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 871/1711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:58:59 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:00.012567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5fa2a569-812d-4fcc-b0b2-9d358d447c09 req-69d33841-5e23-4c05-8341-3e25431d3fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34", "name": "network-vif-deleted", "tag": "d5a456eb-1cbe-422f-934f-21b1dfae3264"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:00.023144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5fa2a569-812d-4fcc-b0b2-9d358d447c09 req-69d33841-5e23-4c05-8341-3e25431d3fa8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:00.023618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5fa2a569-812d-4fcc-b0b2-9d358d447c09 req-69d33841-5e23-4c05-8341-3e25431d3fa8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:00.049512 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5fa2a569-812d-4fcc-b0b2-9d358d447c09 req-69d33841-5e23-4c05-8341-3e25431d3fa8 service nova] Creating event network-vif-deleted:d5a456eb-1cbe-422f-934f-21b1dfae3264 for instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 on nch2-master-1 Jun 04 20:59:00.055287 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5fa2a569-812d-4fcc-b0b2-9d358d447c09 req-69d33841-5e23-4c05-8341-3e25431d3fa8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054348 Jun 04 20:59:00.065897 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 841/1712] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:00.066625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1813761929"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:00.067214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:00.074463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:00.075037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:00.075878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:00.076316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:00.101327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-938556531", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:00.161338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] validate_networks() for [('10998ccc-172c-4efe-afe8-d393fc1e0d64', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:00.419960 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Adding security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c to port 49c5a420-94ab-4019-8435-00f01dd4c9db Jun 04 20:59:00.906436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:00.907406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:00.908112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:00.908743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:00.909318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:00.922280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:00.923144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:00.924502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:00.925209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:00.964814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Getting quotas for project c13a926a61e0412c8eae94528aeb0a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:00.973827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Getting quotas for user 425dba3904234fc08c2913a4e299b003 and project c13a926a61e0412c8eae94528aeb0a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:00.993102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:00.998156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:01.095727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-acc5665f-55d3-463d-86b8-ba2de9852aa7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.089745 Jun 04 20:59:01.102957 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 872/1713] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:01.111033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-56ba9f08-3335-474a-911e-fd73c7ed6a42 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '.version_select at 0x7f2d0199c790>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:01.445845 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7b43fad0-1610-421d-ae2f-57272bb27db1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6/action" status: 202 len: 0 microversion: 2.1 time: 1.384789 Jun 04 20:59:01.446976 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 842/1714] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:59:00 2022] POST /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6/action => generated 0 bytes in 1387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:01.453459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d1f2b0eb-2d46-4a14-be4d-a69cba4428a7 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Action: 'create', calling method: .version_select at 0x7f2d0bf36280>, body: {"pool": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:01.631200 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-56ba9f08-3335-474a-911e-fd73c7ed6a42 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/1f4f3e6f-9988-4417-8ea9-113f5c7ae152" status: 200 len: 184 microversion: 2.1 time: 0.530497 Jun 04 20:59:01.640902 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 873/1715] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 20:59:01 2022] GET /compute/v2.1/os-floating-ips/1f4f3e6f-9988-4417-8ea9-113f5c7ae152 => generated 184 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:01.646854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:01.650370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: 1874cbcd-e559-43ca-8100-8bae0571c90b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:01.670143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:01.672126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:01.681356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:01.683119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:01.706924 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] HTTP exception thrown: Instance 1874cbcd-e559-43ca-8100-8bae0571c90b could not be found. Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Request method failure captured: Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b HTTP/1.1 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZiMhuPTqkbbUzmS8VCkMM8UR6AGe9WOt6z6z8aMMPiBf7RK9jjXJupaCSiksRguY7b_H7SRYhU18ktFVWFQdOYh6veKTBCP99sSkFLvgaxLyr1A5Uwl0s9ogEsI9r8_IosBOWJ1zQNgGpmtc7uzRQ8PBqoLTGWypNsk72iofYTR8I Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveMigrationTest-647686994 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveMigrationTest-647686994-project Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ac8ef83fa94e4c9db70a0115cc867dfc Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveMigrationTest-647686994-project Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 1874cbcd-e559-43ca-8100-8bae0571c90b could not be found. Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1874cbcd-e559-43ca-8100-8bae0571c90b'} Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1874cbcd-e559-43ca-8100-8bae0571c90b could not be found. Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1874cbcd-e559-43ca-8100-8bae0571c90b could not be found. Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:01.709962 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:01.714632 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:01.714632 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:01.714632 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:01.714632 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:01.714632 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1874cbcd-e559-43ca-8100-8bae0571c90b could not be found. Jun 04 20:59:01.714632 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:01.717519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Returning 404 to user: Instance 1874cbcd-e559-43ca-8100-8bae0571c90b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:01.719123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-29b740e0-9793-40f8-b164-3883f44db091 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b" status: 404 len: 111 microversion: 2.1 time: 0.076857 Jun 04 20:59:01.720544 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 874/1716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:01 2022] GET /compute/v2.1/servers/1874cbcd-e559-43ca-8100-8bae0571c90b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:01.727349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:01.728382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:01.742011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:01.742771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:01.744178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:01.745242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:02.152467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:02.168873 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72ee3305-b57f-4f3f-bae1-dd73144f2e5a tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1516 microversion: 2.1 time: 0.446036 Jun 04 20:59:02.186712 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 875/1717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:01 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1516 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:02.211669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:02.220221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:02.248628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:02.257123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:02.258457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:02.268420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:02.509581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:02.525474 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb9b9302-6e7f-420c-96b9-66340bea3680 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1212 microversion: 2.1 time: 0.337473 Jun 04 20:59:02.529435 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 876/1718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:02 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1212 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:02.537712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:02.538724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:02.547960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:02.549280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:02.550205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:02.551029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:02.793295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:59:02.835048 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dfaed503-f088-45ce-923c-9351edd6cf7d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 2128 microversion: 2.25 time: 0.303617 Jun 04 20:59:02.836739 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 877/1719] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:02 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 2128 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:02.844805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4589de0a-9823-4c35-ac35-46bf08720953 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d019e4d30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:03.333885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-4589de0a-9823-4c35-ac35-46bf08720953 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use.", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:03.337223 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4589de0a-9823-4c35-ac35-46bf08720953 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.337223 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4589de0a-9823-4c35-ac35-46bf08720953 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c HTTP/1.1 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: exception: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a128e25e-2b3e-4d0a-8b75-6990ae43d10c'} Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:03.346124 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] Jun 04 20:59:03.353848 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:03.369748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4589de0a-9823-4c35-ac35-46bf08720953 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 400 to user: Security Group a128e25e-2b3e-4d0a-8b75-6990ae43d10c in use. Jun 04 20:59:03.369748 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-dfdbdd3b-d671-4872-ba98-0312d9786725'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:03.369748 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4589de0a-9823-4c35-ac35-46bf08720953 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c" status: 400 len: 185 microversion: 2.1 time: 0.527422 Jun 04 20:59:03.369748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 878/1720] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:02 2022] DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c => generated 185 bytes in 529 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:03.381200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.128"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:03.693442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:03.701905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:03.703208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:03.716797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:03.717545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:04.310986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Acquired lock "refresh_cache-d36797c0-2f7a-498a-90bc-8bc1e14f2090" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 20:59:04.473116 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d1f2b0eb-2d46-4a14-be4d-a69cba4428a7 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.023029 Jun 04 20:59:04.474732 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 843/1721] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:59:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:04.482452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:04.483228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:04.488861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:04.498923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:04.500753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:04.501719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:04.502857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:04.551073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:59:04.730964 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cf701f91-7bf8-459c-af13-f8b218b6e9f4 tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 204 len: 0 microversion: 2.1 time: 0.254299 Jun 04 20:59:04.735839 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 844/1722] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:04 2022] DELETE /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:04.749566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}, {"server_uuid": "1874cbcd-e559-43ca-8100-8bae0571c90b", "name": "network-vif-deleted", "tag": "e8ba6caf-a3be-4046-b49a-213d13e43a01"}, {"name": "network-changed", "server_uuid": "7c6a3d42-40e7-4607-a6b5-32cdf3d067f6", "tag": "49c5a420-94ab-4019-8435-00f01dd4c9db"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:04.777774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:04.779130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:04.802815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] Creating event network-changed:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:59:04.803733 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] Creating event network-vif-deleted:e8ba6caf-a3be-4046-b49a-213d13e43a01 for instance 1874cbcd-e559-43ca-8100-8bae0571c90b on nch2-master-1 Jun 04 20:59:04.804566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] Creating event network-changed:49c5a420-94ab-4019-8435-00f01dd4c9db for instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 on nch1-master-1 Jun 04 20:59:04.824873 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e900abfb-b423-4e9e-a14e-f39da2640cfb req-73eca88c-582b-45c2-ba02-23e3375adadd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.085400 Jun 04 20:59:04.831937 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 845/1723] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:04.841331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-813427228", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "2bb9b937-1a96-478b-a2e9-047f54638e47"}, {"uuid": "773a46a6-d7bf-45de-80ba-4a2b27f9e69b"}, {"uuid": "2bb9b937-1a96-478b-a2e9-047f54638e47"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:05.008691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] validate_networks() for [('2bb9b937-1a96-478b-a2e9-047f54638e47', None, None, None, None, None), ('773a46a6-d7bf-45de-80ba-4a2b27f9e69b', None, None, None, None, None), ('2bb9b937-1a96-478b-a2e9-047f54638e47', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:07.058821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Building network info cache for instance {{(pid=137228) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 20:59:08.130856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:08.134164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:08.134912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:08.143021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:08.143930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:08.160811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.161692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.163083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.163769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.191029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Getting quotas for project d9e0e340cb8d4a64bdfeafcba8908f89. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:08.198212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Getting quotas for user 81630e4b323d43a08a368471273a2989 and project d9e0e340cb8d4a64bdfeafcba8908f89. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:08.212664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:08.228048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:08.295260 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-24923276-a95f-4803-82ac-8153383f88df tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.461560 Jun 04 20:59:08.295988 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 846/1724] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:08.301061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:08.302796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:08.311283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.312123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.313276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.313877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.378378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'flavor' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:59:08.387686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Updating instance_info_cache with network_info: [{"id": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb", "address": "fa:16:3e:d3:a1:aa", "network": {"id": "d13de28a-5d75-4dd4-a643-af6e82d2a36d", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1122774834-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "5f72194d8a044e81a3a48e7716a1395f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapcfb7ff8a-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137228) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 20:59:08.400502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Releasing lock "refresh_cache-d36797c0-2f7a-498a-90bc-8bc1e14f2090" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 20:59:08.401665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-561bae49-1c72-4631-866f-74181bb66cab tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action" status: 202 len: 0 microversion: 2.1 time: 5.031689 Jun 04 20:59:08.407701 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 879/1725] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:59:03 2022] POST /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090/action => generated 0 bytes in 5036 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 20:59:08.411936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Going to try to live migrate instance to nch1-master-1 {{(pid=137229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 20:59:08.418278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:08.420150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:08.436726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.437625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.438528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.442374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.501283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:59:08.640716 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e6214396-804e-4293-8443-5bf664c64280 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 204 len: 0 microversion: 2.1 time: 0.227436 Jun 04 20:59:08.643620 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 880/1726] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:08 2022] DELETE /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:08.653253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:08.654549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:08.661996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:08.664021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.664647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.665540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:08.667564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:08.909848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:08.919255 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6efd6ff6-a60c-420f-b1fb-72867983fdb7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1316 microversion: 2.1 time: 0.274264 Jun 04 20:59:08.929353 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 881/1727] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:08 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:08.934852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed34f3ad-ce98-4bcf-ba31-c2b55b334d3f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'create', calling method: .version_select at 0x7f2d019b9e50>, body: {"keypair": {"name": "tempest-keypair-1334054880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqbl7zJPcJmQFVH7EoxQ9XkONl/7te61PaOHUoqYdX6VqiFKrx0vlLNcpt04mBD+I5zIZrrHvVlB6/cWXL4QOBsjBjhCMmZBITxp9SCPsi0VbVWbsWzqxHwUoUCW0yejA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:08.950803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ed34f3ad-ce98-4bcf-ba31-c2b55b334d3f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:08.956481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ed34f3ad-ce98-4bcf-ba31-c2b55b334d3f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for user be44957fa2304f52a8d34bdac9eaca4f and project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:08.988467 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed34f3ad-ce98-4bcf-ba31-c2b55b334d3f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057384 Jun 04 20:59:08.990270 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 882/1728] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:59:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:09.000105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2e9a71b-d27a-4ae2-b7c7-eb9c318f4300 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Calling method '.version_select at 0x7f2d01aa2160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:09.795840 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2e9a71b-d27a-4ae2-b7c7-eb9c318f4300 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc" status: 202 len: 0 microversion: 2.1 time: 0.803326 Jun 04 20:59:09.796492 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 883/1729] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:59:08 2022] DELETE /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:09.801267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:09.802001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] [instance: f994823a-4d87-426d-9673-d598a15b6ae2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:09.809534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:09.810064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:09.811212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:09.811766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:09.826485 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] HTTP exception thrown: Instance f994823a-4d87-426d-9673-d598a15b6ae2 could not be found. Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Request method failure captured: Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 HTTP/1.1 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ZiMhuPTqkbbUzmS8VCkMM8UR6AGe9WOt6z6z8aMMPiBf7RK9jjXJupaCSiksRguY7b_H7SRYhU18ktFVWFQdOYh6veKTBCP99sSkFLvgaxLyr1A5Uwl0s9ogEsI9r8_IosBOWJ1zQNgGpmtc7uzRQ8PBqoLTGWypNsk72iofYTR8I Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0aeb9ab07bf8476082d5add829aec29f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveMigrationTest-647686994 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0aeb9ab07bf8476082d5add829aec29f Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveMigrationTest-647686994 Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveMigrationTest-647686994-project Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ac8ef83fa94e4c9db70a0115cc867dfc Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveMigrationTest-647686994-project Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f994823a-4d87-426d-9673-d598a15b6ae2 could not be found. Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f994823a-4d87-426d-9673-d598a15b6ae2'} Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f994823a-4d87-426d-9673-d598a15b6ae2 could not be found. Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f994823a-4d87-426d-9673-d598a15b6ae2 could not be found. Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:09.828396 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f994823a-4d87-426d-9673-d598a15b6ae2 could not be found. Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] Returning 404 to user: Instance f994823a-4d87-426d-9673-d598a15b6ae2 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70fc3082-a587-48e8-a215-e6d6c31336be tempest-LiveMigrationTest-647686994 tempest-LiveMigrationTest-647686994-project] 10.222.0.18 "GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2" status: 404 len: 111 microversion: 2.1 time: 0.032454 Jun 04 20:59:09.834379 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 884/1730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:09 2022] GET /compute/v2.1/servers/f994823a-4d87-426d-9673-d598a15b6ae2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:09.835923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5f9b25ad-3f7e-44ad-9825-949e2578865e req-b39630bc-2bea-4185-bdcb-543a0af12199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f994823a-4d87-426d-9673-d598a15b6ae2", "name": "network-vif-deleted", "tag": "446b0ce5-8246-4b96-8079-6b17063c7982"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:09.845244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5f9b25ad-3f7e-44ad-9825-949e2578865e req-b39630bc-2bea-4185-bdcb-543a0af12199 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:09.845786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5f9b25ad-3f7e-44ad-9825-949e2578865e req-b39630bc-2bea-4185-bdcb-543a0af12199 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:09.858940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5f9b25ad-3f7e-44ad-9825-949e2578865e req-b39630bc-2bea-4185-bdcb-543a0af12199 service nova] Creating event network-vif-deleted:446b0ce5-8246-4b96-8079-6b17063c7982 for instance f994823a-4d87-426d-9673-d598a15b6ae2 on nch2-master-1 Jun 04 20:59:09.865193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5f9b25ad-3f7e-44ad-9825-949e2578865e req-b39630bc-2bea-4185-bdcb-543a0af12199 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032360 Jun 04 20:59:09.866307 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 885/1731] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:09.873406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e2ca48fb-aea7-4aa1-bc08-9ea9ce678d86 req-acd4bc75-b405-4413-b6fa-738ead1aea31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:09.882415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e2ca48fb-aea7-4aa1-bc08-9ea9ce678d86 req-acd4bc75-b405-4413-b6fa-738ead1aea31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:09.883062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e2ca48fb-aea7-4aa1-bc08-9ea9ce678d86 req-acd4bc75-b405-4413-b6fa-738ead1aea31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:09.897111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e2ca48fb-aea7-4aa1-bc08-9ea9ce678d86 req-acd4bc75-b405-4413-b6fa-738ead1aea31 service nova] Creating event network-changed:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:59:09.903895 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e2ca48fb-aea7-4aa1-bc08-9ea9ce678d86 req-acd4bc75-b405-4413-b6fa-738ead1aea31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036166 Jun 04 20:59:09.904493 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 886/1732] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:09.909818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:09.910510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:09.917545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:09.917993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:09.919072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:09.919682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:09.989372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:09.997977 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f75cb12e-d8c8-42cf-a54f-49ef10da374f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1216 microversion: 2.1 time: 0.092119 Jun 04 20:59:09.999016 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 887/1733] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:09 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:10.003778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.004288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:10.012336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.012793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.013604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.014037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.028876 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] HTTP exception thrown: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Request method failure captured: Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 HTTP/1.1 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dL9Z6XJWo8F2DpFN9er8b_LWirGda0TwkorKdmMaaeC6ckVLgrFeohlwhktwPT8tl2wNjXiOTDw92pdXGEdZBgmEX9IU5OMHv-zyxv24Nl5aP6DcA314FsOreveENgMxBoMbBTs4TZTSbgnsMz5VQTw1Tm8TtjtOKQ0Sdy5LomvQY Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c80f5171e36f498cb2601ae92861a94a Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34'} Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:10.030566 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Returning 404 to user: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6eb8e23f-037b-4a8e-9de1-54055a38c8c8 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 404 len: 111 microversion: 2.1 time: 0.032010 Jun 04 20:59:10.035597 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 888/1734] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:09 2022] DELETE /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:10.040105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.041068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:10.047737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.048127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.049020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.049525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.225078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:10.233248 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2093616b-f43c-4a5a-8a62-e082df0b06b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1647 microversion: 2.1 time: 0.196845 Jun 04 20:59:10.233899 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 889/1735] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:10 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1647 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:10.238593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d0d28722-ab01-4825-bda6-989849491024 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Calling method '.version_select at 0x7f2d01aa2310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.302609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-d0d28722-ab01-4825-bda6-989849491024 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3f521842-a23a-4ce1-93ba-7574bc86adcc could not be found", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:10.303338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d0d28722-ab01-4825-bda6-989849491024 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] HTTP exception thrown: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d0d28722-ab01-4825-bda6-989849491024 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Request method failure captured: Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc HTTP/1.1 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eHBr3K3St1__h87c_Jw404Xy-shuKUhs-MSUkGIzgU3yYMdBJ0rmwO0tWut8jeEqsAoB9PxINzGMz3_rLiOdYkLiTNsKyKVGI3P3pT1TWj_UAVP0TdIQ2I4g8T63EBlIlxEmo_mDcnsxu6hQGL9Y8m1Xa2sSMa-raFbmg5iKhHrQM Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 164d90f06576437c967ac86132b9a730 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsTestJSON-1071167437 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164d90f06576437c967ac86132b9a730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164d90f06576437c967ac86132b9a730"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164d90f06576437c967ac86132b9a730"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164d90f06576437c967ac86132b9a730"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsTestJSON-1071167437 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 164d90f06576437c967ac86132b9a730 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1071167437 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsTestJSON-1071167437-project Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 17c2fd62612a43b4b4838cbd45b22218 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsTestJSON-1071167437-project Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: exception: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '3f521842-a23a-4ce1-93ba-7574bc86adcc'} Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3f521842-a23a-4ce1-93ba-7574bc86adcc could not be found Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4a3f2e0-7773-4093-b0e3-3f8e85e6ca4c'] Jun 04 20:59:10.305418 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc. Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d0d28722-ab01-4825-bda6-989849491024 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Returning 404 to user: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:10.310753 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d0d28722-ab01-4825-bda6-989849491024 tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc" status: 404 len: 111 microversion: 2.1 time: 0.071959 Jun 04 20:59:10.315959 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 890/1736] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 20:59:10 2022] GET /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:10.315959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.316673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:10.325756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.325756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.327073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.327073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.557067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:10.570068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81fb7648-293f-4f9b-9597-a456cf98c061 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1316 microversion: 2.1 time: 0.257700 Jun 04 20:59:10.570956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 891/1737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:10 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:10.585127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.585857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:10.593117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.593672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.596377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:10.597095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:10.630148 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] HTTP exception thrown: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Request method failure captured: Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 HTTP/1.1 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dL9Z6XJWo8F2DpFN9er8b_LWirGda0TwkorKdmMaaeC6ckVLgrFeohlwhktwPT8tl2wNjXiOTDw92pdXGEdZBgmEX9IU5OMHv-zyxv24Nl5aP6DcA314FsOreveENgMxBoMbBTs4TZTSbgnsMz5VQTw1Tm8TtjtOKQ0Sdy5LomvQY Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c80f5171e36f498cb2601ae92861a94a Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34'} Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.634032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. Jun 04 20:59:10.643167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.647644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Returning 404 to user: Instance 6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:10.648279 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-31465238-f532-443c-8252-efe44ec2020e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34" status: 404 len: 111 microversion: 2.1 time: 0.075046 Jun 04 20:59:10.649902 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 892/1738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:10 2022] GET /compute/v2.1/servers/6d85f7aa-4313-4c67-99a7-e3b3bdc1dd34 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:10.659385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7631209-2a2f-4bdf-ba7c-2156e911591c tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Calling method '.version_select at 0x7f2d01aa21f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.717638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-e7631209-2a2f-4bdf-ba7c-2156e911591c tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3f521842-a23a-4ce1-93ba-7574bc86adcc could not be found", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:10.718682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e7631209-2a2f-4bdf-ba7c-2156e911591c tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] HTTP exception thrown: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7631209-2a2f-4bdf-ba7c-2156e911591c tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Request method failure captured: Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc HTTP/1.1 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eHBr3K3St1__h87c_Jw404Xy-shuKUhs-MSUkGIzgU3yYMdBJ0rmwO0tWut8jeEqsAoB9PxINzGMz3_rLiOdYkLiTNsKyKVGI3P3pT1TWj_UAVP0TdIQ2I4g8T63EBlIlxEmo_mDcnsxu6hQGL9Y8m1Xa2sSMa-raFbmg5iKhHrQM Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 164d90f06576437c967ac86132b9a730 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsTestJSON-1071167437 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_164d90f06576437c967ac86132b9a730"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164d90f06576437c967ac86132b9a730"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/164d90f06576437c967ac86132b9a730"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/164d90f06576437c967ac86132b9a730"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsTestJSON-1071167437 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 164d90f06576437c967ac86132b9a730 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1071167437 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsTestJSON-1071167437-project Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 17c2fd62612a43b4b4838cbd45b22218 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsTestJSON-1071167437-project Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: exception: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '3f521842-a23a-4ce1-93ba-7574bc86adcc'} Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3f521842-a23a-4ce1-93ba-7574bc86adcc could not be found Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63ebcf53-e27b-4a06-96dd-6f18c6a32e2a'] Jun 04 20:59:10.721604 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc. Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7631209-2a2f-4bdf-ba7c-2156e911591c tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] Returning 404 to user: Floating IP not found for ID 3f521842-a23a-4ce1-93ba-7574bc86adcc {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:10.726305 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e7631209-2a2f-4bdf-ba7c-2156e911591c tempest-FloatingIPsTestJSON-1071167437 tempest-FloatingIPsTestJSON-1071167437-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc" status: 404 len: 111 microversion: 2.1 time: 0.071743 Jun 04 20:59:10.731906 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 893/1739] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:59:10 2022] DELETE /compute/v2.1/os-floating-ips/3f521842-a23a-4ce1-93ba-7574bc86adcc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:10.734753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e93e751-07f0-4cc9-9a69-177c37b6efc7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '.version_select at 0x7f2d02451ca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:10.950630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:12.230176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a80fd84-2296-41e0-b04f-49d3afd15537 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/action" status: 202 len: 0 microversion: 2.25 time: 3.932771 Jun 04 20:59:12.231474 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 847/1740] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 20:59:08 2022] POST /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/action => generated 0 bytes in 3935 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:12.237756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:12.238569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:12.248401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:12.249728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:12.251028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:12.251762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:12.438924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:12.452847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:12.457340 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da65fd61-3a91-4b7b-9888-a95b1f5fe92e tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1270 microversion: 2.1 time: 0.223904 Jun 04 20:59:12.458089 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 848/1741] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:12 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:12.465939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:12.466855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:12.479293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:12.480075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:12.483123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:12.483844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:12.670126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:12.678906 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2348065d-c6e4-42ee-acf0-acd279f6f8b8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 200 len: 1301 microversion: 2.1 time: 0.219711 Jun 04 20:59:12.679789 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 849/1742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:12 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 1301 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:12.694905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:12.695543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:12.701874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:12.702317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:12.703082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:12.703615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:13.100463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:13.114374 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-950a2c99-2aa4-4035-bc78-2b5379f44e38 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1316 microversion: 2.1 time: 0.423189 Jun 04 20:59:13.125348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 850/1743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:12 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:13.131564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-505980180", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51b1cca8-5cd7-48be-bf24-582020121ccd"}], "security_groups": [{"name": "tempest-securitygroup--78765769"}], "key_name": "tempest-keypair-1334054880", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:13.461645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] validate_networks() for [('51b1cca8-5cd7-48be-bf24-582020121ccd', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:13.727579 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e93e751-07f0-4cc9-9a69-177c37b6efc7 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/1f4f3e6f-9988-4417-8ea9-113f5c7ae152" status: 202 len: 0 microversion: 2.1 time: 2.996490 Jun 04 20:59:13.729220 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 894/1744] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 20:59:10 2022] DELETE /compute/v2.1/os-floating-ips/1f4f3e6f-9988-4417-8ea9-113f5c7ae152 => generated 0 bytes in 2999 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:13.735235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5c918140-bb76-4e0e-883f-7740c4f443d5 req-cf4edfc5-254f-42d0-92e1-9a50843fe682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:13.764340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5c918140-bb76-4e0e-883f-7740c4f443d5 req-cf4edfc5-254f-42d0-92e1-9a50843fe682 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:13.768702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5c918140-bb76-4e0e-883f-7740c4f443d5 req-cf4edfc5-254f-42d0-92e1-9a50843fe682 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:13.797614 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5c918140-bb76-4e0e-883f-7740c4f443d5 req-cf4edfc5-254f-42d0-92e1-9a50843fe682 service nova] Creating event network-changed:eba1e015-a95a-4ab9-aea1-ca6856d3e3bb for instance 6544912e-117f-4311-88e5-885fd318c074 on nch2-master-1 Jun 04 20:59:13.802897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5c918140-bb76-4e0e-883f-7740c4f443d5 req-cf4edfc5-254f-42d0-92e1-9a50843fe682 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071807 Jun 04 20:59:13.808599 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 895/1745] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:13.820799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:13.822016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:13.830651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:13.831730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:13.832496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:13.834166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:14.959444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:14.970738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:14.973063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:14.974347 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-873fc00a-9258-40af-8a56-d3962689c9ab tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 1.160342 Jun 04 20:59:14.986240 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 896/1746] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:13 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:14.986240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-daf7e132-5c04-420f-9d3b-618bfe68e7b0 req-de3fe291-09b8-40d4-8b6c-c2183bc7baad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6a3d42-40e7-4607-a6b5-32cdf3d067f6", "name": "network-vif-deleted", "tag": "49c5a420-94ab-4019-8435-00f01dd4c9db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:14.989859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-daf7e132-5c04-420f-9d3b-618bfe68e7b0 req-de3fe291-09b8-40d4-8b6c-c2183bc7baad service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:14.990385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-daf7e132-5c04-420f-9d3b-618bfe68e7b0 req-de3fe291-09b8-40d4-8b6c-c2183bc7baad service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.001889 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-daf7e132-5c04-420f-9d3b-618bfe68e7b0 req-de3fe291-09b8-40d4-8b6c-c2183bc7baad service nova] Creating event network-vif-deleted:49c5a420-94ab-4019-8435-00f01dd4c9db for instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 on nch1-master-1 Jun 04 20:59:15.006839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-daf7e132-5c04-420f-9d3b-618bfe68e7b0 req-de3fe291-09b8-40d4-8b6c-c2183bc7baad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030540 Jun 04 20:59:15.007443 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 897/1747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:15.012693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f56cbd62-cd00-4284-a98c-5ff90e564a21 req-4610c71d-f435-4a96-bb0e-e81ec08bc507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "name": "network-vif-plugged", "status": "completed", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:15.023589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f56cbd62-cd00-4284-a98c-5ff90e564a21 req-4610c71d-f435-4a96-bb0e-e81ec08bc507 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.023589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f56cbd62-cd00-4284-a98c-5ff90e564a21 req-4610c71d-f435-4a96-bb0e-e81ec08bc507 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.036306 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f56cbd62-cd00-4284-a98c-5ff90e564a21 req-4610c71d-f435-4a96-bb0e-e81ec08bc507 service nova] Creating event network-vif-plugged:eba1e015-a95a-4ab9-aea1-ca6856d3e3bb for instance 6544912e-117f-4311-88e5-885fd318c074 on nch2-master-1 Jun 04 20:59:15.042240 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f56cbd62-cd00-4284-a98c-5ff90e564a21 req-4610c71d-f435-4a96-bb0e-e81ec08bc507 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033155 Jun 04 20:59:15.043070 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 898/1748] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:15.049480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:15.058832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:15.070892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.071947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.074520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.074853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.104436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:15.140177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:15.141504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:15.142184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:15.143022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:15.143424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:15.167618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.172916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.174112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.176412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.215460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:15.222541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Getting quotas for user be44957fa2304f52a8d34bdac9eaca4f and project 867cd3b05ecb4c93a28ab7a55928789b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:15.238058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:15.242034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:15.316843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-54cc831d-c7d9-4d0a-8be1-393744908afb tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.189832 Jun 04 20:59:15.318403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 851/1749] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:15.328809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:15.329814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:15.338381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.339212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.340551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.341228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.379750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 HTTP/1.1 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '7c6a3d42-40e7-4607-a6b5-32cdf3d067f6'} Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:15.382779 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4f55745-e13e-4a52-8fa8-ee90ad1bdd2f tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 404 len: 111 microversion: 2.1 time: 0.067493 Jun 04 20:59:15.395202 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 852/1750] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:15 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:15.402805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:15.403652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:15.413632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.414439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.415925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.422529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.458824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:59:15.588732 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f836eff-47fc-4e31-a409-7dc4536d8e6e tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 204 len: 0 microversion: 2.1 time: 0.190493 Jun 04 20:59:15.592033 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 853/1751] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:15 2022] DELETE /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:15.596887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:15.606320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-06f9ae2e-9d4a-47a0-973f-77f11808087f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1312 microversion: 2.1 time: 0.560902 Jun 04 20:59:15.610671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:15.611413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:15.612540 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 899/1752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:15 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1312 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:15.618852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.619292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.620123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:15.620553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:15.627899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3617d57-3803-4d5c-ad1a-590b76b34208 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:15.628721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d3617d57-3803-4d5c-ad1a-590b76b34208 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:15.824591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d3617d57-3803-4d5c-ad1a-590b76b34208 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:15.833524 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d3617d57-3803-4d5c-ad1a-590b76b34208 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1245 microversion: 2.1 time: 0.219465 Jun 04 20:59:15.845375 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 900/1753] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:15 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1245 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:15.851137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-76be00de-2780-4923-9575-d8e24ac88ec5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01aa2ee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:16.149139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:16.159474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b33a9081-14ea-4fd3-af6c-26b32f138f63 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1316 microversion: 2.1 time: 0.565495 Jun 04 20:59:16.160251 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 854/1754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:15 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1316 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:16.165692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:16.167472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:16.175550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:16.176410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:16.177521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:16.178961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:16.575985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:16.586306 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-76be00de-2780-4923-9575-d8e24ac88ec5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef" status: 202 len: 0 microversion: 2.1 time: 0.739500 Jun 04 20:59:16.587971 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 901/1755] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:15 2022] DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:16.593498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0a72596-e803-4602-a7ca-9e7e94e774a3 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1526 microversion: 2.1 time: 0.431786 Jun 04 20:59:16.594746 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 855/1756] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:16 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1526 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:16.595031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:16.595931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:16.605551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:16.605944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:16.607238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:16.607695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:16.743073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-802912571", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:16.803023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:17.092213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:17.102824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:17.108770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:17.110266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4cfee58-d71c-48c3-8981-e430a6be3615 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 0.520555 Jun 04 20:59:17.112163 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 902/1757] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:16 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:17.125391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20872da5-0729-4e49-87ae-97927364d3e8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d0194f550>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:17.539151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:17.541065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:17.541764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:17.542366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:17.543000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:17.564476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:17.565657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:17.566736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:17.567445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:17.590908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:17.597876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for user 5b4c3539c5534d2c844944f9be3f9963 and project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:17.623365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:17.630826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:17.684133 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cd6b3f91-a8f8-43ec-9d4d-435648d35459 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.087569 Jun 04 20:59:17.685343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 856/1758] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:17.690868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:17.692241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:17.699485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:17.700073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:17.700907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:17.701519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:17.740843 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20872da5-0729-4e49-87ae-97927364d3e8 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c" status: 202 len: 0 microversion: 2.1 time: 0.626746 Jun 04 20:59:17.741436 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 903/1759] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:17 2022] DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:17.747606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:17.748735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:17.765972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:17.766881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:17.770217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:17.770903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:18.366378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:18.383004 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-322443b9-4127-440a-91db-ee182e08967c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1303 microversion: 2.1 time: 0.640153 Jun 04 20:59:18.392986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 904/1760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:17 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1303 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:18.401439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:18.402133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:18.408883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:18.409359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:18.410836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:18.411686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:18.549452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:18.568367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-11dd0437-bf1b-46f8-971d-5399c5c730aa tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1333 microversion: 2.1 time: 0.881724 Jun 04 20:59:18.569288 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 857/1761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:17 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1333 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:18.574570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:18.575473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:18.582328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:18.583152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:18.584026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:18.584530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:18.852406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:18.871702 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3c6c8ea-0c51-4029-95cc-92c4be0c5deb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.484700 Jun 04 20:59:18.874411 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 905/1762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:18 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:18.898206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:18.901994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:18.929138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:18.944400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:18.950043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:18.950543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:19.062465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c80f5171e36f498cb2601ae92861a94a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f72194d8a044e81a3a48e7716a1395f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:19.075851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:19.080461 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9f76535-b998-4456-bf60-a803fc1bdd5a tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 200 len: 1526 microversion: 2.1 time: 0.509755 Jun 04 20:59:19.084350 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fe2eb742-c1b1-4d2b-9d75-5b42bcbf4eca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1264 microversion: 2.1 time: 0.198018 Jun 04 20:59:19.085810 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 906/1763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:18 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:19.091681 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 858/1764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:18 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 1526 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:19.096193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0983a9ac-266e-48f2-9b8e-6a4b4e30f3f9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'create', calling method: .version_select at 0x7f2d019e49d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1411098043", "description": "tempest-description-1619755779"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:19.098449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:19.099271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:19.107617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:19.108342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:19.109428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:19.110051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:19.416360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:19.429446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:19.431311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:19.433977 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d90082a8-d66f-4b29-84d3-57eb8a765aaa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 0.339948 Jun 04 20:59:19.434995 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 859/1765] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:19 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:19.441079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1281110754", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:19.526312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] validate_networks() for [('10998ccc-172c-4efe-afe8-d393fc1e0d64', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:19.851192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0983a9ac-266e-48f2-9b8e-6a4b4e30f3f9 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.763250 Jun 04 20:59:19.851864 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 907/1766] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 20:59:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:19.880019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:19.881318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:19.912970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:19.915242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:19.916865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:19.918501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:20.894215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:20.902997 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1fd7415-28cc-48eb-bee5-62598b874a70 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 1.049663 Jun 04 20:59:20.906413 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 908/1767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:19 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:20.931009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:20.933913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:20.946079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:20.947285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:20.949627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:20.950651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:20.965301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:20.966085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:20.966250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:20.966579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:20.966990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:20.986201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:20.986700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:20.987432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:20.987911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:21.026595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Getting quotas for project c13a926a61e0412c8eae94528aeb0a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:21.037757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Getting quotas for user 425dba3904234fc08c2913a4e299b003 and project c13a926a61e0412c8eae94528aeb0a4e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:21.066268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:21.068434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:21.072781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:21.162750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90bad991-63d7-4d40-a6f3-51bd3b2cbf40 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.725738 Jun 04 20:59:21.168884 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 860/1768] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:21.180788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bc062d62-8de8-4869-b4ee-6f50a0d8b5e8 req-2ffe14a2-e20c-494d-b673-15fede882e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d36797c0-2f7a-498a-90bc-8bc1e14f2090", "name": "network-vif-deleted", "tag": "cfb7ff8a-4fbe-406a-a5ba-4899277422bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:21.191042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bc062d62-8de8-4869-b4ee-6f50a0d8b5e8 req-2ffe14a2-e20c-494d-b673-15fede882e41 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:21.192683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bc062d62-8de8-4869-b4ee-6f50a0d8b5e8 req-2ffe14a2-e20c-494d-b673-15fede882e41 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:21.207642 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bc062d62-8de8-4869-b4ee-6f50a0d8b5e8 req-2ffe14a2-e20c-494d-b673-15fede882e41 service nova] Creating event network-vif-deleted:cfb7ff8a-4fbe-406a-a5ba-4899277422bb for instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 on nch1-master-1 Jun 04 20:59:21.216066 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bc062d62-8de8-4869-b4ee-6f50a0d8b5e8 req-2ffe14a2-e20c-494d-b673-15fede882e41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048902 Jun 04 20:59:21.219870 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 861/1769] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:21.226026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7222ad97-5388-455b-91ef-3c28628fee10 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Action: 'update', calling method: .version_select at 0x7f2d01a11e50>, body: {"security_group": {"name": "tempest-sg-hth-2000024107", "description": "tempest-description-hth-1352218059"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:21.580879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:21.589674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc6bda28-be59-4c73-8485-55280bb01929 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.681973 Jun 04 20:59:21.590270 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 909/1770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:20 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:21.595850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:21.596465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] [instance: d36797c0-2f7a-498a-90bc-8bc1e14f2090] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:21.603246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:21.603734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:21.604597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:21.604987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:21.620451 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] HTTP exception thrown: Instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 could not be found. Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Request method failure captured: Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 HTTP/1.1 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dL9Z6XJWo8F2DpFN9er8b_LWirGda0TwkorKdmMaaeC6ckVLgrFeohlwhktwPT8tl2wNjXiOTDw92pdXGEdZBgmEX9IU5OMHv-zyxv24Nl5aP6DcA314FsOreveENgMxBoMbBTs4TZTSbgnsMz5VQTw1Tm8TtjtOKQ0Sdy5LomvQY Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5f72194d8a044e81a3a48e7716a1395f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 5f72194d8a044e81a3a48e7716a1395f Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-768555484 Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c80f5171e36f498cb2601ae92861a94a Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-768555484-project Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 could not be found. Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd36797c0-2f7a-498a-90bc-8bc1e14f2090'} Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 could not be found. Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 could not be found. Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:21.622212 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 could not be found. Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] Returning 404 to user: Instance d36797c0-2f7a-498a-90bc-8bc1e14f2090 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d8e8ed09-0008-4e79-861b-2128cb5974a0 tempest-FloatingIPsAssociationTestJSON-768555484 tempest-FloatingIPsAssociationTestJSON-768555484-project] 10.222.0.18 "GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090" status: 404 len: 111 microversion: 2.1 time: 0.032209 Jun 04 20:59:21.627777 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 910/1771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:21 2022] GET /compute/v2.1/servers/d36797c0-2f7a-498a-90bc-8bc1e14f2090 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:21.632388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:21.633016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:21.639990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:21.640437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:21.641227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:21.641667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.120674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:22.131137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-127af532-c57c-4bff-9c61-52ea44769c29 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1270 microversion: 2.1 time: 0.502386 Jun 04 20:59:22.131925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 911/1772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:21 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1270 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:22.136909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:22.137526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:22.144655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:22.145581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.146950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:22.147586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.571361 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7222ad97-5388-455b-91ef-3c28628fee10 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/a6b42169-97d7-4170-a15c-b1aef77467dd" status: 200 len: 218 microversion: 2.1 time: 1.350011 Jun 04 20:59:22.578640 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 862/1773] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Jun 4 20:59:21 2022] PUT /compute/v2.1/os-security-groups/a6b42169-97d7-4170-a15c-b1aef77467dd => generated 218 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:22.585586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:22.587111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:22.615477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:22.615957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.616781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:22.617209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.862273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:22.883097 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-583593c2-f9b2-4331-91ad-615b50051a91 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1275 microversion: 2.1 time: 0.299600 Jun 04 20:59:22.883097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 863/1774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:22 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1275 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:22.895554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:22.896094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:22.923673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:22.924447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.925633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:22.926234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:22.929107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:22.938902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:22.949585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:22.950821 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0a10efa3-e7e6-49c9-b013-267ac6ea3e03 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 0.817785 Jun 04 20:59:22.951382 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 912/1775] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:22 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:22.962551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f705bfb4-cc51-489c-8733-00b897bb58df tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d019e40d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:23.558453 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f705bfb4-cc51-489c-8733-00b897bb58df tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/a6b42169-97d7-4170-a15c-b1aef77467dd" status: 200 len: 218 microversion: 2.1 time: 0.599905 Jun 04 20:59:23.559079 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 913/1776] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 20:59:22 2022] GET /compute/v2.1/os-security-groups/a6b42169-97d7-4170-a15c-b1aef77467dd => generated 218 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:23.564091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:23.564288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:23.571760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:23.572504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:23.573529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:23.574124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:23.876120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:23.892877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd0a0b7e-559f-4fc7-8554-a442b5e8f366 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 1.009331 Jun 04 20:59:23.902482 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 864/1777] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:22 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:23.902482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:23.902828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:23.909993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:23.910449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:23.912128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:23.913347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:24.058137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:24.067599 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7bd4498-3eda-4af3-8e06-c11fa8420c3b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1270 microversion: 2.1 time: 0.172352 Jun 04 20:59:24.068331 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 865/1778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:23 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:24.075885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e1ccc3ba-0266-45d6-8323-c75c171be9aa req-e709060a-20ad-478f-9b46-3123a0e08abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a183ce72-70aa-487e-b90f-7a89e17720b3", "name": "network-vif-unplugged", "status": "completed", "tag": "51a43abd-07c8-4b4a-9258-2f0b67574647"}, {"name": "network-changed", "server_uuid": "a183ce72-70aa-487e-b90f-7a89e17720b3", "tag": "51a43abd-07c8-4b4a-9258-2f0b67574647"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:24.085651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e1ccc3ba-0266-45d6-8323-c75c171be9aa req-e709060a-20ad-478f-9b46-3123a0e08abd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:24.086498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e1ccc3ba-0266-45d6-8323-c75c171be9aa req-e709060a-20ad-478f-9b46-3123a0e08abd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:24.099412 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e1ccc3ba-0266-45d6-8323-c75c171be9aa req-e709060a-20ad-478f-9b46-3123a0e08abd service nova] Creating event network-vif-unplugged:51a43abd-07c8-4b4a-9258-2f0b67574647 for instance a183ce72-70aa-487e-b90f-7a89e17720b3 on nch2-master-1 Jun 04 20:59:24.100295 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e1ccc3ba-0266-45d6-8323-c75c171be9aa req-e709060a-20ad-478f-9b46-3123a0e08abd service nova] Creating event network-changed:51a43abd-07c8-4b4a-9258-2f0b67574647 for instance a183ce72-70aa-487e-b90f-7a89e17720b3 on nch2-master-1 Jun 04 20:59:24.108655 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e1ccc3ba-0266-45d6-8323-c75c171be9aa req-e709060a-20ad-478f-9b46-3123a0e08abd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.038641 Jun 04 20:59:24.109779 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 866/1779] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:24.115980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d2da5ef4-a5fa-4d36-85c9-277b139ea3c3 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a27a60>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:24.154344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:24.164986 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c42a9d61-57a3-481c-9aec-834dfe2c9cdb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.604741 Jun 04 20:59:24.165834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 914/1780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:23 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:24.170917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:24.171827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:24.178288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:24.178978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:24.179913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:24.180329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:25.399132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:25.408726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-683f5570-5619-4504-9434-d5c4780547ee tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1317 microversion: 2.1 time: 1.241591 Jun 04 20:59:25.422438 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 915/1781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:24 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1317 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:25.427726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:25.428540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:25.435724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:25.436536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:25.437586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:25.438219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:25.833809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=12 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:25.957802 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d2da5ef4-a5fa-4d36-85c9-277b139ea3c3 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a6b42169-97d7-4170-a15c-b1aef77467dd" status: 202 len: 0 microversion: 2.1 time: 1.846176 Jun 04 20:59:25.959211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 867/1782] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:24 2022] DELETE /compute/v2.1/os-security-groups/a6b42169-97d7-4170-a15c-b1aef77467dd => generated 0 bytes in 1849 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:25.997758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-97ad3a48-6fb5-43f6-8d56-d1278ce24f42 req-0e397d75-6694-4337-bf84-495c65dd3988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc", "tag": "f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:26.012824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-97ad3a48-6fb5-43f6-8d56-d1278ce24f42 req-0e397d75-6694-4337-bf84-495c65dd3988 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:26.013523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-97ad3a48-6fb5-43f6-8d56-d1278ce24f42 req-0e397d75-6694-4337-bf84-495c65dd3988 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:26.026225 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-97ad3a48-6fb5-43f6-8d56-d1278ce24f42 req-0e397d75-6694-4337-bf84-495c65dd3988 service nova] Creating event network-changed:f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f for instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc on nch2-master-1 Jun 04 20:59:26.032659 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-97ad3a48-6fb5-43f6-8d56-d1278ce24f42 req-0e397d75-6694-4337-bf84-495c65dd3988 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046439 Jun 04 20:59:26.034228 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 868/1783] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:26.037557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:26.039715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:26.040928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:26.050330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:26.051253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:26.052315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:26.052958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:26.066987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:26.070930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:26.076940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e78d436f-8d6a-4128-a3fa-bce9e7261ce6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 0.653112 Jun 04 20:59:26.077842 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 916/1784] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:25 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:26.094048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:26.094823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:26.101663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:26.102112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:26.108095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:26.108897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.083116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:27.097552 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8afbb8aa-8316-4add-b7e5-128ce51d61f9 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 1.061939 Jun 04 20:59:27.102338 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 869/1785] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:26 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:27.132301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:27.133985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:27.135203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:27.147211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.147487 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4bd85f0-95dd-4cc3-b1d3-6e42faf267f5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 1.066169 Jun 04 20:59:27.148300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.153383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.154755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.161740 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 917/1786] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:26 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:27.180857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:27.181903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:27.190485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.191890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.192942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.193719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.219897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:27.243811 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 HTTP/1.1 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7c6a3d42-40e7-4607-a6b5-32cdf3d067f6'} Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:27.248095 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:27.253578 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55db540d-b813-467a-a98c-2184b90aec18 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 404 len: 111 microversion: 2.1 time: 0.086254 Jun 04 20:59:27.255940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 918/1787] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:27 2022] DELETE /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:27.267219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fca9fbbc-0f81-4df6-ba2c-c0e86ea51959 req-c64757cf-72e4-45b8-bf2d-f4413084b29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414c25e0-f653-44da-8176-7c2c73883c6a", "tag": "6ea5ada5-e92c-4620-b275-c84a4e269a93"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:27.286319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fca9fbbc-0f81-4df6-ba2c-c0e86ea51959 req-c64757cf-72e4-45b8-bf2d-f4413084b29b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.287787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fca9fbbc-0f81-4df6-ba2c-c0e86ea51959 req-c64757cf-72e4-45b8-bf2d-f4413084b29b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.312212 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fca9fbbc-0f81-4df6-ba2c-c0e86ea51959 req-c64757cf-72e4-45b8-bf2d-f4413084b29b service nova] Creating event network-changed:6ea5ada5-e92c-4620-b275-c84a4e269a93 for instance 414c25e0-f653-44da-8176-7c2c73883c6a on nch2-master-1 Jun 04 20:59:27.321206 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fca9fbbc-0f81-4df6-ba2c-c0e86ea51959 req-c64757cf-72e4-45b8-bf2d-f4413084b29b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063766 Jun 04 20:59:27.323903 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 919/1788] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:27.341198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:27.343212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:27.383386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.386278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:27.388926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:27.390356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:28.761138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:28.787666 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aa2ebc06-f850-4995-8a82-9048bd9f2568 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 1.671504 Jun 04 20:59:28.791748 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 870/1789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:27 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:28.806737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:28.817825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:28.820356 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-480a3db1-304e-4194-a598-2d1b6293faf9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1317 microversion: 2.1 time: 1.494571 Jun 04 20:59:28.821759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:28.824212 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 920/1790] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:27 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1317 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:28.828539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:28.829288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:28.830283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:28.830892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:28.852917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:28.856365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:28.877491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:28.878851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:28.887782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:28.891448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:28.941886 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 HTTP/1.1 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7c6a3d42-40e7-4607-a6b5-32cdf3d067f6'} Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:28.952384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Instance 7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:28.958630 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0d4b761-c108-4868-8753-e1e7b53e8dd7 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6" status: 404 len: 111 microversion: 2.1 time: 0.126537 Jun 04 20:59:28.963642 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 921/1791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:28 2022] GET /compute/v2.1/servers/7c6a3d42-40e7-4607-a6b5-32cdf3d067f6 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:28.976954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:28.981737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:28.998611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:28.999575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:29.001429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:29.002151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:29.697309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:29.715405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:29.718665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:29.720425 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca714b76-1255-4cfa-aa5f-85bed538dab0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 0.926018 Jun 04 20:59:29.721946 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 871/1792] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:28 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:29.731994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:29.732922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:29.745219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:29.746573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:29.747734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:29.748365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:29.791016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:29.807280 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-914a0979-dfce-435d-a0af-0efc4872ad71 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 0.842102 Jun 04 20:59:29.808811 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 922/1793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:28 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:29.817456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6b50de3f-ee73-45f5-a994-a6ca3093ceae req-61a39405-af5a-498d-aa75-92003769477a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "tag": "f7f513cb-cc63-43e9-bb2f-d9cc059fe6b7"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:29.837618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6b50de3f-ee73-45f5-a994-a6ca3093ceae req-61a39405-af5a-498d-aa75-92003769477a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:29.843191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6b50de3f-ee73-45f5-a994-a6ca3093ceae req-61a39405-af5a-498d-aa75-92003769477a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:29.870999 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6b50de3f-ee73-45f5-a994-a6ca3093ceae req-61a39405-af5a-498d-aa75-92003769477a service nova] Creating event network-changed:f7f513cb-cc63-43e9-bb2f-d9cc059fe6b7 for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:29.885208 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6b50de3f-ee73-45f5-a994-a6ca3093ceae req-61a39405-af5a-498d-aa75-92003769477a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074940 Jun 04 20:59:29.886208 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 923/1794] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:29.891638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d019720d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:30.019614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:30.020526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:59:30.021631 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.021631 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c HTTP/1.1 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a128e25e-2b3e-4d0a-8b75-6990ae43d10c'} Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:30.024788 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] Jun 04 20:59:30.029214 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:30.039463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group a128e25e-2b3e-4d0a-8b75-6990ae43d10c does not exist Jun 04 20:59:30.039463 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-e9e33e32-854b-48a6-8b12-e53a0c645a65'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:30.039463 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-40090b12-508c-4005-bbe0-eed9629be7e6 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c" status: 404 len: 194 microversion: 2.1 time: 0.151268 Jun 04 20:59:30.040498 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 924/1795] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:29 2022] DELETE /compute/v2.1/os-security-groups/a128e25e-2b3e-4d0a-8b75-6990ae43d10c => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:30.049471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a8403ac4-50ea-4c46-9ee4-6c87434a402b req-a129715a-99b0-4b08-a00e-1ede01af2c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414c25e0-f653-44da-8176-7c2c73883c6a", "name": "network-vif-plugged", "status": "completed", "tag": "6ea5ada5-e92c-4620-b275-c84a4e269a93"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:30.076838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a8403ac4-50ea-4c46-9ee4-6c87434a402b req-a129715a-99b0-4b08-a00e-1ede01af2c68 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:30.077652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a8403ac4-50ea-4c46-9ee4-6c87434a402b req-a129715a-99b0-4b08-a00e-1ede01af2c68 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:30.082520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:30.109366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a8403ac4-50ea-4c46-9ee4-6c87434a402b req-a129715a-99b0-4b08-a00e-1ede01af2c68 service nova] Creating event network-vif-plugged:6ea5ada5-e92c-4620-b275-c84a4e269a93 for instance 414c25e0-f653-44da-8176-7c2c73883c6a on nch2-master-1 Jun 04 20:59:30.115627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a8403ac4-50ea-4c46-9ee4-6c87434a402b req-a129715a-99b0-4b08-a00e-1ede01af2c68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073124 Jun 04 20:59:30.116908 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 925/1796] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:30.130804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:30.132038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:30.155558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:30.156611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:30.158201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:30.159113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:30.679427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:30.693653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a14c8bdf-bd49-4d36-a789-653ab54c37cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.969764 Jun 04 20:59:30.694818 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 872/1797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:29 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:30.700822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:30.702577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:30.713370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:30.714281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:30.716580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:30.717070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:30.998902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:31.008804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:31.010424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61c52d61-8c4a-4135-a314-643aac3a04cb tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.888746 Jun 04 20:59:31.011278 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 926/1798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:30 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:31.025388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a921f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:31.054459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=24 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:31.270854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:31.271888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group 0cfffa36-c62e-487d-9037-03c6f9c958ef not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:59:31.272974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.272974 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef HTTP/1.1 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0cfffa36-c62e-487d-9037-03c6f9c958ef'} Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:31.274622 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group 0cfffa36-c62e-487d-9037-03c6f9c958ef does not exist Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-167cc308-9707-42cf-ae12-48ddfffa4be1'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-30dbb8ce-a512-49da-bc76-7cc3b58bc616 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef" status: 404 len: 194 microversion: 2.1 time: 0.264326 Jun 04 20:59:31.281093 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 927/1799] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:31 2022] DELETE /compute/v2.1/os-security-groups/0cfffa36-c62e-487d-9037-03c6f9c958ef => generated 194 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:31.292060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:31.294299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:31.313008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:31.314200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:31.316835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:31.317523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:31.670832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:31.679462 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7bdff8e2-045a-4ee9-ba99-391a6cdba245 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1317 microversion: 2.1 time: 0.983326 Jun 04 20:59:31.689428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 873/1800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:30 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1317 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:31.695418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:31.695762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:31.710611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:31.711499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:31.713082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:31.714611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:32.522833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:32.564406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:32.571717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:32.574864 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ff9c97a-1a27-4026-a365-bf5978321a9c tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1646 microversion: 2.25 time: 1.293094 Jun 04 20:59:32.576711 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 928/1801] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:31 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1646 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:32.583254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a3bdc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:32.808131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:32.814820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group 03158387-3950-4bce-a6c3-15ac8f7bf673 not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:59:32.815910 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.815910 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673 HTTP/1.1 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '03158387-3950-4bce-a6c3-15ac8f7bf673'} Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:32.818012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group 03158387-3950-4bce-a6c3-15ac8f7bf673 does not exist Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6daead5c-518f-45ee-a77b-ab255eb393c6'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15e58018-7f17-4e6d-96e2-cb23872a785a tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673" status: 404 len: 194 microversion: 2.1 time: 0.241535 Jun 04 20:59:32.824853 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 929/1802] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:32 2022] DELETE /compute/v2.1/os-security-groups/03158387-3950-4bce-a6c3-15ac8f7bf673 => generated 194 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:32.833545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:32.833545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:32.840209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:32.840692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:32.842008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:32.842671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.093366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:33.110273 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c56c4cfb-6dfb-4371-9f29-bdd5a765c1a5 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 1.419182 Jun 04 20:59:33.112090 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 874/1803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:31 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:33.118526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:33.120346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:33.148140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.155614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.156795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.157446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.436897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:33.445554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3056ca12-e9b8-4684-bbaa-c823b00f90da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.624265 Jun 04 20:59:33.446917 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 930/1804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:32 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:33.456840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-51147f51-1d84-467e-8171-bce9ea2a8271 req-9a7c560d-7cee-4cd3-9fb1-c1394c323cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "tag": "5bab4667-8446-419d-b001-37166c877a45"}, {"name": "network-changed", "server_uuid": "b5eaee8c-2eae-4b79-8877-9662b743bdc0", "tag": "f01d8e9d-1098-489c-a951-002d58f61ad8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:33.467215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-51147f51-1d84-467e-8171-bce9ea2a8271 req-9a7c560d-7cee-4cd3-9fb1-c1394c323cec service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.467988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-51147f51-1d84-467e-8171-bce9ea2a8271 req-9a7c560d-7cee-4cd3-9fb1-c1394c323cec service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.486726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-51147f51-1d84-467e-8171-bce9ea2a8271 req-9a7c560d-7cee-4cd3-9fb1-c1394c323cec service nova] Creating event network-changed:5bab4667-8446-419d-b001-37166c877a45 for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:33.491719 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-51147f51-1d84-467e-8171-bce9ea2a8271 req-9a7c560d-7cee-4cd3-9fb1-c1394c323cec service nova] Creating event network-changed:f01d8e9d-1098-489c-a951-002d58f61ad8 for instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 on nch1-master-1 Jun 04 20:59:33.504883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-51147f51-1d84-467e-8171-bce9ea2a8271 req-9a7c560d-7cee-4cd3-9fb1-c1394c323cec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055568 Jun 04 20:59:33.505742 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 931/1805] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:33.510163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:33.516794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:33.517823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:33.521893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ded6d20-f4de-49e7-9aa7-598bc27377d3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.407907 Jun 04 20:59:33.527401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.527932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.528858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.529302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.530854 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 875/1806] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:33 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:33.536974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a355e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:33.568302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:33.570439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group 8003143b-64f4-4d13-944f-5367f66e6466 not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:59:33.571201 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.571201 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466 HTTP/1.1 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '8003143b-64f4-4d13-944f-5367f66e6466'} Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:33.575347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group 8003143b-64f4-4d13-944f-5367f66e6466 does not exist Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-88d38a88-7a87-41b7-a0a2-062dd31cda80'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ca7d04f-7c91-439e-a34f-5b6e35b1e65d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466" status: 404 len: 194 microversion: 2.1 time: 0.044965 Jun 04 20:59:33.580771 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 876/1807] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:33 2022] DELETE /compute/v2.1/os-security-groups/8003143b-64f4-4d13-944f-5367f66e6466 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:33.591268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-6614c5b6-9030-4c42-ad36-ad0da8acb07f req-70ea5200-c4f9-49f9-994f-d43ce2302ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc", "name": "network-vif-plugged", "status": "completed", "tag": "f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:33.596232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6614c5b6-9030-4c42-ad36-ad0da8acb07f req-70ea5200-c4f9-49f9-994f-d43ce2302ab5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.596682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6614c5b6-9030-4c42-ad36-ad0da8acb07f req-70ea5200-c4f9-49f9-994f-d43ce2302ab5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.610878 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-6614c5b6-9030-4c42-ad36-ad0da8acb07f req-70ea5200-c4f9-49f9-994f-d43ce2302ab5 service nova] Creating event network-vif-plugged:f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f for instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc on nch2-master-1 Jun 04 20:59:33.618242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-6614c5b6-9030-4c42-ad36-ad0da8acb07f req-70ea5200-c4f9-49f9-994f-d43ce2302ab5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038217 Jun 04 20:59:33.619903 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 877/1808] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:33.630624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a355e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:33.730229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:33.730229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:59:33.730229 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.730229 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa HTTP/1.1 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a67f13aa-b039-4a5c-b1c0-c945bc83ebaa'} Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:33.730799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group a67f13aa-b039-4a5c-b1c0-c945bc83ebaa does not exist Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-ffbb4d4e-8849-443e-835b-06448f45071e'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3ca8b6c-8318-4030-8611-2f8aeab45e52 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa" status: 404 len: 194 microversion: 2.1 time: 0.110234 Jun 04 20:59:33.736828 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 878/1809] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:33 2022] DELETE /compute/v2.1/os-security-groups/a67f13aa-b039-4a5c-b1c0-c945bc83ebaa => generated 194 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:33.744616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:33.744616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:33.762048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.762523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:33.763361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:33.763814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.094970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.107668 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c16b54ab-abe9-4a14-9aca-35f763bb7091 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1507 microversion: 2.1 time: 0.600201 Jun 04 20:59:34.109198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 932/1810] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:33 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1507 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:34.114700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01972f70>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.181760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:34.183374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Neutron security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 20:59:34.184132 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.184132 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94 HTTP/1.1 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f9b11803-9c30-4c8c-afc9-60f98e1d7f94'} Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:34.186265 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Security group f9b11803-9c30-4c8c-afc9-60f98e1d7f94 does not exist Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6c28cbe7-863d-4c0c-9a4c-da6f96430406'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e90e5cc-b8ea-4569-bce2-d5bc24020dd5 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94" status: 404 len: 194 microversion: 2.1 time: 0.077406 Jun 04 20:59:34.190713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 933/1811] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:34 2022] DELETE /compute/v2.1/os-security-groups/f9b11803-9c30-4c8c-afc9-60f98e1d7f94 => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:34.203776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.204656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:34.227310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.229766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.230303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.231554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.233889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.240368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.245923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.247619 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6371c936-40a5-495e-98ed-de01df15d9fd tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1636 microversion: 2.25 time: 0.510337 Jun 04 20:59:34.249141 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 879/1812] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:33 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1636 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:34.257756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.259938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:34.267163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.268178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.269369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.270355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.304425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:59:34.454252 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ecbd63e-c2b9-4631-b5d3-19ca9d3b061b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 204 len: 0 microversion: 2.1 time: 0.203007 Jun 04 20:59:34.455496 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 880/1813] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:34 2022] DELETE /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:34.462902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.463781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:34.473549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.474316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.476037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.477104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.528285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:59:34.637589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.648371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ccd4c41-6cf4-487e-84d2-976c582f5a24 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 0.458832 Jun 04 20:59:34.661770 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 934/1814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:34 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:34.667416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4b48126-9d58-4089-8a60-570b9e72f327 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '.version_select at 0x7f2d019e4c10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.672257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4b48126-9d58-4089-8a60-570b9e72f327 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.673103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4b48126-9d58-4089-8a60-570b9e72f327 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.685324 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4b48126-9d58-4089-8a60-570b9e72f327 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1276 microversion: 2.25 time: 0.021221 Jun 04 20:59:34.686503 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43df36f0-4dbe-4fda-b29b-e06571ebce95 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 204 len: 0 microversion: 2.1 time: 0.228771 Jun 04 20:59:34.686924 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 935/1815] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Jun 4 20:59:34 2022] GET /compute/v2.1/os-migrations => generated 1276 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:34.687848 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 881/1816] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:34 2022] DELETE /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:34.692890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.694270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:34.703055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.704112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.705296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.710612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.715998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.717030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:34.733856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.734391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.735334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:34.736949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:34.975671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.986832 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd21e1af-33bd-4b99-838e-daae61462ff6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1513 microversion: 2.1 time: 0.298046 Jun 04 20:59:34.987422 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 936/1817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:34 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1513 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:34.996546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:34.997670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:34.998254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:35.005482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.006203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.007166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.007828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.020152 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f2fe7ba-7890-4dc4-9ddb-cdb25c4bb316 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.319595 Jun 04 20:59:35.022909 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 882/1818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:34 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:35.035712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:35.043156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:35.064491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.065364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.066704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.067387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.268325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:35.277897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4d8fb2f-01ff-4539-9a37-f8d7d5c8dc7c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.289363 Jun 04 20:59:35.278999 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 937/1819] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:34 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:35.286354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:35.287388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:35.294878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:35.299241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.300099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.301535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.302286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.318474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:59:35.344296 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7274d725-c0f6-47e7-929b-9bbdaf4d818f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 2128 microversion: 2.25 time: 0.320204 Jun 04 20:59:35.344925 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 883/1820] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:35 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 2128 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:35.551252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1923314245", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "b50e2dbc-27dc-4302-bc77-50cc183290eb"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:35.551606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:35.561710 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-18f4b4f3-33bd-419e-af0e-cf35d76b9979 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1647 microversion: 2.1 time: 0.281011 Jun 04 20:59:35.571676 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 938/1821] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:35 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1647 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:35.571676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:35.572340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:35.580351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.580806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.581655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.582238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.643390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] validate_networks() for [('b50e2dbc-27dc-4302-bc77-50cc183290eb', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:35.878872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:59:35.921575 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-51db15e7-3fba-4aee-8f71-73efecf8532a tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 2128 microversion: 2.25 time: 0.356924 Jun 04 20:59:35.922388 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 939/1822] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:35 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 2128 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:35.939158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-244dada6-1aac-4b8a-80c1-7f91c3d4632a req-73a00c46-bab4-40a0-8228-1b8673c58186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "tag": "6db052f5-0f8b-4c63-8a42-5dfa31a515df"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:35.950671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-244dada6-1aac-4b8a-80c1-7f91c3d4632a req-73a00c46-bab4-40a0-8228-1b8673c58186 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:35.953868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-244dada6-1aac-4b8a-80c1-7f91c3d4632a req-73a00c46-bab4-40a0-8228-1b8673c58186 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:35.972551 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-244dada6-1aac-4b8a-80c1-7f91c3d4632a req-73a00c46-bab4-40a0-8228-1b8673c58186 service nova] Creating event network-changed:6db052f5-0f8b-4c63-8a42-5dfa31a515df for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:35.978291 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-244dada6-1aac-4b8a-80c1-7f91c3d4632a req-73a00c46-bab4-40a0-8228-1b8673c58186 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054081 Jun 04 20:59:35.979680 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 940/1823] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:35.985364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:35.986331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:35.993389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:36.000478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:36.001698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:36.002306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:36.370037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:36.388941 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de87f38f-2d16-444e-888d-3df21503d5a2 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1369 microversion: 2.1 time: 0.407709 Jun 04 20:59:36.401124 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 941/1824] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:35 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1369 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:36.407883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:36.408966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:36.426180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:36.426822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:36.428367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:36.429141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:37.214329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:37.241547 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72fe08bc-6e79-44c1-b1d4-d3c48ca7ec3c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1513 microversion: 2.1 time: 0.837078 Jun 04 20:59:37.267836 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 942/1825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:36 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1513 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:37.288780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:37.289896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:37.299489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:37.304928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:37.307610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:37.309515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:37.836272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:37.836922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:37.837493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:37.838084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:37.838606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:37.854311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:37.857762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:37.858795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:37.859450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:37.904956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Getting quotas for project 2df84f0dd560488b9b85303294bc6fca. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:37.916058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Getting quotas for user c329a5d4cc2f4311ae154a8810698837 and project 2df84f0dd560488b9b85303294bc6fca. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:37.938586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:37.940970 ncdv-master-1 devstack@n-api.service[137229]: WARNING nova.utils [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1923314245 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-192331424 Jun 04 20:59:37.941925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:38.019078 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a58f0aa0-ea81-4ed8-bfae-8cc60e800bb3 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.671749 Jun 04 20:59:38.027528 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 884/1826] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:38.035929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:38.037485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:38.044640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:38.046096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:38.047703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:38.048270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:38.193927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lazy-loading 'services' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:59:38.256958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:38.267878 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf09574a-fcff-4f66-901e-55738ad4f817 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.986445 Jun 04 20:59:38.268756 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 943/1827] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:37 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:38.291414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:38.298203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:38.305176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:38.312023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:38.314065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:38.314730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:38.344633 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cf91187e-cb18-475c-a7ac-0a9c37d2cb60 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/os-volume_attachments/40e4e2d0-1a42-4e71-9df7-e2abd0414e4f" status: 202 len: 0 microversion: 2.25 time: 0.317903 Jun 04 20:59:38.345230 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 885/1828] 10.222.0.18 () {60 vars in 1456 bytes} [Sat Jun 4 20:59:38 2022] DELETE /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/os-volume_attachments/40e4e2d0-1a42-4e71-9df7-e2abd0414e4f => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:38.369265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:38.370021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:38.395805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:38.397767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:38.399881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:38.402045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:38.409957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:39.162140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:39.197022 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-80795c42-db01-4c02-8417-2f42c3a66fad tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.915785 Jun 04 20:59:39.201536 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 944/1829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:38 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:39.209073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:39.210154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:39.255862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.258486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.269152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.269857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.277014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5163967e1f4f14b64ed72ffbf64db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89428fdfbe7748018280e169ceebc0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:39.286759 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98c1afa4-51ad-445e-97ce-68e92fc3cc8d tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 200 len: 1647 microversion: 2.1 time: 0.940099 Jun 04 20:59:39.300662 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 886/1830] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:38 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 1647 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:39.306074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:39.306948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:39.317141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.322474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.323674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.324369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.592214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:39.600948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9228a2eb-4341-4790-9d39-6a667a908743 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1292 microversion: 2.1 time: 0.298866 Jun 04 20:59:39.601571 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 887/1831] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:39 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1292 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:39.606750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:39.607443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:39.613897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.614340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.615142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.615607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.651995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.652426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.653098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lazy-loading 'fault' on Instance uuid 414c25e0-f653-44da-8176-7c2c73883c6a {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 20:59:39.738286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:39.747666 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98fbfcf5-1796-4679-8563-14981c2f6f70 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 200 len: 1307 microversion: 2.1 time: 0.144997 Jun 04 20:59:39.763556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 888/1832] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:39 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:39.763556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:39.763556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:39.772681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.773783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.775319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.782302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:39.788364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.810555 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a6bf3f69-e20a-47cd-be20-77b8f5d11bc3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1563 microversion: 2.1 time: 0.596944 Jun 04 20:59:39.812795 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 945/1833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:39 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1563 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:39.832247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a209e49-7be0-4795-85b0-075b8e301aea tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.082148 Jun 04 20:59:39.833414 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 889/1834] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Jun 4 20:59:39 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:39.849205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c86403cf-da13-48b6-8286-8348928a626c req-c353784f-e178-434a-80ba-3f772e0281d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5eaee8c-2eae-4b79-8877-9662b743bdc0", "name": "network-vif-plugged", "status": "completed", "tag": "f01d8e9d-1098-489c-a951-002d58f61ad8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:39.857820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9351d3c7-d610-4ddf-864d-8a8324fa4ce3 req-397d85cd-215f-4eb5-8d23-3f3d42dbdd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22dde75e-3edf-4266-9c1b-698d37dbd5e3", "name": "network-vif-deleted", "tag": "8eaa5fdb-e707-4814-be8f-863044de9255"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:39.875235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9351d3c7-d610-4ddf-864d-8a8324fa4ce3 req-397d85cd-215f-4eb5-8d23-3f3d42dbdd1f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.878040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9351d3c7-d610-4ddf-864d-8a8324fa4ce3 req-397d85cd-215f-4eb5-8d23-3f3d42dbdd1f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.881204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c86403cf-da13-48b6-8286-8348928a626c req-c353784f-e178-434a-80ba-3f772e0281d6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.883697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c86403cf-da13-48b6-8286-8348928a626c req-c353784f-e178-434a-80ba-3f772e0281d6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.912057 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9351d3c7-d610-4ddf-864d-8a8324fa4ce3 req-397d85cd-215f-4eb5-8d23-3f3d42dbdd1f service nova] Creating event network-vif-deleted:8eaa5fdb-e707-4814-be8f-863044de9255 for instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 on nch1-master-1 Jun 04 20:59:39.930679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9351d3c7-d610-4ddf-864d-8a8324fa4ce3 req-397d85cd-215f-4eb5-8d23-3f3d42dbdd1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092674 Jun 04 20:59:39.936075 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 890/1835] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:39.944086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:39.944971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:39.966072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c86403cf-da13-48b6-8286-8348928a626c req-c353784f-e178-434a-80ba-3f772e0281d6 service nova] Creating event network-vif-plugged:f01d8e9d-1098-489c-a951-002d58f61ad8 for instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 on nch1-master-1 Jun 04 20:59:39.967706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.968937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.969952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:39.970561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:39.978879 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c86403cf-da13-48b6-8286-8348928a626c req-c353784f-e178-434a-80ba-3f772e0281d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163962 Jun 04 20:59:39.987657 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 946/1836] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:40.002304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.002914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:40.023931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.024386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.025292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.025919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.205592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f10f8bb-78cc-42ec-b791-4cb07e4d121e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.212931 Jun 04 20:59:40.206714 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 947/1837] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 20:59:39 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:40.217823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.218936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:40.243153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.243931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.244990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.245599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.251094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:40.515697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:40.526605 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a3fc71ba-a908-4706-bd2c-afaf81cd0e6f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.586149 Jun 04 20:59:40.527432 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 891/1838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:39 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:40.542508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.543423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] [instance: 22dde75e-3edf-4266-9c1b-698d37dbd5e3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:40.550737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.551431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.552419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.553016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.569593 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] HTTP exception thrown: Instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 could not be found. Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Request method failure captured: Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 HTTP/1.1 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8dHutbQrK2ObjiP08B-fR_OYiztguR76pyoFVE3IgjHxxl4tdone7Q-kU6zFm32ZBHR5xoqMJ8MDwqpajGUfyXhtgF8l1ScpT3nBMOZ5mXcATxYpufzfpGhvI2po_tkSp7tCiiqrKkOonUY-W-yrn5RzMEJWTW54CjiiCb-EXYqjS8 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89428fdfbe7748018280e169ceebc0df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89428fdfbe7748018280e169ceebc0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 89428fdfbe7748018280e169ceebc0df Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1658182348 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb5163967e1f4f14b64ed72ffbf64db8 Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsTestJSON-1658182348-project Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 could not be found. Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '22dde75e-3edf-4266-9c1b-698d37dbd5e3'} Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 could not be found. Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 could not be found. Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:40.571776 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 could not be found. Jun 04 20:59:40.577439 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.579532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Returning 404 to user: Instance 22dde75e-3edf-4266-9c1b-698d37dbd5e3 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:40.580586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a094bec-297f-46b7-b17c-a938c955caa1 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3" status: 404 len: 111 microversion: 2.1 time: 0.042264 Jun 04 20:59:40.581694 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 892/1839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:40 2022] GET /compute/v2.1/servers/22dde75e-3edf-4266-9c1b-698d37dbd5e3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:40.592573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b1580c7-39ac-4379-a7a1-420439443412 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a27700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.690519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:40.706146 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c5f4ccec-40b8-4b75-b7f1-3bc46c5fcf4f tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.494955 Jun 04 20:59:40.714141 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 948/1840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:40 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:59:40.719263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.729294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:40.743347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.745274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.747412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.748065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.867079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:40.881001 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fcdb4afc-8d43-4b64-ac65-442d2f190f41 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1290 microversion: 2.1 time: 0.165390 Jun 04 20:59:40.881600 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 949/1841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:40 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1290 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:40.895259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.895915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:40.917061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.917502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.918301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.918736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.940431 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a HTTP/1.1 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '414c25e0-f653-44da-8176-7c2c73883c6a'} Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:40.943006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 20:59:40.947684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:40.949544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:40.950641 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-010fafa3-305c-4de2-9464-399868e6aa3d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 404 len: 111 microversion: 2.1 time: 0.068130 Jun 04 20:59:40.951798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 950/1842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:40 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:40.968839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:40.975319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:40.994666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.995709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:40.996776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:40.997414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:41.235574 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b1580c7-39ac-4379-a7a1-420439443412 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/3eb33528-ea67-40f1-87fb-a1e1fcaaa65e" status: 202 len: 0 microversion: 2.1 time: 0.649226 Jun 04 20:59:41.240326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 893/1843] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:40 2022] DELETE /compute/v2.1/os-security-groups/3eb33528-ea67-40f1-87fb-a1e1fcaaa65e => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:41.258580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a4fa80a2-6462-4b65-b4e9-8d043d920fe0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] Calling method '.version_select at 0x7f2d01a35ca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:41.347210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:41.360088 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e52bd25e-93d8-4490-9ba0-54208cf814b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.394794 Jun 04 20:59:41.369683 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 951/1844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:40 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:41.549555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:41.564309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:41.603336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:41.604504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:41.605727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:41.609503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.102236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:42.116931 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df8710e3-295a-4c5f-b576-59b23b888293 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.575566 Jun 04 20:59:42.118925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 952/1845] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:41 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 20:59:42.130583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-908936d4-ad83-401a-a90e-553652bd18fb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-908936d4-ad83-401a-a90e-553652bd18fb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 163 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": 12345, "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 12345 Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:59:42.135503 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 04 20:59:42.142603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:42.148423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-908936d4-ad83-401a-a90e-553652bd18fb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:42.149927 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-908936d4-ad83-401a-a90e-553652bd18fb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026692 Jun 04 20:59:42.151433 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 953/1846] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:42 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:42.160353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:42.161637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:42.174026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.175390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.180811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.187956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.256435 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a4fa80a2-6462-4b65-b4e9-8d043d920fe0 tempest-SecurityGroupsTestJSON-1658182348 tempest-SecurityGroupsTestJSON-1658182348-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9c3a8960-bd08-455b-a085-653f3fa93396" status: 202 len: 0 microversion: 2.1 time: 1.009236 Jun 04 20:59:42.259733 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 894/1847] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 20:59:41 2022] DELETE /compute/v2.1/os-security-groups/9c3a8960-bd08-455b-a085-653f3fa93396 => generated 0 bytes in 1015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:42.276331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:42.277262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:42.291690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.295061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.296258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.296745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.811325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:42.820766 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d270f77-c017-4769-bab4-b0c7a65d605e tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1332 microversion: 2.1 time: 0.558168 Jun 04 20:59:42.833749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:42.843314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 895/1848] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:42 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1332 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:42.844457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c68c5540-6340-4ad0-b1fd-8d326dca7bf7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.691638 Jun 04 20:59:42.856820 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 954/1849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:42 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:42.859112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-f3122029-5b9c-4abe-b58f-8f83f68fef24 req-ea4aa337-8d7e-4bb3-a703-fdc676fbfb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414c25e0-f653-44da-8176-7c2c73883c6a", "name": "network-vif-deleted", "tag": "6ea5ada5-e92c-4620-b275-c84a4e269a93"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:42.869977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:42.874781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:42.892744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f3122029-5b9c-4abe-b58f-8f83f68fef24 req-ea4aa337-8d7e-4bb3-a703-fdc676fbfb20 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.893163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.894339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.894505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f3122029-5b9c-4abe-b58f-8f83f68fef24 req-ea4aa337-8d7e-4bb3-a703-fdc676fbfb20 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.899041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:42.899590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:42.926551 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-f3122029-5b9c-4abe-b58f-8f83f68fef24 req-ea4aa337-8d7e-4bb3-a703-fdc676fbfb20 service nova] Creating event network-vif-deleted:6ea5ada5-e92c-4620-b275-c84a4e269a93 for instance 414c25e0-f653-44da-8176-7c2c73883c6a on nch2-master-1 Jun 04 20:59:42.935880 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-f3122029-5b9c-4abe-b58f-8f83f68fef24 req-ea4aa337-8d7e-4bb3-a703-fdc676fbfb20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090845 Jun 04 20:59:42.942759 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 896/1850] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:42.968040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1558310766", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1e56980c-95ca-4182-ba01-f6d8494d4447"}], "block_device_mapping_v2": [{"uuid": "153e56ad-00b6-438f-923c-903891b5c847", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:43.131891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] validate_networks() for [('1e56980c-95ca-4182-ba01-f6d8494d4447', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:43.256502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:43.267789 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5482c608-600d-4f51-9984-9865b5af6475 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.408142 Jun 04 20:59:43.270587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 955/1851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:42 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:43.278340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:43.283800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:43.304476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:43.304953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:43.306989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:43.309192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:44.182286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:44.207190 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc3e6251-9399-4b7e-9083-38f8431d8305 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1312 microversion: 2.1 time: 0.934380 Jun 04 20:59:44.211309 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 956/1852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:43 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1312 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:44.238621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:44.241095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:44.261794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:44.264423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:44.265858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:44.273154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:44.836172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:44.852461 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-448b4379-08e6-4a1d-99f9-27334b1a600f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.638601 Jun 04 20:59:44.855720 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 957/1853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:44 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:44.867294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:44.869787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:44.889673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:44.891435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:44.895192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:44.896800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:45.431561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:45.432683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:45.433855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:45.434441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:45.435702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:45.456573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:45.457851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:45.463201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:45.463942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:45.530423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:45.535914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:45.544763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Getting quotas for user e25328c90d26437a85d8d5509437ed99 and project af5ccb3a1d6f4f9e9eaad08d25ce57fd. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:45.662434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:45.668567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='153e56ad-00b6-438f-923c-903891b5c847',volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:45.668800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:45.689197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66925b44-af45-445d-a495-64694fbd10ec tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1332 microversion: 2.1 time: 0.830200 Jun 04 20:59:45.692392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 958/1854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:44 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1332 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:45.729657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:45.733356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:45.761669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:45.763397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:45.767958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:45.769163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:46.133201 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0f569e4-8571-4a65-9bed-59f53d0962c6 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.170304 Jun 04 20:59:46.143837 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 897/1855] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 20:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 04 20:59:46.172363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e24ce524-0c7c-4573-b549-7ad5297541cd req-f193ef0b-20a6-488d-b870-d66956246bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc", "tag": "f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:46.193587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e24ce524-0c7c-4573-b549-7ad5297541cd req-f193ef0b-20a6-488d-b870-d66956246bfa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:46.194038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e24ce524-0c7c-4573-b549-7ad5297541cd req-f193ef0b-20a6-488d-b870-d66956246bfa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:46.223174 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e24ce524-0c7c-4573-b549-7ad5297541cd req-f193ef0b-20a6-488d-b870-d66956246bfa service nova] Creating event network-changed:f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f for instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc on nch2-master-1 Jun 04 20:59:46.233999 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e24ce524-0c7c-4573-b549-7ad5297541cd req-f193ef0b-20a6-488d-b870-d66956246bfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086469 Jun 04 20:59:46.234973 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 898/1856] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:46.246839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a64d3552-b95b-4b09-acce-16ccecf3e7e2 req-6580855a-f4b2-4cdd-a2e6-de2a92e2cd4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b2523f-383d-40a9-8794-390c4e67684e", "tag": "50e6596d-fd85-4321-a3cc-35e8868b4460"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:46.270549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a64d3552-b95b-4b09-acce-16ccecf3e7e2 req-6580855a-f4b2-4cdd-a2e6-de2a92e2cd4c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:46.270989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a64d3552-b95b-4b09-acce-16ccecf3e7e2 req-6580855a-f4b2-4cdd-a2e6-de2a92e2cd4c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:46.307428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:46.308790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a64d3552-b95b-4b09-acce-16ccecf3e7e2 req-6580855a-f4b2-4cdd-a2e6-de2a92e2cd4c service nova] Creating event network-changed:50e6596d-fd85-4321-a3cc-35e8868b4460 for instance 85b2523f-383d-40a9-8794-390c4e67684e on nch2-master-1 Jun 04 20:59:46.319752 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aeb06535-e88c-4496-9b36-a90579194424 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.622838 Jun 04 20:59:46.322830 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 959/1857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:45 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:46.327634 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a64d3552-b95b-4b09-acce-16ccecf3e7e2 req-6580855a-f4b2-4cdd-a2e6-de2a92e2cd4c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088892 Jun 04 20:59:46.328568 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 899/1858] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:46.340157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:46.341724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:46.362573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a87c4fb-4988-4638-9ccf-4157254b49a8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:46.363290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a87c4fb-4988-4638-9ccf-4157254b49a8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:46.380209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:46.380693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:46.381547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:46.381997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:46.531830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a87c4fb-4988-4638-9ccf-4157254b49a8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:46.545332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a87c4fb-4988-4638-9ccf-4157254b49a8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:46.561961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a87c4fb-4988-4638-9ccf-4157254b49a8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:46.565764 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a87c4fb-4988-4638-9ccf-4157254b49a8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1104 microversion: 2.25 time: 0.235865 Jun 04 20:59:46.567705 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 900/1859] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:46 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1104 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:46.708869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:46.713448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:46.714549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:46.722139 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6b9c144-730e-45c6-9107-2664772af2dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1461 microversion: 2.1 time: 0.397782 Jun 04 20:59:46.722762 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 960/1860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:46 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1461 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:46.739988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:46.742758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:46.748580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:46.750736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:47.404074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:47.404870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:47.422509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:47.423207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:47.424196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:47.426345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:47.597689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:47.611535 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ad898ac1-eb26-4a1b-bb02-fa13fc07c574 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1332 microversion: 2.1 time: 0.904238 Jun 04 20:59:47.624907 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 901/1861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:46 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1332 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:47.637638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:47.638588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:47.656978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:47.667300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:47.668358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:47.668818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:48.324539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:48.335524 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f83b8aae-438b-4246-b507-59a156e0e6d1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.707875 Jun 04 20:59:48.337888 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 902/1862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:47 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:48.346980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:48.348131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:48.382201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:48.386633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:48.388114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:48.391153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:48.725962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:48.744942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:48.748202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:48.750931 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4aef23ba-d10c-4410-a776-e4a77c8ceef0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1251 microversion: 2.25 time: 0.410374 Jun 04 20:59:48.756387 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 903/1863] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:48 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1251 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:48.763272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c67a89b3-76d6-4735-b6ce-7da20971058f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1064521807", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ac96704a-67df-48a9-a9a6-4111f08c7fdb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:48.802493 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33c78c99-341c-4c8a-9d9b-ad14cc9e5f87 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1612 microversion: 2.1 time: 2.059848 Jun 04 20:59:48.841095 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 961/1864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:46 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1612 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:48.863771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:48.866954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:48.893657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:48.895242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:48.897017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:48.901176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:48.937481 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c67a89b3-76d6-4735-b6ce-7da20971058f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Block Device ac96704a-67df-48a9-a9a6-4111f08c7fdb is not bootable. Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c67a89b3-76d6-4735-b6ce-7da20971058f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 358 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1064521807", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ac96704a-67df-48a9-a9a6-4111f08c7fdb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: exception: Block Device ac96704a-67df-48a9-a9a6-4111f08c7fdb is not bootable. Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1064521807', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ac96704a-67df-48a9-a9a6-4111f08c7fdb'}], 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ac96704a-67df-48a9-a9a6-4111f08c7fdb is not bootable. Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:48.948073 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ac96704a-67df-48a9-a9a6-4111f08c7fdb is not bootable. Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ac96704a-67df-48a9-a9a6-4111f08c7fdb is not bootable. Jun 04 20:59:48.952394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:48.955873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c67a89b3-76d6-4735-b6ce-7da20971058f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Block Device ac96704a-67df-48a9-a9a6-4111f08c7fdb is not bootable. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:48.957022 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c67a89b3-76d6-4735-b6ce-7da20971058f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.199003 Jun 04 20:59:48.961542 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 904/1865] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:48.968896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3cf2d036-cf19-45f0-ac79-f76c0ba5495c req-16c03481-39a6-48f5-8808-fd2cee0fbfdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "name": "network-vif-plugged", "status": "completed", "tag": "6db052f5-0f8b-4c63-8a42-5dfa31a515df"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:48.984131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3cf2d036-cf19-45f0-ac79-f76c0ba5495c req-16c03481-39a6-48f5-8808-fd2cee0fbfdb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:48.984880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3cf2d036-cf19-45f0-ac79-f76c0ba5495c req-16c03481-39a6-48f5-8808-fd2cee0fbfdb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:49.004574 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3cf2d036-cf19-45f0-ac79-f76c0ba5495c req-16c03481-39a6-48f5-8808-fd2cee0fbfdb service nova] Creating event network-vif-plugged:6db052f5-0f8b-4c63-8a42-5dfa31a515df for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:49.021667 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3cf2d036-cf19-45f0-ac79-f76c0ba5495c req-16c03481-39a6-48f5-8808-fd2cee0fbfdb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056707 Jun 04 20:59:49.025937 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 905/1866] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:49.037689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:49.040726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:49.060280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:49.062451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:49.063590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:49.064325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:49.317574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '416e81041f5545889211b6f6f777a5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d612beb2b4d758bbae05a31ba753c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:49.324671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] flavor_id is None. Assuming migration. {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 04 20:59:49.325425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 20:59:49.550945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:49.568037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef32ee77-f3b4-4e36-a8d8-ccf1d316746d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1332 microversion: 2.1 time: 0.723030 Jun 04 20:59:49.592721 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 962/1867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:48 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1332 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:49.605082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:49.605722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:49.626246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:49.626858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:49.627983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:49.628467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:49.954655 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b77277ca-0a15-4a24-ac89-04705ab70654 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0/action" status: 202 len: 0 microversion: 2.1 time: 0.926772 Jun 04 20:59:49.956509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 906/1868] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:59:49 2022] POST /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0/action => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 20:59:49.968314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:49.969626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:49.980521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:49.985970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:49.987320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:49.987963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:50.365409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:50.382313 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-031076c2-1576-4547-9118-cc6dae8bfda4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.786423 Jun 04 20:59:50.383037 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 963/1869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:49 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:50.388602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:50.391744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:50.400001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:50.400731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:50.401756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:50.402463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:50.514909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:50.532051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:50.533714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:50.534957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb506c76-7e36-48d5-9872-77d97b1aa21b tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1239 microversion: 2.25 time: 0.150291 Jun 04 20:59:50.536316 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 964/1870] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:50 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1239 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:50.574344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:50.584045 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7723e49-f19d-4332-9d3f-6183049708c8 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 0.625947 Jun 04 20:59:50.598101 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 907/1871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:49 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:50.607454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:50.609639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:50.621889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:50.622335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:50.625261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:50.629854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:50.704209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3af85cf7-b7ba-4108-acd1-408aa20caf1e tempest-FloatingIPDetailsNegativeTestJSON-1481353417 tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project] Calling method '.version_select at 0x7f2d01945a60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:50.820846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-3af85cf7-b7ba-4108-acd1-408aa20caf1e tempest-FloatingIPDetailsNegativeTestJSON-1481353417 tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 802fe560-0236-45e7-b4fe-895a2dc7251a could not be found", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 20:59:50.824696 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3af85cf7-b7ba-4108-acd1-408aa20caf1e tempest-FloatingIPDetailsNegativeTestJSON-1481353417 tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project] HTTP exception thrown: Floating IP not found for ID 802fe560-0236-45e7-b4fe-895a2dc7251a Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3af85cf7-b7ba-4108-acd1-408aa20caf1e tempest-FloatingIPDetailsNegativeTestJSON-1481353417 tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project] Request method failure captured: Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-floating-ips/802fe560-0236-45e7-b4fe-895a2dc7251a HTTP/1.1 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fF__OkZ13X-0RC1pU90B0bFyVNmsvNF7VjtvKT7iKX-hQFURmvN9ImeSXyZ3hwaLw1y7ooAFTgKrNEjx8ZB1q-TsLRBGrkpW0uiJEN_6OoRUxGsXqoI5mxCm63CenACC-vCTwfpFB4pHyk4bK3CA4MolTcdwSDINZayH4QxiDeORI Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 89b34ac08aef435c97db4e30fa0eb3d1 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1481353417 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89b34ac08aef435c97db4e30fa0eb3d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89b34ac08aef435c97db4e30fa0eb3d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89b34ac08aef435c97db4e30fa0eb3d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89b34ac08aef435c97db4e30fa0eb3d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1481353417 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 89b34ac08aef435c97db4e30fa0eb3d1 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1481353417 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 08668532897146e38928d6370c974168 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: exception: Floating IP not found for ID 802fe560-0236-45e7-b4fe-895a2dc7251a Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '802fe560-0236-45e7-b4fe-895a2dc7251a'} Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 802fe560-0236-45e7-b4fe-895a2dc7251a could not be found Jun 04 20:59:50.828871 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a48a3fee-2c8b-4e41-b6a4-e4e777102aa6'] Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 802fe560-0236-45e7-b4fe-895a2dc7251a. Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 802fe560-0236-45e7-b4fe-895a2dc7251a Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 802fe560-0236-45e7-b4fe-895a2dc7251a Jun 04 20:59:50.833856 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:50.837021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3af85cf7-b7ba-4108-acd1-408aa20caf1e tempest-FloatingIPDetailsNegativeTestJSON-1481353417 tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project] Returning 404 to user: Floating IP not found for ID 802fe560-0236-45e7-b4fe-895a2dc7251a {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:50.839021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3af85cf7-b7ba-4108-acd1-408aa20caf1e tempest-FloatingIPDetailsNegativeTestJSON-1481353417 tempest-FloatingIPDetailsNegativeTestJSON-1481353417-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips/802fe560-0236-45e7-b4fe-895a2dc7251a" status: 404 len: 111 microversion: 2.1 time: 0.301191 Jun 04 20:59:50.839789 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 965/1872] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 20:59:50 2022] GET /compute/v2.1/os-floating-ips/802fe560-0236-45e7-b4fe-895a2dc7251a => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 20:59:50.847188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:50.847947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:50.858181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:50.858922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:50.859849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:50.860390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.110727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:51.127267 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e11fe700-6a78-4a50-be84-81858b35827c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1470 microversion: 2.1 time: 0.519262 Jun 04 20:59:51.127976 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 908/1873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:50 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1470 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:51.141885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:51.148203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:51.173960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.174797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.175851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.184110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.216034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:51.499000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:51.513276 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c00dca7b-4914-498a-b51e-0d404e954878 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.670095 Jun 04 20:59:51.515263 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 966/1874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:50 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:51.529461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "name": "network-vif-plugged", "status": "completed", "tag": "f7f513cb-cc63-43e9-bb2f-d9cc059fe6b7"}, {"server_uuid": "85b2523f-383d-40a9-8794-390c4e67684e", "name": "network-vif-plugged", "status": "completed", "tag": "50e6596d-fd85-4321-a3cc-35e8868b4460"}, {"server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "name": "network-vif-plugged", "status": "completed", "tag": "5bab4667-8446-419d-b001-37166c877a45"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:51.554326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.557465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.578387 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] Creating event network-vif-plugged:f7f513cb-cc63-43e9-bb2f-d9cc059fe6b7 for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:51.579266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] Creating event network-vif-plugged:50e6596d-fd85-4321-a3cc-35e8868b4460 for instance 85b2523f-383d-40a9-8794-390c4e67684e on nch2-master-1 Jun 04 20:59:51.580125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] Creating event network-vif-plugged:5bab4667-8446-419d-b001-37166c877a45 for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:51.590621 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-94f05738-9dea-4742-94bc-3b0e3d9f8137 req-7e8c37d5-ce6d-42d3-8357-078239b24086 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.070572 Jun 04 20:59:51.591798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 967/1875] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:51.598960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:51.599980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:51.608121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.608959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.610091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.610778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.665368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:51.703944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:51.713659 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44a1796c-53ed-4075-af6e-d39ffb9aa185 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1332 microversion: 2.1 time: 0.583996 Jun 04 20:59:51.717879 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 909/1876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:51 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1332 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:51.734917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:51.736584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:51.755310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.755947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:51.757568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:51.759413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.232869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:53.253958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:53.255604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:53.257749 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0db06522-0e96-4d3b-91c3-39309d4fc589 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1281 microversion: 2.25 time: 1.663638 Jun 04 20:59:53.279908 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 968/1877] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:51 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1281 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:53.285211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:53.286133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:53.290527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:53.307429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:53.309111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.310687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:53.311318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.329978 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-49e3f2e9-578c-4816-b069-4f3fdfaa727c tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1354 microversion: 2.1 time: 1.609619 Jun 04 20:59:53.330601 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 910/1878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:51 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1354 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:53.351725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:53.352731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:53.392843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:53.393298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.397193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:53.397647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.739873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:53.740209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:53.754235 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bca651ae-5143-4d96-9d8e-079843c85d49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1470 microversion: 2.1 time: 0.473091 Jun 04 20:59:53.766595 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9828292d-4826-4937-9639-9d25f75d00fd tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1332 microversion: 2.1 time: 0.421427 Jun 04 20:59:53.766595 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 911/1879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:53 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1332 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:53.766866 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 969/1880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:53 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1470 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:53.774066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8dba58d2-a4eb-4ed3-929d-8ee1f8a4a551 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1254948923", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "destination_type": "local"}, {"source_type": "volume", "uuid": "30a79c1e-eb28-4879-87bc-0d6a7f76e1eb", "destination_type": "invalid"}], "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8dba58d2-a4eb-4ed3-929d-8ee1f8a4a551 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 495 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1254948923", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "destination_type": "local"}, {"source_type": "volume", "uuid": "30a79c1e-eb28-4879-87bc-0d6a7f76e1eb", "destination_type": "invalid"}], "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1254948923', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '30a79c1e-eb28-4879-87bc-0d6a7f76e1eb', 'destination_type': 'invalid'}], 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'invalid' Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:53.780012 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 04 20:59:53.786015 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 20:59:53.802170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8dba58d2-a4eb-4ed3-929d-8ee1f8a4a551 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:53.805119 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8dba58d2-a4eb-4ed3-929d-8ee1f8a4a551 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.036902 Jun 04 20:59:53.808353 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 970/1881] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:53 2022] POST /compute/v2.1/servers => generated 155 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:53.843782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:53.850271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:53.875636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:53.878156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.888327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:53.889014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:53.942901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-359086961", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:54.026989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 20:59:54.260516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:54.270906 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c64c6335-4a41-4e34-a1d0-51658d65753a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.442354 Jun 04 20:59:54.272711 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 971/1882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:53 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:54.279250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:54.279901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:54.296118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:54.296832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:54.297899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:54.298431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:54.696720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:54.709051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:54.712629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:54.714799 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-873a48a1-1a49-4d37-b822-d01349b29ff8 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1281 microversion: 2.25 time: 0.440245 Jun 04 20:59:54.716368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 972/1883] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:54 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:54.723477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:54.725153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:54.735963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:54.736918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:54.738132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:54.738885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.030899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 20:59:55.031906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 20:59:55.032549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 20:59:55.033132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 20:59:55.033549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 20:59:55.063176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.064355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.068546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.080156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.087829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:55.098433 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-513f99a0-ad58-4447-b573-46db776e6920 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.380107 Jun 04 20:59:55.099034 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 973/1884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:54 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:55.105024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.105727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.110613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:55.114838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.115299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.116147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.116584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.120007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:55.137467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 20:59:55.140152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 20:59:55.201104 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7b6c1d11-c1e5-4b49-a5de-f09d1433cf56 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442002 Jun 04 20:59:55.201935 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 912/1885] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 20:59:55.221254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-914ea75b-83c8-4c41-bf82-7405e86a918a req-6a68a9fa-17c8-44f1-a3df-9a4c1de46fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eb0950-bab8-42f7-8302-60fe6aea12ea", "tag": "a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:55.247611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-914ea75b-83c8-4c41-bf82-7405e86a918a req-6a68a9fa-17c8-44f1-a3df-9a4c1de46fb8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.248460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-914ea75b-83c8-4c41-bf82-7405e86a918a req-6a68a9fa-17c8-44f1-a3df-9a4c1de46fb8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.266356 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-914ea75b-83c8-4c41-bf82-7405e86a918a req-6a68a9fa-17c8-44f1-a3df-9a4c1de46fb8 service nova] Creating event network-changed:a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e for instance 17eb0950-bab8-42f7-8302-60fe6aea12ea on nch2-master-1 Jun 04 20:59:55.278538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-914ea75b-83c8-4c41-bf82-7405e86a918a req-6a68a9fa-17c8-44f1-a3df-9a4c1de46fb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075036 Jun 04 20:59:55.281334 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 913/1886] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:55.292553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.295933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.311700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.312280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.313233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.314990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.522363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:55.534326 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8dd6c276-3ebc-44e2-b308-fb1b922b4c76 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1801 microversion: 2.1 time: 0.434147 Jun 04 20:59:55.538457 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 974/1887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1801 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:55.544389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.551323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.565514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.566010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.566753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.567188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.594440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:55.603470 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ddda5d57-cc1f-412f-b758-1d7c7a94d363 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.318550 Jun 04 20:59:55.612148 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 914/1888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:55.623427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65e762b5-5228-40ef-9140-4662e3264f5e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1355073079", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65e762b5-5228-40ef-9140-4662e3264f5e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 492 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1355073079", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1355073079', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jun 04 20:59:55.626746 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 04 20:59:55.630483 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:55.632519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65e762b5-5228-40ef-9140-4662e3264f5e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:55.632519 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-65e762b5-5228-40ef-9140-4662e3264f5e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017401 Jun 04 20:59:55.632894 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 915/1889] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:55 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:55.639974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22c520ab-68c3-4480-ba81-2a773b8efa35 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.640992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22c520ab-68c3-4480-ba81-2a773b8efa35 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.719535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22c520ab-68c3-4480-ba81-2a773b8efa35 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:55.749539 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22c520ab-68c3-4480-ba81-2a773b8efa35 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1214 microversion: 2.1 time: 0.114481 Jun 04 20:59:55.750143 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 916/1890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:55.759970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.760813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.768813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.787037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.789672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.791961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.849040 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-be5cb79f-ec53-44b8-8cb3-6b0699995c7b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1/ips" status: 200 len: 215 microversion: 2.1 time: 0.096558 Jun 04 20:59:55.860335 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 917/1891] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1/ips => generated 215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:55.864026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.865786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.877110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.878642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.879710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.880317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.882185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:55.890639 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-76807f71-cf04-4a60-a7dd-231165fe28fe tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1537 microversion: 2.1 time: 0.350688 Jun 04 20:59:55.891395 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 975/1892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1537 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:55.909901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:55.910886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:55.923573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.924408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:55.925710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:55.927142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:56.160846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:56.181526 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c00a594-9cfc-4226-9968-d752b979b398 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.324134 Jun 04 20:59:56.182941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 918/1893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:56.189348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:56.190116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:56.214168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:56.215108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:56.218008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:56.218650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:56.253099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 20:59:56.271896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:56.289913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:56.291889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:56.295415 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1cd43661-3d4e-4326-8a28-0cf82e2f3bfa tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1281 microversion: 2.25 time: 0.389481 Jun 04 20:59:56.298140 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 976/1894] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:55 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1281 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:56.308842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a443b26d-8579-412d-94c2-22e4c97bbac0 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'create', calling method: .version_select at 0x7f2d019e4280>, body: {"pool": "68fefb59-8f6d-41f3-89ac-cca30a7243e2"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:56.463335 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a22eca13-5ca8-4f22-b91e-a5819067addd tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 204 len: 0 microversion: 2.1 time: 0.277951 Jun 04 20:59:56.464799 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 919/1895] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 20:59:56 2022] DELETE /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 20:59:56.473498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:56.474503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:56.483628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:56.484386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:56.485352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:56.486082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:56.894549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:56.904581 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9dd74032-bbe2-4350-8a88-6f2fd6aac3ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.436784 Jun 04 20:59:56.905161 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 920/1896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:56 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:56.910405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:56.911023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:56.917443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:56.917893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:56.918790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:56.919220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:57.591226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:57.599329 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7cef16ec-88b6-4f5f-a5d8-580785687933 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1807 microversion: 2.1 time: 0.692940 Jun 04 20:59:57.600230 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 921/1897] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:56 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1807 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:57.605235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:57.605862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:57.612426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:57.613227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:57.614016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:57.614449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:57.848434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:57.857025 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-808ee8fc-2bfd-4eeb-a3d2-926da2a7e328 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.255472 Jun 04 20:59:57.859004 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 922/1898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:57 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:57.871880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:57.872786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:57.878980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:57.879713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:57.880658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:57.881533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:57.997932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:58.006717 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c3c71fd4-ea5c-42ec-a2a7-f230473114d6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1266 microversion: 2.1 time: 0.144300 Jun 04 20:59:58.007116 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 923/1899] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:57 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:58.016450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36feeff4-c019-41b3-ab8d-9dd0d3ad8bc7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36feeff4-c019-41b3-ab8d-9dd0d3ad8bc7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 416 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.019530 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 20:59:58.023771 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.027042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36feeff4-c019-41b3-ab8d-9dd0d3ad8bc7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:58.027941 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36feeff4-c019-41b3-ab8d-9dd0d3ad8bc7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.019811 Jun 04 20:59:58.028497 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 924/1900] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 20:59:58 2022] POST /compute/v2.1/servers => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:58.033230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:58.033875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:58.042572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:58.042998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:58.043815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:58.044446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:58.241456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:58.250252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:58.251931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:58.253057 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2634e71b-dbe3-4cde-af61-71cd7de1f939 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1281 microversion: 2.25 time: 0.223607 Jun 04 20:59:58.253613 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 925/1901] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:58 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 20:59:58.391067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6cb0cd6-fbe2-464b-9c05-aad2b17df78a tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d01a0eee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Cp+gzP2WHDYxwiqCJSNl9OEKF9FxsJXheZ/iHAnN5PjeOZMzsVeSMxf5v+8A7gqYeuiSp2p6ZuyjuNTg09ro2mxDyc09LJ0TOGVJIFRwpYQU8WK0eCY/vYAqH9eyhAQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:58.396981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c6cb0cd6-fbe2-464b-9c05-aad2b17df78a tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6cb0cd6-fbe2-464b-9c05-aad2b17df78a tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 257 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Cp+gzP2WHDYxwiqCJSNl9OEKF9FxsJXheZ/iHAnN5PjeOZMzsVeSMxf5v+8A7gqYeuiSp2p6ZuyjuNTg09ro2mxDyc09LJ0TOGVJIFRwpYQU8WK0eCY/vYAqH9eyhAQ=="}} Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0Cp+gzP2WHDYxwiqCJSNl9OEKF9FxsJXheZ/iHAnN5PjeOZMzsVeSMxf5v+8A7gqYeuiSp2p6ZuyjuNTg09ro2mxDyc09LJ0TOGVJIFRwpYQU8WK0eCY/vYAqH9eyhAQ=='}}} Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:58.406317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6cb0cd6-fbe2-464b-9c05-aad2b17df78a tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6cb0cd6-fbe2-464b-9c05-aad2b17df78a tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.153549 Jun 04 20:59:58.412394 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 926/1902] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:59:58 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 20:59:58.414557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:58.414557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:58.422082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:58.422567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:58.423397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:58.423863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:58.754556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:58.764906 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72cce331-b9c4-4e9a-9e15-df9ec48a8083 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.355066 Jun 04 20:59:58.765938 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 927/1903] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:58 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:58.771103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d019438b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1325089675", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:58.786167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:58.792112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for user 08a2bdc9ea314187bfaa5e64627e7420 and project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:58.809653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 2167 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1325089675", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 20:59:58.824026 ncdv-master-1 devstack@n-api.service[137229]: exception: Keypair data is invalid: failed to generate fingerprint Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1325089675', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 20:59:58.826836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 04 20:59:58.830276 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 20:59:58.833266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 20:59:58.834172 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a9e0b00-3257-46ec-83bc-64a515f0e46f tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067123 Jun 04 20:59:58.834763 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 928/1904] 10.222.0.18 () {60 vars in 1159 bytes} [Sat Jun 4 20:59:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 20:59:58.840512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:58.841121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:58.844625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:58.856018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:58.856764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:58.858154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:58.858585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.148714 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a443b26d-8579-412d-94c2-22e4c97bbac0 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.846984 Jun 04 20:59:59.149424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:59.150228 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 977/1905] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 20:59:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:59.158558 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c4bc690-a048-41c3-ba1c-1ba1bf184359 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1786 microversion: 2.1 time: 0.322569 Jun 04 20:59:59.159155 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 929/1906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:58 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1786 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:59.161163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:59.161822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:59.171667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a8302b8a-d7e6-46ab-991a-49be7666f821 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d0bd28700>, body: {"keypair": {"name": "tempest-keypair-836889233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDailqZgrywh0hKyvkTd8FxNLO1HZMJJv37eCSwlGTYzzw7VC1G+JaAVnIZupmOV+KTs+mkpwF/vZml4eca7j79cuiVbCMZquYjhYqKgEb8qh3i1PMaO0yFTVv7zN8xguw=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:59.172851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.173330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.174112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.174597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.216890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a8302b8a-d7e6-46ab-991a-49be7666f821 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 20:59:59.225087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a8302b8a-d7e6-46ab-991a-49be7666f821 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for user 08a2bdc9ea314187bfaa5e64627e7420 and project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 20:59:59.282128 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a8302b8a-d7e6-46ab-991a-49be7666f821 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121786 Jun 04 20:59:59.283116 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 930/1907] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 20:59:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:59.291080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:59.292034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:59.300823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.300823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.300823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.301297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.572012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:59.583233 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f2f87bd-5b8a-4efd-8573-a51ea444ac4d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.431654 Jun 04 20:59:59.591748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 978/1908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:59 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:59.597560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:59.599088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:59.610843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.611820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.612804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.613418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.654413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:59.665191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a142704-34a4-4f4a-ad63-92040782a67b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.380010 Jun 04 20:59:59.667385 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 931/1909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:59 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:59.682513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-93efeac2-cac0-4408-8cda-1cbcf2d50f1a req-3eae622a-ac5b-4c07-bc92-7a2049a55b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "name": "network-vif-deleted", "tag": "6db052f5-0f8b-4c63-8a42-5dfa31a515df"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:59.697459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-93efeac2-cac0-4408-8cda-1cbcf2d50f1a req-3eae622a-ac5b-4c07-bc92-7a2049a55b68 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.698331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-93efeac2-cac0-4408-8cda-1cbcf2d50f1a req-3eae622a-ac5b-4c07-bc92-7a2049a55b68 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.703831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:59:59.717249 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-93efeac2-cac0-4408-8cda-1cbcf2d50f1a req-3eae622a-ac5b-4c07-bc92-7a2049a55b68 service nova] Creating event network-vif-deleted:6db052f5-0f8b-4c63-8a42-5dfa31a515df for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 20:59:59.728698 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-93efeac2-cac0-4408-8cda-1cbcf2d50f1a req-3eae622a-ac5b-4c07-bc92-7a2049a55b68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052545 Jun 04 20:59:59.729722 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 932/1910] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 20:59:59.742932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.28"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 20:59:59.744829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:59.760006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.760711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 20:59:59.761518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.762787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.763478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.781724 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab784237-f99e-405b-9651-7faf31301371 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1272 microversion: 2.1 time: 0.193387 Jun 04 20:59:59.783604 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 979/1911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 20:59:59 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 20:59:59.803325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 20:59:59.804307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 20:59:59.816556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.817012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.817874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 20:59:59.819199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 20:59:59.830685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Acquired lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 21:00:00.177550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:00.188139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:00.205122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:00.207944 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c285430c-1bbb-4828-ac61-2ea87e6ffff5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1281 microversion: 2.25 time: 0.422955 Jun 04 21:00:00.208869 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 980/1912] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 20:59:59 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1281 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:00.214468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d01968820>, body: {"keypair": {"name": "tempest-keypair-836889233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpS8gYiD1uecz1v6PUgXcMEcd2EhRU9LIC6BFYQm/t4UvE32v4+v4UHKvIMOzz67j3dh+jMZ/cGEOm5/i0ataAkpxpEcZWX7ACO9jHlnJ2Cs5NM1iW8HDOjoFXeYl4Qg=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:00.231697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:00.240116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for user 08a2bdc9ea314187bfaa5e64627e7420 and project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:00.280055 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] HTTP exception thrown: Key pair 'tempest-keypair-836889233' already exists. Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 272 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: {"keypair": {"name": "tempest-keypair-836889233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpS8gYiD1uecz1v6PUgXcMEcd2EhRU9LIC6BFYQm/t4UvE32v4+v4UHKvIMOzz67j3dh+jMZ/cGEOm5/i0ataAkpxpEcZWX7ACO9jHlnJ2Cs5NM1iW8HDOjoFXeYl4Qg=="}} Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: exception: Key pair 'tempest-keypair-836889233' already exists. Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-836889233', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpS8gYiD1uecz1v6PUgXcMEcd2EhRU9LIC6BFYQm/t4UvE32v4+v4UHKvIMOzz67j3dh+jMZ/cGEOm5/i0ataAkpxpEcZWX7ACO9jHlnJ2Cs5NM1iW8HDOjoFXeYl4Qg=='}}} Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result.read() Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '08a2bdc9ea314187bfaa5e64627e7420-tempest-keypair-836889233' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 04 21:00:00.288629 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi session.flush() Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result.read() Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 04 21:00:00.294718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '08a2bdc9ea314187bfaa5e64627e7420-tempest-keypair-836889233' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 4, 21, 0, 0, 266526), 'updated_at': None, 'name': 'tempest-keypair-836889233', 'user_id': '08a2bdc9ea314187bfaa5e64627e7420', 'fingerprint': '51:ec:74:ec:ff:ef:24:f9:16:37:00:5f:63:14:db:fc', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOpS8gYiD1uecz1v6PUgXcMEcd2EhRU9LIC6BFYQm/t4UvE32v4+v4UHKvIMOzz67j3dh+jMZ/cGEOm5/i0ataAkpxpEcZWX7ACO9jHlnJ2Cs5NM1iW8HDOjoFXeYl4Qg==', 'type': 'ssh'}] Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi keypair.create() Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._create() Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-836889233' already exists. Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 04 21:00:00.301333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-836889233' already exists. Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-836889233' already exists. Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 409 to user: Key pair 'tempest-keypair-836889233' already exists. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9ced76da-6ccd-4eb6-9cd6-eddec8a29067 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.080535 Jun 04 21:00:00.307861 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 981/1913] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:00:00 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:00.313518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a8716ab-fa5a-498a-999c-3eaf3c580b2d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2051576818", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": -1, "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:00.328817 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7a8716ab-fa5a-498a-999c-3eaf3c580b2d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Flavor -1 could not be found. Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a8716ab-fa5a-498a-999c-3eaf3c580b2d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 206 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2051576818", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": -1, "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: exception: Flavor -1 could not be found. Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2051576818', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': -1, 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:00.331185 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a8716ab-fa5a-498a-999c-3eaf3c580b2d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a8716ab-fa5a-498a-999c-3eaf3c580b2d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.040087 Jun 04 21:00:00.335613 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 982/1914] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:00 2022] POST /compute/v2.1/servers => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:00.343319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:00.344009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:00.350863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:00.351276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:00.352216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:00.352722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:00.479111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:00.493375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-034f35f6-db24-463e-b75e-1ecc7d7df997 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 200 len: 1297 microversion: 2.1 time: 0.158881 Jun 04 21:00:00.493887 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 983/1915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:00 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 1297 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:00.498407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5506bbb6-543d-428a-90fc-811d0748ccb3 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Calling method '.version_select at 0x7f2d01962d30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:00.520498 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5506bbb6-543d-428a-90fc-811d0748ccb3 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-836889233" status: 202 len: 0 microversion: 2.1 time: 0.024986 Jun 04 21:00:00.521102 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 984/1916] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:00:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-836889233 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:00:00.527709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:00.528335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:00.535328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:00.535804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:00.536584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:00.537027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:00.797230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:00.809850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d11681e5-da31-436f-9900-3eb3faef9b02 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.286992 Jun 04 21:00:00.810504 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 985/1917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:00 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:00.815861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d197069-b013-4fc9-8506-dee5965cba50 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d01971ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESGitSLbts+VCxM/HQJP6jMCL87gZQLz1y05Cb2exnOlky+MSuEmeifd9h+9fU1IcjxAaEcLAZqNOxyN5gRGEzmLZWFvPd0wPWTunoR7nUVzwaE9e7cXF2u5mjM5rl9ig=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d197069-b013-4fc9-8506-dee5965cba50 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 247 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESGitSLbts+VCxM/HQJP6jMCL87gZQLz1y05Cb2exnOlky+MSuEmeifd9h+9fU1IcjxAaEcLAZqNOxyN5gRGEzmLZWFvPd0wPWTunoR7nUVzwaE9e7cXF2u5mjM5rl9ig=="}} Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESGitSLbts+VCxM/HQJP6jMCL87gZQLz1y05Cb2exnOlky+MSuEmeifd9h+9fU1IcjxAaEcLAZqNOxyN5gRGEzmLZWFvPd0wPWTunoR7nUVzwaE9e7cXF2u5mjM5rl9ig=='}}} Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi '' Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:00.818750 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:00:00.826512 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:00.831019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d197069-b013-4fc9-8506-dee5965cba50 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:00.832196 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d197069-b013-4fc9-8506-dee5965cba50 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.020154 Jun 04 21:00:00.833437 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 986/1918] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:00:00 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:00.843129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:00.843876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:00.850565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:00.852315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:00.853003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:00.854016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:00.854659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:01.250709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:01.266561 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15ed3cb2-e88e-4dd0-bd49-0e74419f86b8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.431005 Jun 04 21:00:01.275717 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 987/1919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:00 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:01.280461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:01.281336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:01.288742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:01.289199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:01.290974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:01.291695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:01.941339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:01.949612 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cac90ba4-f728-4a7b-ba41-3568c9e3bd3a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1314 microversion: 2.1 time: 0.680814 Jun 04 21:00:01.950198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 988/1920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:01 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:01.954740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:01.955776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:01.962394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:01.962875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:01.963701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:01.964107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.260557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:02.268554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c018b654-2b8e-4acc-bd1b-7f722fed5075 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.317362 Jun 04 21:00:02.269117 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 989/1921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:01 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:02.289986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d0192ac10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1265930961", "public_key": " "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:02.307423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:02.313438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for user 08a2bdc9ea314187bfaa5e64627e7420 and project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:02.333323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 95 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1265930961", "public_key": " "}} Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: exception: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1265930961', 'public_key': ' '}}} Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.335951 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0d4fd277-5dfe-4be5-a54e-60b31c864954 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.052584 Jun 04 21:00:02.343278 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 990/1922] 10.222.0.18 () {60 vars in 1157 bytes} [Sat Jun 4 21:00:02 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:02.348023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4c6899df-e9ee-4baf-a77c-55720065b023 req-93db3248-8bb8-4ef8-9ecc-9b9b5b1f8ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eb0950-bab8-42f7-8302-60fe6aea12ea", "name": "network-vif-plugged", "status": "completed", "tag": "a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:02.359248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4c6899df-e9ee-4baf-a77c-55720065b023 req-93db3248-8bb8-4ef8-9ecc-9b9b5b1f8ffc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.359248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4c6899df-e9ee-4baf-a77c-55720065b023 req-93db3248-8bb8-4ef8-9ecc-9b9b5b1f8ffc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.374054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4c6899df-e9ee-4baf-a77c-55720065b023 req-93db3248-8bb8-4ef8-9ecc-9b9b5b1f8ffc service nova] Creating event network-vif-plugged:a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e for instance 17eb0950-bab8-42f7-8302-60fe6aea12ea on nch2-master-1 Jun 04 21:00:02.381701 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4c6899df-e9ee-4baf-a77c-55720065b023 req-93db3248-8bb8-4ef8-9ecc-9b9b5b1f8ffc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041157 Jun 04 21:00:02.383766 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 991/1923] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:02.391863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:02.394569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:02.419718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.423660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.425621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.426697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.450352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:02.549014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 21:00:02.820714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:02.842287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:02.844043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:02.845619 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a5f77d38-ca72-4fc7-a6ad-40aabbf8d007 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1281 microversion: 2.25 time: 0.460530 Jun 04 21:00:02.857444 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 992/1924] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:02 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:02.862900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:02.863654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:02.871472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.872075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.872941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.873460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.889411 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] HTTP exception thrown: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Request method failure captured: Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 HTTP/1.1 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eUunCuiBASsc9D7a2ghikcmsPdo34X0hjy78locJq2Tn0q1hq5Bgh0Q7sLDpcIYiu3kYcQEBpn_77SzF7mem9rxdyP8yO5lyYz0chUvpB2CT_XIBNGyVBaHxA2GvEH-URgTW5qVkr2iSqCEZnzVjkmJxtU4N9mSYRcdqi0JEWdBhU Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 81630e4b323d43a08a368471273a2989 Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0f7ff568-6656-41de-b3c0-ada352adc3d1'} Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:02.891199 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Returning 404 to user: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:02.896978 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-52746279-197b-4da2-9ce2-4c92c12d8cd7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 404 len: 111 microversion: 2.1 time: 0.035093 Jun 04 21:00:02.900459 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 993/1925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:02 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:02.904439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-09ff8a9f-64d9-41a4-ad14-d87bb522fbc3 req-ab7fa237-925e-4cce-a966-b562fafb2b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "name": "network-vif-deleted", "tag": "5bab4667-8446-419d-b001-37166c877a45"}, {"server_uuid": "0f7ff568-6656-41de-b3c0-ada352adc3d1", "name": "network-vif-deleted", "tag": "f7f513cb-cc63-43e9-bb2f-d9cc059fe6b7"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:02.913344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-09ff8a9f-64d9-41a4-ad14-d87bb522fbc3 req-ab7fa237-925e-4cce-a966-b562fafb2b4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.913909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-09ff8a9f-64d9-41a4-ad14-d87bb522fbc3 req-ab7fa237-925e-4cce-a966-b562fafb2b4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.928372 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-09ff8a9f-64d9-41a4-ad14-d87bb522fbc3 req-ab7fa237-925e-4cce-a966-b562fafb2b4e service nova] Creating event network-vif-deleted:5bab4667-8446-419d-b001-37166c877a45 for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 21:00:02.928954 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-09ff8a9f-64d9-41a4-ad14-d87bb522fbc3 req-ab7fa237-925e-4cce-a966-b562fafb2b4e service nova] Creating event network-vif-deleted:f7f513cb-cc63-43e9-bb2f-d9cc059fe6b7 for instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 on nch1-master-1 Jun 04 21:00:02.934994 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-09ff8a9f-64d9-41a4-ad14-d87bb522fbc3 req-ab7fa237-925e-4cce-a966-b562fafb2b4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034158 Jun 04 21:00:02.936149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 994/1926] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:02.942363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:02.943218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:02.953065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.953613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:02.955226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:02.955818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:03.302068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:03.312251 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e5eb3c71-d687-4cc9-8c04-557ddaa66052 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.374411 Jun 04 21:00:03.314697 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 995/1927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:02 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:03.327288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d989febc-3e24-4f5d-ab29-4c3043257781 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1715394921", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d989febc-3e24-4f5d-ab29-4c3043257781 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 173 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1715394921", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1715394921', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi -1 Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:03.330980 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.336635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d989febc-3e24-4f5d-ab29-4c3043257781 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:03.339311 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d989febc-3e24-4f5d-ab29-4c3043257781 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022219 Jun 04 21:00:03.340056 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 996/1928] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:03 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:03.350869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb31064c-f7e6-47ea-9ff2-ca2cadf99d16 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d019a0160>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXSeWAPsHuyQmlKdt1L/JyfmulKUYfPq/PXCbj6os7Qnxtx3/sIEcGGIpa/b8/Fx/uCp7t5wRfkOZqpxvRradKO+HxxsKzqmNAsZSJFOUF2Zb0IWCS7Nao64F0UN/yPCQ=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb31064c-f7e6-47ea-9ff2-ca2cadf99d16 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 507 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXSeWAPsHuyQmlKdt1L/JyfmulKUYfPq/PXCbj6os7Qnxtx3/sIEcGGIpa/b8/Fx/uCp7t5wRfkOZqpxvRradKO+HxxsKzqmNAsZSJFOUF2Zb0IWCS7Nao64F0UN/yPCQ=="}} Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXSeWAPsHuyQmlKdt1L/JyfmulKUYfPq/PXCbj6os7Qnxtx3/sIEcGGIpa/b8/Fx/uCp7t5wRfkOZqpxvRradKO+HxxsKzqmNAsZSJFOUF2Zb0IWCS7Nao64F0UN/yPCQ=='}}} Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 04 21:00:03.354072 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:03.358338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb31064c-f7e6-47ea-9ff2-ca2cadf99d16 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:03.368639 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb31064c-f7e6-47ea-9ff2-ca2cadf99d16 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.014288 Jun 04 21:00:03.368639 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 997/1929] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:00:03 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:03.378084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-55bdbb10-31f5-4ec4-9a3f-62d7bebf57d6 req-98461189-54f4-4e82-a736-485cd4f1d327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b2523f-383d-40a9-8794-390c4e67684e", "tag": "50e6596d-fd85-4321-a3cc-35e8868b4460"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:03.390902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-55bdbb10-31f5-4ec4-9a3f-62d7bebf57d6 req-98461189-54f4-4e82-a736-485cd4f1d327 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:03.391627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-55bdbb10-31f5-4ec4-9a3f-62d7bebf57d6 req-98461189-54f4-4e82-a736-485cd4f1d327 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:03.408502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-55bdbb10-31f5-4ec4-9a3f-62d7bebf57d6 req-98461189-54f4-4e82-a736-485cd4f1d327 service nova] Creating event network-changed:50e6596d-fd85-4321-a3cc-35e8868b4460 for instance 85b2523f-383d-40a9-8794-390c4e67684e on nch2-master-1 Jun 04 21:00:03.415298 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-55bdbb10-31f5-4ec4-9a3f-62d7bebf57d6 req-98461189-54f4-4e82-a736-485cd4f1d327 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045657 Jun 04 21:00:03.421677 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 998/1930] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:03.427360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:03.430581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:03.437682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:03.438230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:03.439017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:03.439450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:03.933365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:03.944789 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-408bfb9c-f81b-4514-b127-7b5d84b66884 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1314 microversion: 2.1 time: 0.521675 Jun 04 21:00:03.946026 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 999/1931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:03 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:03.953970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:03.954995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:03.977464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:03.978329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:03.978910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:03.979350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:04.258117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Updating instance_info_cache with network_info: [{"id": "50e6596d-fd85-4321-a3cc-35e8868b4460", "address": "fa:16:3e:da:42:63", "network": {"id": "b50e2dbc-27dc-4302-bc77-50cc183290eb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1785714418-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2df84f0dd560488b9b85303294bc6fca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap50e6596d-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 21:00:04.272365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Releasing lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 21:00:04.273479 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6e531005-170b-442c-837d-50a340a82b2a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action" status: 202 len: 0 microversion: 2.1 time: 4.541920 Jun 04 21:00:04.277396 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 933/1932] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 20:59:59 2022] POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action => generated 0 bytes in 4544 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 21:00:04.279294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Action: 'create', calling method: .version_select at 0x7f2d019f65e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1153027100", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:04.291467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=31 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:04.295716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:04.301211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Getting quotas for user 08a2bdc9ea314187bfaa5e64627e7420 and project 6f1bae4089ad4a3b9f60e428562f72b6. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:04.318662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 118 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1153027100", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: exception: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1153027100', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 04 21:00:04.320697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ddb0f6bd-c9f0-4437-a1f7-d36248b871af tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047020 Jun 04 21:00:04.328134 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 934/1933] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:00:04 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:04.334096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:04.334707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:04.346050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:04.346506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:04.347494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:04.347970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:04.454760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:04.463264 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ab8cc76-ec08-4de7-ae0a-eab10d029b39 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.515979 Jun 04 21:00:04.464124 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1000/1934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:03 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:04.468375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f9cb33fd-6d93-4d6a-b273-699696dbfa2b tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'create', calling method: .version_select at 0x7f2d019054c0>, body: {"pool": "68fefb59-8f6d-41f3-89ac-cca30a7243e2"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:04.790331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:04.799265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:04.801209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:04.802411 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9fd12f72-bbcd-430d-8f36-82ddc04867f1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1477 microversion: 2.25 time: 0.478717 Jun 04 21:00:04.802938 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 935/1935] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:04 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:04.808822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:04.810374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:04.817329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:04.817777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:04.818557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:04.818995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:05.096621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:05.497090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:05.505741 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d9f4ac3-c9c9-4503-937b-d01479b1f6ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.701559 Jun 04 21:00:05.506330 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 936/1936] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:04 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:05.511170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdac2a18-9b3c-4ad5-a1ce-bf2c9c6798b2 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Calling method '.version_select at 0x7f2d018bc3a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:05.526477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-fdac2a18-9b3c-4ad5-a1ce-bf2c9c6798b2 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1185300265 not found for user 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdac2a18-9b3c-4ad5-a1ce-bf2c9c6798b2 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Request method failure captured: Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1185300265 HTTP/1.1 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fN-oWc0HAG4G05jI1Me5FxCW5MYgdbfUJAFwfOqw2yswwVoLzx4e6U5RLA1HrnXufTHJcfwaGREJuOBL1tJblDhW9m3A4nNnLUGN2nJEDtdzx1DiSCWwaObHjg-NKcMatOdxmOnRRFCoF2FCD9ZfY30yCUkZODjnhtLjdRCCaTzfM Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f1bae4089ad4a3b9f60e428562f72b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f1bae4089ad4a3b9f60e428562f72b6 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-782385333 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-KeyPairsNegativeTestJSON-782385333-project Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: exception: Keypair tempest-keypair-non-existent-1185300265 not found for user 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'tempest-keypair-non-existent-1185300265'} Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1185300265 not found for user 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:05.529170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1185300265 not found for user 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1185300265 not found for user 08a2bdc9ea314187bfaa5e64627e7420 Jun 04 21:00:05.534401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:05.539777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdac2a18-9b3c-4ad5-a1ce-bf2c9c6798b2 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1185300265 not found for user 08a2bdc9ea314187bfaa5e64627e7420 {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:05.540996 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fdac2a18-9b3c-4ad5-a1ce-bf2c9c6798b2 tempest-KeyPairsNegativeTestJSON-782385333 tempest-KeyPairsNegativeTestJSON-782385333-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1185300265" status: 404 len: 145 microversion: 2.1 time: 0.033542 Jun 04 21:00:05.547277 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 937/1937] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1185300265 => generated 145 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:05.554586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:05.556247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:05.566340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:05.567161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:05.567970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:05.568600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:05.827175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:05.845701 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02a7adda-2508-438a-9b38-c8fa5afd0e1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.295957 Jun 04 21:00:05.846294 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 938/1938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:05 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:05.887247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:05.894534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:05.938496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:05.939028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:05.942444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:05.943216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:06.299684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 17eb0950-bab8-42f7-8302-60fe6aea12ea {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:06.324511 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ff178f9-ec58-482d-b3e3-db9cad1a6c0f tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1970 microversion: 2.25 time: 0.450630 Jun 04 21:00:06.336094 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 939/1939] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:05 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1970 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:06.342690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:06.343393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:06.349854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:06.350659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:06.351753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:06.352514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:06.611392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:06.635348 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f9608e3-3bbf-43a6-8492-ef09da272e50 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1314 microversion: 2.1 time: 0.296184 Jun 04 21:00:06.647527 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 940/1940] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:06 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:06.660741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-34235697-a61e-44e7-ae07-4a71bc692994 req-4161ea08-7bb7-4f79-bbe6-364932f32bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662547fc-144c-4672-93aa-7156e176d296", "tag": "f3072dba-57fc-4bfd-9a9f-666c77fe5168"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:06.676336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-34235697-a61e-44e7-ae07-4a71bc692994 req-4161ea08-7bb7-4f79-bbe6-364932f32bba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:06.677104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-34235697-a61e-44e7-ae07-4a71bc692994 req-4161ea08-7bb7-4f79-bbe6-364932f32bba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:06.694838 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-34235697-a61e-44e7-ae07-4a71bc692994 req-4161ea08-7bb7-4f79-bbe6-364932f32bba service nova] Creating event network-changed:f3072dba-57fc-4bfd-9a9f-666c77fe5168 for instance 662547fc-144c-4672-93aa-7156e176d296 on nch1-master-1 Jun 04 21:00:06.703059 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-34235697-a61e-44e7-ae07-4a71bc692994 req-4161ea08-7bb7-4f79-bbe6-364932f32bba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053299 Jun 04 21:00:06.704224 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 941/1941] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:06.710672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ae2d0a2-2009-4430-8b88-ebece011283f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1555463570", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:06.714555 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4ae2d0a2-2009-4430-8b88-ebece011283f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ae2d0a2-2009-4430-8b88-ebece011283f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 216 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1555463570", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1555463570', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:06.716397 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 04 21:00:06.721476 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:06.722191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ae2d0a2-2009-4430-8b88-ebece011283f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:06.723176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ae2d0a2-2009-4430-8b88-ebece011283f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.017716 Jun 04 21:00:06.723901 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 942/1942] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:06 2022] POST /compute/v2.1/servers => generated 123 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:06.733738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:06.734783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:06.745214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:06.745987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:06.747382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:06.747973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.296410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 17eb0950-bab8-42f7-8302-60fe6aea12ea {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:07.321417 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72c69831-9379-4a54-b81f-f375f342af9d tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1970 microversion: 2.25 time: 0.592590 Jun 04 21:00:07.323342 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 943/1943] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:06 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1970 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:07.341286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:07.342164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:07.351752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.352525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.376218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.376218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.680845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f9cb33fd-6d93-4d6a-b273-699696dbfa2b tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.214353 Jun 04 21:00:07.682065 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1001/1944] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 21:00:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:07.693190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:07.694550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:07.714181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:07.722773 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97cc2a81-34b1-4322-bd24-9ea56be4eb7c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.398093 Jun 04 21:00:07.733112 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 944/1945] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:07 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:07.734691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97883f39-b6bd-4b0c-8180-57a8a3286f39 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:07.736140 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:00:07.736140 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:00:07.737378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97883f39-b6bd-4b0c-8180-57a8a3286f39 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.737825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97883f39-b6bd-4b0c-8180-57a8a3286f39 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.744492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97883f39-b6bd-4b0c-8180-57a8a3286f39 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.746470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.748934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97883f39-b6bd-4b0c-8180-57a8a3286f39 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.749130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.754629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.755786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.814233 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97883f39-b6bd-4b0c-8180-57a8a3286f39 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.083066 Jun 04 21:00:07.814872 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 945/1946] 10.222.0.18 () {60 vars in 1216 bytes} [Sat Jun 4 21:00:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:00:07.827434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:07.828085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:07.862384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.862750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:07.866782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:07.867340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:08.132975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:08.150813 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df5db4d9-5afd-4b58-8edb-1080fdf8e7f3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.467060 Jun 04 21:00:08.168300 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1002/1947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:07 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:08.176201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'action', calling method: .version_select at 0x7f2d08ea6790>, body: {"addFloatingIp": {"address": "172.35.4.63"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:08.177873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:08.187151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:08.188783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:08.191984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:08.191984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:08.210999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:08.220253 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9795272e-e30e-4bba-b824-ea5398e6d8dd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1314 microversion: 2.1 time: 0.396765 Jun 04 21:00:08.223305 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 946/1948] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:07 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:08.228197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:08.230628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Acquired lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 21:00:08.236066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:08.249096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:08.249552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:08.252152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:08.252593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:08.283548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'flavor' on Instance uuid 17eb0950-bab8-42f7-8302-60fe6aea12ea {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:08.299160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Going to try to live migrate instance to nch1-master-1 {{(pid=137229) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 21:00:09.043798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2.", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:00:09.045346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Releasing lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 21:00:09.046103 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.046103 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Request method failure captured: Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action HTTP/1.1 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 45 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8e2Z8Uvp5Qih_4k5SHyXSeLVUvrVep_6JkVc0MvFJOHs9ID0Gqa0w_qzBn_HFu4f3L40x6lQ6oJLnuSW7lJOElNKJkrD9_nbb90MObBIBKsRdtuD2WliRvYFttZxKFKtTVWgS4hXLm62-VTboreuT0v0fAMiSJA2WWQL6kej-Fku8E Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c329a5d4cc2f4311ae154a8810698837 Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: {"addFloatingIp": {"address": "172.35.4.63"}} Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '85b2523f-383d-40a9-8794-390c4e67684e', 'body': {'addFloatingIp': {'address': '172.35.4.63'}}} Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2689, in associate_floating_ip Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:00:09.049113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2691, in associate_floating_ip Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] Jun 04 21:00:09.054528 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:09.061132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Returning 400 to user: Cannot associate floating IP 172.35.4.63 (b3925dfd-0a0a-4f99-9922-3c6d4d2f615e) with port 50e6596d-fd85-4321-a3cc-35e8868b4460 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 68fefb59-8f6d-41f3-89ac-cca30a7243e2. Jun 04 21:00:09.061132 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-c755dce0-187c-4e0c-a86f-ecb1cb543b0f'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:09.061132 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fe502365-9f7f-4d73-98cb-8c0d0f71333a tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action" status: 400 len: 381 microversion: 2.1 time: 0.891730 Jun 04 21:00:09.062105 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1003/1949] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:08 2022] POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action => generated 381 bytes in 893 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:09.067783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:09.068594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:09.078716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:09.079594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:09.080571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:09.081191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:09.528013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:09.536352 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39dbdfdc-61ac-4e3c-966f-dff0af0b3360 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.472996 Jun 04 21:00:09.541168 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1004/1950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:09 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:09.546354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:09.548562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:09.576569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:09.576952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:09.577986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:09.578432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:09.875861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:09.887913 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e74d104-6aba-47a4-97e0-d42755f018ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.345308 Jun 04 21:00:09.888513 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1005/1951] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:09 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:09.911895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-587f10d7-2355-4f17-bdc7-09953399d8f1 req-cca7f79a-8a6f-48e9-a4f5-3fa6e27b1667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662547fc-144c-4672-93aa-7156e176d296", "name": "network-vif-plugged", "status": "completed", "tag": "f3072dba-57fc-4bfd-9a9f-666c77fe5168"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:09.924985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-587f10d7-2355-4f17-bdc7-09953399d8f1 req-cca7f79a-8a6f-48e9-a4f5-3fa6e27b1667 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:09.925407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-587f10d7-2355-4f17-bdc7-09953399d8f1 req-cca7f79a-8a6f-48e9-a4f5-3fa6e27b1667 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:09.970706 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-587f10d7-2355-4f17-bdc7-09953399d8f1 req-cca7f79a-8a6f-48e9-a4f5-3fa6e27b1667 service nova] Creating event network-vif-plugged:f3072dba-57fc-4bfd-9a9f-666c77fe5168 for instance 662547fc-144c-4672-93aa-7156e176d296 on nch1-master-1 Jun 04 21:00:09.985214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-587f10d7-2355-4f17-bdc7-09953399d8f1 req-cca7f79a-8a6f-48e9-a4f5-3fa6e27b1667 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082937 Jun 04 21:00:09.986420 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1006/1952] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:09.996102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ee9ad86b-4398-417f-932d-b878f92f3728 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '.version_select at 0x7f2d019450d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:10.175190 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3b6437b9-f7d1-4de9-ba51-0f21325af88c tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea/action" status: 202 len: 0 microversion: 2.25 time: 1.950540 Jun 04 21:00:10.180024 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 947/1953] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:00:08 2022] POST /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea/action => generated 0 bytes in 1956 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:10.185469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:10.186338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:10.198836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:10.199651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:10.200841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:10.201491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:11.065993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:11.090765 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c71a63d-fb39-4fa3-b68f-6b7b4af7a1ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1314 microversion: 2.1 time: 0.909016 Jun 04 21:00:11.091862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 948/1954] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:10 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:11.100689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf9b0675-3bef-4bf9-8fe0-2e576b2a09ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-978319681", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "key_name": "tempest-key-1622250198", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:11.203319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-bf9b0675-3bef-4bf9-8fe0-2e576b2a09ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] validate_networks() for [('10998ccc-172c-4efe-afe8-d393fc1e0d64', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:11.957106 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bf9b0675-3bef-4bf9-8fe0-2e576b2a09ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Invalid key_name provided. Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf9b0675-3bef-4bf9-8fe0-2e576b2a09ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 246 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-978319681", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "key_name": "tempest-key-1622250198", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid key_name provided. Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-978319681', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'key_name': 'tempest-key-1622250198', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1622250198 not found for user 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:11.969345 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf9b0675-3bef-4bf9-8fe0-2e576b2a09ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid key_name provided. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf9b0675-3bef-4bf9-8fe0-2e576b2a09ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.877939 Jun 04 21:00:11.978372 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 949/1955] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:11 2022] POST /compute/v2.1/servers => generated 70 bytes in 879 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:00:11.996273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1281759851", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "7c15b563-f74a-48ef-a1d2-a1cc0e51626d"}, {"uuid": "81e0e4d8-3021-472c-a377-ffe71ffd97a2"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:12.078903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] validate_networks() for [('7c15b563-f74a-48ef-a1d2-a1cc0e51626d', None, None, None, None, None), ('81e0e4d8-3021-472c-a377-ffe71ffd97a2', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:12.321309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:12.785274 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ee9ad86b-4398-417f-932d-b878f92f3728 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/b3925dfd-0a0a-4f99-9922-3c6d4d2f615e" status: 202 len: 0 microversion: 2.1 time: 2.797209 Jun 04 21:00:12.788466 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1007/1956] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:00:09 2022] DELETE /compute/v2.1/os-floating-ips/b3925dfd-0a0a-4f99-9922-3c6d4d2f615e => generated 0 bytes in 2801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:00:12.794493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:12.795533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:12.804931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:12.805677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:12.807588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:12.808425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.497174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:13.508560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:13.511826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:13.512562 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a055d42e-8c42-4c3c-8dc6-7e5d652ba346 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1487 microversion: 2.25 time: 0.722839 Jun 04 21:00:13.513203 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1008/1957] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:12 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1487 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:13.527859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37cf4b6a-6b9d-4adb-8221-172f88294ef6"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:13.528949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:13.535470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:13.535957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.536723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:13.537155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.828936 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e19d9e78-2665-48b6-81b7-a9a8da732340 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313915 Jun 04 21:00:13.829887 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1009/1958] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:00:13 2022] POST /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:13.854017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:13.858815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:13.869762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:13.870719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.872159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:13.873099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.944195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:13.944707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:13.945087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:13.946064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:13.946600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:13.962935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:13.964614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.965574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:13.968318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:13.994263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Getting quotas for project d9e0e340cb8d4a64bdfeafcba8908f89. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:14.001397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Getting quotas for user 81630e4b323d43a08a368471273a2989 and project d9e0e340cb8d4a64bdfeafcba8908f89. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:14.018639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:14.022798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:14.093801 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e5a3eaf-9eac-4c0c-a89c-cf9c7a8a50f1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.121217 Jun 04 21:00:14.094371 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 950/1959] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:14.107964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:14.109358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:14.126724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:14.127175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:14.132100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:14.132795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:14.536504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:14.549259 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-151eac55-83a6-4c98-be01-db505b8ae228 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.717832 Jun 04 21:00:14.562799 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1010/1960] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:13 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:14.573583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:14.575294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:14.585546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:14.586538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:14.588365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:14.589088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:14.594465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:14.604149 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7da749da-74d7-4fb3-8a15-ae041a1f311e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.507896 Jun 04 21:00:14.607891 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 951/1961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:14 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:14.620612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'action', calling method: .version_select at 0x7f2d08ea55e0>, body: {"removeFloatingIp": {"address": "172.35.4.28"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:14.962021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:14.972149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:14.972608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:14.973549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:14.988655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:14.989891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:14.995357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:15.003632 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2b3f0666-b336-4b35-9758-8eff90f24fb2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1502 microversion: 2.1 time: 0.437474 Jun 04 21:00:15.041352 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1011/1962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:14 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1502 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:15.056731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:15.061339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:15.076224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:15.078123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:15.081835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:15.083063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:15.223823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:15.234577 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d101c7c2-5108-452b-9cef-d84791bfd56a tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1265 microversion: 2.1 time: 0.191382 Jun 04 21:00:15.240145 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1012/1963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:15 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:15.245855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:15.246561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:15.253727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:15.254308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:15.255154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:15.256139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:15.892006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Acquired lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 21:00:16.062890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:16.080175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:16.085157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:16.086544 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e63ef30-9657-4d2f-a33c-69751a1e94df tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1487 microversion: 2.25 time: 0.845020 Jun 04 21:00:16.089448 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1013/1964] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:15 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1487 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:16.109718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:16.121152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:16.129247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:16.131268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:16.132493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:16.138019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:16.633703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:16.644936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:16.648898 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a085164-6074-4cd5-8b37-b03716260ce5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.542720 Jun 04 21:00:16.650943 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1014/1965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:16 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:16.661650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:16.662659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:16.727874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:16.732655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:16.734799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:16.735240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:16.782044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:16.952773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-abd099e7-fd49-42f6-95d2-e854687a2317 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 204 len: 0 microversion: 2.1 time: 0.295994 Jun 04 21:00:16.953457 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1015/1966] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:16 2022] DELETE /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:16.961461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:16.964907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:16.979658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:16.980960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:16.982000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:16.982634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:17.758591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:17.783654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4d6e618d-56dc-45f3-ae98-d4cc99270f5d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1475 microversion: 2.1 time: 0.812317 Jun 04 21:00:17.783654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1016/1967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:16 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1475 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:17.783654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:17.783654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:17.786446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:17.787190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:17.788518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:17.789926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:17.903767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:17.913575 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a192880b-84f4-436e-b9d0-8a0ac25ed852 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1271 microversion: 2.1 time: 0.144180 Jun 04 21:00:17.915368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1017/1968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:17 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:17.923677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a57f6d93-5903-4522-a199-19f3441b2395 req-d52a0465-378d-4035-a712-ddceb7ecef4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eb0950-bab8-42f7-8302-60fe6aea12ea", "name": "network-vif-unplugged", "status": "completed", "tag": "a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:17.934175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a57f6d93-5903-4522-a199-19f3441b2395 req-d52a0465-378d-4035-a712-ddceb7ecef4f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:17.934988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a57f6d93-5903-4522-a199-19f3441b2395 req-d52a0465-378d-4035-a712-ddceb7ecef4f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:17.950402 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a57f6d93-5903-4522-a199-19f3441b2395 req-d52a0465-378d-4035-a712-ddceb7ecef4f service nova] Creating event network-vif-unplugged:a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e for instance 17eb0950-bab8-42f7-8302-60fe6aea12ea on nch2-master-1 Jun 04 21:00:17.956451 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a57f6d93-5903-4522-a199-19f3441b2395 req-d52a0465-378d-4035-a712-ddceb7ecef4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037853 Jun 04 21:00:17.957646 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1018/1969] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:17.967228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e8443c97-1552-4448-9810-b33e63cbd03e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-152312123", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:18.219879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-e8443c97-1552-4448-9810-b33e63cbd03e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Neutron security group does_not_exist not found {{(pid=137228) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jun 04 21:00:18.220581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e8443c97-1552-4448-9810-b33e63cbd03e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e8443c97-1552-4448-9810-b33e63cbd03e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 257 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-152312123", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: exception: Unable to find security_group with name or id 'does_not_exist' Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-152312123', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jun 04 21:00:18.229636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:18.236612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e8443c97-1552-4448-9810-b33e63cbd03e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:18.245351 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e8443c97-1552-4448-9810-b33e63cbd03e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.272177 Jun 04 21:00:18.245351 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1019/1970] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:17 2022] POST /compute/v2.1/servers => generated 106 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:18.245351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:18.245351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:18.247755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:18.247755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:18.249883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:18.249883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:18.394090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 21:00:19.049239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:19.067439 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bf0d268-e867-41e8-8cf2-81ef17e5a50d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 200 len: 1508 microversion: 2.1 time: 0.833694 Jun 04 21:00:19.069021 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1020/1971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:18 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 1508 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:19.098626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:19.104804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:19.115617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:19.117429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:19.119982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:19.120800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:19.690182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:19.701430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:19.705639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:19.708226 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6b89e81-35da-4a1a-86a0-b2b7152752c0 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1487 microversion: 2.25 time: 0.637624 Jun 04 21:00:19.719957 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1021/1972] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:19 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1487 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:19.720794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:19.722102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:19.732282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:19.732845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:19.733790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:19.734342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:19.767266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'flavor' on Instance uuid e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:19.953212 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e402feff-c517-467c-9ee5-8605f1007167 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/action" status: 200 len: 32 microversion: 2.1 time: 0.237314 Jun 04 21:00:19.954263 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1022/1973] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:19 2022] POST /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:00:19.959980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:19.962668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:19.986166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:19.988374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:19.989463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:19.990019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:20.909624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Updating instance_info_cache with network_info: [{"id": "50e6596d-fd85-4321-a3cc-35e8868b4460", "address": "fa:16:3e:da:42:63", "network": {"id": "b50e2dbc-27dc-4302-bc77-50cc183290eb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1785714418-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2df84f0dd560488b9b85303294bc6fca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap50e6596d-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 21:00:20.923427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Releasing lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 21:00:20.924510 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7846b00c-e2ea-4804-8989-fe3cd80db9f5 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action" status: 202 len: 0 microversion: 2.1 time: 6.315307 Jun 04 21:00:20.925210 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 952/1974] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:14 2022] POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action => generated 0 bytes in 6316 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 21:00:20.931613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-cfa059a5-222d-4d74-8e3c-e84f70d5d9cf req-dce80a06-15fa-48e9-80ea-f24aefb725c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b2523f-383d-40a9-8794-390c4e67684e", "tag": "50e6596d-fd85-4321-a3cc-35e8868b4460"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:20.934438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:20.945802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cfa059a5-222d-4d74-8e3c-e84f70d5d9cf req-dce80a06-15fa-48e9-80ea-f24aefb725c2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:20.946425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cfa059a5-222d-4d74-8e3c-e84f70d5d9cf req-dce80a06-15fa-48e9-80ea-f24aefb725c2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:20.948884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba93dc33-60ae-4fee-b49d-8e4861ab2713 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.992976 Jun 04 21:00:20.949692 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1023/1975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:19 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:20.954884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:20.955829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:20.958427 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-cfa059a5-222d-4d74-8e3c-e84f70d5d9cf req-dce80a06-15fa-48e9-80ea-f24aefb725c2 service nova] Creating event network-changed:50e6596d-fd85-4321-a3cc-35e8868b4460 for instance 85b2523f-383d-40a9-8794-390c4e67684e on nch2-master-1 Jun 04 21:00:20.964801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:20.965259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:20.966391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:20.967190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:20.968513 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-cfa059a5-222d-4d74-8e3c-e84f70d5d9cf req-dce80a06-15fa-48e9-80ea-f24aefb725c2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042030 Jun 04 21:00:20.969361 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 953/1976] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:20.974849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:20.975547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:20.983426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:20.984478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:20.985463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:20.985896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.445372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:21.468465 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a47cc480-7b4a-463e-910d-255eba98c370 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1313 microversion: 2.1 time: 0.497615 Jun 04 21:00:21.471107 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 954/1977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:20 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:21.483194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:21.486241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:21.492147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:21.495074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.497225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.499239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.501055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.520254 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f5e018a2-e762-4bb1-98dc-d78ef0465008 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1474 microversion: 2.1 time: 0.567141 Jun 04 21:00:21.521312 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1024/1978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:20 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1474 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:21.535825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c80fa497-ea48-4d56-97e6-3819bdf42046 req-a8922ad3-b954-4ad4-8049-076066afaf1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17eb0950-bab8-42f7-8302-60fe6aea12ea", "tag": "a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e"}, {"server_uuid": "662547fc-144c-4672-93aa-7156e176d296", "name": "network-vif-deleted", "tag": "f3072dba-57fc-4bfd-9a9f-666c77fe5168"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:21.577227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c80fa497-ea48-4d56-97e6-3819bdf42046 req-a8922ad3-b954-4ad4-8049-076066afaf1e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.577923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c80fa497-ea48-4d56-97e6-3819bdf42046 req-a8922ad3-b954-4ad4-8049-076066afaf1e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.618587 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c80fa497-ea48-4d56-97e6-3819bdf42046 req-a8922ad3-b954-4ad4-8049-076066afaf1e service nova] Creating event network-changed:a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e for instance 17eb0950-bab8-42f7-8302-60fe6aea12ea on nch2-master-1 Jun 04 21:00:21.622006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c80fa497-ea48-4d56-97e6-3819bdf42046 req-a8922ad3-b954-4ad4-8049-076066afaf1e service nova] Creating event network-vif-deleted:f3072dba-57fc-4bfd-9a9f-666c77fe5168 for instance 662547fc-144c-4672-93aa-7156e176d296 on nch1-master-1 Jun 04 21:00:21.651890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c80fa497-ea48-4d56-97e6-3819bdf42046 req-a8922ad3-b954-4ad4-8049-076066afaf1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.115477 Jun 04 21:00:21.653699 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1025/1979] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:21.663701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:21.664606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:21.673255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.674014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.674820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.675262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.706640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 HTTP/1.1 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '662547fc-144c-4672-93aa-7156e176d296'} Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:21.708698 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:00:21.714440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:21.716821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:21.717923 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39140b61-32cd-4751-81f8-cd42d060da91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 404 len: 111 microversion: 2.1 time: 0.063081 Jun 04 21:00:21.720144 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1026/1980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:21 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:21.727583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:21.728445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:21.762000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.762469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:21.763120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:21.774545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:22.269746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:22.286758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:22.289611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:22.291232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:22.291775 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c027dd95-8ea8-442c-9010-a6b5ffdb54c9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1487 microversion: 2.25 time: 0.569956 Jun 04 21:00:22.293160 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1027/1981] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:21 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1487 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:22.299014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f000a334-6988-4904-bfd0-f151aeb80112 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '.version_select at 0x7f2d01928c10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:22.307432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ed124f6-d1b8-442e-879b-17424848a5f4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1734 microversion: 2.1 time: 0.833123 Jun 04 21:00:22.308978 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 955/1982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:21 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1734 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:22.314615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:22.316189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:22.324136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:22.324959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:22.326277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:22.327095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:22.902562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:22.914412 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d57fecc9-6ff9-49f0-a562-0441430e4ca4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.601469 Jun 04 21:00:22.915887 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 956/1983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:22 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:22.923832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-463471882", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:23.022580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:23.984737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:24.011102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=9 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:24.725939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:24.727417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:24.728198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:24.729040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:24.729251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:24.773222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:24.775077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:24.776364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:24.778845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:24.822733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:24.829157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:24.833224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:24.860014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:24.863319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:24.935369 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eaba0cb6-22c9-4f66-a29a-ea7a25ad3169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018111 Jun 04 21:00:24.936812 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 957/1984] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:24.945265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:24.945933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:24.955760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:24.956224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:24.957558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:24.958045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.368949 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f000a334-6988-4904-bfd0-f151aeb80112 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/fb9c906d-d0c5-4804-a1de-8d9c7bafe778" status: 202 len: 0 microversion: 2.1 time: 3.074309 Jun 04 21:00:25.370083 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1028/1985] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:00:22 2022] DELETE /compute/v2.1/os-floating-ips/fb9c906d-d0c5-4804-a1de-8d9c7bafe778 => generated 0 bytes in 3076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:00:25.380416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:25.382347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:25.405449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:25.418734 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-980a392e-2a9e-4cf5-a5a0-74567f53342b tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.480756 Jun 04 21:00:25.419964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.420533 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 958/1986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:24 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:25.421435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.423222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.425029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.426125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf7ddee6-9008-4977-a5ba-b8974715dba8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:25.426638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf7ddee6-9008-4977-a5ba-b8974715dba8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 818ecc83-d355-4092-9992-4422edad6ccb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:25.433734 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bf7ddee6-9008-4977-a5ba-b8974715dba8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 818ecc83-d355-4092-9992-4422edad6ccb could not be found. Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf7ddee6-9008-4977-a5ba-b8974715dba8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/818ecc83-d355-4092-9992-4422edad6ccb HTTP/1.1 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 818ecc83-d355-4092-9992-4422edad6ccb could not be found. Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '818ecc83-d355-4092-9992-4422edad6ccb'} Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818ecc83-d355-4092-9992-4422edad6ccb could not be found. Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818ecc83-d355-4092-9992-4422edad6ccb could not be found. Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:25.435799 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818ecc83-d355-4092-9992-4422edad6ccb could not be found. Jun 04 21:00:25.441231 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:25.443550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf7ddee6-9008-4977-a5ba-b8974715dba8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 818ecc83-d355-4092-9992-4422edad6ccb could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:25.444635 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf7ddee6-9008-4977-a5ba-b8974715dba8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/818ecc83-d355-4092-9992-4422edad6ccb" status: 404 len: 111 microversion: 2.1 time: 0.022513 Jun 04 21:00:25.460314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 959/1987] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:25 2022] DELETE /compute/v2.1/servers/818ecc83-d355-4092-9992-4422edad6ccb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:25.729603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a0cac85b-38d3-445e-b385-252b9d7fe9bc tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Action: 'create', calling method: .version_select at 0x7f2d01874af0>, body: {"keypair": {"name": "tempest-keypair-299277983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4uUUvvS3fZ2qlaquEGvjaIVVDVF92P9Vt2Z2g94Gl01VITrr0YuktjAD0rRz4DeF2aoXZcVkOkiKftwpiAAMm3uAzftQvaaVsKUnM6QIfFWNIaPJnEFKMSbxv0kWfgYw=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:25.747658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a0cac85b-38d3-445e-b385-252b9d7fe9bc tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Getting quotas for project 2f6678835ec247d69b883f430be98e08. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:25.756680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a0cac85b-38d3-445e-b385-252b9d7fe9bc tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Getting quotas for user 3f083a447601492b8b9d7ad1ad9d934a and project 2f6678835ec247d69b883f430be98e08. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:25.783434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:25.795843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a0cac85b-38d3-445e-b385-252b9d7fe9bc tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.333828 Jun 04 21:00:25.797493 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a0bf297-ce4c-4b3d-9817-b11ec72fcc6b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1472 microversion: 2.1 time: 0.425950 Jun 04 21:00:25.803202 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 960/1988] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:00:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:25.810231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1029/1989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:25 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1472 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:25.815203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-f2f92b3a-fac6-44ee-a52f-d79a2a0b325f req-643d42f7-0d06-455f-8753-98d04727a807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5eaee8c-2eae-4b79-8877-9662b743bdc0", "name": "network-vif-unplugged", "status": "completed", "tag": "f01d8e9d-1098-489c-a951-002d58f61ad8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:25.816648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:25.817549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:25.827145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f2f92b3a-fac6-44ee-a52f-d79a2a0b325f req-643d42f7-0d06-455f-8753-98d04727a807 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.828021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f2f92b3a-fac6-44ee-a52f-d79a2a0b325f req-643d42f7-0d06-455f-8753-98d04727a807 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.840387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.843948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.844351 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-f2f92b3a-fac6-44ee-a52f-d79a2a0b325f req-643d42f7-0d06-455f-8753-98d04727a807 service nova] Creating event network-vif-unplugged:f01d8e9d-1098-489c-a951-002d58f61ad8 for instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 on nch2-master-1 Jun 04 21:00:25.845164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.845795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.858192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-f2f92b3a-fac6-44ee-a52f-d79a2a0b325f req-643d42f7-0d06-455f-8753-98d04727a807 service nova] Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:00:25.873506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-f2f92b3a-fac6-44ee-a52f-d79a2a0b325f req-643d42f7-0d06-455f-8753-98d04727a807 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068909 Jun 04 21:00:25.875075 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 961/1990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:25.882381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:25.883475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:25.893613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.894745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:25.895870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:25.897386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:26.740995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:26.747245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:26.757642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:26.760417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:26.760716 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32f6d536-fa7b-433a-9c9a-ef0646ef1573 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1734 microversion: 2.1 time: 0.883665 Jun 04 21:00:26.762511 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6fcc47e-308a-45a5-9001-88f04c06c8e4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1477 microversion: 2.25 time: 0.950515 Jun 04 21:00:26.767701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 962/1991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:25 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1734 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:26.777244 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1030/1992] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:25 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1477 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:26.780322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:26.781060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:26.783329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e51c2dc4-1599-4496-98ad-b26bc816f3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e51c2dc4-1599-4496-98ad-b26bc816f3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Request method failure captured: Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action HTTP/1.1 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 34 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8e2Z8Uvp5Qih_4k5SHyXSeLVUvrVep_6JkVc0MvFJOHs9ID0Gqa0w_qzBn_HFu4f3L40x6lQ6oJLnuSW7lJOElNKJkrD9_nbb90MObBIBKsRdtuD2WliRvYFttZxKFKtTVWgS4hXLm62-VTboreuT0v0fAMiSJA2WWQL6kej-Fku8E Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c329a5d4cc2f4311ae154a8810698837 Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: {"addFloatingIp": {"address": ""}} Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '85b2523f-383d-40a9-8794-390c4e67684e', 'body': {'addFloatingIp': {'address': ''}}} Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi '' Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:26.788349 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e51c2dc4-1599-4496-98ad-b26bc816f3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:26.797254 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e51c2dc4-1599-4496-98ad-b26bc816f3c4 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action" status: 400 len: 142 microversion: 2.1 time: 0.012657 Jun 04 21:00:26.799070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:26.799070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:26.800521 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1031/1993] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:26 2022] POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action => generated 142 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:26.800676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:26.800676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:26.820856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:26.824460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:26.840991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:26.841457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:26.860656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:26.861146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:26.932584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:26.943022 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0962d2c4-ea96-489f-8887-48441b271ed8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1274 microversion: 2.1 time: 0.172617 Jun 04 21:00:26.947194 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 963/1994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:26 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:26.961064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:26.962070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:26.969655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:26.970638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:26.971716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:26.972365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.264303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:27.269082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:27.290071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5cbbf1d7-6fd1-40e3-b9e5-180e626b88bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.495272 Jun 04 21:00:27.304451 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1032/1995] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:26 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:27.312745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2286359c-228e-4c77-ad0f-cca6df1f44d4 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '.version_select at 0x7f2d0189caf0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:27.315894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2286359c-228e-4c77-ad0f-cca6df1f44d4 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.316719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2286359c-228e-4c77-ad0f-cca6df1f44d4 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.328663 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2286359c-228e-4c77-ad0f-cca6df1f44d4 tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 2119 microversion: 2.25 time: 0.021044 Jun 04 21:00:27.329988 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1033/1996] 10.222.0.18 () {60 vars in 1183 bytes} [Sat Jun 4 21:00:27 2022] GET /compute/v2.1/os-migrations => generated 2119 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:27.335227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:27.337117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:27.345795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.346452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.347499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.349113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.381070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:27.394609 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-807bf8d4-9e71-4271-a994-bddb2dc5be50 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.445011 Jun 04 21:00:27.397137 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 964/1997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:26 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:27.411283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Acquired lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 21:00:27.412613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:27.413421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:27.426914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.427385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.428378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.428808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.687751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Releasing lock "refresh_cache-85b2523f-383d-40a9-8794-390c4e67684e" {{(pid=137228) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 21:00:27.688328 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] HTTP exception thrown: floating IP not found Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Request method failure captured: Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action HTTP/1.1 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 41 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8e2Z8Uvp5Qih_4k5SHyXSeLVUvrVep_6JkVc0MvFJOHs9ID0Gqa0w_qzBn_HFu4f3L40x6lQ6oJLnuSW7lJOElNKJkrD9_nbb90MObBIBKsRdtuD2WliRvYFttZxKFKtTVWgS4hXLm62-VTboreuT0v0fAMiSJA2WWQL6kej-Fku8E Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c329a5d4cc2f4311ae154a8810698837 Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: exception: floating IP not found Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '85b2523f-383d-40a9-8794-390c4e67684e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2685, in associate_floating_ip Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 04 21:00:27.689966 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Returning 404 to user: floating IP not found {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa353aed-3962-4db7-900c-ddd42ae92c2d tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action" status: 404 len: 67 microversion: 2.1 time: 0.360178 Jun 04 21:00:27.696274 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1034/1998] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:27 2022] POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action => generated 67 bytes in 362 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:27.702321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:27.703035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:27.714755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.716722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.717819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.718422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.882148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:27.894453 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a7909db-f833-40d2-94fd-4fcb03e24b41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1469 microversion: 2.1 time: 0.493474 Jun 04 21:00:27.895912 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 965/1999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:27 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1469 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:27.903324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:27.904204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:27.926711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.927250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:27.928149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:27.929724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.100334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:28.110273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-23d2cdce-20fb-4790-8568-f7669eab44a8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.415857 Jun 04 21:00:28.111125 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1035/2000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:27 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:28.115796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2348c1d-4f60-4f30-9e2a-69f25202d895 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:28.238850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d2348c1d-4f60-4f30-9e2a-69f25202d895 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2348c1d-4f60-4f30-9e2a-69f25202d895 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Request method failure captured: Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action HTTP/1.1 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 44 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8e2Z8Uvp5Qih_4k5SHyXSeLVUvrVep_6JkVc0MvFJOHs9ID0Gqa0w_qzBn_HFu4f3L40x6lQ6oJLnuSW7lJOElNKJkrD9_nbb90MObBIBKsRdtuD2WliRvYFttZxKFKtTVWgS4hXLm62-VTboreuT0v0fAMiSJA2WWQL6kej-Fku8E Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c329a5d4cc2f4311ae154a8810698837 Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: exception: Floating IP not found for address 0.0.0.0. Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '85b2523f-383d-40a9-8794-390c4e67684e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2913, in get_instance_id_by_floating_address Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 04 21:00:28.248771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 04 21:00:28.256394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.260196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2348c1d-4f60-4f30-9e2a-69f25202d895 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:28.261289 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2348c1d-4f60-4f30-9e2a-69f25202d895 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action" status: 404 len: 88 microversion: 2.1 time: 0.149209 Jun 04 21:00:28.262412 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1036/2001] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:28 2022] POST /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e/action => generated 88 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:28.267268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:28.267943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:28.284225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.285543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.286348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] Lazy-loading 'services' on Instance uuid 17eb0950-bab8-42f7-8302-60fe6aea12ea {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:28.287167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.288103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.329327 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5f74168-f4cc-49a9-bdb8-d4290fb67dae tempest-LiveAutoBlockMigrationV225Test-617269557 tempest-LiveAutoBlockMigrationV225Test-617269557-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1970 microversion: 2.25 time: 0.431238 Jun 04 21:00:28.329965 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 966/2002] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:27 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1970 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:28.364417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:28.366771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:28.387831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.400508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.402146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.402793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.576176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ebddd57-4189-4fe5-b50e-7614ed9fb76b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0/action" status: 204 len: 0 microversion: 2.1 time: 0.244836 Jun 04 21:00:28.577339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 967/2003] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:28 2022] POST /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0/action => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:28.594010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:28.594792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:28.609024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.609490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.610361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.610985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.671656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:28.682718 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4fd81e4-a4ca-4fd7-9c70-de9e5a2de781 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1734 microversion: 2.1 time: 0.419221 Jun 04 21:00:28.685792 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1037/2004] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:28 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1734 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:28.701894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5eaee8c-2eae-4b79-8877-9662b743bdc0", "tag": "f01d8e9d-1098-489c-a951-002d58f61ad8"}, {"name": "network-changed", "server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "tag": "1bfd296a-5b0b-4aaf-bf31-6c50c2a96d0c"}, {"name": "network-changed", "server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "tag": "737c1c2d-0c86-4ca1-8201-fc1a26dd5f76"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:28.723800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:28.740210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.741112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.763744 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Creating event network-changed:f01d8e9d-1098-489c-a951-002d58f61ad8 for instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 on nch2-master-1 Jun 04 21:00:28.764554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Creating event network-changed:1bfd296a-5b0b-4aaf-bf31-6c50c2a96d0c for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:28.765145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Creating event network-changed:737c1c2d-0c86-4ca1-8201-fc1a26dd5f76 for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:28.781376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:00:28.801299 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a499f53c-bdc6-423d-aa38-f8a7bf79fefe req-ff30ce97-999f-4146-833b-cfc81784b3ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.105583 Jun 04 21:00:28.803531 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1038/2005] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:28.811324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3018637a-9934-4e45-bc14-b8a2985559ea tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:28.813444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3018637a-9934-4e45-bc14-b8a2985559ea tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Failed to fetch instance by id 9223372036854775808 {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 21:00:28.814885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3018637a-9934-4e45-bc14-b8a2985559ea tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3018637a-9934-4e45-bc14-b8a2985559ea tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 9223372036854775808 could not be found. Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '9223372036854775808'} Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:28.816909 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:28.822529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:28.822529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:28.822529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:28.822529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jun 04 21:00:28.822529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:28.824026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3018637a-9934-4e45-bc14-b8a2985559ea tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:28.825053 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3018637a-9934-4e45-bc14-b8a2985559ea tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.019280 Jun 04 21:00:28.826117 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1039/2006] 10.222.0.18 () {58 vars in 1187 bytes} [Sat Jun 4 21:00:28 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:28.831434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:28.832419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:28.842979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.844486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.846731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:28.848300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:28.902658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:29.044638 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bc169f8-a275-4cc3-b14b-5513cf3c6e22 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "DELETE /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 204 len: 0 microversion: 2.1 time: 0.215951 Jun 04 21:00:29.047930 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1040/2007] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:28 2022] DELETE /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:29.062971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:29.063800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:29.073259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.074034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.075189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.075975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.115878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:29.223577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:29.240477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d27011d-9d04-48f6-9d69-b5160e7f3ae0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1314 microversion: 2.1 time: 0.661535 Jun 04 21:00:29.241943 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 968/2008] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:28 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:29.246852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:29.252854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:29.262627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61f33712-6fa1-431c-8d13-576ec01a3562 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "DELETE /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 204 len: 0 microversion: 2.25 time: 0.210907 Jun 04 21:00:29.267607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.268356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.270113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1041/2009] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:00:29 2022] DELETE /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:00:29.272676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.273325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.281316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:29.282440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:29.299445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.300833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.301959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.302855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.611639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:29.622898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d66df38-49f8-4453-a173-2d2f0012ecd3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.379278 Jun 04 21:00:29.632384 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 969/2010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:29 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:29.632384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "d3a3af3e-97f9-42aa-82c5-25fe6877e77d"}], "security_groups": [{"name": "tempest-securitygroup--1027131281"}], "key_name": "tempest-keypair-299277983", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:29.709396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:29.717974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e75b9d42-65ee-4533-a0cb-d82c157d483e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1469 microversion: 2.1 time: 0.444366 Jun 04 21:00:29.727878 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1042/2011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:29 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1469 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:29.737036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:29.737717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:29.757267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.757703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.758596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:29.759213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:29.886103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] validate_networks() for [('d3a3af3e-97f9-42aa-82c5-25fe6877e77d', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:30.092518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:30.100773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-300ab9ac-0fd2-403d-a7b9-a316205ae2b4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.374806 Jun 04 21:00:30.101833 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1043/2012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:29 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:30.121657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:30.123428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:30.132128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:30.132730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:30.133770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:30.134565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:30.981695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c329a5d4cc2f4311ae154a8810698837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2df84f0dd560488b9b85303294bc6fca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:30.990726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0d2612b-dd1c-462b-9ed9-b0e6980d3d92 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 200 len: 1543 microversion: 2.1 time: 0.880401 Jun 04 21:00:30.992134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1044/2013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:30 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 1543 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:30.998213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:30.998997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:31.006874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.007339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.008594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.009106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.178362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:31.178982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:31.179307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:31.179757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:31.180208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:31.190133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.190554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.191390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.191891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.199037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:31.201529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:31.211443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Getting quotas for project 2f6678835ec247d69b883f430be98e08. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:31.218338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Getting quotas for user 3f083a447601492b8b9d7ad1ad9d934a and project 2f6678835ec247d69b883f430be98e08. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:31.220761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:31.222244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:31.224417 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-930493e5-fed2-4e2c-ba6a-00010f70c3f4 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1483 microversion: 2.25 time: 0.230913 Jun 04 21:00:31.225482 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1045/2014] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:30 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1483 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:31.234046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:31.236446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:31.245250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:31.245876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:31.252972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.254074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.256133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.256774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.296995 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a872e31c-bf41-495c-8008-97ad8cca7ce0 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.670788 Jun 04 21:00:31.297970 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 970/2015] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:31.303002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1db67c8e-f868-419d-acf9-44a820d31031 req-0df5d001-53f6-4620-940c-323b263a9276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87aaf5f4-6faf-4ce7-bdd1-70d1a879d015", "tag": "66951d04-0f6b-4841-a05d-c0335707cb34"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:31.313482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1db67c8e-f868-419d-acf9-44a820d31031 req-0df5d001-53f6-4620-940c-323b263a9276 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.314113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1db67c8e-f868-419d-acf9-44a820d31031 req-0df5d001-53f6-4620-940c-323b263a9276 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.330995 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1db67c8e-f868-419d-acf9-44a820d31031 req-0df5d001-53f6-4620-940c-323b263a9276 service nova] Creating event network-changed:66951d04-0f6b-4841-a05d-c0335707cb34 for instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 on nch1-master-1 Jun 04 21:00:31.337533 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1db67c8e-f868-419d-acf9-44a820d31031 req-0df5d001-53f6-4620-940c-323b263a9276 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037625 Jun 04 21:00:31.338335 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 971/2016] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:31.346188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:31.347113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:31.355306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.356375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.357355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.357960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.503341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:31.520375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-95da258e-6e69-492b-a72a-f4744ffc6f87 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1734 microversion: 2.1 time: 0.293494 Jun 04 21:00:31.520892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1046/2017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:31 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1734 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:31.526217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:31.526835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:31.536861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.537326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.538135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.538665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.573839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:31.582646 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff5ff9e5-9cbc-4bcb-9985-f97ee52f7ff8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.242502 Jun 04 21:00:31.583231 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 972/2018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:31 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:31.588806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:31.589692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:31.604369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.605441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.606490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.607116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.874044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:31.889666 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d90f6c0-7097-45b2-8f38-fb739530e805 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1314 microversion: 2.1 time: 0.366594 Jun 04 21:00:31.895773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1047/2019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:31 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:31.918693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:31.919571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:31.928417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.929228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:31.930210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:31.931045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.253990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:32.269554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e4926d1-fcb4-43ae-b748-9b3c702fd600 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.684860 Jun 04 21:00:32.272512 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 973/2020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:31 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:32.281140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:32.282605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:32.293250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.294160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.295682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.296429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.687892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:32.697712 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ba7cdeb-35de-437f-a4d4-5f39b1323070 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1469 microversion: 2.1 time: 0.800264 Jun 04 21:00:32.708602 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1048/2021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:31 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1469 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:32.714371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fbee0311-b612-4ba7-8d53-30bb34e99035 req-9be0161a-59c7-4589-b567-f50d4be8ff72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5eaee8c-2eae-4b79-8877-9662b743bdc0", "name": "network-vif-plugged", "status": "completed", "tag": "f01d8e9d-1098-489c-a951-002d58f61ad8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:32.724969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fbee0311-b612-4ba7-8d53-30bb34e99035 req-9be0161a-59c7-4589-b567-f50d4be8ff72 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.726543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fbee0311-b612-4ba7-8d53-30bb34e99035 req-9be0161a-59c7-4589-b567-f50d4be8ff72 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.743070 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fbee0311-b612-4ba7-8d53-30bb34e99035 req-9be0161a-59c7-4589-b567-f50d4be8ff72 service nova] Creating event network-vif-plugged:f01d8e9d-1098-489c-a951-002d58f61ad8 for instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 on nch2-master-1 Jun 04 21:00:32.746707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:32.752004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-fbee0311-b612-4ba7-8d53-30bb34e99035 req-9be0161a-59c7-4589-b567-f50d4be8ff72 service nova] Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:00:32.765054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fbee0311-b612-4ba7-8d53-30bb34e99035 req-9be0161a-59c7-4589-b567-f50d4be8ff72 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054796 Jun 04 21:00:32.765824 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1049/2022] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:32.773689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-883fbd49-7fd0-4487-b035-0e072574e287 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:32.774564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-883fbd49-7fd0-4487-b035-0e072574e287 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Failed to fetch instance by id -1 {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 04 21:00:32.774944 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-883fbd49-7fd0-4487-b035-0e072574e287 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance -1 could not be found. Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-883fbd49-7fd0-4487-b035-0e072574e287 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance -1 could not be found. Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '-1'} Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:32.776691 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:32.782270 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:32.782270 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:32.782270 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jun 04 21:00:32.782270 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.782270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-883fbd49-7fd0-4487-b035-0e072574e287 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance -1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:32.783036 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-883fbd49-7fd0-4487-b035-0e072574e287 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014273 Jun 04 21:00:32.783875 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1050/2023] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:00:32 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:32.789781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:32.790797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] [instance: 85b2523f-383d-40a9-8794-390c4e67684e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:32.798992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.799624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.800525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.801033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.818115 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] HTTP exception thrown: Instance 85b2523f-383d-40a9-8794-390c4e67684e could not be found. Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Request method failure captured: Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e HTTP/1.1 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8e2Z8Uvp5Qih_4k5SHyXSeLVUvrVep_6JkVc0MvFJOHs9ID0Gqa0w_qzBn_HFu4f3L40x6lQ6oJLnuSW7lJOElNKJkrD9_nbb90MObBIBKsRdtuD2WliRvYFttZxKFKtTVWgS4hXLm62-VTboreuT0v0fAMiSJA2WWQL6kej-Fku8E Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2df84f0dd560488b9b85303294bc6fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2df84f0dd560488b9b85303294bc6fca Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c329a5d4cc2f4311ae154a8810698837 Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 85b2523f-383d-40a9-8794-390c4e67684e could not be found. Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '85b2523f-383d-40a9-8794-390c4e67684e'} Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b2523f-383d-40a9-8794-390c4e67684e could not be found. Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b2523f-383d-40a9-8794-390c4e67684e could not be found. Jun 04 21:00:32.819806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b2523f-383d-40a9-8794-390c4e67684e could not be found. Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] Returning 404 to user: Instance 85b2523f-383d-40a9-8794-390c4e67684e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f937f0e8-5f56-4ffc-9ddc-326ae30bcdc2 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520 tempest-FloatingIPsAssociationNegativeTestJSON-1980706520-project] 10.222.0.18 "GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e" status: 404 len: 111 microversion: 2.1 time: 0.037434 Jun 04 21:00:32.827930 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1051/2024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:32 2022] GET /compute/v2.1/servers/85b2523f-383d-40a9-8794-390c4e67684e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:32.829029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:32.833031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:32.833031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:32.839582 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-021bd594-87ee-460d-9cce-ace19f7c97af tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1221 microversion: 2.1 time: 0.565250 Jun 04 21:00:32.840097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.840835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.841859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.842523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.848983 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 974/2025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:32 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1221 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:32.854076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:32.854689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:32.862060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.862856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:32.864357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:32.865006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:33.302243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:33.314388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:33.322232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:33.326002 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a6271c0b-89fe-4242-bf4e-344b9a19998d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 200 len: 1441 microversion: 2.25 time: 0.500343 Jun 04 21:00:33.327224 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1052/2026] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:32 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 1441 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:33.349753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:33.352344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:33.375717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:33.376807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:33.378475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:33.379135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:33.775131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:33.783872 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38c28236-03cd-4b87-9610-e789b33a75dc tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1734 microversion: 2.1 time: 0.933689 Jun 04 21:00:33.793855 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 975/2027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:32 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1734 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:33.793855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:33.793855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:33.796819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:33.797423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:33.798203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:33.798623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:33.920324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:33.929189 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d2bf86d-4ea1-4c62-9249-456fd811bad0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.600554 Jun 04 21:00:33.930614 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1053/2028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:33 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:33.947881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:33.948491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:33.969357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:33.969807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:33.970671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:33.971104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:34.204709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:34.216084 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9acdb2f7-6608-4257-bfe1-aef10cb8a64a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1314 microversion: 2.1 time: 0.430049 Jun 04 21:00:34.217733 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 976/2029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:33 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:34.224228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-f55b22a4-5613-424c-8811-c9644857db25 req-6b61d2e9-ed9d-4345-a521-10fa53adfc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b2523f-383d-40a9-8794-390c4e67684e", "name": "network-vif-deleted", "tag": "50e6596d-fd85-4321-a3cc-35e8868b4460"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:34.235642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f55b22a4-5613-424c-8811-c9644857db25 req-6b61d2e9-ed9d-4345-a521-10fa53adfc8f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:34.236225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f55b22a4-5613-424c-8811-c9644857db25 req-6b61d2e9-ed9d-4345-a521-10fa53adfc8f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:34.248851 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-f55b22a4-5613-424c-8811-c9644857db25 req-6b61d2e9-ed9d-4345-a521-10fa53adfc8f service nova] Creating event network-vif-deleted:50e6596d-fd85-4321-a3cc-35e8868b4460 for instance 85b2523f-383d-40a9-8794-390c4e67684e on nch2-master-1 Jun 04 21:00:34.254332 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-f55b22a4-5613-424c-8811-c9644857db25 req-6b61d2e9-ed9d-4345-a521-10fa53adfc8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Jun 04 21:00:34.255888 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 977/2030] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:34.262041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-26abde67-03e2-4a58-8b7c-079791adb950 req-d2bd4367-e402-4333-8b16-8c837be1b770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17eb0950-bab8-42f7-8302-60fe6aea12ea", "name": "network-vif-deleted", "tag": "a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:34.272773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-26abde67-03e2-4a58-8b7c-079791adb950 req-d2bd4367-e402-4333-8b16-8c837be1b770 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:34.273688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-26abde67-03e2-4a58-8b7c-079791adb950 req-d2bd4367-e402-4333-8b16-8c837be1b770 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:34.285657 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-26abde67-03e2-4a58-8b7c-079791adb950 req-d2bd4367-e402-4333-8b16-8c837be1b770 service nova] Creating event network-vif-deleted:a76b4a54-7adc-4d3a-9e99-eaa4f77dcd4e for instance 17eb0950-bab8-42f7-8302-60fe6aea12ea on nch1-master-1 Jun 04 21:00:34.291614 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-26abde67-03e2-4a58-8b7c-079791adb950 req-d2bd4367-e402-4333-8b16-8c837be1b770 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034156 Jun 04 21:00:34.294132 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 978/2031] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:34.302122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:34.303053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:34.312820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:34.313646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:34.314672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:34.315269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:34.514026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:34.526431 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-02369568-15f9-4acf-bc38-e5d930bf0f52 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.582694 Jun 04 21:00:34.527028 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1054/2032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:33 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:34.532029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:34.542863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:34.549306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:34.549761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:34.550599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:34.551034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.407499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:35.416338 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-518b295c-0ffb-495e-8dc4-22209664992a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1469 microversion: 2.1 time: 1.120805 Jun 04 21:00:35.417582 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 979/2033] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:34 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1469 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:35.423373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:35.424257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:35.431421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:35.432153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.433438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:35.434054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.647270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:35.656826 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8aa1d480-c1f5-4b56-9fe5-4a3f3af0e488 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1351 microversion: 2.1 time: 1.128487 Jun 04 21:00:35.660247 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1055/2034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:34 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1351 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:35.668994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:35.681160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 17eb0950-bab8-42f7-8302-60fe6aea12ea] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:35.689227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:35.689686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.692964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:35.693411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.718975 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] HTTP exception thrown: Instance 17eb0950-bab8-42f7-8302-60fe6aea12ea could not be found. Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Request method failure captured: Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea HTTP/1.1 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8cDdVpJYuSAoSfcGnCbmQsckGG7Qxg6dKXeLE0KG6YWBk9LeyctMfLEYSWfEwYRTuhMCUfoND2WAD7msoF1T1PIAWPDHjigOO89fbSdUOqBSUmjCNTcNxiQqH5dlRWbxz1EeaHJfnMc1K8oSX8UnMehTa7inLX8ugjBUniQ5eEMwNQ Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.25 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: e25328c90d26437a85d8d5509437ed99 Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 17eb0950-bab8-42f7-8302-60fe6aea12ea could not be found. Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '17eb0950-bab8-42f7-8302-60fe6aea12ea'} Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17eb0950-bab8-42f7-8302-60fe6aea12ea could not be found. Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17eb0950-bab8-42f7-8302-60fe6aea12ea could not be found. Jun 04 21:00:35.731050 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17eb0950-bab8-42f7-8302-60fe6aea12ea could not be found. Jun 04 21:00:35.736279 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:35.738356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Returning 404 to user: Instance 17eb0950-bab8-42f7-8302-60fe6aea12ea could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:35.739401 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f60e055-d645-419b-94cf-501300bfcf71 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea" status: 404 len: 111 microversion: 2.25 time: 0.074548 Jun 04 21:00:35.744495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1056/2035] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:35 2022] GET /compute/v2.1/servers/17eb0950-bab8-42f7-8302-60fe6aea12ea => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:35.756537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:35.757913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:35.772241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:35.773028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.774045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:35.783949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:35.969466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:35.981265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f1cced06-a72f-439c-9109-9e1185740e51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.562159 Jun 04 21:00:35.982321 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 980/2036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:35 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:35.987910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:35.988935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:35.996585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.002700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.004346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.005032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.255493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:36.270107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd226c9d-ac99-4c1f-b2ec-5c8b2a1e2b1f tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1714 microversion: 2.1 time: 0.524070 Jun 04 21:00:36.287209 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1057/2037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:35 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1714 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:36.290998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:36.292746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:36.311229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.314588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.315967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.317587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.363082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:36.380328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-249b50ff-4eb0-4c0d-b70e-91a24c0db79b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1314 microversion: 2.1 time: 0.396525 Jun 04 21:00:36.381754 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 981/2038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:35 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:36.388299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ded27e3f-96f8-4f58-b619-f59119ab7117 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:36.388849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ded27e3f-96f8-4f58-b619-f59119ab7117 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:36.402388 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ded27e3f-96f8-4f58-b619-f59119ab7117 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce could not be found. Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ded27e3f-96f8-4f58-b619-f59119ab7117 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/2bb10dca-c308-4ba8-91cb-9fd7f298b5ce/action HTTP/1.1 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 19 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: {"forceDelete": {}} Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce could not be found. Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '2bb10dca-c308-4ba8-91cb-9fd7f298b5ce', 'body': {'forceDelete': {}}} Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce could not be found. Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce could not be found. Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:36.416640 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce could not be found. Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ded27e3f-96f8-4f58-b619-f59119ab7117 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 2bb10dca-c308-4ba8-91cb-9fd7f298b5ce could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ded27e3f-96f8-4f58-b619-f59119ab7117 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/2bb10dca-c308-4ba8-91cb-9fd7f298b5ce/action" status: 404 len: 111 microversion: 2.1 time: 0.035293 Jun 04 21:00:36.422161 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 982/2039] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:36 2022] POST /compute/v2.1/servers/2bb10dca-c308-4ba8-91cb-9fd7f298b5ce/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:36.432461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-736c92cc-9477-44e7-a15e-4e2b9e49f215 req-c9ace169-6582-4d3d-8891-eefcba317ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989d37f9-1809-4c90-b21e-b602ea326af6", "tag": "6abbedee-2a93-43a3-924c-d0dcd6574754"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:36.449088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-736c92cc-9477-44e7-a15e-4e2b9e49f215 req-c9ace169-6582-4d3d-8891-eefcba317ac6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.449876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-736c92cc-9477-44e7-a15e-4e2b9e49f215 req-c9ace169-6582-4d3d-8891-eefcba317ac6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.467392 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-736c92cc-9477-44e7-a15e-4e2b9e49f215 req-c9ace169-6582-4d3d-8891-eefcba317ac6 service nova] Creating event network-changed:6abbedee-2a93-43a3-924c-d0dcd6574754 for instance 989d37f9-1809-4c90-b21e-b602ea326af6 on nch1-master-1 Jun 04 21:00:36.474614 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-736c92cc-9477-44e7-a15e-4e2b9e49f215 req-c9ace169-6582-4d3d-8891-eefcba317ac6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052177 Jun 04 21:00:36.476355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 983/2040] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:36.484885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:36.485660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:36.492485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.493056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.493833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.494583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.722825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:36.740366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da0c9d31-06f4-4184-b259-98931baebef2 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.460859 Jun 04 21:00:36.752815 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1058/2041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:36 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:36.758616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:36.759657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:36.771153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.771153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.771153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:36.771836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:36.973907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:36.988112 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-009c260f-1ad6-4ef7-8fb8-018e23d8cfb6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.509902 Jun 04 21:00:36.988707 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 984/2042] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:36 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:37.004727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:37.005496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:37.012263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.012917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.013910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.014516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.178529 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Cannot 'detach_volume' instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc while it is in vm_state rescued Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments/37cf4b6a-6b9d-4adb-8221-172f88294ef6 HTTP/1.1 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: exception: Cannot 'detach_volume' instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc while it is in vm_state rescued Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': 'e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc', 'id': '37cf4b6a-6b9d-4adb-8221-172f88294ef6'} Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc while it is in vm_state rescued Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:37.181178 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc while it is in vm_state rescued Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 409 to user: Cannot 'detach_volume' instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc while it is in vm_state rescued {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c371d0e-6210-4c9a-be47-99a0108f5b3d tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments/37cf4b6a-6b9d-4adb-8221-172f88294ef6" status: 409 len: 152 microversion: 2.1 time: 0.193060 Jun 04 21:00:37.186516 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 985/2043] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:00:36 2022] DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments/37cf4b6a-6b9d-4adb-8221-172f88294ef6 => generated 152 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:37.209024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:37.209882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:37.218165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.218618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.219411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.222083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.245384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:37.266604 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-93f6b008-4bb7-48aa-b872-486b51b056e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1461 microversion: 2.1 time: 0.512233 Jun 04 21:00:37.267552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1059/2044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:36 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1461 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:37.272865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:37.273921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:37.280935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.281639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.282633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.283240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.628446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:37.636493 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95ec6b66-0a9d-4e30-8009-ff04dd3797f8 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1351 microversion: 2.1 time: 0.451309 Jun 04 21:00:37.645726 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 986/2045] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:37 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1351 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:37.645726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a73b99e1-542a-4eb3-b09d-9645a1ce69d1 req-90148dfe-0c63-4350-aec6-ae50d0d9d468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aaf5f4-6faf-4ce7-bdd1-70d1a879d015", "name": "network-vif-plugged", "status": "completed", "tag": "66951d04-0f6b-4841-a05d-c0335707cb34"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:37.651632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a73b99e1-542a-4eb3-b09d-9645a1ce69d1 req-90148dfe-0c63-4350-aec6-ae50d0d9d468 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.652113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a73b99e1-542a-4eb3-b09d-9645a1ce69d1 req-90148dfe-0c63-4350-aec6-ae50d0d9d468 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.664062 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a73b99e1-542a-4eb3-b09d-9645a1ce69d1 req-90148dfe-0c63-4350-aec6-ae50d0d9d468 service nova] Creating event network-vif-plugged:66951d04-0f6b-4841-a05d-c0335707cb34 for instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 on nch1-master-1 Jun 04 21:00:37.669171 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a73b99e1-542a-4eb3-b09d-9645a1ce69d1 req-90148dfe-0c63-4350-aec6-ae50d0d9d468 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Jun 04 21:00:37.669973 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 987/2046] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:37.675287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:37.675919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:37.683087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.683556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.684351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.684785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.690662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:37.701118 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6ded6ff1-156b-4f0a-8c6d-20b80781844e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.431521 Jun 04 21:00:37.706675 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1060/2047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:37 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:37.716678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:37.717458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:37.724504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.725130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.725947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.726596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.767400 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63f187b8-406d-4a15-8e80-5eba84460e35 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/action" status: 202 len: 0 microversion: 2.1 time: 0.095713 Jun 04 21:00:37.771978 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 988/2048] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:37 2022] POST /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:00:37.776124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:37.776943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:37.784766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.785311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:37.786190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:37.786613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.512654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c70ae07-48db-416b-8cd9-a72fc61a59b6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1612 microversion: 2.1 time: 0.802477 Jun 04 21:00:38.513252 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1061/2049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:37 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1612 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:38.518294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-524967b4-48c5-48a3-84ce-34bd3a9c3be6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:38.519829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-524967b4-48c5-48a3-84ce-34bd3a9c3be6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 9d78b218-7819-4247-b493-61491485ff00] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:38.528436 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-524967b4-48c5-48a3-84ce-34bd3a9c3be6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 9d78b218-7819-4247-b493-61491485ff00 could not be found. Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-524967b4-48c5-48a3-84ce-34bd3a9c3be6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/9d78b218-7819-4247-b493-61491485ff00/action HTTP/1.1 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 39 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: {"os-getConsoleOutput": {"length": 10}} Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 9d78b218-7819-4247-b493-61491485ff00 could not be found. Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '9d78b218-7819-4247-b493-61491485ff00', 'body': {'os-getConsoleOutput': {'length': 10}}} Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d78b218-7819-4247-b493-61491485ff00 could not be found. Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d78b218-7819-4247-b493-61491485ff00 could not be found. Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:38.534043 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d78b218-7819-4247-b493-61491485ff00 could not be found. Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-524967b4-48c5-48a3-84ce-34bd3a9c3be6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 9d78b218-7819-4247-b493-61491485ff00 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-524967b4-48c5-48a3-84ce-34bd3a9c3be6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/9d78b218-7819-4247-b493-61491485ff00/action" status: 404 len: 111 microversion: 2.1 time: 0.021019 Jun 04 21:00:38.541525 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1062/2050] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:38 2022] POST /compute/v2.1/servers/9d78b218-7819-4247-b493-61491485ff00/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:38.545052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:38.545669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:38.553261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.553709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.554784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.556227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.567639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:38.580554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-edf74b1f-91e3-4c22-88fc-d1d07082ab91 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1314 microversion: 2.1 time: 0.810873 Jun 04 21:00:38.581370 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 989/2051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:37 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:38.589056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:38.590421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:38.600477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.601229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.602483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.603103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.873237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:38.878632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:38.899245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:38.913561 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72bbdd4a-d97a-4818-8fa2-0c01d71b092e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1722 microversion: 2.1 time: 0.326068 Jun 04 21:00:38.915949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 990/2052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:38 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:38.918277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-50a6cb5b-6e81-49fe-881b-e023a1923bac tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.376988 Jun 04 21:00:38.934471 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1063/2053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:38 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:38.944385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:38.945856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:38.949395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7139ce46-1148-47ea-b797-b13f5a89a693 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '.version_select at 0x7f2d018f3e50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:38.959344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7139ce46-1148-47ea-b797-b13f5a89a693 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.960052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7139ce46-1148-47ea-b797-b13f5a89a693 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.963857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:38.966937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.971195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.972689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:38.973460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:38.979727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7139ce46-1148-47ea-b797-b13f5a89a693 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.043096 Jun 04 21:00:38.985339 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1064/2054] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 21:00:38 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:39.004517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:39.005143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:39.044172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:39.047687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:39.048912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:39.051807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:39.079099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:39.201968 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-015352f8-13a4-4352-b963-84d0c5f0c6d5 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 204 len: 0 microversion: 2.25 time: 0.281313 Jun 04 21:00:39.202546 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 991/2055] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:00:38 2022] DELETE /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:00:39.215530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:39.216780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:39.227752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:39.228930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:39.231343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:39.232023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:39.343411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:39.351530 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aef52b1b-3747-4d63-94a6-8d3da20aa21e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.350785 Jun 04 21:00:39.353015 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1065/2056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:38 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:39.357801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1023488200", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:39.439308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:39.678206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:39.686658 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca8c43e1-b230-488b-886d-9eb8059c119d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1351 microversion: 2.1 time: 0.482455 Jun 04 21:00:39.696366 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 992/2057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:39 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1351 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:39.701281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:39.701903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:39.708668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:39.709508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:39.710318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:39.710725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.019461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:40.019461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:40.019461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:40.022752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:40.026356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:40.027175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:40.038942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:40.039298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.040307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.040718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:40.041127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.041838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.042088 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7ac00e99-b904-4e8f-aa13-6be8dc0c0f31 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1564 microversion: 2.25 time: 0.344317 Jun 04 21:00:40.051572 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 993/2058] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:39 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1564 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:40.051572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:40.051572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:40.054067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.054619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.055578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.056141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.061049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:40.066755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for user 5b4c3539c5534d2c844944f9be3f9963 and project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:40.080744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:40.083421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:40.131167 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-57cb99b3-31f2-4122-937b-f73242896365 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777069 Jun 04 21:00:40.131852 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1066/2059] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:40.137598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:40.138213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:40.144853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.145553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.146858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.147462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.554631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:40.568504 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf6f8b7c-1d7a-4a79-ad5f-32a5336926f5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.523973 Jun 04 21:00:40.569838 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 994/2060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:40 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:40.578200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-977673ab-b79d-43d4-b325-f94977742977 req-5a56d080-f668-4baa-826d-fa50a3d333ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "name": "network-vif-plugged", "status": "completed", "tag": "737c1c2d-0c86-4ca1-8201-fc1a26dd5f76"}, {"server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "name": "network-vif-plugged", "status": "completed", "tag": "1bfd296a-5b0b-4aaf-bf31-6c50c2a96d0c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:40.584346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:40.593611 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f332809a-8403-4d3d-8ea1-cc0683275df6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1501 microversion: 2.1 time: 0.460446 Jun 04 21:00:40.594385 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1067/2061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:40 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1501 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:40.601949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:40.602574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:40.604504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-977673ab-b79d-43d4-b325-f94977742977 req-5a56d080-f668-4baa-826d-fa50a3d333ed service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.607786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-977673ab-b79d-43d4-b325-f94977742977 req-5a56d080-f668-4baa-826d-fa50a3d333ed service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.628202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.629023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.630660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.631687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.676644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-977673ab-b79d-43d4-b325-f94977742977 req-5a56d080-f668-4baa-826d-fa50a3d333ed service nova] Creating event network-vif-plugged:737c1c2d-0c86-4ca1-8201-fc1a26dd5f76 for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:40.678791 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-977673ab-b79d-43d4-b325-f94977742977 req-5a56d080-f668-4baa-826d-fa50a3d333ed service nova] Creating event network-vif-plugged:1bfd296a-5b0b-4aaf-bf31-6c50c2a96d0c for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:40.693255 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-977673ab-b79d-43d4-b325-f94977742977 req-5a56d080-f668-4baa-826d-fa50a3d333ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.119890 Jun 04 21:00:40.694824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 995/2062] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:40.706590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:40.709342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:40.730771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.732761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:40.734414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:40.736135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.199656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:41.229530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:41.583778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.596435 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba536fbb-7922-432e-b84b-8fd496ff3516 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 200 len: 1728 microversion: 2.1 time: 1.000656 Jun 04 21:00:41.600368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1068/2063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:40 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 1728 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:41.615252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:41.616743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:41.626500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.626961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.627851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.628260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.656608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.666621 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f271f0c-a35c-469b-8d83-fc2b1b6c8ab7 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1334 microversion: 2.1 time: 0.969041 Jun 04 21:00:41.667856 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 996/2064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:40 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1334 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:41.673409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74af5a62-a91a-4a01-86b1-57656ce375ca tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:41.674286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74af5a62-a91a-4a01-86b1-57656ce375ca tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 735815ca-15ba-4c9c-b0d7-0d396900737e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:41.681571 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-74af5a62-a91a-4a01-86b1-57656ce375ca tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 735815ca-15ba-4c9c-b0d7-0d396900737e could not be found. Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74af5a62-a91a-4a01-86b1-57656ce375ca tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/735815ca-15ba-4c9c-b0d7-0d396900737e HTTP/1.1 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 735815ca-15ba-4c9c-b0d7-0d396900737e could not be found. Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '735815ca-15ba-4c9c-b0d7-0d396900737e'} Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 735815ca-15ba-4c9c-b0d7-0d396900737e could not be found. Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 735815ca-15ba-4c9c-b0d7-0d396900737e could not be found. Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:41.689496 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:41.695565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:41.695565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:41.695565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:41.695565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 735815ca-15ba-4c9c-b0d7-0d396900737e could not be found. Jun 04 21:00:41.695565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:41.697321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74af5a62-a91a-4a01-86b1-57656ce375ca tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 735815ca-15ba-4c9c-b0d7-0d396900737e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:41.698368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74af5a62-a91a-4a01-86b1-57656ce375ca tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/735815ca-15ba-4c9c-b0d7-0d396900737e" status: 404 len: 111 microversion: 2.1 time: 0.029336 Jun 04 21:00:41.702439 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 997/2065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:41 2022] GET /compute/v2.1/servers/735815ca-15ba-4c9c-b0d7-0d396900737e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:41.707321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:41.707964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:41.723814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.724272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.725141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.725583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.745788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.759776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9f80e06c-7c32-4f88-8f16-820ca8c5c8a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1265 microversion: 2.1 time: 0.157825 Jun 04 21:00:41.760741 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1069/2066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:41 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:41.772561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:41.773251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:41.785259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.786004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.786800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.787232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.828867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.829567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.830044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lazy-loading 'fault' on Instance uuid a183ce72-70aa-487e-b90f-7a89e17720b3 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:41.887732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.894414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:41.902647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.906666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.907155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:41.908644 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb2fab6e-c2cd-4b94-9f81-4d2b5f3b2066 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 200 len: 1351 microversion: 2.25 time: 0.144686 Jun 04 21:00:41.911468 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1070/2067] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:41 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:41.915071 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e160566-bd85-4be4-83ac-35c6481871c1 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1351 microversion: 2.1 time: 0.211453 Jun 04 21:00:41.916608 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 998/2068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:41 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:41.920265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2b48c133-15e1-49eb-9645-d0b393dc9519 req-95a2cf59-4677-4d09-82ff-8d81732de52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a183ce72-70aa-487e-b90f-7a89e17720b3", "name": "network-vif-deleted", "tag": "51a43abd-07c8-4b4a-9258-2f0b67574647"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:41.921537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:41.922033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:41.931194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.931945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.932941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.933558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.939578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2b48c133-15e1-49eb-9645-d0b393dc9519 req-95a2cf59-4677-4d09-82ff-8d81732de52f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:41.945196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2b48c133-15e1-49eb-9645-d0b393dc9519 req-95a2cf59-4677-4d09-82ff-8d81732de52f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:41.971397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2b48c133-15e1-49eb-9645-d0b393dc9519 req-95a2cf59-4677-4d09-82ff-8d81732de52f service nova] Creating event network-vif-deleted:51a43abd-07c8-4b4a-9258-2f0b67574647 for instance a183ce72-70aa-487e-b90f-7a89e17720b3 on nch1-master-1 Jun 04 21:00:42.003769 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2b48c133-15e1-49eb-9645-d0b393dc9519 req-95a2cf59-4677-4d09-82ff-8d81732de52f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088318 Jun 04 21:00:42.005386 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1071/2069] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:42.011631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:42.021294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:42.055545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.056019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.056832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.057281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.066286 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-836e8524-8968-45b3-869b-26d94dfd7bca tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148555 Jun 04 21:00:42.066981 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 999/2070] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:00:41 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:42.319620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:42.333774 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da895a82-9a11-4541-859b-eadfa1f48c16 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.326955 Jun 04 21:00:42.334373 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1072/2071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:42 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:42.355849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:42.357010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:42.371190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.372467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.375257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.376075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.412030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30a9a8cf-3f14-42f9-8afc-bb0dd688c197"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:42.413150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:42.421003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.421812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.422895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.423339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.583198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:42.591624 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aa16c991-49fb-4681-b34b-0a11dd455e0e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.242654 Jun 04 21:00:42.592526 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1000/2072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:42 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:42.651044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9538da61-e333-48e3-aa07-293165ed904a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1372011036", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9538da61-e333-48e3-aa07-293165ed904a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 238 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1372011036", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1372011036', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:42.653942 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9538da61-e333-48e3-aa07-293165ed904a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9538da61-e333-48e3-aa07-293165ed904a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009246 Jun 04 21:00:42.658835 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1001/2073] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 21:00:42.666714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:42.667429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:42.675144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.675731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.676711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.677202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.793679 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c7d04b32-3696-4d22-977d-511e736b931f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384910 Jun 04 21:00:42.795308 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1073/2074] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:00:42 2022] POST /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:00:42.814622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:42.815835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:42.825544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.826331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.827127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.827599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.835903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:42.846460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e09429a7-c783-45d4-8d91-1a9e260c5146 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.183969 Jun 04 21:00:42.847216 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1002/2075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:42 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:42.872308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e7abd35a-5563-4b05-812d-60fbf2951b6c req-5a20d82d-7bc1-45fe-a065-68294e503562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989d37f9-1809-4c90-b21e-b602ea326af6", "name": "network-vif-plugged", "status": "completed", "tag": "6abbedee-2a93-43a3-924c-d0dcd6574754"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:42.890471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e7abd35a-5563-4b05-812d-60fbf2951b6c req-5a20d82d-7bc1-45fe-a065-68294e503562 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.890993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e7abd35a-5563-4b05-812d-60fbf2951b6c req-5a20d82d-7bc1-45fe-a065-68294e503562 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.903488 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e7abd35a-5563-4b05-812d-60fbf2951b6c req-5a20d82d-7bc1-45fe-a065-68294e503562 service nova] Creating event network-vif-plugged:6abbedee-2a93-43a3-924c-d0dcd6574754 for instance 989d37f9-1809-4c90-b21e-b602ea326af6 on nch1-master-1 Jun 04 21:00:42.908922 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e7abd35a-5563-4b05-812d-60fbf2951b6c req-5a20d82d-7bc1-45fe-a065-68294e503562 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042477 Jun 04 21:00:42.909977 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1003/2076] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:42.915949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:42.916714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:42.924298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.924850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:42.925732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:42.928170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.016650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:43.027399 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3722588b-b7b2-4761-ae02-98740898a6e9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1271 microversion: 2.1 time: 0.115750 Jun 04 21:00:43.029085 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1004/2077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:42 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:43.044169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.045538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.054170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:43.054617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.055494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.056529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.056976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.064011 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bcbf9608-c836-44b0-835e-7d065a8336ba tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1670 microversion: 2.1 time: 0.267244 Jun 04 21:00:43.068336 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1074/2078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:42 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1670 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:43.073929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.074927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.083324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.084272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.085554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.087437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.308371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:43.325352 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e2df9113-fd63-4c32-91eb-e79fb818e54a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.294855 Jun 04 21:00:43.326236 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1005/2079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:43 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:43.333575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.336087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: a183ce72-70aa-487e-b90f-7a89e17720b3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.348447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.348986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.350812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.352727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.386566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] HTTP exception thrown: Instance a183ce72-70aa-487e-b90f-7a89e17720b3 could not be found. Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Request method failure captured: Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 HTTP/1.1 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8cDdVpJYuSAoSfcGnCbmQsckGG7Qxg6dKXeLE0KG6YWBk9LeyctMfLEYSWfEwYRTuhMCUfoND2WAD7msoF1T1PIAWPDHjigOO89fbSdUOqBSUmjCNTcNxiQqH5dlRWbxz1EeaHJfnMc1K8oSX8UnMehTa7inLX8ugjBUniQ5eEMwNQ Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.25 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e25328c90d26437a85d8d5509437ed99 Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance a183ce72-70aa-487e-b90f-7a89e17720b3 could not be found. Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a183ce72-70aa-487e-b90f-7a89e17720b3'} Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a183ce72-70aa-487e-b90f-7a89e17720b3 could not be found. Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a183ce72-70aa-487e-b90f-7a89e17720b3 could not be found. Jun 04 21:00:43.391175 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a183ce72-70aa-487e-b90f-7a89e17720b3 could not be found. Jun 04 21:00:43.396966 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.401028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:43.405316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Returning 404 to user: Instance a183ce72-70aa-487e-b90f-7a89e17720b3 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:43.406387 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae787385-5c65-4241-a47e-c7d8d8be516d tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3" status: 404 len: 111 microversion: 2.25 time: 0.078788 Jun 04 21:00:43.408406 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1006/2080] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:43 2022] GET /compute/v2.1/servers/a183ce72-70aa-487e-b90f-7a89e17720b3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:43.412856 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab085f1e-7550-4a40-9bc4-c9622cf7d4c7 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1351 microversion: 2.1 time: 0.343188 Jun 04 21:00:43.417480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.418339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.423637 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1075/2081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:43 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1351 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:43.430091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.430870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.439069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.439933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.440961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.441657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.442438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.444181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.445784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.448178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.488570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:43.500750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a12e9bf5-81fc-4b9d-aa5c-4f6a717868c3 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337/ips" status: 200 len: 180 microversion: 2.1 time: 0.091081 Jun 04 21:00:43.506862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1007/2082] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:00:43 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337/ips => generated 180 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:43.508556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8301d4c4-0fba-451c-93b7-c6d78478d23d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-873886048", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8301d4c4-0fba-451c-93b7-c6d78478d23d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 234 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-873886048", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-873886048', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = func(instance) Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'notvalid' Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:43.515403 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8301d4c4-0fba-451c-93b7-c6d78478d23d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8301d4c4-0fba-451c-93b7-c6d78478d23d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014528 Jun 04 21:00:43.521413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1008/2083] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:43.530579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.531179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.540479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.541133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.542034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.542833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.576939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:43.598122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:43.628989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc951b2a-8d0d-49fd-8c9f-9e7cdd98adb1 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "DELETE /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 204 len: 0 microversion: 2.25 time: 0.203084 Jun 04 21:00:43.634173 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1076/2084] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:00:43 2022] DELETE /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:00:43.639912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.640637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.647882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.648435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.649351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.649799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.689042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:43.741724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-766d1d4c-6da4-420f-b7d9-62dbc1b0f3c1 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 204 len: 0 microversion: 2.1 time: 0.220704 Jun 04 21:00:43.742841 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1009/2085] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:43 2022] DELETE /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:43.750848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:43.751995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:43.760969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.761733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.763126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:43.763843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:43.991800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.000872 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4db6605-5b7a-4b21-9b88-61e77311c778 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.365279 Jun 04 21:00:44.001935 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1077/2086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:43 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:44.010418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:44.011129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:44.025658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.027253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.028211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.028881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.061390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.078973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.082740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.085302 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92e448f6-1984-4363-ae71-edb5d36b87b3 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1548 microversion: 2.25 time: 0.338929 Jun 04 21:00:44.088108 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1010/2087] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:43 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1548 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:44.095317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:44.096676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:44.115771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.116241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.117188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.117815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.366727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.385103 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64a3cf8e-85de-4c05-a9e3-23caeba4f366 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1676 microversion: 2.1 time: 0.378483 Jun 04 21:00:44.388100 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1078/2088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:44 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1676 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:44.399694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:44.400452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:44.408550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.409037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.410031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.412081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.470897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.497650 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7311de9-9def-4080-9656-19bc94133eef tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.406698 Jun 04 21:00:44.498426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1011/2089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:44 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:44.514255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:44.515185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:44.532611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.533288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.534298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.534915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.711426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.721719 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-edd56c11-4040-4a59-a53d-a7529915cb8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1313 microversion: 2.1 time: 0.331049 Jun 04 21:00:44.722413 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1079/2090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:44 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:44.746658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1507d1d8-78ad-46a2-b817-8e5964110732 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:44.747349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1507d1d8-78ad-46a2-b817-8e5964110732 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: a3b9f85b-6923-4a71-bf22-ed834b0e5faa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:44.759136 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1507d1d8-78ad-46a2-b817-8e5964110732 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance a3b9f85b-6923-4a71-bf22-ed834b0e5faa could not be found. Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1507d1d8-78ad-46a2-b817-8e5964110732 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/a3b9f85b-6923-4a71-bf22-ed834b0e5faa/action HTTP/1.1 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 13 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: {"pause": {}} Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a3b9f85b-6923-4a71-bf22-ed834b0e5faa could not be found. Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a3b9f85b-6923-4a71-bf22-ed834b0e5faa', 'body': {'pause': {}}} Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3b9f85b-6923-4a71-bf22-ed834b0e5faa could not be found. Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3b9f85b-6923-4a71-bf22-ed834b0e5faa could not be found. Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:44.761636 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3b9f85b-6923-4a71-bf22-ed834b0e5faa could not be found. Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1507d1d8-78ad-46a2-b817-8e5964110732 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance a3b9f85b-6923-4a71-bf22-ed834b0e5faa could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1507d1d8-78ad-46a2-b817-8e5964110732 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/a3b9f85b-6923-4a71-bf22-ed834b0e5faa/action" status: 404 len: 111 microversion: 2.1 time: 0.026790 Jun 04 21:00:44.770826 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1080/2091] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:44 2022] POST /compute/v2.1/servers/a3b9f85b-6923-4a71-bf22-ed834b0e5faa/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:44.773245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4d110c0e-24d2-487c-924c-c8772ffb5bc8 req-9818093f-c202-48bc-b3f2-f5e713b9fac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc", "tag": "f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:44.785288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4d110c0e-24d2-487c-924c-c8772ffb5bc8 req-9818093f-c202-48bc-b3f2-f5e713b9fac5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.785796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4d110c0e-24d2-487c-924c-c8772ffb5bc8 req-9818093f-c202-48bc-b3f2-f5e713b9fac5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.799109 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4d110c0e-24d2-487c-924c-c8772ffb5bc8 req-9818093f-c202-48bc-b3f2-f5e713b9fac5 service nova] Creating event network-changed:f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f for instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc on nch2-master-1 Jun 04 21:00:44.805249 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4d110c0e-24d2-487c-924c-c8772ffb5bc8 req-9818093f-c202-48bc-b3f2-f5e713b9fac5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039340 Jun 04 21:00:44.805872 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1081/2092] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:44.811987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:44.812805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:44.820384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.821013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.822038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:44.822956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:44.826991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:44.844187 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00235fce-47eb-40bd-a3e3-fc610162c345 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1351 microversion: 2.1 time: 0.344264 Jun 04 21:00:44.844761 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1012/2093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:44 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1351 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:44.995730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:45.009885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ee3fdb7-35ee-400b-91d0-d99fee99f06b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.202412 Jun 04 21:00:45.010572 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1082/2094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:44 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:45.029358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:45.030296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:45.043603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.044071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.045083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.045527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.117219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:45.119199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:45.150581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.153477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.155115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.158905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.611595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:45.620875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:45.629392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:45.630895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:45.632198 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e5cce01-88ce-49e2-978b-f10472c6e1e9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1548 microversion: 2.25 time: 0.531162 Jun 04 21:00:45.633175 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1083/2095] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:45 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1548 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:45.643988 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c883beba-ff41-48db-a37f-b8dd4c0caf7b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.604690 Jun 04 21:00:45.649399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:45.650163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:45.656021 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1013/2096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:45 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:45.662074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:45.662673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:45.666958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.668632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.669921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.670067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.670544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.671351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.671749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.671906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.778422 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66061f34-20ee-4c72-9d1c-a4487f2b15f9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 202 len: 0 microversion: 2.1 time: 0.118503 Jun 04 21:00:45.783542 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1014/2097] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:45 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:00:45.792954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:45.793964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:45.803596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.804937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:45.806523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:45.807155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.368864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:46.381465 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e90b898c-4674-4099-9b75-81dd208261dc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1313 microversion: 2.1 time: 0.595316 Jun 04 21:00:46.383835 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1015/2098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:45 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:46.389349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:46.390091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:46.406495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:46.418432 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72b54103-c499-4b14-9b43-b928138cc121 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1676 microversion: 2.1 time: 0.782353 Jun 04 21:00:46.418681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.419323 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1084/2099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:45 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1676 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:46.430341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.430341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.430341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.436701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:46.439249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:46.451032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.451660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.453309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.453853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.822253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:46.856559 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17491649-5b38-4170-9dd6-59a70c6aa45e tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1541 microversion: 2.1 time: 0.435851 Jun 04 21:00:46.857485 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1085/2100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:46 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1541 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:46.872229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:46.873071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:46.886966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.887620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.889225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.890953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.908838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:46.920231 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1409316a-37c5-45b1-9914-bd27f5121fac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1490 microversion: 2.1 time: 0.535168 Jun 04 21:00:46.923449 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1016/2101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:46 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1490 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:46.933591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:46.938736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:46.953871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.955775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.958055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:46.959562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:46.966186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:46.975088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:47.005767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.006561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.007193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lazy-loading 'fault' on Instance uuid 733596ac-52ff-421c-8693-fb08a213ca15 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:47.071773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:47.108317 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1f5cfae-4465-4422-b89b-9c0e90283b75 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 204 len: 0 microversion: 2.1 time: 0.247220 Jun 04 21:00:47.111564 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1086/2102] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:46 2022] DELETE /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:47.123292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:47.124778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-755fc9f2-1235-4a30-b411-49f2f57b883a req-174aa58d-1329-4df8-8167-0b5bd194f21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc", "tag": "f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f"}, {"server_uuid": "733596ac-52ff-421c-8693-fb08a213ca15", "name": "network-vif-deleted", "tag": "3af2fa06-745e-409f-9676-ffd6b6ffa5ca"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:47.126349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:47.127703 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3481e67c-1fec-44a3-ae65-e74c6fce5acc tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 200 len: 1351 microversion: 2.25 time: 0.201543 Jun 04 21:00:47.150941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1017/2103] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:46 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 1351 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:47.155866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-755fc9f2-1235-4a30-b411-49f2f57b883a req-174aa58d-1329-4df8-8167-0b5bd194f21f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.156725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-755fc9f2-1235-4a30-b411-49f2f57b883a req-174aa58d-1329-4df8-8167-0b5bd194f21f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.160322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:47.161331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:47.176789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.182410 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-755fc9f2-1235-4a30-b411-49f2f57b883a req-174aa58d-1329-4df8-8167-0b5bd194f21f service nova] Creating event network-changed:f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f for instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc on nch2-master-1 Jun 04 21:00:47.184168 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-755fc9f2-1235-4a30-b411-49f2f57b883a req-174aa58d-1329-4df8-8167-0b5bd194f21f service nova] Creating event network-vif-deleted:3af2fa06-745e-409f-9676-ffd6b6ffa5ca for instance 733596ac-52ff-421c-8693-fb08a213ca15 on nch1-master-1 Jun 04 21:00:47.190213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.194841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.196487 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-755fc9f2-1235-4a30-b411-49f2f57b883a req-174aa58d-1329-4df8-8167-0b5bd194f21f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081268 Jun 04 21:00:47.196927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.199773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1087/2104] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:47.207961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:47.208602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:47.217613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.218469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.219459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.220280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.261766 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'pause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state paused Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 13 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: {"pause": {}} Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'pause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state paused Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'pause': {}}} Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state paused. Cannot pause while the instance is in this state. Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state paused Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:47.263448 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:47.268938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:47.268938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:47.268938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:47.268938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state paused Jun 04 21:00:47.268938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:47.270553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'pause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state paused {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:47.271782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82ec8958-b2c3-4610-a285-93e75049cb5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 143 microversion: 2.1 time: 0.069814 Jun 04 21:00:47.272380 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1088/2105] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:47 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 143 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:47.278337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:47.278958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:47.290102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.292402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.293760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.294698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.496569 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6a86a0a-85af-4f73-86ab-bc6733776037 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344316 Jun 04 21:00:47.497186 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1018/2106] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:00:47 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6/os-interface => generated 285 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:47.508940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:47.509799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:47.517380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.518187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.519253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.519998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.626545 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dfc9d5c7-a1cf-4782-898c-ee745720907d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 202 len: 0 microversion: 2.1 time: 0.121017 Jun 04 21:00:47.627933 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1019/2107] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:47 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:00:47.653803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5bb66dd1-194e-43ed-bfa6-642e0a4eab6a req-302dd7e1-e388-4514-aa1d-412eecea9795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "name": "network-vif-deleted", "tag": "1bfd296a-5b0b-4aaf-bf31-6c50c2a96d0c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:47.675682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5bb66dd1-194e-43ed-bfa6-642e0a4eab6a req-302dd7e1-e388-4514-aa1d-412eecea9795 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.676668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5bb66dd1-194e-43ed-bfa6-642e0a4eab6a req-302dd7e1-e388-4514-aa1d-412eecea9795 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.698534 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5bb66dd1-194e-43ed-bfa6-642e0a4eab6a req-302dd7e1-e388-4514-aa1d-412eecea9795 service nova] Creating event network-vif-deleted:1bfd296a-5b0b-4aaf-bf31-6c50c2a96d0c for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:47.706564 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5bb66dd1-194e-43ed-bfa6-642e0a4eab6a req-302dd7e1-e388-4514-aa1d-412eecea9795 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076863 Jun 04 21:00:47.709707 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1020/2108] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:47.719984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:47.720932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:47.732075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.732852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.733752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.734206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.872038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:47.881039 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f969b856-75d0-48de-89d3-329f3a5aa218 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1553 microversion: 2.1 time: 0.607210 Jun 04 21:00:47.891958 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1089/2109] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:47 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1553 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:47.897643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:47.898867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:47.905959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.906691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:47.907759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:47.908450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:48.605734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:48.615985 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cfe371e1-0b44-4be6-99b3-37bfc9b05393 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1313 microversion: 2.1 time: 0.903601 Jun 04 21:00:48.616981 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1021/2110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:47 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:48.624444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-54224403-18f8-426f-9a68-60579ecb86f7 req-87f9e8a8-7b20-46e4-b924-e2cef2757a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "name": "network-vif-unplugged", "status": "completed", "tag": "737c1c2d-0c86-4ca1-8201-fc1a26dd5f76"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:48.633189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-54224403-18f8-426f-9a68-60579ecb86f7 req-87f9e8a8-7b20-46e4-b924-e2cef2757a7d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:48.633680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-54224403-18f8-426f-9a68-60579ecb86f7 req-87f9e8a8-7b20-46e4-b924-e2cef2757a7d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:48.645193 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-54224403-18f8-426f-9a68-60579ecb86f7 req-87f9e8a8-7b20-46e4-b924-e2cef2757a7d service nova] Creating event network-vif-unplugged:737c1c2d-0c86-4ca1-8201-fc1a26dd5f76 for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:48.651670 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-54224403-18f8-426f-9a68-60579ecb86f7 req-87f9e8a8-7b20-46e4-b924-e2cef2757a7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032762 Jun 04 21:00:48.652569 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1022/2111] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:48.657907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:48.658803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:48.665640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:48.666046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81630e4b323d43a08a368471273a2989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e0e340cb8d4a64bdfeafcba8908f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:48.666296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:48.667275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:48.667948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:48.690605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-476e30cf-d54e-4e66-a447-fca7a8d1d098 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 200 len: 1497 microversion: 2.1 time: 0.797100 Jun 04 21:00:48.693769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1090/2112] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:47 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 1497 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:48.705861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:48.706585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 733596ac-52ff-421c-8693-fb08a213ca15] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:48.717588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:48.718038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:48.718968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:48.720087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:48.735779 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] HTTP exception thrown: Instance 733596ac-52ff-421c-8693-fb08a213ca15 could not be found. Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Request method failure captured: Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 HTTP/1.1 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8cDdVpJYuSAoSfcGnCbmQsckGG7Qxg6dKXeLE0KG6YWBk9LeyctMfLEYSWfEwYRTuhMCUfoND2WAD7msoF1T1PIAWPDHjigOO89fbSdUOqBSUmjCNTcNxiQqH5dlRWbxz1EeaHJfnMc1K8oSX8UnMehTa7inLX8ugjBUniQ5eEMwNQ Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.25 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: e25328c90d26437a85d8d5509437ed99 Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 733596ac-52ff-421c-8693-fb08a213ca15 could not be found. Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '733596ac-52ff-421c-8693-fb08a213ca15'} Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 733596ac-52ff-421c-8693-fb08a213ca15 could not be found. Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 733596ac-52ff-421c-8693-fb08a213ca15 could not be found. Jun 04 21:00:48.737410 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 733596ac-52ff-421c-8693-fb08a213ca15 could not be found. Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Returning 404 to user: Instance 733596ac-52ff-421c-8693-fb08a213ca15 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f1d21be-7db0-44a7-ab79-9bae665737ec tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15" status: 404 len: 111 microversion: 2.25 time: 0.044914 Jun 04 21:00:48.747099 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1091/2113] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:48 2022] GET /compute/v2.1/servers/733596ac-52ff-421c-8693-fb08a213ca15 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:48.873527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1515351854", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "cb31943d-3a91-4b52-84f6-c98fcd43073f"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:48.933585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] validate_networks() for [('cb31943d-3a91-4b52-84f6-c98fcd43073f', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:49.129461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:49.139373 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-848ee6d4-eab8-4dc8-b2f3-e450dbcf9113 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.485427 Jun 04 21:00:49.140338 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1023/2114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:48 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:49.145311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:49.151753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:49.162033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:49.162837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:49.164948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:49.165577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:49.209167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:49.268305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:49.361010 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b9d4f125-848e-4e4e-a5d4-80ddf3b7fb33 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 204 len: 0 microversion: 2.25 time: 0.218770 Jun 04 21:00:49.365433 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1024/2115] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:00:49 2022] DELETE /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:00:49.372191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:49.373184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:49.380702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:49.380875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:49.382482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:49.383298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:49.879994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:49.888583 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-069f9e12-fc7c-49fe-a965-afa11da155ed tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 200 len: 1553 microversion: 2.1 time: 0.521733 Jun 04 21:00:49.897695 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1025/2116] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:49 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 1553 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:49.897695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:49.897695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:49.902048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:49.903282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:49.904301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:49.904734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.049955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:50.076408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:50.462195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:50.463376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:50.464173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:50.464992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:50.466147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:50.484630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.485425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.488012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.488779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.513491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:50.519468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:50.532101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for user d96f5288364449e3af2f39c71a8c3ef2 and project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:50.534374 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebeb3fdb-04ef-439e-a5e7-344e1ecae07d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.643768 Jun 04 21:00:50.535356 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1026/2117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:49 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:50.548557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4a7aaeb4-2959-4c4c-9296-ce9cd862ad03 req-fe1f133b-5bfe-4040-a7ae-bb77d86f7fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44488ee-6a65-404c-8907-02ee23f75774", "tag": "471386bb-e273-4917-a745-e543e8ccf6e1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:50.564450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4a7aaeb4-2959-4c4c-9296-ce9cd862ad03 req-fe1f133b-5bfe-4040-a7ae-bb77d86f7fb9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.564960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:50.565353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4a7aaeb4-2959-4c4c-9296-ce9cd862ad03 req-fe1f133b-5bfe-4040-a7ae-bb77d86f7fb9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.574970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:50.581724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4a7aaeb4-2959-4c4c-9296-ce9cd862ad03 req-fe1f133b-5bfe-4040-a7ae-bb77d86f7fb9 service nova] Creating event network-changed:471386bb-e273-4917-a745-e543e8ccf6e1 for instance b44488ee-6a65-404c-8907-02ee23f75774 on nch2-master-1 Jun 04 21:00:50.588993 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4a7aaeb4-2959-4c4c-9296-ce9cd862ad03 req-fe1f133b-5bfe-4040-a7ae-bb77d86f7fb9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052221 Jun 04 21:00:50.589979 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1027/2118] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:50.596829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:50.597540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:50.608358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.609183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.610168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.610807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.658080 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61348b49-2679-47a2-91cc-38780ba148e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915113 Jun 04 21:00:50.659113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1092/2119] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:50.664916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:50.665880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:50.672721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.674131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.675370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.676077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.767302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:50.781860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:50.783769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e25328c90d26437a85d8d5509437ed99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5ccb3a1d6f4f9e9eaad08d25ce57fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:50.785333 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-55905223-18bb-48d4-8991-5d4367023003 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 200 len: 1347 microversion: 2.25 time: 0.193949 Jun 04 21:00:50.786580 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1028/2120] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:50 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 1347 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:00:50.806389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:50.807404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:50.817053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.817808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.819728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.820427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.846627 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] HTTP exception thrown: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Request method failure captured: Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 HTTP/1.1 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eUunCuiBASsc9D7a2ghikcmsPdo34X0hjy78locJq2Tn0q1hq5Bgh0Q7sLDpcIYiu3kYcQEBpn_77SzF7mem9rxdyP8yO5lyYz0chUvpB2CT_XIBNGyVBaHxA2GvEH-URgTW5qVkr2iSqCEZnzVjkmJxtU4N9mSYRcdqi0JEWdBhU Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 81630e4b323d43a08a368471273a2989 Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f564b5ba-622e-46ce-8fa7-d482909b7337'} Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:50.848831 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Returning 404 to user: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-619c4efb-ca54-4490-afae-d88c8bd0c971 tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 404 len: 111 microversion: 2.1 time: 0.062561 Jun 04 21:00:50.857188 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1029/2121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:50 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:50.858938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4d0621ad-7bcb-48d7-a11c-24b3f4f4c214 req-aebc2c0a-381d-4573-a1c6-6d1da595af10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f564b5ba-622e-46ce-8fa7-d482909b7337", "name": "network-vif-deleted", "tag": "737c1c2d-0c86-4ca1-8201-fc1a26dd5f76"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:50.869904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d0621ad-7bcb-48d7-a11c-24b3f4f4c214 req-aebc2c0a-381d-4573-a1c6-6d1da595af10 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.870667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d0621ad-7bcb-48d7-a11c-24b3f4f4c214 req-aebc2c0a-381d-4573-a1c6-6d1da595af10 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.890912 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4d0621ad-7bcb-48d7-a11c-24b3f4f4c214 req-aebc2c0a-381d-4573-a1c6-6d1da595af10 service nova] Creating event network-vif-deleted:737c1c2d-0c86-4ca1-8201-fc1a26dd5f76 for instance f564b5ba-622e-46ce-8fa7-d482909b7337 on nch2-master-1 Jun 04 21:00:50.903324 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4d0621ad-7bcb-48d7-a11c-24b3f4f4c214 req-aebc2c0a-381d-4573-a1c6-6d1da595af10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048393 Jun 04 21:00:50.905010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1030/2122] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:50.916588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:50.920575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:50.930602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.931476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.932687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:50.934466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:50.956023 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a/action HTTP/1.1 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 28 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: {"reboot": {"type": "SOFT"}} Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '414c25e0-f653-44da-8176-7c2c73883c6a', 'body': {'reboot': {'type': 'SOFT'}}} Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:50.958713 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:50.964460 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:50.968710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:50.969871 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e2d25639-2053-4afe-83f4-7fb38aa96721 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a/action" status: 404 len: 111 microversion: 2.1 time: 0.063040 Jun 04 21:00:50.983031 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1031/2123] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:50 2022] POST /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:50.992015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-11e9052f-6b88-42e1-bdc6-0d5ee176266d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:50.992947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-11e9052f-6b88-42e1-bdc6-0d5ee176266d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.005009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:51.007606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:51.017213 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3912fd64-75b9-4a1b-b7df-66960f78cd47 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1313 microversion: 2.1 time: 0.356544 Jun 04 21:00:51.019398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1093/2124] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:50 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:51.033185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:51.035029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.050292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.053133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.055887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.056485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.105470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-11e9052f-6b88-42e1-bdc6-0d5ee176266d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:51.125768 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-11e9052f-6b88-42e1-bdc6-0d5ee176266d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1208 microversion: 2.1 time: 0.141027 Jun 04 21:00:51.135445 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1032/2125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:50 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1208 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:51.135445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:51.135445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.147180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.148392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.150062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.150809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.412481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:51.426543 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed9f97e5-397b-4bd2-86e9-b781bbbae783 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.298395 Jun 04 21:00:51.427167 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1033/2126] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:51 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:51.451364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:51.452263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.464771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.466514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.468028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.471494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.585309 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 HTTP/1.1 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '87aaf5f4-6faf-4ce7-bdd1-70d1a879d015'} Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:51.590161 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:51.598787 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.620863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:51.621363 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3b21737-d788-44ee-9211-eafcd4443cdb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 404 len: 111 microversion: 2.1 time: 0.598857 Jun 04 21:00:51.623147 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1094/2127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:51 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 111 bytes in 603 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:51.808902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:51.809612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] [instance: 0b7b6b65-2659-4310-b317-0de0ef27ae4f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.824844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.832341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.836733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.839184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.886340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:51.897360 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cf60748d-6ef5-44a0-a084-6e02a4501b89 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.451318 Jun 04 21:00:51.897974 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1034/2128] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:51 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:00:51.900024 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] HTTP exception thrown: Instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f could not be found. Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Request method failure captured: Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f HTTP/1.1 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8cDdVpJYuSAoSfcGnCbmQsckGG7Qxg6dKXeLE0KG6YWBk9LeyctMfLEYSWfEwYRTuhMCUfoND2WAD7msoF1T1PIAWPDHjigOO89fbSdUOqBSUmjCNTcNxiQqH5dlRWbxz1EeaHJfnMc1K8oSX8UnMehTa7inLX8ugjBUniQ5eEMwNQ Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.25 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af5ccb3a1d6f4f9e9eaad08d25ce57fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: af5ccb3a1d6f4f9e9eaad08d25ce57fd Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: e25328c90d26437a85d8d5509437ed99 Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1858155877-project Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f could not be found. Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0b7b6b65-2659-4310-b317-0de0ef27ae4f'} Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f could not be found. Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f could not be found. Jun 04 21:00:51.901936 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f could not be found. Jun 04 21:00:51.906529 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.916552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] Returning 404 to user: Instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:51.918928 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1120d67e-a274-45e1-9677-da7e137693d9 tempest-LiveAutoBlockMigrationV225Test-1858155877 tempest-LiveAutoBlockMigrationV225Test-1858155877-project] 10.222.0.18 "GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f" status: 404 len: 111 microversion: 2.25 time: 0.117996 Jun 04 21:00:51.925891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:51.926543 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1095/2129] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:00:51 2022] GET /compute/v2.1/servers/0b7b6b65-2659-4310-b317-0de0ef27ae4f => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:51.928091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.937499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6165d85e-b869-4d5a-8549-6fd5c97375ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:51.943276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6165d85e-b869-4d5a-8549-6fd5c97375ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.945238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.946412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:51.953445 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-6165d85e-b869-4d5a-8549-6fd5c97375ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72 could not be found. Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6165d85e-b869-4d5a-8549-6fd5c97375ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/8efe9fcd-6434-49c0-a6ce-8bd45cde1b72/action HTTP/1.1 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 28 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: {"reboot": {"type": "SOFT"}} Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72 could not be found. Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8efe9fcd-6434-49c0-a6ce-8bd45cde1b72', 'body': {'reboot': {'type': 'SOFT'}}} Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72 could not be found. Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72 could not be found. Jun 04 21:00:51.955330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72 could not be found. Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6165d85e-b869-4d5a-8549-6fd5c97375ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 8efe9fcd-6434-49c0-a6ce-8bd45cde1b72 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6165d85e-b869-4d5a-8549-6fd5c97375ed tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/8efe9fcd-6434-49c0-a6ce-8bd45cde1b72/action" status: 404 len: 111 microversion: 2.1 time: 0.030241 Jun 04 21:00:51.959940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1096/2130] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:51 2022] POST /compute/v2.1/servers/8efe9fcd-6434-49c0-a6ce-8bd45cde1b72/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:51.967256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:51.969020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:51.969606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:51.970523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.003342 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:52.019270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.020993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.025438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015/os-volume_attachments HTTP/1.1 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': '87aaf5f4-6faf-4ce7-bdd1-70d1a879d015'} Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:52.026796 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:52.033392 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60b743d5-0542-42ee-9b22-d4e906a25f6a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.132047 Jun 04 21:00:52.034993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.036027 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1035/2131] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:00:51 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015/os-volume_attachments => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:52.049014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:52.053046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:52.068386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.073214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.075796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.076496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.560049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:52.573767 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae8c8fb5-7c7f-4e51-88a8-6c3f7bbae2de tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.610476 Jun 04 21:00:52.586281 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1097/2132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:51 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:00:52.591887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d22b328b-12df-4cd8-8e39-22b59363827c req-d67a6e82-1cf0-4511-85fc-725714e96bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44488ee-6a65-404c-8907-02ee23f75774", "name": "network-vif-plugged", "status": "completed", "tag": "471386bb-e273-4917-a745-e543e8ccf6e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:52.615020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d22b328b-12df-4cd8-8e39-22b59363827c req-d67a6e82-1cf0-4511-85fc-725714e96bcd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.615466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d22b328b-12df-4cd8-8e39-22b59363827c req-d67a6e82-1cf0-4511-85fc-725714e96bcd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.644563 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d22b328b-12df-4cd8-8e39-22b59363827c req-d67a6e82-1cf0-4511-85fc-725714e96bcd service nova] Creating event network-vif-plugged:471386bb-e273-4917-a745-e543e8ccf6e1 for instance b44488ee-6a65-404c-8907-02ee23f75774 on nch2-master-1 Jun 04 21:00:52.656505 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d22b328b-12df-4cd8-8e39-22b59363827c req-d67a6e82-1cf0-4511-85fc-725714e96bcd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067840 Jun 04 21:00:52.661809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:52.665695 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1098/2133] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:52.671416 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d243720d-0753-4d37-9150-b34975ebdab3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1313 microversion: 2.1 time: 0.632412 Jun 04 21:00:52.679077 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1036/2134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:52 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:52.683244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:52.688390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:52.696302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-742811878", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:52.707122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.707942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.709006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.721220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.791967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:52.927724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:52.945595 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d8904d91-3579-443e-b293-35c1296a29b2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1266 microversion: 2.1 time: 0.271796 Jun 04 21:00:52.947134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1099/2135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:52 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:52.952687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:52.953571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:52.960775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.961504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:52.962474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:52.963057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.334502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:53.344661 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19159fac-6328-40fd-9737-14f575b15b3f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.396021 Jun 04 21:00:53.345149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1100/2136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:52 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:53.350103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-001052cb-3a64-4293-b7e2-4bcff07250e2 req-4f2b0ac9-95cf-4131-b441-fb6886fa5bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87aaf5f4-6faf-4ce7-bdd1-70d1a879d015", "name": "network-vif-deleted", "tag": "66951d04-0f6b-4841-a05d-c0335707cb34"}, {"server_uuid": "0b7b6b65-2659-4310-b317-0de0ef27ae4f", "name": "network-vif-deleted", "tag": "eae0c7d0-b5b1-4b5a-a0cd-a7245b049763"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:53.360807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-001052cb-3a64-4293-b7e2-4bcff07250e2 req-4f2b0ac9-95cf-4131-b441-fb6886fa5bbd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.361249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-001052cb-3a64-4293-b7e2-4bcff07250e2 req-4f2b0ac9-95cf-4131-b441-fb6886fa5bbd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.382481 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-001052cb-3a64-4293-b7e2-4bcff07250e2 req-4f2b0ac9-95cf-4131-b441-fb6886fa5bbd service nova] Creating event network-vif-deleted:66951d04-0f6b-4841-a05d-c0335707cb34 for instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 on nch1-master-1 Jun 04 21:00:53.383233 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-001052cb-3a64-4293-b7e2-4bcff07250e2 req-4f2b0ac9-95cf-4131-b441-fb6886fa5bbd service nova] Creating event network-vif-deleted:eae0c7d0-b5b1-4b5a-a0cd-a7245b049763 for instance 0b7b6b65-2659-4310-b317-0de0ef27ae4f on nch1-master-1 Jun 04 21:00:53.394076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-001052cb-3a64-4293-b7e2-4bcff07250e2 req-4f2b0ac9-95cf-4131-b441-fb6886fa5bbd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047200 Jun 04 21:00:53.394702 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1101/2137] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:53.402758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1be2f0ce-7849-48fc-8fe5-654ba0b04eed req-f8358236-3b3c-4cdf-89b7-7a1544cc9ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989d37f9-1809-4c90-b21e-b602ea326af6", "tag": "6abbedee-2a93-43a3-924c-d0dcd6574754"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:53.414784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1be2f0ce-7849-48fc-8fe5-654ba0b04eed req-f8358236-3b3c-4cdf-89b7-7a1544cc9ae9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.415355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1be2f0ce-7849-48fc-8fe5-654ba0b04eed req-f8358236-3b3c-4cdf-89b7-7a1544cc9ae9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.430976 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1be2f0ce-7849-48fc-8fe5-654ba0b04eed req-f8358236-3b3c-4cdf-89b7-7a1544cc9ae9 service nova] Creating event network-changed:6abbedee-2a93-43a3-924c-d0dcd6574754 for instance 989d37f9-1809-4c90-b21e-b602ea326af6 on nch1-master-1 Jun 04 21:00:53.438441 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1be2f0ce-7849-48fc-8fe5-654ba0b04eed req-f8358236-3b3c-4cdf-89b7-7a1544cc9ae9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042349 Jun 04 21:00:53.439917 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1102/2138] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:53.446943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:53.448709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:53.455636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.456214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.457137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.457643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.475064 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a/action HTTP/1.1 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 65 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '414c25e0-f653-44da-8176-7c2c73883c6a', 'body': {'rebuild': {'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf'}}} Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 04 21:00:53.477168 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bcad51f2-38ad-4866-bbd4-00567e4a2793 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a/action" status: 404 len: 111 microversion: 2.1 time: 0.038668 Jun 04 21:00:53.482492 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1103/2139] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:53 2022] POST /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:53.491164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:53.491990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:53.499500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.500074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.500928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.501438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.702320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:53.703350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:53.704057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:53.704690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:53.705176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:53.716728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.717588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.718617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.719279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.749060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:53.766208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:53.786852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:53.790168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:53.837539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:53.847346 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-385a662d-54e7-4e50-a8a5-50454e39c92b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.360100 Jun 04 21:00:53.850315 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1104/2140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:53 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:00:53.850807 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02f3e0f1-f10f-43c9-9074-1562ccdcff9b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170091 Jun 04 21:00:53.852794 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1037/2141] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:53.860509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:53.863801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:53.874200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.874821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.876394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:53.877211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:53.897480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c3943cb-e51f-4101-a709-d4e05193168b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:53.898561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2c3943cb-e51f-4101-a709-d4e05193168b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:54.159208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2c3943cb-e51f-4101-a709-d4e05193168b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:54.184276 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c3943cb-e51f-4101-a709-d4e05193168b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530" status: 200 len: 1214 microversion: 2.1 time: 0.306648 Jun 04 21:00:54.186610 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1038/2142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:53 2022] GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 => generated 1214 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:54.199662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:54.200987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:54.218638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.221183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:54.222411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.222856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:54.283099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:54.312437 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ac5a57a-4368-4eeb-9504-e79a1303ff9b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1313 microversion: 2.1 time: 0.443244 Jun 04 21:00:54.316845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1105/2143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:53 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:54.329452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:54.331016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:54.344713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.345802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:54.347608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.348287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:54.593455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:54.605074 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b095c985-dfa1-4a8f-9088-e7e2226694bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.416811 Jun 04 21:00:54.606004 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1039/2144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:54 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:54.620389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:54.620903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:54.682159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:00:54.705819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.707055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:54.725824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'flavor' on Instance uuid 890b5288-ac78-4da0-af4d-6f14bf779530 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:54.739982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'system_metadata' on Instance uuid 890b5288-ac78-4da0-af4d-6f14bf779530 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:54.743085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:54.753340 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ac793f1c-aea5-48de-9a72-f72f8736a661 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.434516 Jun 04 21:00:54.756854 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1106/2145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:54 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:54.770538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c03cf81d-c146-4f14-b8a4-95324328632d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:54.772338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c03cf81d-c146-4f14-b8a4-95324328632d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 0ac9c5c4-f051-43a3-8d39-cc1819926d4e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:54.781605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-c03cf81d-c146-4f14-b8a4-95324328632d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 0ac9c5c4-f051-43a3-8d39-cc1819926d4e could not be found. Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c03cf81d-c146-4f14-b8a4-95324328632d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/0ac9c5c4-f051-43a3-8d39-cc1819926d4e/action HTTP/1.1 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 65 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 0ac9c5c4-f051-43a3-8d39-cc1819926d4e could not be found. Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0ac9c5c4-f051-43a3-8d39-cc1819926d4e', 'body': {'rebuild': {'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf'}}} Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ac9c5c4-f051-43a3-8d39-cc1819926d4e could not be found. Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 04 21:00:54.783452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ac9c5c4-f051-43a3-8d39-cc1819926d4e could not be found. Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ac9c5c4-f051-43a3-8d39-cc1819926d4e could not be found. Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c03cf81d-c146-4f14-b8a4-95324328632d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 0ac9c5c4-f051-43a3-8d39-cc1819926d4e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:54.789792 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c03cf81d-c146-4f14-b8a4-95324328632d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/0ac9c5c4-f051-43a3-8d39-cc1819926d4e/action" status: 404 len: 111 microversion: 2.1 time: 0.025342 Jun 04 21:00:54.801552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1107/2146] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:54 2022] POST /compute/v2.1/servers/0ac9c5c4-f051-43a3-8d39-cc1819926d4e/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:54.803540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'metadata' on Instance uuid 890b5288-ac78-4da0-af4d-6f14bf779530 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:00:54.812403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:54.814433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:54.825433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.826314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:54.828778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:54.829399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.006978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:55.015610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-947fcc34-ea21-4070-bad0-393e8024d919 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.209631 Jun 04 21:00:55.016354 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1108/2147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:54 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:55.034582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:55.035546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.043705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.046288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.047647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.048545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.331193 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.scheduler.client.report [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Deleted allocations for instance 890b5288-ac78-4da0-af4d-6f14bf779530 Jun 04 21:00:55.348951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:55.356820 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-703c900a-5f2f-483e-960f-8ebf0e741d1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530" status: 204 len: 0 microversion: 2.1 time: 0.749654 Jun 04 21:00:55.357530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1040/2148] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:54 2022] DELETE /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:00:55.366225 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-92394c35-2eb9-4dda-a3a2-bde90be46825 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.336112 Jun 04 21:00:55.367297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:55.367793 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1109/2149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:55 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:55.368545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.372498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:55.373121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.377690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.378493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.379568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.380225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.393387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.393844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.395233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.395886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.402095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:55.414158 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 HTTP/1.1 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '890b5288-ac78-4da0-af4d-6f14bf779530'} Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:55.416016 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:55.422151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3499a84b-f098-4165-b037-55dfef330ad1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530" status: 404 len: 111 microversion: 2.1 time: 0.048705 Jun 04 21:00:55.427357 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1110/2150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:55 2022] GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:55.432854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-96a51021-ab01-4bdc-9ae5-20571dc78a1c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:55.433404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-96a51021-ab01-4bdc-9ae5-20571dc78a1c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.440632 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-96a51021-ab01-4bdc-9ae5-20571dc78a1c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b could not be found. Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-96a51021-ab01-4bdc-9ae5-20571dc78a1c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/3cef8a36-8ac1-4f5a-8f15-e87609f56b3b/action HTTP/1.1 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: {"restore": {}} Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b could not be found. Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '3cef8a36-8ac1-4f5a-8f15-e87609f56b3b', 'body': {'restore': {}}} Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b could not be found. Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b could not be found. Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:55.442388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b could not be found. Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-96a51021-ab01-4bdc-9ae5-20571dc78a1c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 3cef8a36-8ac1-4f5a-8f15-e87609f56b3b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-96a51021-ab01-4bdc-9ae5-20571dc78a1c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/3cef8a36-8ac1-4f5a-8f15-e87609f56b3b/action" status: 404 len: 111 microversion: 2.1 time: 0.015392 Jun 04 21:00:55.447643 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1111/2151] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:55 2022] POST /compute/v2.1/servers/3cef8a36-8ac1-4f5a-8f15-e87609f56b3b/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:55.455281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:55.455966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.466444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.467071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.468231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.468682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.634233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:55.644035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1ab94214-cea9-4420-892e-c09d78fbc8e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1463 microversion: 2.1 time: 0.281739 Jun 04 21:00:55.656924 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1041/2152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:55 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1463 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:55.663351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-533179775", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:55.698284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:55.709076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-275d2503-41ed-4d7e-80ca-803b79eda546 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.259228 Jun 04 21:00:55.710326 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1112/2153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:55 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:55.715638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:55.716219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.731284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.731704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.732593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.733158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.735328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:00:55.747998 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] HTTP exception thrown: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Request method failure captured: Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 HTTP/1.1 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eUunCuiBASsc9D7a2ghikcmsPdo34X0hjy78locJq2Tn0q1hq5Bgh0Q7sLDpcIYiu3kYcQEBpn_77SzF7mem9rxdyP8yO5lyYz0chUvpB2CT_XIBNGyVBaHxA2GvEH-URgTW5qVkr2iSqCEZnzVjkmJxtU4N9mSYRcdqi0JEWdBhU Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 81630e4b323d43a08a368471273a2989 Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f564b5ba-622e-46ce-8fa7-d482909b7337'} Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:55.749717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Returning 404 to user: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64baffc1-4a0e-43b9-a373-ae30e85f47da tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 404 len: 111 microversion: 2.1 time: 0.039896 Jun 04 21:00:55.757684 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1113/2154] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:55 2022] DELETE /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:55.760345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:55.761382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:55.763267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:55.769268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.770016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.770992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:55.771962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:55.895354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:55.911196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Old instance type m1.heat2, new instance type m1.heat {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:00:55.923036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:55.923468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:55.923977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:55.924383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:55.930573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:56.072017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e542db9f-48c8-47eb-acd4-fb8a97a61fc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774/action" status: 202 len: 0 microversion: 2.1 time: 0.315082 Jun 04 21:00:56.075914 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1114/2155] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:55 2022] POST /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:00:56.085161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:56.086269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:56.096728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.097445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.098706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.099410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.768286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:56.784833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:00:56.786079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:00:56.786915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:00:56.787570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:00:56.788228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:00:56.798270 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fb7e1803-30a9-45de-947d-02dfb5afc55b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.721809 Jun 04 21:00:56.801586 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1115/2156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:56 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:56.802150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.802882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.803979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.805198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.814831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:56.815480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: f564b5ba-622e-46ce-8fa7-d482909b7337] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:56.834210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.835662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.838089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:00:56.839526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.840348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.850548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:00:56.873093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:00:56.877063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:00:56.882160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] HTTP exception thrown: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Request method failure captured: Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 HTTP/1.1 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eUunCuiBASsc9D7a2ghikcmsPdo34X0hjy78locJq2Tn0q1hq5Bgh0Q7sLDpcIYiu3kYcQEBpn_77SzF7mem9rxdyP8yO5lyYz0chUvpB2CT_XIBNGyVBaHxA2GvEH-URgTW5qVkr2iSqCEZnzVjkmJxtU4N9mSYRcdqi0JEWdBhU Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 81630e4b323d43a08a368471273a2989 Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f564b5ba-622e-46ce-8fa7-d482909b7337'} Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:56.885131 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Returning 404 to user: Instance f564b5ba-622e-46ce-8fa7-d482909b7337 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59620648-1fcc-43e4-a714-ee599fe6bcda tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337" status: 404 len: 111 microversion: 2.1 time: 0.082937 Jun 04 21:00:56.894860 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1116/2157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:56 2022] GET /compute/v2.1/servers/f564b5ba-622e-46ce-8fa7-d482909b7337 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:56.900205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:56.904151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:56.919183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.920757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.922644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:56.923106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:56.970983 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f00604db-444f-42b7-bfe7-3391bafd6c33 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310545 Jun 04 21:00:56.973443 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1042/2158] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:00:57.011552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:57.015045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.026940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.027394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.028500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.028946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.338560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:57.351125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d97b5572-f2d9-4460-8e3c-ba5b259cc433 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.462659 Jun 04 21:00:57.352435 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1117/2159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:56 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:57.357349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c91f0e41-e3db-4f77-bec9-1b375ff4a254 req-9284acab-5f36-4640-8fd1-0968b64dc6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3220a33d-d40a-40ba-9569-27179eeb3979", "tag": "a010160e-6e0c-4393-9c1a-97cd5d792950"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:57.377593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c91f0e41-e3db-4f77-bec9-1b375ff4a254 req-9284acab-5f36-4640-8fd1-0968b64dc6dd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.378102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c91f0e41-e3db-4f77-bec9-1b375ff4a254 req-9284acab-5f36-4640-8fd1-0968b64dc6dd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.391827 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c91f0e41-e3db-4f77-bec9-1b375ff4a254 req-9284acab-5f36-4640-8fd1-0968b64dc6dd service nova] Creating event network-changed:a010160e-6e0c-4393-9c1a-97cd5d792950 for instance 3220a33d-d40a-40ba-9569-27179eeb3979 on nch1-master-1 Jun 04 21:00:57.403296 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c91f0e41-e3db-4f77-bec9-1b375ff4a254 req-9284acab-5f36-4640-8fd1-0968b64dc6dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049284 Jun 04 21:00:57.404265 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1118/2160] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:00:57.410532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:57.411777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.420047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.420539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.421340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.421786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.432275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:57.443656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:00:57.449981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a0d3fc91-70c9-4695-815e-ccce58c6bf68 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1472 microversion: 2.1 time: 0.474127 Jun 04 21:00:57.450764 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'restore' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: {"restore": {}} Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'restore' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'restore': {}}} Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state active. Cannot restore while the instance is in this state. Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.453209 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'restore' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:57.459037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a84cc4d7-d76a-46dd-8238-5edb266844ae tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 145 microversion: 2.1 time: 0.049100 Jun 04 21:00:57.459813 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1043/2162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:56 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1472 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:57.459940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1119/2162] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:57 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:57.464643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c7ed8c0-26eb-4f00-9d65-20faf4d01e90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:57.465270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c7ed8c0-26eb-4f00-9d65-20faf4d01e90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.467325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:57.468064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.491450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.492238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.493042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.493565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.514819 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] HTTP exception thrown: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Request method failure captured: Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 HTTP/1.1 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eUunCuiBASsc9D7a2ghikcmsPdo34X0hjy78locJq2Tn0q1hq5Bgh0Q7sLDpcIYiu3kYcQEBpn_77SzF7mem9rxdyP8yO5lyYz0chUvpB2CT_XIBNGyVBaHxA2GvEH-URgTW5qVkr2iSqCEZnzVjkmJxtU4N9mSYRcdqi0JEWdBhU Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 81630e4b323d43a08a368471273a2989 Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '0f7ff568-6656-41de-b3c0-ada352adc3d1'} Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:57.516778 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Returning 404 to user: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b72e75dc-a144-4f57-9c6e-cffe751461cf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 404 len: 111 microversion: 2.1 time: 0.056862 Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1044/2163] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:00:57 2022] DELETE /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:57.527306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.534192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.534639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.535634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.535921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.556727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4c7ed8c0-26eb-4f00-9d65-20faf4d01e90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:57.565785 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c7ed8c0-26eb-4f00-9d65-20faf4d01e90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1214 microversion: 2.1 time: 0.105072 Jun 04 21:00:57.566432 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1120/2164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:57 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:57.583466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:57.584398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] [instance: 0f7ff568-6656-41de-b3c0-ada352adc3d1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.593370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.593994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.594852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.595298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.640077 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] HTTP exception thrown: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Request method failure captured: Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 HTTP/1.1 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eUunCuiBASsc9D7a2ghikcmsPdo34X0hjy78locJq2Tn0q1hq5Bgh0Q7sLDpcIYiu3kYcQEBpn_77SzF7mem9rxdyP8yO5lyYz0chUvpB2CT_XIBNGyVBaHxA2GvEH-URgTW5qVkr2iSqCEZnzVjkmJxtU4N9mSYRcdqi0JEWdBhU Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d9e0e340cb8d4a64bdfeafcba8908f89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d9e0e340cb8d4a64bdfeafcba8908f89 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestMultiNic-1799328016 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 81630e4b323d43a08a368471273a2989 Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestMultiNic-1799328016-project Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0f7ff568-6656-41de-b3c0-ada352adc3d1'} Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.641655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. Jun 04 21:00:57.647408 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.648762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] Returning 404 to user: Instance 0f7ff568-6656-41de-b3c0-ada352adc3d1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:57.650742 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f10c7f6a-d918-47ba-888d-8fab1d694dbf tempest-ServersTestMultiNic-1799328016 tempest-ServersTestMultiNic-1799328016-project] 10.222.0.18 "GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1" status: 404 len: 111 microversion: 2.1 time: 0.083053 Jun 04 21:00:57.651372 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1121/2165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:57 2022] GET /compute/v2.1/servers/0f7ff568-6656-41de-b3c0-ada352adc3d1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:57.728604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:57.737758 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bcc4607c-b820-4873-8c34-40fa8ef0251a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.216593 Jun 04 21:00:57.738616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1045/2166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:57 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:57.757086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:57.758564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.765094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.765550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.766547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:57.766997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:57.949911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:57.958060 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-abd7e230-36c8-4b1e-af6b-e921e55f65e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.205266 Jun 04 21:00:57.958769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1122/2167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:57 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:57.976421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d92283a9-c559-4dd5-8d3d-b207bcb89174 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:57.977602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d92283a9-c559-4dd5-8d3d-b207bcb89174 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:57.984928 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-d92283a9-c559-4dd5-8d3d-b207bcb89174 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b could not be found. Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d92283a9-c559-4dd5-8d3d-b207bcb89174 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b/action HTTP/1.1 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 14 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: {"resume": {}} Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b could not be found. Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b', 'body': {'resume': {}}} Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b could not be found. Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b could not be found. Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:57.991547 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b could not be found. Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d92283a9-c559-4dd5-8d3d-b207bcb89174 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d92283a9-c559-4dd5-8d3d-b207bcb89174 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b/action" status: 404 len: 111 microversion: 2.1 time: 0.024345 Jun 04 21:00:58.005810 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1046/2168] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:57 2022] POST /compute/v2.1/servers/b01d33f7-c1c9-4ba0-a5c4-1ec79938ac1b/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:00:58.008080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:58.008863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.015460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.016181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.016974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.017587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.227898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:58.240478 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b344d8c-1aed-4c3e-8435-7d502afbba36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.239416 Jun 04 21:00:58.253980 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1123/2169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:57 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:58.259819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:58.260440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.271945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.272478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.273580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.274185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.370548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:58.371232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.381128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.385329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.386371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.386995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.638432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:58.650895 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-231a5fc9-7cb8-4884-bff8-19a575782abd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.394929 Jun 04 21:00:58.654025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1047/2170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:58 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:58.669957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:58.670904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.686307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.686766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.692096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.692586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.699909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:58.709664 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d9c87a7-12ec-47d7-8d62-166892c6687f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.345668 Jun 04 21:00:58.710817 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1124/2171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:58 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:00:58.716049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:58.717045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.725429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.727916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.732101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.732855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.838074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:58.851875 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81752dac-5014-443c-a129-e29b9f4f1c30 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1266 microversion: 2.1 time: 0.138097 Jun 04 21:00:58.852772 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1125/2172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:58 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:58.872634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:58.875207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.891625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.892090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.892888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.895205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.917219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:58.926251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-618ab29d-d75e-4434-a49c-4217803529f3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1472 microversion: 2.1 time: 0.270737 Jun 04 21:00:58.927097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1048/2173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:58 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1472 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:58.944627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'resume' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 14 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: {"resume": {}} Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'resume' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'resume': {}}} Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state active. Cannot resume while the instance is in this state. Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:58.947903 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:58.953790 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:58.953790 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:00:58.953790 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:00:58.953790 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:00:58.953790 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:00:58.953790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'resume' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:58.957188 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c3473d56-9024-414e-844b-d0506ce847b0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 144 microversion: 2.1 time: 0.099057 Jun 04 21:00:58.957968 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1126/2174] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:00:58 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 144 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:00:58.966184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:58.966803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:58.973405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.973858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:58.974653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:58.975090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.131560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:59.147052 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8a6c627-af8f-4bbc-b1d4-92d2f8c2b8cb tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.184034 Jun 04 21:00:59.163024 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1049/2175] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:58 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:59.175371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:59.177134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:59.199933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.200486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.211846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.212388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.501767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:59.512985 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2cc37d9b-438e-4436-9061-4f3be99ecd1a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.351187 Jun 04 21:00:59.518433 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1127/2176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:59 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:59.657560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca3fb42d-c3bc-4d16-976c-0d239c7269e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca3fb42d-c3bc-4d16-976c-0d239c7269e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 160 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "10998ccc-172c-4efe-afe8-d393fc1e0d64"}]}} Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': '', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'networks': [{'uuid': '10998ccc-172c-4efe-afe8-d393fc1e0d64'}]}}} Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '' Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:00:59.662057 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:00:59.668489 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:00:59.671194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca3fb42d-c3bc-4d16-976c-0d239c7269e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:00:59.672317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca3fb42d-c3bc-4d16-976c-0d239c7269e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020909 Jun 04 21:00:59.672987 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1050/2177] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:00:59 2022] POST /compute/v2.1/servers => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:00:59.682448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:59.683073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:59.689734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.690393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.691357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.691998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.727375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:59.728330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:59.748003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.748802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.749827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.750455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.899265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:59.911587 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-891d293c-b515-4e73-90a3-f3f51fc32b3b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.232695 Jun 04 21:00:59.912871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1128/2178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:59 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:59.952113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:00:59.962795 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69297e3a-94b2-4b41-a3f4-3170d5c31788 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.239644 Jun 04 21:00:59.964308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1051/2179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:59 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:00:59.969680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:00:59.970299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:00:59.977179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.977823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:00:59.978788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:00:59.979445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.076080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:00.088243 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ad99796-835c-40b6-91b8-a6350a1a2b17 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1272 microversion: 2.1 time: 0.122288 Jun 04 21:01:00.098352 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1052/2180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:00:59 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:00.098352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:00.098352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:00.101489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:00.102195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.102985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:00.103419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.203750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4d720e1-39d2-45b2-a709-63880875377e tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] Calling method '.version_select at 0x7f2d01962670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:00.204951 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:01:00.204951 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:01:00.217523 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d4d720e1-39d2-45b2-a709-63880875377e tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.303104 Jun 04 21:01:00.218395 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1129/2181] 10.222.0.18 () {60 vars in 1225 bytes} [Sat Jun 4 21:00:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:01:00.227544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:00.228477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:00.235598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:00.236302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.237443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:00.238107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.488957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:00.500174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:00.509394 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cae9e55b-56d9-411b-832d-2162c4fd1dd7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.419325 Jun 04 21:01:00.510799 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1053/2182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:00 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:00.517082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d3b7272-2e04-4b42-9deb-df0d953d4d0b tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] Action: 'update', calling method: .version_select at 0x7f2d01a35550>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:00.519827 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:01:00.519827 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:01:00.578170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:00.594935 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7066762d-8800-4b2a-9d8f-f20c206cb629 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1472 microversion: 2.1 time: 0.374771 Jun 04 21:01:00.595938 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1130/2183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:00 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:00.613169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19df6819-d002-4934-8599-c8e329a81a46 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:00.614424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19df6819-d002-4934-8599-c8e329a81a46 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: c2cc4819-6d41-4db1-9337-7b776cf05792] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:00.633780 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-19df6819-d002-4934-8599-c8e329a81a46 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance c2cc4819-6d41-4db1-9337-7b776cf05792 could not be found. Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19df6819-d002-4934-8599-c8e329a81a46 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/c2cc4819-6d41-4db1-9337-7b776cf05792/action HTTP/1.1 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 14 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: {"shelve": {}} Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c2cc4819-6d41-4db1-9337-7b776cf05792 could not be found. Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c2cc4819-6d41-4db1-9337-7b776cf05792', 'body': {'shelve': {}}} Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cc4819-6d41-4db1-9337-7b776cf05792 could not be found. Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cc4819-6d41-4db1-9337-7b776cf05792 could not be found. Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:00.639736 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:00.644652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:00.644652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:00.644652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cc4819-6d41-4db1-9337-7b776cf05792 could not be found. Jun 04 21:01:00.644652 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:00.647961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19df6819-d002-4934-8599-c8e329a81a46 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance c2cc4819-6d41-4db1-9337-7b776cf05792 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:00.652542 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19df6819-d002-4934-8599-c8e329a81a46 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/c2cc4819-6d41-4db1-9337-7b776cf05792/action" status: 404 len: 111 microversion: 2.1 time: 0.052666 Jun 04 21:01:00.656380 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1131/2184] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:00 2022] POST /compute/v2.1/servers/c2cc4819-6d41-4db1-9337-7b776cf05792/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:00.661569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:00.669054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:00.686848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:00.688036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=7 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:00.689164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.690510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:00.691067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:00.772851 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d3b7272-2e04-4b42-9deb-df0d953d4d0b tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.260491 Jun 04 21:01:00.778395 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1054/2185] 10.222.0.18 () {62 vars in 1246 bytes} [Sat Jun 4 21:01:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:01:00.783385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0d82adf-6941-48e6-b794-4eaa0332951c tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] Calling method '.version_select at 0x7f2d0bd9c280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:00.784327 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:01:00.784327 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:01:00.811986 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0d82adf-6941-48e6-b794-4eaa0332951c tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.032121 Jun 04 21:01:00.820503 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1055/2186] 10.222.0.18 () {60 vars in 1225 bytes} [Sat Jun 4 21:01:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:01:00.826497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f66ce0bf-343f-40c3-81d4-65f7090c5ac2 tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] Action: 'update', calling method: .version_select at 0x7f2d0bd5f310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:00.949740 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f66ce0bf-343f-40c3-81d4-65f7090c5ac2 tempest-QuotaClassesAdmin257Test-1084247519 tempest-QuotaClassesAdmin257Test-1084247519-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.123988 Jun 04 21:01:00.949740 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1056/2187] 10.222.0.18 () {62 vars in 1246 bytes} [Sat Jun 4 21:01:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:01:00.984632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:00.985017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:01.000827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.001291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.002104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.002555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.108457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:01.121192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8fc45296-e49a-4ae0-90ab-f8b394df743c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.463365 Jun 04 21:01:01.138369 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1132/2188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:00 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:01.151858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:01.153825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:01.176680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.177382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.181963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.182645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.251984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:01.343839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:01.384062 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0bebbb5f-e5f5-4a32-b7b4-49b04c42600d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1272 microversion: 2.1 time: 0.244151 Jun 04 21:01:01.385468 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1133/2189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:01 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:01.390529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:01.391083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:01.392187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:01.402310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.402867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.403807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.404340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.407610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c3270140-9a6f-4e46-b654-909f6d5a31da tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.423301 Jun 04 21:01:01.419841 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1057/2190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:00 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:01.613656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:01.614414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:01.627485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.633518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.634892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.636252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.647479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:01.667832 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db986af8-2df8-498f-97a7-7107c8015fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.281107 Jun 04 21:01:01.670911 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1134/2191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:01 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:01.688213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:01.688760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:01.697049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.697909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.698921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:01.699841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:01.749188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lazy-loading 'flavor' on Instance uuid 6544912e-117f-4311-88e5-885fd318c074 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:01:01.978718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:01.993792 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2bde9f9d-1d0d-49a5-b172-b53d362f00e4 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.384685 Jun 04 21:01:01.994531 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1058/2192] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:01 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:02.095669 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-95ee18e9-f3a5-4781-b918-c6c042bfec15 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 202 len: 0 microversion: 2.1 time: 0.412095 Jun 04 21:01:02.096693 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1135/2193] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:01 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:01:02.106223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:02.107174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:02.122916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:02.124332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:02.125316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:02.125963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:02.328011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:02.336358 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92b5ecd4-b62a-4123-aec6-4315e3602618 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.234171 Jun 04 21:01:02.337511 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1059/2194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:02 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:02.404713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:02.405433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:02.412434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:02.413106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:02.414195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:02.414839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:02.426684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:02.428127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:02.438861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:02.439678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:02.440513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:02.448136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:02.674540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:02.685965 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0cbe4ab0-7742-42b5-b7c8-3b541347cbe8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.285708 Jun 04 21:01:02.686461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1136/2195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:02 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:02.701056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:02.709560 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c4d1e13c-361f-436e-89fe-f000393dc3e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.287824 Jun 04 21:01:02.710256 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1060/2196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:02 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:03.011861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:03.012876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:03.020911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.022181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.023213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.023902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.118796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a090aea2-a153-4cfc-835e-a9379bbadfa8 req-89eeba99-14d9-4f73-bb8b-3334143c565c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220a33d-d40a-40ba-9569-27179eeb3979", "name": "network-vif-plugged", "status": "completed", "tag": "a010160e-6e0c-4393-9c1a-97cd5d792950"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:03.147951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a090aea2-a153-4cfc-835e-a9379bbadfa8 req-89eeba99-14d9-4f73-bb8b-3334143c565c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.148860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a090aea2-a153-4cfc-835e-a9379bbadfa8 req-89eeba99-14d9-4f73-bb8b-3334143c565c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.179550 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a090aea2-a153-4cfc-835e-a9379bbadfa8 req-89eeba99-14d9-4f73-bb8b-3334143c565c service nova] Creating event network-vif-plugged:a010160e-6e0c-4393-9c1a-97cd5d792950 for instance 3220a33d-d40a-40ba-9569-27179eeb3979 on nch1-master-1 Jun 04 21:01:03.187621 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a090aea2-a153-4cfc-835e-a9379bbadfa8 req-89eeba99-14d9-4f73-bb8b-3334143c565c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073526 Jun 04 21:01:03.188903 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1061/2197] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:01:03.204273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9ff5369c-caa2-45f7-8c9c-9a878239e856 req-0db61820-5a63-4682-beea-16baf94aec47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bbb0bf-776c-4609-ae09-e9be74061980", "tag": "72d560b2-e37e-4cfd-a216-f9d7e6109f1a"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:03.214718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9ff5369c-caa2-45f7-8c9c-9a878239e856 req-0db61820-5a63-4682-beea-16baf94aec47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.215483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9ff5369c-caa2-45f7-8c9c-9a878239e856 req-0db61820-5a63-4682-beea-16baf94aec47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.228301 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9ff5369c-caa2-45f7-8c9c-9a878239e856 req-0db61820-5a63-4682-beea-16baf94aec47 service nova] Creating event network-changed:72d560b2-e37e-4cfd-a216-f9d7e6109f1a for instance f8bbb0bf-776c-4609-ae09-e9be74061980 on nch1-master-1 Jun 04 21:01:03.233220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9ff5369c-caa2-45f7-8c9c-9a878239e856 req-0db61820-5a63-4682-beea-16baf94aec47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042822 Jun 04 21:01:03.233838 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1062/2198] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:03.357922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:03.359072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:03.371007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.372126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.374331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.375059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.399723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:03.412138 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-16357309-9f8f-442f-94e7-5c36a7fcdcfc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.404640 Jun 04 21:01:03.412732 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1137/2199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:03 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:03.713161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:03.717656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:03.722455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:03.730385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.730847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.731715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.732188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.733490 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02e987e4-2088-4002-b107-b7cb6c744418 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.383159 Jun 04 21:01:03.734311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1063/2200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:03 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:03.748346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:03.750752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:03.763004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.767978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:03.768905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:03.769931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:04.089853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:04.095152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:04.099459 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35ad9e59-32ed-4de4-8121-9bcf18d1c233 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.399382 Jun 04 21:01:04.100606 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1138/2201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:03 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:04.129245 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df317596-d164-4604-9569-20ffde31d575 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.386882 Jun 04 21:01:04.130158 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1064/2202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:03 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:04.434164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:04.435145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:04.442231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:04.442688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:04.443851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:04.444740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:04.600574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:04.610064 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bab330f1-e3ca-4921-b03e-9e2b3947c593 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.184549 Jun 04 21:01:04.611229 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1139/2203] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:04 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:04.751740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:04.752535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:04.760276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:04.760724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:04.761500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:04.761931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:04.911417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:04.921620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2094e1df-515c-4e15-8d9e-ae5f6fa3e56c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.174379 Jun 04 21:01:04.922551 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1065/2204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:04 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:05.120061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:05.121389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:05.129083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.129826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.130861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.131494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.146948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:05.147470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:05.157902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.158828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.160320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.160946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.362303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:05.364355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:05.370976 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4b928aae-185b-4247-975e-cada134d74a0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1308 microversion: 2.1 time: 0.228282 Jun 04 21:01:05.381501 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1066/2205] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:05 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1308 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:05.381610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db0adca2-191e-4f61-a16e-e3792641c0df tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.258249 Jun 04 21:01:05.381610 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1140/2206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:05 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:05.573897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8be1786d-9355-4777-acb3-70927071f4e9 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] Action: 'create', calling method: .version_select at 0x7f2d0bf36430>, body: {"security_group": {"name": "tempest-securitygroup-1011770131", "description": "tempest-description-1212277696"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:05.628881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:05.629519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:05.636698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.637562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.638635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.639263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.854861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:05.870530 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65d5d906-fcbe-49ee-83d2-70302ab93750 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.247022 Jun 04 21:01:05.875014 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1141/2207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:05 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:05.939722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:05.940571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:05.949650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.951617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:05.955379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:05.955956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:06.034088 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8be1786d-9355-4777-acb3-70927071f4e9 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.660736 Jun 04 21:01:06.035741 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1067/2208] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:01:05 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:06.048454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-94dd4b56-e8af-4190-a4b6-4426c87d9cf4 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] Action: 'create', calling method: .version_select at 0x7f2d0bde81f0>, body: {"security_group": {"name": "tempest-securitygroup-1135316202", "description": "tempest-description-140312767"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:06.184356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:06.194543 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e26ff96-8d6b-4efd-99a3-0edfe2b5eb36 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.259083 Jun 04 21:01:06.195443 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1142/2209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:05 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:06.273186 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-94dd4b56-e8af-4190-a4b6-4426c87d9cf4 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.228685 Jun 04 21:01:06.274007 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1068/2210] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:01:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:06.393184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:06.394078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:06.403140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:06.403927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:06.404763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:06.405318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:06.410501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ebf0ace-5ce3-40fb-800a-6c40c33fa653 tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] Action: 'create', calling method: .version_select at 0x7f2d019bf1f0>, body: {"security_group": {"name": "tempest-securitygroup-1965588326", "description": "tempest-description-452007377"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:06.443318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:06.670164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:06.685439 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-587a1b13-09df-45b1-ade6-d76b1b83788e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1489 microversion: 2.1 time: 0.297551 Jun 04 21:01:06.687584 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1069/2211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:06 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1489 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:06.698675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:06.699823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:06.708156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:06.708990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:06.709804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:06.710566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:06.818777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:06.972372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:06.977820 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ebf0ace-5ce3-40fb-800a-6c40c33fa653 tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.695559 Jun 04 21:01:06.979086 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1143/2212] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:01:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:06.985427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:06.987174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:07.003314 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d136952-780c-4901-8a5c-b21e229489a6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.313079 Jun 04 21:01:07.003594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.004391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.005201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.005655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.019412 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1070/2213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:06 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:07.033695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:07.034634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:07.044553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.046764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.048086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.048704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.128570 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82ea2b90-ceae-41a1-951c-f0c61a9f6a55 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979/action" status: 202 len: 0 microversion: 2.1 time: 0.147722 Jun 04 21:01:07.129273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1144/2214] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:06 2022] POST /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:07.149559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e57539c-4830-4d58-b626-cecde41df1f0 tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] Action: 'create', calling method: .version_select at 0x7f2d01968310>, body: {"security_group": {"name": "tempest-securitygroup-1675854060", "description": "tempest-description-1983575412"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:07.280521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:07.292817 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e1cbb7f8-b6cd-4097-ad78-d94a8ce79a35 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.269896 Jun 04 21:01:07.293424 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1071/2215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:07 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:07.308946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:07.310027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:07.321965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.324496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.325563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.327671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.505983 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e57539c-4830-4d58-b626-cecde41df1f0 tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.374922 Jun 04 21:01:07.513104 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1145/2216] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:01:07 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:07.519013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:07.519798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:07.528076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.528783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.529763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:07.530358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:07.691548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:07.701968 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e6ed24b-0bb9-4fbe-aa20-5d9f1c0cebca tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1494 microversion: 2.1 time: 0.400528 Jun 04 21:01:07.705565 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1072/2217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:07 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1494 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:07.710370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb2f33ba-9299-4f46-a522-1695a486d0aa tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] Calling method '.version_select at 0x7f2d0bd83700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:07.821852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:07.833846 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-25327dc3-d364-4f1d-9fdb-e20976cece04 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.318921 Jun 04 21:01:07.837125 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1146/2218] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:07 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:08.023867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:08.024537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:08.041728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:08.042190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:08.043201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:08.044439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:08.266972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:08.288232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2cfe8602-c284-44bd-b74c-d29420fee72d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.266187 Jun 04 21:01:08.289738 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1147/2219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:08 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:08.312612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:08.313266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:08.320474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:08.321368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:08.322918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:08.323841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:08.562790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:08.574398 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff5c23fe-3d34-47d8-9582-c1651b72b11f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.265581 Jun 04 21:01:08.575786 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1148/2220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:08 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:08.725011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:08.725643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:08.734590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:08.735357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:08.736189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:08.736637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:08.741609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:08.964003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:08.988460 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8335e3d9-e00f-43ac-82b7-a3290d606bbe tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 200 len: 1474 microversion: 2.1 time: 0.267774 Jun 04 21:01:08.989892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1149/2221] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:08 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:09.002908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:09.003585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:09.010331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:09.010789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:09.011617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:09.012065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:09.206772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:09.222022 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-58ff8ca7-85b4-49aa-a65b-ee84ae304bc3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.227722 Jun 04 21:01:09.224233 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1150/2222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:08 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:09.240279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-598698330"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:09.246440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:09.257687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:09.258494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:09.259583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:09.260951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:09.684728 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4110f8a7-4d2c-4bf3-890b-cc20fc51df82 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979/action" status: 202 len: 0 microversion: 2.1 time: 0.458537 Jun 04 21:01:09.686234 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1151/2223] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:09 2022] POST /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:01:09.694059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:09.695096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:09.703746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:09.704652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:09.705830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:09.706948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:10.088196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:10.099480 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e21b518-d84d-4bb8-b162-36d7f9f7c0ad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.411712 Jun 04 21:01:10.104079 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1152/2224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:09 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:10.114289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb2f33ba-9299-4f46-a522-1695a486d0aa tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10991 microversion: 2.1 time: 2.407238 Jun 04 21:01:10.115105 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1073/2225] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Jun 4 21:01:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10991 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:01:10.120611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:10.121195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4206d7a5-4003-4c6c-80f5-8107c67b5510 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0be6a310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:10.121923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:10.131033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:10.132036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:10.133201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:10.133643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:10.188224 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4206d7a5-4003-4c6c-80f5-8107c67b5510 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1413 microversion: 2.1 time: 0.071491 Jun 04 21:01:10.189473 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1074/2226] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:10 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:10.195470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-eae6e1ce-fdf5-4b85-8c28-d83b945b1725 req-b3bc2b06-42db-4458-932d-5ce53cc985ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bbb0bf-776c-4609-ae09-e9be74061980", "name": "network-vif-plugged", "status": "completed", "tag": "72d560b2-e37e-4cfd-a216-f9d7e6109f1a"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:10.205908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-eae6e1ce-fdf5-4b85-8c28-d83b945b1725 req-b3bc2b06-42db-4458-932d-5ce53cc985ab service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:10.207552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-eae6e1ce-fdf5-4b85-8c28-d83b945b1725 req-b3bc2b06-42db-4458-932d-5ce53cc985ab service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:10.215223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:10.222775 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-eae6e1ce-fdf5-4b85-8c28-d83b945b1725 req-b3bc2b06-42db-4458-932d-5ce53cc985ab service nova] Creating event network-vif-plugged:72d560b2-e37e-4cfd-a216-f9d7e6109f1a for instance f8bbb0bf-776c-4609-ae09-e9be74061980 on nch1-master-1 Jun 04 21:01:10.229808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-eae6e1ce-fdf5-4b85-8c28-d83b945b1725 req-b3bc2b06-42db-4458-932d-5ce53cc985ab service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038529 Jun 04 21:01:10.230762 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1075/2227] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:10.236806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-03bf0297-144d-4b07-a4ff-ce01d22f0140 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] Calling method '.version_select at 0x7f2d0bde8040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:10.432710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:10.440873 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c0133a3-506a-405d-a53e-92b1f4c13a56 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.334982 Jun 04 21:01:10.452288 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1153/2228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:10 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:10.457701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:10.458598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:10.465938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:10.466701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:10.467755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:10.468408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:10.940218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=28,nova_cell0:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:10.954776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-03bf0297-144d-4b07-a4ff-ce01d22f0140 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.722547 Jun 04 21:01:10.956195 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1076/2229] 10.222.0.18 () {58 vars in 1190 bytes} [Sat Jun 4 21:01:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:10.969744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fe29b86-8437-460b-9c28-8b3060ff773d tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] Calling method '.version_select at 0x7f2d0be6a940>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:11.064502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:11.075475 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-078525e3-1518-4fff-98f9-27592bccaef9 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.621565 Jun 04 21:01:11.087044 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1154/2230] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:10 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:11.127529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:11.128918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:11.141218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:11.142148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:11.143132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:11.144649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:11.296408 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7fe29b86-8437-460b-9c28-8b3060ff773d tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/12d624ad-70bd-4805-a1eb-25740616d1a0" status: 202 len: 0 microversion: 2.1 time: 0.331383 Jun 04 21:01:11.300539 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1077/2231] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:01:10 2022] DELETE /compute/v2.1/os-security-groups/12d624ad-70bd-4805-a1eb-25740616d1a0 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:11.305197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ead2082b-22ac-41b4-a4ee-95ea7a44a260 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0bf2f5e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:11.340182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:11.361232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-490464f9-a8da-4b5b-b0f0-75d6c10d6878 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1314 microversion: 2.1 time: 0.242465 Jun 04 21:01:11.362081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1155/2232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:11 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:11.383291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed48e985-0440-42a5-b4a4-c1e2292e95c3 tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] Calling method '.version_select at 0x7f2d01b4b0d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:11.395285 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ead2082b-22ac-41b4-a4ee-95ea7a44a260 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1413 microversion: 2.1 time: 0.096268 Jun 04 21:01:11.396324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1078/2233] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:11 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:11.466341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:11.467347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:11.478461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:11.479161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:11.480226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:11.481205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:11.683592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed48e985-0440-42a5-b4a4-c1e2292e95c3 tempest-SecurityGroupsTestAdminJSON-1527502768 tempest-SecurityGroupsTestAdminJSON-1527502768-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/477428f9-8203-40ff-b7a5-9a141995267f" status: 202 len: 0 microversion: 2.1 time: 0.308300 Jun 04 21:01:11.684187 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1156/2234] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:01:11 2022] DELETE /compute/v2.1/os-security-groups/477428f9-8203-40ff-b7a5-9a141995267f => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:11.697348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f08ae288-6133-41a0-a39d-e7d7700015db tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] Calling method '.version_select at 0x7f2d01b4b4c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:11.706271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:11.722326 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fef24555-3795-4dd3-ab58-2b709a36c84f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.261289 Jun 04 21:01:11.723495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1079/2235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:11 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:11.940486 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f08ae288-6133-41a0-a39d-e7d7700015db tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/126697bf-2c77-4957-89c4-789536456f39" status: 202 len: 0 microversion: 2.1 time: 0.250848 Jun 04 21:01:11.941666 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1157/2236] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:01:11 2022] DELETE /compute/v2.1/os-security-groups/126697bf-2c77-4957-89c4-789536456f39 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:11.950643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44fa95d3-82d4-4464-a1e7-f7f4ae2bd358 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] Calling method '.version_select at 0x7f2d0be6aa60>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:12.095735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:12.099377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:12.106685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.107434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.108367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.108938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.328682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:12.344418 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73c99041-e67d-4bbc-a4f2-c35deecf764c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.253267 Jun 04 21:01:12.347407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44fa95d3-82d4-4464-a1e7-f7f4ae2bd358 tempest-SecurityGroupsTestAdminJSON-119392850 tempest-SecurityGroupsTestAdminJSON-119392850-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/be931b77-234d-4deb-aa27-8c6c7a22ec95" status: 202 len: 0 microversion: 2.1 time: 0.401277 Jun 04 21:01:12.348485 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1080/2237] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:01:11 2022] DELETE /compute/v2.1/os-security-groups/be931b77-234d-4deb-aa27-8c6c7a22ec95 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:12.357072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1158/2238] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:12 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:12.382402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:12.383343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:12.410627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8897586-cd12-4198-9ad0-f19f5020d0c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01a92940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:12.415440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.416543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.419132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.420881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.489949 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8897586-cd12-4198-9ad0-f19f5020d0c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1413 microversion: 2.1 time: 0.083757 Jun 04 21:01:12.490706 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1159/2239] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:12 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:12.650574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:12.661893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af66bbf4-2bbc-48d3-888d-36b1b6c8b926 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1501 microversion: 2.1 time: 0.283179 Jun 04 21:01:12.662986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1081/2240] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:12 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1501 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:12.680990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:12.681385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:12.698100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.698753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.700116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.700953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.755053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:12.756262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:12.774214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.775015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.776166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.776750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.852755 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-97f34da6-0432-4ca3-9677-919f328d2853 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980/action" status: 202 len: 0 microversion: 2.1 time: 0.168369 Jun 04 21:01:12.855184 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1160/2241] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:12 2022] POST /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:12.863825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:12.864855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:12.874498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.875236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:12.876459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:12.877041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:13.122639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:13.132212 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b854a9b7-d9ca-499a-b5ac-6c6786c6f596 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.381690 Jun 04 21:01:13.137454 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1082/2242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:12 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:13.175356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:13.186973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf6343ec-b376-4492-b397-3e9b9a3a3775 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1506 microversion: 2.1 time: 0.328189 Jun 04 21:01:13.200666 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1161/2243] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:12 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:13.364132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:13.365512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:13.376983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:13.378062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:13.378974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:13.379564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:13.504038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b0cbb56-de06-451e-9a4a-574a357b65b4 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d018694c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:13.595125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:13.605303 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b0cbb56-de06-451e-9a4a-574a357b65b4 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1413 microversion: 2.1 time: 0.105371 Jun 04 21:01:13.605881 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b3556a1-9350-4a7e-8635-59b934ffa33a tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1532 microversion: 2.1 time: 0.245819 Jun 04 21:01:13.611010 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1162/2244] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:13 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:13.617648 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1083/2245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:13 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1532 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:14.154400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:14.154914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:14.169646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.180390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.181523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.182126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.212865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:14.214616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:14.225394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.226942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.228115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.228689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.700099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:14.711535 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b6ab9049-26ff-444b-8eea-d2e8b63b9993 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.560969 Jun 04 21:01:14.713342 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1163/2246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:14 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:14.733185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5ce7a6e6-8200-4a19-a9cb-23459c1ed471 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d019684c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:14.779165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:14.792403 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5314d666-cce9-4f8a-99e8-ab8b9cb9c71f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1486 microversion: 2.1 time: 0.589070 Jun 04 21:01:14.793101 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1084/2247] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:14 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1486 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:14.797903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:14.803548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:14.818114 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5ce7a6e6-8200-4a19-a9cb-23459c1ed471 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1413 microversion: 2.1 time: 0.094836 Jun 04 21:01:14.819589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.820886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1164/2248] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:14 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:14.821308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.822143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.822588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.838311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:14.839656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:14.855905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.856580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.858582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:14.859199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:14.903973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:01:15.056906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:15.065113 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0bb1da9-3922-437f-b7ab-78a0768f00bc tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 204 len: 0 microversion: 2.1 time: 0.233732 Jun 04 21:01:15.067495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1165/2249] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:14 2022] DELETE /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:15.081224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:15.084068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:15.106504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:15.108009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:15.110877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:15.111809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:15.355735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:15.371362 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-71388791-5c7e-4f5e-b54d-6f1286097149 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1532 microversion: 2.1 time: 0.576988 Jun 04 21:01:15.375165 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1085/2250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:14 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1532 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:15.497732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-aa5bb009-0065-4225-9058-233705213402 req-1136d9c8-27f2-477a-8c77-d4a83e3e390a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220a33d-d40a-40ba-9569-27179eeb3979", "name": "network-vif-plugged", "status": "completed", "tag": "a010160e-6e0c-4393-9c1a-97cd5d792950"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:15.531152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:15.535805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:15.536354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-aa5bb009-0065-4225-9058-233705213402 req-1136d9c8-27f2-477a-8c77-d4a83e3e390a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:15.538374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-aa5bb009-0065-4225-9058-233705213402 req-1136d9c8-27f2-477a-8c77-d4a83e3e390a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:15.558876 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-50cb74cd-6c99-49dd-ba1c-af8075ef11e3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1492 microversion: 2.1 time: 0.486990 Jun 04 21:01:15.565461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1166/2251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:15 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1492 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:15.591385 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-aa5bb009-0065-4225-9058-233705213402 req-1136d9c8-27f2-477a-8c77-d4a83e3e390a service nova] Creating event network-vif-plugged:a010160e-6e0c-4393-9c1a-97cd5d792950 for instance 3220a33d-d40a-40ba-9569-27179eeb3979 on nch1-master-1 Jun 04 21:01:15.607558 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-aa5bb009-0065-4225-9058-233705213402 req-1136d9c8-27f2-477a-8c77-d4a83e3e390a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115731 Jun 04 21:01:15.612241 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1086/2252] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:01:15.731792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:15.732607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:15.750667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:15.754049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:15.756126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:15.758872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:15.834512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b10a5ce-0a0a-40bd-844d-7fbfbf5c99a4 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01a27e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:16.120023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:16.131503 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6f8a4543-2a75-4fa3-85bb-d7bee02dffb3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.404663 Jun 04 21:01:16.132686 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1167/2253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:15 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:16.392623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:16.393359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:16.408206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:16.421125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:16.424505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:16.424576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:16.621806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:16.630609 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89e228f3-16d8-483e-be40-b7f2d2abed44 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1527 microversion: 2.1 time: 0.242944 Jun 04 21:01:16.643042 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1168/2254] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:16 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1527 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:16.648970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:16.649942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:16.656955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:16.658580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:16.659640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:16.660610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:16.881482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:16.895589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a8a9fc30-d034-4eb8-b3a2-42d3ce22c835 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1492 microversion: 2.1 time: 0.250766 Jun 04 21:01:16.897403 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1169/2255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:16 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1492 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:17.150613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:17.151790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:17.166172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:17.169449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:17.180448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:17.182102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:17.765990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:17.785118 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e77158a-93cd-41a2-ae75-2b35429e6039 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.635756 Jun 04 21:01:17.788994 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1170/2256] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:17 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:17.803114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:17.804508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:17.835046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:17.840518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:17.842333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:17.845556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:18.362767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'services' on Instance uuid e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:01:18.734276 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e79f02b5-f745-42d6-ad7b-6294357637a4 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments/37cf4b6a-6b9d-4adb-8221-172f88294ef6" status: 202 len: 0 microversion: 2.1 time: 0.943435 Jun 04 21:01:18.742591 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1171/2257] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:01:17 2022] DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments/37cf4b6a-6b9d-4adb-8221-172f88294ef6 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:18.762371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:18.763917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:18.785232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:18.786579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:18.790278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:18.790963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:19.860446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:19.886989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-91076c11-c653-4034-a5fe-c0279ce61a5b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1527 microversion: 2.1 time: 1.141536 Jun 04 21:01:19.905634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1172/2258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:18 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1527 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:19.921251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:19.925389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:19.949042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:19.951070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:19.954720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:19.955588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:20.039029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:20.039712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:20.040270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'fault' on Instance uuid f8bbb0bf-776c-4609-ae09-e9be74061980 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:01:20.149135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:20.167172 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2adb910f-2e14-4759-8b12-79121148f04d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 200 len: 1304 microversion: 2.1 time: 0.255046 Jun 04 21:01:20.167172 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1173/2259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:19 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:20.187774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:20.188906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:20.223566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:20.224076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:20.224887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:20.225335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:20.352704 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d47eba63-a704-4698-b1fd-b17cbe3b6707 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186270 Jun 04 21:01:20.353482 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1174/2260] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:01:20 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc/os-volume_attachments => generated 25 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:01:20.364178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:20.369355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:20.385231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:20.385860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:20.386886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:20.389931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:21.314351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:21.331430 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a50c6ae4-4025-4642-a6e8-85fd828973a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.976573 Jun 04 21:01:21.332057 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1175/2261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:20 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:21.359835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f89658c4-76e1-4c0c-880e-18d56f145dad req-db00b773-ca0f-4807-bce4-b61b526a784a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bbb0bf-776c-4609-ae09-e9be74061980", "name": "network-vif-deleted", "tag": "72d560b2-e37e-4cfd-a216-f9d7e6109f1a"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:21.405587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f89658c4-76e1-4c0c-880e-18d56f145dad req-db00b773-ca0f-4807-bce4-b61b526a784a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:21.406842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f89658c4-76e1-4c0c-880e-18d56f145dad req-db00b773-ca0f-4807-bce4-b61b526a784a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:21.472657 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f89658c4-76e1-4c0c-880e-18d56f145dad req-db00b773-ca0f-4807-bce4-b61b526a784a service nova] Creating event network-vif-deleted:72d560b2-e37e-4cfd-a216-f9d7e6109f1a for instance f8bbb0bf-776c-4609-ae09-e9be74061980 on nch1-master-1 Jun 04 21:01:21.494673 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f89658c4-76e1-4c0c-880e-18d56f145dad req-db00b773-ca0f-4807-bce4-b61b526a784a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157457 Jun 04 21:01:21.505175 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1176/2262] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:21.543241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:21.545681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:21.575657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:21.576128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:21.576940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:21.584157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:21.694049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Cannot 'reboot' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action HTTP/1.1 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 28 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: {"reboot": {"type": "HARD"}} Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'reboot' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7907307f-3aab-444e-a6ab-d0988fd26463', 'body': {'reboot': {'type': 'HARD'}}} Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:01:21.695999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 409 to user: Cannot 'reboot' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:21.699314 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0adea6e9-6351-44e6-bce5-1461ab3e46a3 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action" status: 409 len: 145 microversion: 2.1 time: 0.182273 Jun 04 21:01:21.705326 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1177/2263] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:21 2022] POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action => generated 145 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:21.722169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:21.726105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:21.740867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:21.748224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:21.749394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:21.753329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.139125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:22.147712 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-862426a6-9492-4ba5-b52e-63e75a5397af tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1527 microversion: 2.1 time: 0.440687 Jun 04 21:01:22.161634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1178/2264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:21 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1527 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:22.166382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:22.167003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:22.203238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.204693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.207863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.208329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.234436 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 HTTP/1.1 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f8bbb0bf-776c-4609-ae09-e9be74061980'} Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:22.236885 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a92e7ac8-91a0-44fe-97b9-0a6ae77287c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 404 len: 111 microversion: 2.1 time: 0.077082 Jun 04 21:01:22.240195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1179/2265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:22 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:22.251227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:22.253588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:22.265805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.266272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.267198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.267711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.320136 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Cannot 'rebuild' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action HTTP/1.1 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 65 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'rebuild' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '7907307f-3aab-444e-a6ab-d0988fd26463', 'body': {'rebuild': {'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf'}}} Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 in vm_state rescued. Cannot rebuild while the instance is in this state. Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:22.326595 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued Jun 04 21:01:22.329857 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:22.330694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 409 to user: Cannot 'rebuild' instance 7907307f-3aab-444e-a6ab-d0988fd26463 while it is in vm_state rescued {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:22.340338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6485983-e674-44be-8828-003740c9aa75 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action" status: 409 len: 146 microversion: 2.1 time: 0.089871 Jun 04 21:01:22.341127 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1180/2266] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:22 2022] POST /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463/action => generated 146 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:22.354109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:22.354949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:22.368558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.369780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.372469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.373270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.417208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:01:22.575021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4f59f31-0ec1-4fc6-9d75-53edca8b6bd1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 204 len: 0 microversion: 2.1 time: 0.218484 Jun 04 21:01:22.576478 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1181/2267] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:22 2022] DELETE /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:22.594062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:22.602284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:22.610656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.611184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:22.612016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:22.612451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:23.071552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:23.073524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:23.086206 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b2743b90-80f6-496a-9ff9-92b7bf32d1dd tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1477 microversion: 2.1 time: 0.502156 Jun 04 21:01:23.087215 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1182/2268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:22 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1477 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:23.102282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1594686551", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:25.520679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=8,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:25.559350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=60 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:33.126364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:37.072194 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b10a5ce-0a0a-40bd-844d-7fbfbf5c99a4 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1413 microversion: 2.1 time: 21.242658 Jun 04 21:01:37.073589 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1087/2269] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:15 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1413 bytes in 21244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:37.077679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:37.078427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:37.107477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.107973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:37.108784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.109225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:37.178071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:01:37.178713 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc could not be found. Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc HTTP/1.1 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc could not be found. Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc'} Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc could not be found. Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc could not be found. Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:37.180115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc could not be found. Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 404 to user: Instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:37.183932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60660a7c-1a14-4129-8799-14ecb7b14eaa tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc" status: 404 len: 111 microversion: 2.1 time: 0.107668 Jun 04 21:01:37.185471 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1088/2270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:37 2022] GET /compute/v2.1/servers/e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:37.203346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:37.204002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:37.211020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.211461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:37.212301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.218215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:37.533549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:37.542278 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d3e1a504-a4d9-4990-9a08-8541a1916639 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1527 microversion: 2.1 time: 0.355682 Jun 04 21:01:37.545600 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1089/2271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:37 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1527 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:37.554400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0b03e937-b057-4a68-8635-de759065f203 req-3713bb3f-bac6-4c82-972b-ebf91893bcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "name": "network-vif-plugged", "status": "completed", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:37.566803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0b03e937-b057-4a68-8635-de759065f203 req-3713bb3f-bac6-4c82-972b-ebf91893bcc7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.567576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0b03e937-b057-4a68-8635-de759065f203 req-3713bb3f-bac6-4c82-972b-ebf91893bcc7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:37.588791 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0b03e937-b057-4a68-8635-de759065f203 req-3713bb3f-bac6-4c82-972b-ebf91893bcc7 service nova] Creating event network-vif-plugged:eba1e015-a95a-4ab9-aea1-ca6856d3e3bb for instance 6544912e-117f-4311-88e5-885fd318c074 on nch2-master-1 Jun 04 21:01:37.602718 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0b03e937-b057-4a68-8635-de759065f203 req-3713bb3f-bac6-4c82-972b-ebf91893bcc7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054942 Jun 04 21:01:37.605297 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1090/2272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:37.617200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:37.618286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:37.655797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.656603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:37.657686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:37.662291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.019623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:38.033619 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63453865-bbc5-4151-b435-97a5bfd81748 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1471 microversion: 2.1 time: 0.426739 Jun 04 21:01:38.045264 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1091/2273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:37 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:38.045561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:38.048336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:38.057741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.058292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.059178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.059721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.088646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:01:38.089111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:01:38.089602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:01:38.090022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:01:38.090443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:01:38.101267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:01:38.115150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.115907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.119066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.120775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.179475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:01:38.190697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:01:38.225739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:01:38.228120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:01:38.252170 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa044122-1404-47c9-b558-41cc1e882496 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "DELETE /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 204 len: 0 microversion: 2.1 time: 0.210053 Jun 04 21:01:38.254507 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1092/2274] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:38 2022] DELETE /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:38.259044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-695bc118-7c4f-4c8d-a3c4-9fcc2e303595 req-886c6e31-a5d6-401f-a72b-38242a1a221e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc", "name": "network-vif-deleted", "tag": "f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:38.269857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-695bc118-7c4f-4c8d-a3c4-9fcc2e303595 req-886c6e31-a5d6-401f-a72b-38242a1a221e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.270538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-695bc118-7c4f-4c8d-a3c4-9fcc2e303595 req-886c6e31-a5d6-401f-a72b-38242a1a221e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.296326 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-695bc118-7c4f-4c8d-a3c4-9fcc2e303595 req-886c6e31-a5d6-401f-a72b-38242a1a221e service nova] Creating event network-vif-deleted:f68ab626-7bd1-4df7-8ecb-ec9847ad9f4f for instance e01bd9e4-710b-4019-a6f3-6f6f6dedb4cc on nch2-master-1 Jun 04 21:01:38.304335 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-695bc118-7c4f-4c8d-a3c4-9fcc2e303595 req-886c6e31-a5d6-401f-a72b-38242a1a221e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049088 Jun 04 21:01:38.305026 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1093/2275] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:38.320397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99ddcffa-b49f-4593-a7ed-f227b9f3b5c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.231745 Jun 04 21:01:38.321602 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1183/2276] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 15234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:01:38.326893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5336ca37-8486-40b1-9c17-aceb8de30d58 req-35de5d6e-4f27-4bef-8c49-3dfb61b11abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44488ee-6a65-404c-8907-02ee23f75774", "name": "network-vif-unplugged", "status": "completed", "tag": "471386bb-e273-4917-a745-e543e8ccf6e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:38.337125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5336ca37-8486-40b1-9c17-aceb8de30d58 req-35de5d6e-4f27-4bef-8c49-3dfb61b11abb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.337904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5336ca37-8486-40b1-9c17-aceb8de30d58 req-35de5d6e-4f27-4bef-8c49-3dfb61b11abb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.353111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5336ca37-8486-40b1-9c17-aceb8de30d58 req-35de5d6e-4f27-4bef-8c49-3dfb61b11abb service nova] Creating event network-vif-unplugged:471386bb-e273-4917-a745-e543e8ccf6e1 for instance b44488ee-6a65-404c-8907-02ee23f75774 on nch1-master-1 Jun 04 21:01:38.359903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-5336ca37-8486-40b1-9c17-aceb8de30d58 req-35de5d6e-4f27-4bef-8c49-3dfb61b11abb service nova] Instance b44488ee-6a65-404c-8907-02ee23f75774 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:01:38.417757 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5336ca37-8486-40b1-9c17-aceb8de30d58 req-35de5d6e-4f27-4bef-8c49-3dfb61b11abb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094607 Jun 04 21:01:38.424621 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1184/2277] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:38.434609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa7a6d04-60a3-460b-84b0-7940e14dcda7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '.version_select at 0x7f2d01aa2310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:38.490581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa7a6d04-60a3-460b-84b0-7940e14dcda7 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334054880" status: 202 len: 0 microversion: 2.1 time: 0.064585 Jun 04 21:01:38.491594 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1185/2278] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334054880 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:38.501666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:38.502504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:38.539023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2aa35b29-185f-44b4-a092-70d1a81885ab tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Calling method '.version_select at 0x7f2d01a27790>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:38.551445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.552317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.553393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.554183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.701754 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4216311c-4c8f-4709-928b-419ad5eaab8b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774/action" status: 204 len: 0 microversion: 2.1 time: 0.207521 Jun 04 21:01:38.702950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2aa35b29-185f-44b4-a092-70d1a81885ab tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] 10.222.0.18 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.396167 Jun 04 21:01:38.705303 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1186/2280] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:38 2022] POST /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774/action => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:38.705465 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1094/2280] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 21:01:38 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:01:38.710648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7ace260a-c587-4fef-983e-33b887ebded3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0bde8ca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:38.718369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:38.719100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:38.746045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.747777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.749248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:38.750142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:38.864728 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7ace260a-c587-4fef-983e-33b887ebded3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1422 microversion: 2.1 time: 0.158150 Jun 04 21:01:38.872512 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1095/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:38 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1422 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:38.892379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62db5410-34b1-4464-8f25-7cdb7842ec7c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:38.906469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-62db5410-34b1-4464-8f25-7cdb7842ec7c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:39.144965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62db5410-34b1-4464-8f25-7cdb7842ec7c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:39.155867 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62db5410-34b1-4464-8f25-7cdb7842ec7c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1215 microversion: 2.1 time: 0.275238 Jun 04 21:01:39.157339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1096/2282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:38 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1215 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:39.171060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:39.172172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:39.192146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:39.196800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:39.198010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:39.198824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:39.335270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:39.350830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46ef45e7-a68a-4f18-bd01-c40a54ef63f2 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1666 microversion: 2.1 time: 0.643052 Jun 04 21:01:39.352273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1187/2283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:38 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1666 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:39.369240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54859a23-f89a-497e-9b51-af5aff55bec5 tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Action: 'create', calling method: .version_select at 0x7f2d027f7ee0>, body: {"pool": "non_exist_pool"} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:39.465588 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-54859a23-f89a-497e-9b51-af5aff55bec5 tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] HTTP exception thrown: Floating IP pool not found. Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54859a23-f89a-497e-9b51-af5aff55bec5 tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Request method failure captured: Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 26 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8gq2ovlCfPjI0d66yrM5br1s1cWpqtZIXHaqFi7zbcoHgx7-XXmBpIwvWBKSjBzTOqrrbaXM_rDYjHnKj0l-ulFNqkZtyb-8H8wy-sfwKbSF24B2DKVRz0J5iw7oiUUDb7Q5Ksgi9_7GtxSXHAAK0JyrKpRSKEERU0GEl7Hfmd_l8I Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 574e32b3eb5f4945a0db8b24ea8f8469 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-690653759 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-690653759 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 574e32b3eb5f4945a0db8b24ea8f8469 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-690653759 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-FloatingIPsNegativeTestJSON-690653759-project Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: cea501dbd3de466a9c1095e8466165d0 Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-690653759-project Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: {"pool": "non_exist_pool"} Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: exception: Floating IP pool not found. Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:39.467551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:39.471707 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 04 21:01:39.471707 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.473242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54859a23-f89a-497e-9b51-af5aff55bec5 tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Returning 404 to user: Floating IP pool not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:39.474273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54859a23-f89a-497e-9b51-af5aff55bec5 tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.120769 Jun 04 21:01:39.475031 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1188/2284] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 21:01:39 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:39.484930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:39.485574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:39.504447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:39.504919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:39.505755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:39.506209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:39.710468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:39.723871 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7ab93b6-de1b-410f-a258-db8ef4dbf8dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1509 microversion: 2.1 time: 0.557562 Jun 04 21:01:39.724844 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1097/2285] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:39 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1509 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:39.730353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ea8fe86-15ad-4d74-b10c-4a2a69c19528 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01a278b0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:39.798619 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ea8fe86-15ad-4d74-b10c-4a2a69c19528 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 200 len: 1422 microversion: 2.1 time: 0.072361 Jun 04 21:01:39.799350 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1098/2286] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:01:39 2022] GET /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 1422 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:39.816048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fabbab5d-e90c-426c-897f-ce835a1d642c tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Calling method '.version_select at 0x7f2d0be35c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:39.931155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-fabbab5d-e90c-426c-897f-ce835a1d642c tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 80a29e6a-12ee-4e32-a4a1-69f8a6879192 could not be found", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:01:39.931761 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-fabbab5d-e90c-426c-897f-ce835a1d642c tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] HTTP exception thrown: Floating IP not found for ID 80a29e6a-12ee-4e32-a4a1-69f8a6879192 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fabbab5d-e90c-426c-897f-ce835a1d642c tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Request method failure captured: Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-floating-ips/80a29e6a-12ee-4e32-a4a1-69f8a6879192 HTTP/1.1 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gq2ovlCfPjI0d66yrM5br1s1cWpqtZIXHaqFi7zbcoHgx7-XXmBpIwvWBKSjBzTOqrrbaXM_rDYjHnKj0l-ulFNqkZtyb-8H8wy-sfwKbSF24B2DKVRz0J5iw7oiUUDb7Q5Ksgi9_7GtxSXHAAK0JyrKpRSKEERU0GEl7Hfmd_l8I Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 574e32b3eb5f4945a0db8b24ea8f8469 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-690653759 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/574e32b3eb5f4945a0db8b24ea8f8469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-690653759 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 574e32b3eb5f4945a0db8b24ea8f8469 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-690653759 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-FloatingIPsNegativeTestJSON-690653759-project Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: cea501dbd3de466a9c1095e8466165d0 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-690653759-project Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: exception: Floating IP not found for ID 80a29e6a-12ee-4e32-a4a1-69f8a6879192 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '80a29e6a-12ee-4e32-a4a1-69f8a6879192'} Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 80a29e6a-12ee-4e32-a4a1-69f8a6879192 could not be found Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b29fdf6-e589-451c-a839-d9e955b895f0'] Jun 04 21:01:39.934453 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 80a29e6a-12ee-4e32-a4a1-69f8a6879192. Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 80a29e6a-12ee-4e32-a4a1-69f8a6879192 Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 80a29e6a-12ee-4e32-a4a1-69f8a6879192 Jun 04 21:01:39.938720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:39.942371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fabbab5d-e90c-426c-897f-ce835a1d642c tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] Returning 404 to user: Floating IP not found for ID 80a29e6a-12ee-4e32-a4a1-69f8a6879192 {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:39.943914 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fabbab5d-e90c-426c-897f-ce835a1d642c tempest-FloatingIPsNegativeTestJSON-690653759 tempest-FloatingIPsNegativeTestJSON-690653759-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/80a29e6a-12ee-4e32-a4a1-69f8a6879192" status: 404 len: 111 microversion: 2.1 time: 0.135181 Jun 04 21:01:39.945160 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1099/2287] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:01:39 2022] DELETE /compute/v2.1/os-floating-ips/80a29e6a-12ee-4e32-a4a1-69f8a6879192 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:39.951904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fe35e0df-cbc4-472f-b00a-936e51fe21bb req-81583b33-6a2d-43d9-84b4-913a6a7262e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220a33d-d40a-40ba-9569-27179eeb3979", "name": "network-vif-unplugged", "status": "completed", "tag": "a010160e-6e0c-4393-9c1a-97cd5d792950"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:39.974414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe35e0df-cbc4-472f-b00a-936e51fe21bb req-81583b33-6a2d-43d9-84b4-913a6a7262e7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:39.975024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe35e0df-cbc4-472f-b00a-936e51fe21bb req-81583b33-6a2d-43d9-84b4-913a6a7262e7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:40.013692 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fe35e0df-cbc4-472f-b00a-936e51fe21bb req-81583b33-6a2d-43d9-84b4-913a6a7262e7 service nova] Creating event network-vif-unplugged:a010160e-6e0c-4393-9c1a-97cd5d792950 for instance 3220a33d-d40a-40ba-9569-27179eeb3979 on nch1-master-1 Jun 04 21:01:40.020177 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fe35e0df-cbc4-472f-b00a-936e51fe21bb req-81583b33-6a2d-43d9-84b4-913a6a7262e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073375 Jun 04 21:01:40.024017 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1100/2288] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:40.033904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-67486ea1-1809-476e-9353-3fcd47b307e1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01a27d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:40.233217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:40.247027 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c61235f9-b99a-4480-9437-66489c576181 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1471 microversion: 2.1 time: 0.770602 Jun 04 21:01:40.248229 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1189/2289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:39 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:40.253105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:40.260137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:40.276933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:40.277556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:40.278778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:40.279353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:40.471184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:40.486246 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-52b90020-b3ce-435b-b8a4-7103f358983d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1267 microversion: 2.1 time: 0.235126 Jun 04 21:01:40.488109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1190/2290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:40 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:40.499768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:40.502270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:40.549780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:40.550298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:40.553559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:40.554108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.057147 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-67486ea1-1809-476e-9353-3fcd47b307e1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 204 len: 0 microversion: 2.1 time: 1.029552 Jun 04 21:01:41.057833 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1101/2291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:40 2022] DELETE /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 0 bytes in 1033 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:41.068121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-05fd45a6-2aa9-483b-be21-a96199985fe7 req-ee7244a1-84e6-4aed-ae98-727bf071afa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44488ee-6a65-404c-8907-02ee23f75774", "tag": "471386bb-e273-4917-a745-e543e8ccf6e1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:41.090449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-05fd45a6-2aa9-483b-be21-a96199985fe7 req-ee7244a1-84e6-4aed-ae98-727bf071afa4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.093640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-05fd45a6-2aa9-483b-be21-a96199985fe7 req-ee7244a1-84e6-4aed-ae98-727bf071afa4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.122477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-05fd45a6-2aa9-483b-be21-a96199985fe7 req-ee7244a1-84e6-4aed-ae98-727bf071afa4 service nova] Creating event network-changed:471386bb-e273-4917-a745-e543e8ccf6e1 for instance b44488ee-6a65-404c-8907-02ee23f75774 on nch1-master-1 Jun 04 21:01:41.138621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-05fd45a6-2aa9-483b-be21-a96199985fe7 req-ee7244a1-84e6-4aed-ae98-727bf071afa4 service nova] Instance b44488ee-6a65-404c-8907-02ee23f75774 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:01:41.153414 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-05fd45a6-2aa9-483b-be21-a96199985fe7 req-ee7244a1-84e6-4aed-ae98-727bf071afa4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089249 Jun 04 21:01:41.154371 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1102/2292] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:41.163558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:41.164589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:41.178153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.178902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.180111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.180605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.212218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:41.224515 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d1b54687-4dc3-46c1-b7ac-8bb63436ea45 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1666 microversion: 2.1 time: 0.735206 Jun 04 21:01:41.237045 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1191/2293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:40 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1666 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:41.248126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:41.248644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:41.264838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.266901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.270194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.271046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.314741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:01:41.484541 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13f3265b-86cc-4334-b52f-474067997cce tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 204 len: 0 microversion: 2.1 time: 0.244256 Jun 04 21:01:41.487647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1192/2294] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:41 2022] DELETE /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:41.504569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:41.506718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:41.524348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.524908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.526687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.527924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.699605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:41.714249 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fb516130-4279-4b67-8121-054b53f8a7a3 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1509 microversion: 2.1 time: 0.558343 Jun 04 21:01:41.714861 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1103/2295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:41 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:41.724315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:41.724982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:41.744742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.745313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.746697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:41.747192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:41.857030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:41.866827 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf9b3a33-2741-402a-9ba2-9c2c37da0957 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1273 microversion: 2.1 time: 0.150544 Jun 04 21:01:41.867454 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1104/2296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:41 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:41.890970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2109786554", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "cb31943d-3a91-4b52-84f6-c98fcd43073f"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:41.964712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] validate_networks() for [('cb31943d-3a91-4b52-84f6-c98fcd43073f', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:01:41.976866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:41.989065 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f58b0bb-1f7d-4abd-96a1-0fa6b4516b4a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1471 microversion: 2.1 time: 0.499561 Jun 04 21:01:42.003942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1193/2297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:41 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1471 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:42.037835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4ed254c2-ac80-4455-bec9-fcb8a63361f5 req-06de372c-fa59-4d63-8c21-a5633c4ed28e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44488ee-6a65-404c-8907-02ee23f75774", "name": "network-vif-plugged", "status": "completed", "tag": "471386bb-e273-4917-a745-e543e8ccf6e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:42.049286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4ed254c2-ac80-4455-bec9-fcb8a63361f5 req-06de372c-fa59-4d63-8c21-a5633c4ed28e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.050088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4ed254c2-ac80-4455-bec9-fcb8a63361f5 req-06de372c-fa59-4d63-8c21-a5633c4ed28e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:42.080892 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4ed254c2-ac80-4455-bec9-fcb8a63361f5 req-06de372c-fa59-4d63-8c21-a5633c4ed28e service nova] Creating event network-vif-plugged:471386bb-e273-4917-a745-e543e8ccf6e1 for instance b44488ee-6a65-404c-8907-02ee23f75774 on nch1-master-1 Jun 04 21:01:42.094371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-4ed254c2-ac80-4455-bec9-fcb8a63361f5 req-06de372c-fa59-4d63-8c21-a5633c4ed28e service nova] Instance b44488ee-6a65-404c-8907-02ee23f75774 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:01:42.120220 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4ed254c2-ac80-4455-bec9-fcb8a63361f5 req-06de372c-fa59-4d63-8c21-a5633c4ed28e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084497 Jun 04 21:01:42.120862 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1194/2298] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:01:42.240586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:42.242214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:42.250395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.251056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:42.252178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.252985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:42.291693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:01:42.410836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61346790-2566-4fea-a23a-0605e5af9024 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 204 len: 0 microversion: 2.1 time: 0.175283 Jun 04 21:01:42.412205 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1195/2299] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:42 2022] DELETE /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:42.422693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:42.424769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:42.435066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.435667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:42.437874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.439113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:42.743559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:42.755950 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3554b155-7f87-4112-8909-d876bf14d80d tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1598 microversion: 2.1 time: 0.341196 Jun 04 21:01:42.757286 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1196/2300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:42 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1598 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:42.765886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:42.766514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:42.792403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.793138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:42.793774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:42.794211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:43.546052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:43.557983 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05f2e633-40a0-4ad7-ba4e-355564e3d4ee tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1508 microversion: 2.1 time: 0.799403 Jun 04 21:01:43.559276 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1197/2301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:42 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1508 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:43.566946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:43.568474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:43.580932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:43.582180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:43.586152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:43.587065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:43.615602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:43.815810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:01:43.816798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:01:43.817802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:01:43.818440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:01:43.819438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:01:43.831776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:43.833131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:43.834495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:43.835580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:43.898337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:01:43.909849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for user d96f5288364449e3af2f39c71a8c3ef2 and project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:01:43.929798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:01:43.933425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:01:44.005282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-472ca6b9-e855-41b7-8145-8797157812d2 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.118031 Jun 04 21:01:44.014670 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1105/2302] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:01:44.022963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:44.025085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:44.037299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.038632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.039954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.040781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.219064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:44.242221 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb186f7c-dca8-4697-a286-7839f28f9a22 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1452 microversion: 2.1 time: 0.681498 Jun 04 21:01:44.243103 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1198/2303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:43 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1452 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:44.247975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:44.248795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:44.269293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.270159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.271306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.272330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.803977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:44.818849 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e80fda2c-8a80-43d9-a9c4-b470df54beb1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 0.801731 Jun 04 21:01:44.821255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1106/2304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:44 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:44.827218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-07b94048-6e53-4940-93e5-68bcbcf50266 req-be63c10d-1c5d-48fe-9209-89dcfdcc8ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989d37f9-1809-4c90-b21e-b602ea326af6", "name": "network-vif-deleted", "tag": "6abbedee-2a93-43a3-924c-d0dcd6574754"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:44.837301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-07b94048-6e53-4940-93e5-68bcbcf50266 req-be63c10d-1c5d-48fe-9209-89dcfdcc8ec7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.838312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-07b94048-6e53-4940-93e5-68bcbcf50266 req-be63c10d-1c5d-48fe-9209-89dcfdcc8ec7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.844473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:44.855808 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5cb06d0b-dc94-4609-8b68-f7a288801378 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1471 microversion: 2.1 time: 0.611416 Jun 04 21:01:44.859639 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-07b94048-6e53-4940-93e5-68bcbcf50266 req-be63c10d-1c5d-48fe-9209-89dcfdcc8ec7 service nova] Creating event network-vif-deleted:6abbedee-2a93-43a3-924c-d0dcd6574754 for instance 989d37f9-1809-4c90-b21e-b602ea326af6 on nch1-master-1 Jun 04 21:01:44.874268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1199/2305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:44 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1471 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:44.881149 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-07b94048-6e53-4940-93e5-68bcbcf50266 req-be63c10d-1c5d-48fe-9209-89dcfdcc8ec7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053849 Jun 04 21:01:44.882456 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1107/2306] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:44.889867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:44.891817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:44.897064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:44.898588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:44.906355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.908041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.909096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.909693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.923162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.923677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:44.924541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:44.924978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.098580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:45.109270 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-004b6bbe-8ae0-4d68-b848-e18dcbe928f0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1212 microversion: 2.1 time: 0.224201 Jun 04 21:01:45.109879 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1108/2307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:44 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1212 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:45.119133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f083a447601492b8b9d7ad1ad9d934a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6678835ec247d69b883f430be98e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:45.127798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-87a24f69-2198-43e6-89ed-3642c27c7eaa req-5b9ceeef-fa1b-4547-a730-a0b84a1f9644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "name": "network-vif-unplugged", "status": "completed", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:45.130881 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5ea8c402-3aa8-4d24-9bef-3429031682bb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 200 len: 1310 microversion: 2.1 time: 0.253065 Jun 04 21:01:45.131662 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1200/2308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:44 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 1310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:45.145580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-87a24f69-2198-43e6-89ed-3642c27c7eaa req-5b9ceeef-fa1b-4547-a730-a0b84a1f9644 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.146339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:45.148006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:45.149790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-87a24f69-2198-43e6-89ed-3642c27c7eaa req-5b9ceeef-fa1b-4547-a730-a0b84a1f9644 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.156756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.157561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.158861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.159475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.173712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.server_external_events [req-87a24f69-2198-43e6-89ed-3642c27c7eaa req-5b9ceeef-fa1b-4547-a730-a0b84a1f9644 service nova] Unable to find a host for instance 6544912e-117f-4311-88e5-885fd318c074. Dropping event network-vif-unplugged {{(pid=137229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 21:01:45.181681 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-87a24f69-2198-43e6-89ed-3642c27c7eaa req-5b9ceeef-fa1b-4547-a730-a0b84a1f9644 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062166 Jun 04 21:01:45.183831 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1109/2309] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 21:01:45.191002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:45.191948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:45.198616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.200198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.201341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.201976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.788518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:45.796667 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bed46cb3-3ce1-497b-a079-7dd242203cef tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1508 microversion: 2.1 time: 0.611519 Jun 04 21:01:45.797268 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1110/2310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:45 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1508 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:45.840277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:45.842197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:45.858579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.859138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.860074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.860718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.867825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:45.889400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4eb2a8a5-4060-4de2-96c9-d09e415f0290 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1452 microversion: 2.1 time: 0.752899 Jun 04 21:01:45.891499 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1201/2311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:45 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1452 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:45.899478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:45.900130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:45.909356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.910374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:45.911714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:45.916139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.009999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:47.029569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:47.032494 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a673149e-3ab1-4f2b-89da-2b941eb20a52 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 1.198075 Jun 04 21:01:47.033590 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1111/2312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:45 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:01:47.043624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:47.044457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:47.046147 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-43e702c5-b4cb-4551-b3bf-f0332b3b4352 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1463 microversion: 2.1 time: 1.152861 Jun 04 21:01:47.046747 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1202/2313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:45 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1463 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:47.051647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:47.054409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:47.067601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.068244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.069483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.071640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.072122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.072461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.073299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.076246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.114274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lazy-loading 'flavor' on Instance uuid 6544912e-117f-4311-88e5-885fd318c074 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:01:47.140868 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'shelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state shelved_offloaded Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 14 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: {"shelve": {}} Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: exception: Cannot 'shelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state shelved_offloaded Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'shelve': {}}} Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jun 04 21:01:47.143239 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state shelved_offloaded Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state shelved_offloaded Jun 04 21:01:47.150951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.154347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'shelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state shelved_offloaded {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:47.155637 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f1dc0bad-d853-4b26-8b4d-65406d7f9a24 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 155 microversion: 2.1 time: 0.120373 Jun 04 21:01:47.161324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1112/2314] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:47 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 155 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:47.170072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:47.170788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] [instance: 989d37f9-1809-4c90-b21e-b602ea326af6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:47.182026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.182755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.184333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.186729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.208319 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] HTTP exception thrown: Instance 989d37f9-1809-4c90-b21e-b602ea326af6 could not be found. Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Request method failure captured: Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 HTTP/1.1 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fmtrYH1Rf5TO_n1LPm0Q_VokKw-oZy0B7nskFZV7Lq2g6sNF8boK10osLGTE-hQGowRMxXVut2ZRinpJCHVsqeZfZLzxJl9IpdmjOFyA7gANlByaQv2UCXbelRpN0c1cMICrtGlbky5wLip2NrYo6J9qbFE8T0A2isX3qHUt1a61E Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 2f6678835ec247d69b883f430be98e08 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestFqdnHostnames-981861331 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2f6678835ec247d69b883f430be98e08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f6678835ec247d69b883f430be98e08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2f6678835ec247d69b883f430be98e08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2f6678835ec247d69b883f430be98e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestFqdnHostnames-981861331 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 2f6678835ec247d69b883f430be98e08 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-981861331 Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestFqdnHostnames-981861331-project Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3f083a447601492b8b9d7ad1ad9d934a Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestFqdnHostnames-981861331-project Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 989d37f9-1809-4c90-b21e-b602ea326af6 could not be found. Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '989d37f9-1809-4c90-b21e-b602ea326af6'} Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 989d37f9-1809-4c90-b21e-b602ea326af6 could not be found. Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 989d37f9-1809-4c90-b21e-b602ea326af6 could not be found. Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:47.210995 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 989d37f9-1809-4c90-b21e-b602ea326af6 could not be found. Jun 04 21:01:47.217282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:47.219252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Returning 404 to user: Instance 989d37f9-1809-4c90-b21e-b602ea326af6 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:47.221586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4aaeb057-2264-4b29-8f1e-22f53e39dacb tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6" status: 404 len: 111 microversion: 2.1 time: 0.057792 Jun 04 21:01:47.224191 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1113/2315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:47 2022] GET /compute/v2.1/servers/989d37f9-1809-4c90-b21e-b602ea326af6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:47.230263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:47.237380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:47.239272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:47.243359 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a296f8d0-d874-4230-9aec-25e941f68ecf tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1266 microversion: 2.1 time: 0.195289 Jun 04 21:01:47.244132 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1203/2316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:47 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:47.250289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.250755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.251626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.252077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.254280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:47.255591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:47.274731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.275601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.276625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:47.277284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:47.281987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:47.931722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:47.951847 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e6ce6eb-dab0-439d-93dd-56812b6b2d71 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1463 microversion: 2.1 time: 0.704863 Jun 04 21:01:47.953673 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1204/2317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:47 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1463 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:47.957260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:47.960833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:47.963329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:47.973651 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b840edb3-194b-458f-8723-2910bbca5ebd tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1508 microversion: 2.1 time: 0.748213 Jun 04 21:01:47.975178 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1114/2318] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:47 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1508 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:47.980081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4af94062-586d-4dc8-a489-161dd85dde50 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] Calling method '.version_select at 0x7f2d0bde8b80>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:48.000447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.006357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.008094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.009321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.025460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4af94062-586d-4dc8-a489-161dd85dde50 tempest-ServersTestFqdnHostnames-981861331 tempest-ServersTestFqdnHostnames-981861331-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299277983" status: 202 len: 0 microversion: 2.1 time: 0.048945 Jun 04 21:01:48.026379 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1115/2319] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299277983 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:48.041489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-52056f3d-3808-452b-a370-3e6d22289e24 req-1ea7f12c-aa60-4ed3-a1cc-ae08f6bf9569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3220a33d-d40a-40ba-9569-27179eeb3979", "name": "network-vif-deleted", "tag": "a010160e-6e0c-4393-9c1a-97cd5d792950"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:48.067662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-52056f3d-3808-452b-a370-3e6d22289e24 req-1ea7f12c-aa60-4ed3-a1cc-ae08f6bf9569 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.068408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-52056f3d-3808-452b-a370-3e6d22289e24 req-1ea7f12c-aa60-4ed3-a1cc-ae08f6bf9569 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.083422 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-52056f3d-3808-452b-a370-3e6d22289e24 req-1ea7f12c-aa60-4ed3-a1cc-ae08f6bf9569 service nova] Creating event network-vif-deleted:a010160e-6e0c-4393-9c1a-97cd5d792950 for instance 3220a33d-d40a-40ba-9569-27179eeb3979 on nch1-master-1 Jun 04 21:01:48.093093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-52056f3d-3808-452b-a370-3e6d22289e24 req-1ea7f12c-aa60-4ed3-a1cc-ae08f6bf9569 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065446 Jun 04 21:01:48.093954 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1116/2320] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:48.109245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-70291ae1-e9e0-4687-b6e4-751c36678aeb tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'create', calling method: .version_select at 0x7f2d0bf34c10>, body: {"keypair": {"name": "tempest-keypair-1733995133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgKkLqYUD54AdnWsDj8IrdyJliHuKd1DvTzm0ijsZ7AvjpDRRrCGEJCTOyTn0GVKYAUwOdE3ukPfM6+aJlJMfecyAHQ29qX2EkGvIh3fTSEK7KDKOpbkdkw/HA2w1MMdw=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:48.137662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-70291ae1-e9e0-4687-b6e4-751c36678aeb tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for project 29ca718638c842a98bb90cc3adb3979f. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:01:48.141953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:48.144543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-70291ae1-e9e0-4687-b6e4-751c36678aeb tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for user 5b4c3539c5534d2c844944f9be3f9963 and project 29ca718638c842a98bb90cc3adb3979f. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:01:48.190949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-70291ae1-e9e0-4687-b6e4-751c36678aeb tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095083 Jun 04 21:01:48.192304 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1117/2321] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:01:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:48.197404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:48.198905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:48.210976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.212825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.213950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.214603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.216731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:48.341601 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9de6e6e7-81ae-4bfd-89cf-9196434a2c93 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 202 len: 0 microversion: 2.1 time: 0.385489 Jun 04 21:01:48.346522 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1205/2322] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:01:47 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:01:48.352957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:48.353793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:48.364572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.365337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.366377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.367074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.872797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:48.884980 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb0ccf19-f68c-488b-bcf0-ce690797e73f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1266 microversion: 2.1 time: 0.536950 Jun 04 21:01:48.888912 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1206/2323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:48 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:48.897344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:48.898274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:48.921915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.924749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:48.929318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:48.930206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:49.531754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:49.541868 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9569c0c9-c53c-45df-b5cf-63e1e2c9c963 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 1.348248 Jun 04 21:01:49.556998 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1118/2324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:48 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:49.569945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:49.570798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:49.589710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:49.590379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:49.591194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:49.591686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:49.660688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:49.665394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:49.667862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'fault' on Instance uuid 7907307f-3aab-444e-a6ab-d0988fd26463 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:01:49.816602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:49.825908 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e2c52bf-543b-478c-87bc-8d5e3c50ca1e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 200 len: 1312 microversion: 2.1 time: 0.267408 Jun 04 21:01:49.826514 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1119/2325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:49 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:49.836508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-26536d86-58e9-40d8-89ca-bf7b8dd54192 req-5186c2e9-c954-402b-ab84-e17259656ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2c35d6-29be-4969-b399-b35e4ceea667", "tag": "1841e45a-a429-4cc2-8e93-ecdde075787a"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:49.859342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-26536d86-58e9-40d8-89ca-bf7b8dd54192 req-5186c2e9-c954-402b-ab84-e17259656ff1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:49.859980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-26536d86-58e9-40d8-89ca-bf7b8dd54192 req-5186c2e9-c954-402b-ab84-e17259656ff1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:49.890159 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-26536d86-58e9-40d8-89ca-bf7b8dd54192 req-5186c2e9-c954-402b-ab84-e17259656ff1 service nova] Creating event network-changed:1841e45a-a429-4cc2-8e93-ecdde075787a for instance cf2c35d6-29be-4969-b399-b35e4ceea667 on nch1-master-1 Jun 04 21:01:49.908154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-26536d86-58e9-40d8-89ca-bf7b8dd54192 req-5186c2e9-c954-402b-ab84-e17259656ff1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075483 Jun 04 21:01:49.908792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1120/2326] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:49.915364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:49.916031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:49.934535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:49.937377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:49.937377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:49.937377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:50.125801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:50.140793 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2943c99e-015e-4893-8f29-2923ba7a981f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1460 microversion: 2.1 time: 1.250512 Jun 04 21:01:50.144130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1207/2327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:48 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1460 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:50.565388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:50.566026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:50.580586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:50.581301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:50.585311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:50.586068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:50.658451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:50.672161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-35b74924-b3e4-493a-b7f2-533f945f90e7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1308 microversion: 2.1 time: 0.761496 Jun 04 21:01:50.674749 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1121/2328] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:49 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1308 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:50.843627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:50.844255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 7907307f-3aab-444e-a6ab-d0988fd26463] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:50.857834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:50.858298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:50.859115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:50.859578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:50.918073 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 could not be found. Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 HTTP/1.1 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 could not be found. Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '7907307f-3aab-444e-a6ab-d0988fd26463'} Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 could not be found. Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 could not be found. Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:50.924331 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 could not be found. Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 404 to user: Instance 7907307f-3aab-444e-a6ab-d0988fd26463 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:50.927644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2dcb52b1-1602-4cda-8c75-0145dd0c9ca0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463" status: 404 len: 111 microversion: 2.1 time: 0.086345 Jun 04 21:01:50.931970 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1122/2329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:50 2022] GET /compute/v2.1/servers/7907307f-3aab-444e-a6ab-d0988fd26463 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:01:50.944490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:50.945007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:50.973545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:50.974248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:50.976070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:50.976693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:51.031981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:01:51.140074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:51.208764 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-495f242f-c1a1-4bc4-843d-4e8858d5e776 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "DELETE /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 204 len: 0 microversion: 2.1 time: 0.275033 Jun 04 21:01:51.212865 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1123/2330] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:50 2022] DELETE /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:01:51.237853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:51.239245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:51.260465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:51.262033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:51.263862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:51.268170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:51.649033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:51.687569 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0d30866d-0ee7-4e04-9f18-b2009eae675f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 1.125086 Jun 04 21:01:51.691577 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1208/2331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:50 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:51.707540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:51.708468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:51.719758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:51.720476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:51.721662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:51.722875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:51.990716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:52.001017 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-545db282-6ee2-4e55-980f-b4e6fa05f378 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.785134 Jun 04 21:01:52.013725 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1124/2332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:51 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:52.018916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:52.019643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:52.027697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:52.028482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:52.029463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:52.030095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:52.238338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:52.247304 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-476b5d0c-ec91-466f-ab56-9fd2d12949b1 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.551783 Jun 04 21:01:52.258081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1209/2333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:51 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:52.438251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:52.451652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c186d87-1bbb-49e2-a5bf-0751b5adae0d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1308 microversion: 2.1 time: 0.436600 Jun 04 21:01:52.454693 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1125/2334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:52 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:52.468338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-103771f8-6960-471b-99de-c45cb1d56bc2 req-c33b5f2b-bc06-4965-8ea2-072dfadb501f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7907307f-3aab-444e-a6ab-d0988fd26463", "name": "network-vif-deleted", "tag": "49322108-2953-4067-a051-dd150b181db1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:52.492613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-103771f8-6960-471b-99de-c45cb1d56bc2 req-c33b5f2b-bc06-4965-8ea2-072dfadb501f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:52.493665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-103771f8-6960-471b-99de-c45cb1d56bc2 req-c33b5f2b-bc06-4965-8ea2-072dfadb501f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:52.504970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88c475c9-4ae8-40f6-afb9-c546cf2aa21a tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Calling method '.version_select at 0x7f2d027f7e50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:52.533674 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-103771f8-6960-471b-99de-c45cb1d56bc2 req-c33b5f2b-bc06-4965-8ea2-072dfadb501f service nova] Creating event network-vif-deleted:49322108-2953-4067-a051-dd150b181db1 for instance 7907307f-3aab-444e-a6ab-d0988fd26463 on nch1-master-1 Jun 04 21:01:52.541735 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-103771f8-6960-471b-99de-c45cb1d56bc2 req-c33b5f2b-bc06-4965-8ea2-072dfadb501f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085087 Jun 04 21:01:52.542826 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1126/2335] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:52.547578 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-88c475c9-4ae8-40f6-afb9-c546cf2aa21a tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] HTTP exception thrown: Image not found. Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88c475c9-4ae8-40f6-afb9-c546cf2aa21a tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Request method failure captured: Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/images/e85bc0fe-c2ef-4853-a034-beec426c116c/metadata/os_distro HTTP/1.1 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8g_8c9vFJOJmQTdPxW-QmxzQv2slwpx-o7SVMHtTZYjjPvSPMNz_wOC-wb9YmgE0QaH5JIlOh_7HWzr2Egk9U8M9zAc7WyPFn9erunizqi_nYHnO4shbVN-Mu-JWgronYI2P0qPWK2ReWgmmOqb_k1TQDaOgDNGqEL75AFvgHb8x54 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 28c7d452f8ee427f8b40c32ab14de52e Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'image_id': 'e85bc0fe-c2ef-4853-a034-beec426c116c', 'id': 'os_distro'} Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e85bc0fe-c2ef-4853-a034-beec426c116c Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:01:52.558831 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e85bc0fe-c2ef-4853-a034-beec426c116c could not be found. Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.563041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88c475c9-4ae8-40f6-afb9-c546cf2aa21a tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:52.566706 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88c475c9-4ae8-40f6-afb9-c546cf2aa21a tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] 10.222.0.18 "DELETE /compute/v2.1/images/e85bc0fe-c2ef-4853-a034-beec426c116c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.305287 Jun 04 21:01:52.566706 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1210/2336] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:01:52 2022] DELETE /compute/v2.1/images/e85bc0fe-c2ef-4853-a034-beec426c116c/metadata/os_distro => generated 62 bytes in 308 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:52.577265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-792353dc-817f-4fc7-a635-312ba1eb5c08 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Calling method '.version_select at 0x7f2d026a2ee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:52.603870 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-792353dc-817f-4fc7-a635-312ba1eb5c08 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] HTTP exception thrown: Image not found. Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-792353dc-817f-4fc7-a635-312ba1eb5c08 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Request method failure captured: Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/images/3a13be6a-dbb7-4b8b-93f6-fd130e30318b/metadata/os_version HTTP/1.1 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8g_8c9vFJOJmQTdPxW-QmxzQv2slwpx-o7SVMHtTZYjjPvSPMNz_wOC-wb9YmgE0QaH5JIlOh_7HWzr2Egk9U8M9zAc7WyPFn9erunizqi_nYHnO4shbVN-Mu-JWgronYI2P0qPWK2ReWgmmOqb_k1TQDaOgDNGqEL75AFvgHb8x54 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 28c7d452f8ee427f8b40c32ab14de52e Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'image_id': '3a13be6a-dbb7-4b8b-93f6-fd130e30318b', 'id': 'os_version'} Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3a13be6a-dbb7-4b8b-93f6-fd130e30318b Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:01:52.606431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3a13be6a-dbb7-4b8b-93f6-fd130e30318b could not be found. Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:52.610087 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.612994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-792353dc-817f-4fc7-a635-312ba1eb5c08 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:52.612994 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-792353dc-817f-4fc7-a635-312ba1eb5c08 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] 10.222.0.18 "GET /compute/v2.1/images/3a13be6a-dbb7-4b8b-93f6-fd130e30318b/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.039735 Jun 04 21:01:52.618399 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1127/2337] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:01:52 2022] GET /compute/v2.1/images/3a13be6a-dbb7-4b8b-93f6-fd130e30318b/metadata/os_version => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:52.624271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ee0f4d0b-dbf0-41c2-a554-521a1304e198 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Calling method '.version_select at 0x7f2d023a9940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:52.671352 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-ee0f4d0b-dbf0-41c2-a554-521a1304e198 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] HTTP exception thrown: Image not found. Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ee0f4d0b-dbf0-41c2-a554-521a1304e198 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Request method failure captured: Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/images/6358d0e2-7124-44d3-a930-06dc8dbb2d65/metadata HTTP/1.1 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8g_8c9vFJOJmQTdPxW-QmxzQv2slwpx-o7SVMHtTZYjjPvSPMNz_wOC-wb9YmgE0QaH5JIlOh_7HWzr2Egk9U8M9zAc7WyPFn9erunizqi_nYHnO4shbVN-Mu-JWgronYI2P0qPWK2ReWgmmOqb_k1TQDaOgDNGqEL75AFvgHb8x54 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 28c7d452f8ee427f8b40c32ab14de52e Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'image_id': '6358d0e2-7124-44d3-a930-06dc8dbb2d65'} Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6358d0e2-7124-44d3-a930-06dc8dbb2d65 Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:01:52.679070 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6358d0e2-7124-44d3-a930-06dc8dbb2d65 could not be found. Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.682383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ee0f4d0b-dbf0-41c2-a554-521a1304e198 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:52.685502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ee0f4d0b-dbf0-41c2-a554-521a1304e198 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] 10.222.0.18 "GET /compute/v2.1/images/6358d0e2-7124-44d3-a930-06dc8dbb2d65/metadata" status: 404 len: 62 microversion: 2.1 time: 0.064025 Jun 04 21:01:52.689198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1211/2338] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:01:52 2022] GET /compute/v2.1/images/6358d0e2-7124-44d3-a930-06dc8dbb2d65/metadata => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:52.695728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b848288c-945c-4a89-ada0-9d41c53efd58 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Action: 'update_all', calling method: .version_select at 0x7f2d0bf86430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:52.709634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:52.710522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:52.717317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:52.718105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:52.719103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:52.719886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:52.730621 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b848288c-945c-4a89-ada0-9d41c53efd58 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] HTTP exception thrown: Image not found. Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b848288c-945c-4a89-ada0-9d41c53efd58 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Request method failure captured: Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/images/376dfed0-4c87-4490-89b4-a509f824db94/metadata HTTP/1.1 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 57 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8g_8c9vFJOJmQTdPxW-QmxzQv2slwpx-o7SVMHtTZYjjPvSPMNz_wOC-wb9YmgE0QaH5JIlOh_7HWzr2Egk9U8M9zAc7WyPFn9erunizqi_nYHnO4shbVN-Mu-JWgronYI2P0qPWK2ReWgmmOqb_k1TQDaOgDNGqEL75AFvgHb8x54 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 28c7d452f8ee427f8b40c32ab14de52e Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'image_id': '376dfed0-4c87-4490-89b4-a509f824db94', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 376dfed0-4c87-4490-89b4-a509f824db94 Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:01:52.733556 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 376dfed0-4c87-4490-89b4-a509f824db94 could not be found. Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:52.737473 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.743153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b848288c-945c-4a89-ada0-9d41c53efd58 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:52.744232 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b848288c-945c-4a89-ada0-9d41c53efd58 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] 10.222.0.18 "PUT /compute/v2.1/images/376dfed0-4c87-4490-89b4-a509f824db94/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052817 Jun 04 21:01:52.745312 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1128/2339] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:01:52 2022] PUT /compute/v2.1/images/376dfed0-4c87-4490-89b4-a509f824db94/metadata => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:52.754945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd0ebff2-dda7-44da-b331-44fd42cb5184 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Action: 'update', calling method: .version_select at 0x7f2d0be6f1f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:52.792432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-fd0ebff2-dda7-44da-b331-44fd42cb5184 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] HTTP exception thrown: Image not found. Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd0ebff2-dda7-44da-b331-44fd42cb5184 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Request method failure captured: Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/images/8c25030f-7985-414d-b056-ad6382ed8368/metadata/os_distro HTTP/1.1 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 30 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8g_8c9vFJOJmQTdPxW-QmxzQv2slwpx-o7SVMHtTZYjjPvSPMNz_wOC-wb9YmgE0QaH5JIlOh_7HWzr2Egk9U8M9zAc7WyPFn9erunizqi_nYHnO4shbVN-Mu-JWgronYI2P0qPWK2ReWgmmOqb_k1TQDaOgDNGqEL75AFvgHb8x54 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 28c7d452f8ee427f8b40c32ab14de52e Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: {"meta": {"os_distro": "alt"}} Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'image_id': '8c25030f-7985-414d-b056-ad6382ed8368', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8c25030f-7985-414d-b056-ad6382ed8368 Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:01:52.794950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c25030f-7985-414d-b056-ad6382ed8368 could not be found. Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:52.798238 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.803269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd0ebff2-dda7-44da-b331-44fd42cb5184 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:52.804366 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd0ebff2-dda7-44da-b331-44fd42cb5184 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] 10.222.0.18 "PUT /compute/v2.1/images/8c25030f-7985-414d-b056-ad6382ed8368/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.053904 Jun 04 21:01:52.805140 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1129/2340] 10.222.0.18 () {60 vars in 1309 bytes} [Sat Jun 4 21:01:52 2022] PUT /compute/v2.1/images/8c25030f-7985-414d-b056-ad6382ed8368/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 21:01:52.816765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7a30f99-c70f-4a1f-b728-b726b6bdecb4 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Action: 'create', calling method: .version_select at 0x7f2d0277bdc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:52.843903 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-e7a30f99-c70f-4a1f-b728-b726b6bdecb4 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] HTTP exception thrown: Image not found. Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7a30f99-c70f-4a1f-b728-b726b6bdecb4 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Request method failure captured: Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/images/63da9d94-eaa9-48ce-a22b-18deef2ac683/metadata HTTP/1.1 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 57 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8g_8c9vFJOJmQTdPxW-QmxzQv2slwpx-o7SVMHtTZYjjPvSPMNz_wOC-wb9YmgE0QaH5JIlOh_7HWzr2Egk9U8M9zAc7WyPFn9erunizqi_nYHnO4shbVN-Mu-JWgronYI2P0qPWK2ReWgmmOqb_k1TQDaOgDNGqEL75AFvgHb8x54 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/30dfb49bbee24d9dacf529ded86a18f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 30dfb49bbee24d9dacf529ded86a18f8 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-508620571 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 28c7d452f8ee427f8b40c32ab14de52e Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-508620571-project Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'image_id': '63da9d94-eaa9-48ce-a22b-18deef2ac683', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 63da9d94-eaa9-48ce-a22b-18deef2ac683 Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:01:52.847047 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 63da9d94-eaa9-48ce-a22b-18deef2ac683 could not be found. Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7a30f99-c70f-4a1f-b728-b726b6bdecb4 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e7a30f99-c70f-4a1f-b728-b726b6bdecb4 tempest-ImagesMetadataNegativeTestJSON-508620571 tempest-ImagesMetadataNegativeTestJSON-508620571-project] 10.222.0.18 "POST /compute/v2.1/images/63da9d94-eaa9-48ce-a22b-18deef2ac683/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037884 Jun 04 21:01:52.855056 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1130/2341] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Jun 4 21:01:52 2022] POST /compute/v2.1/images/63da9d94-eaa9-48ce-a22b-18deef2ac683/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 04 21:01:53.023172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:53.024228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:53.042945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:53.044332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:53.056112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:53.056826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:53.738907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:53.744907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:53.766534 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e34eb245-4974-4dc4-a605-bcf3780e492c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.748962 Jun 04 21:01:53.768414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7c60b04f-cf9a-4f4b-be84-cdc6b38987af tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 1.063050 Jun 04 21:01:53.768880 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1131/2342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:53 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:53.771254 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1212/2343] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:52 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:53.777638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:53.778745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:53.789204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:53.789986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:53.791776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:53.792656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:53.801124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:53.802080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:53.813358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:53.814079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:53.815640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:53.816414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:53.851133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:54.417600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:54.433188 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0628ac97-b727-45d6-b5f6-4a46554bd42c tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 0.642075 Jun 04 21:01:54.434165 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1132/2344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:53 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:54.449668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af2991ff-9a07-42b6-a60e-e1eae2fa9381 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Action: 'create', calling method: .version_select at 0x7f2d0bd9c790>, body: {"keypair": {"name": "tempest-keypair-1404489988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLAcm3bHaHWICpuo++sCILg/h8d1PxscfZDdDDnNe89Rl3tpp5uOe2ifYOqElFgW9kcZEX/PHFCmcZT2Z9A6e5WpcyDoR5Re+B2ymAwGF60oZEECeOJVO8aXFC7DI23WQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:54.492743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-af2991ff-9a07-42b6-a60e-e1eae2fa9381 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Getting quotas for project 83e17865ce4e4d2ba7854d03668bfb78. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:01:54.500483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-af2991ff-9a07-42b6-a60e-e1eae2fa9381 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Getting quotas for user 890837d5b27e4471b54c1eac851e88c5 and project 83e17865ce4e4d2ba7854d03668bfb78. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:01:54.522679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:54.536808 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fcf23d50-a5f6-44e7-a42f-484d6678343e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1308 microversion: 2.1 time: 0.763301 Jun 04 21:01:54.537745 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1213/2345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:53 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1308 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:54.579044 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af2991ff-9a07-42b6-a60e-e1eae2fa9381 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.140223 Jun 04 21:01:54.579806 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1133/2346] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 21:01:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 21:01:54.589232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-247342be-ec7d-43eb-9b5b-d4cb1737765a req-6f9dc0d7-b6b8-4140-bda3-bef8afacf5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328b885a-2830-40c9-8726-53e1d9288a4a", "tag": "0e1e5687-915f-4676-b561-9d37640fadea"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:54.611903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-247342be-ec7d-43eb-9b5b-d4cb1737765a req-6f9dc0d7-b6b8-4140-bda3-bef8afacf5b9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:54.612412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-247342be-ec7d-43eb-9b5b-d4cb1737765a req-6f9dc0d7-b6b8-4140-bda3-bef8afacf5b9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:54.629960 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-247342be-ec7d-43eb-9b5b-d4cb1737765a req-6f9dc0d7-b6b8-4140-bda3-bef8afacf5b9 service nova] Creating event network-changed:0e1e5687-915f-4676-b561-9d37640fadea for instance 328b885a-2830-40c9-8726-53e1d9288a4a on nch2-master-1 Jun 04 21:01:54.637303 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-247342be-ec7d-43eb-9b5b-d4cb1737765a req-6f9dc0d7-b6b8-4140-bda3-bef8afacf5b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058818 Jun 04 21:01:54.640072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1214/2347] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:01:54.795448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:54.804046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:54.805506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:54.805748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:54.824727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:54.826090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:54.826873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:54.827285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:54.828140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:54.830489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:54.831052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:54.831591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:55.566306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:55.576407 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b445b3de-d2ee-4777-8a47-c6ad71084dab tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 0.778370 Jun 04 21:01:55.587898 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1215/2348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:54 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:55.592777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c8611c6-c133-410e-8c35-ab9a73a47691 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '.version_select at 0x7f2d01ab4af0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:55.595495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c8611c6-c133-410e-8c35-ab9a73a47691 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:55.596008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c8611c6-c133-410e-8c35-ab9a73a47691 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:55.617842 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7c8611c6-c133-410e-8c35-ab9a73a47691 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.028476 Jun 04 21:01:55.619187 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1216/2349] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 21:01:55 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:55.623731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:55.638550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:55.663645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:55.664780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:55.666310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:55.667028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:55.698158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:55.702741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:55.710018 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4e56280-108e-4939-b169-511f81e0c847 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.918732 Jun 04 21:01:55.713443 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1134/2350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:54 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:55.728044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:55.729283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:55.746905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:55.747743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:55.750830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:55.751607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:56.719415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:56.742164 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3161a210-5917-4fa4-8313-0b00f69f7e55 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1522 microversion: 2.1 time: 1.120691 Jun 04 21:01:56.759320 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1217/2351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:55 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1522 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:56.761055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:56.767020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0eed51d4-00c3-451e-b63b-4f02ae1deb55 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:56.775613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3fce74fb-e8ab-49d5-9943-984168248161 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1308 microversion: 2.1 time: 1.060625 Jun 04 21:01:56.776211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1135/2352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:55 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1308 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:56.781178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0eed51d4-00c3-451e-b63b-4f02ae1deb55 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018810 Jun 04 21:01:56.782250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1218/2353] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:01:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:56.792028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:56.792884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:56.805338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:56.807838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:56.808844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:56.809504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:56.980308 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff23e89f-1ad8-4a33-8199-9e1aeab86087 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] 10.222.0.18 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.196864 Jun 04 21:01:56.981036 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1219/2354] 10.222.0.18 () {58 vars in 1127 bytes} [Sat Jun 4 21:01:56 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 21:01:56.988807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f95c9d3b-e8fe-4587-94ab-301a908c14f7 req-09cf2720-8001-40c7-a6ae-b215163ecb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:56.998695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f95c9d3b-e8fe-4587-94ab-301a908c14f7 req-09cf2720-8001-40c7-a6ae-b215163ecb45 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:56.999132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f95c9d3b-e8fe-4587-94ab-301a908c14f7 req-09cf2720-8001-40c7-a6ae-b215163ecb45 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:57.010999 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f95c9d3b-e8fe-4587-94ab-301a908c14f7 req-09cf2720-8001-40c7-a6ae-b215163ecb45 service nova] Creating event network-changed:eba1e015-a95a-4ab9-aea1-ca6856d3e3bb for instance 6544912e-117f-4311-88e5-885fd318c074 on nch1-master-1 Jun 04 21:01:57.016490 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f95c9d3b-e8fe-4587-94ab-301a908c14f7 req-09cf2720-8001-40c7-a6ae-b215163ecb45 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Jun 04 21:01:57.017390 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1220/2355] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:57.023172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:57.024156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:57.030905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:57.031350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:57.032361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:57.032799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:57.552093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:57.566310 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4d30ed8-4c60-4301-9468-024a90a1dffd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 0.778265 Jun 04 21:01:57.567284 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1136/2356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:56 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:57.595722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dff0ee8b-119b-4619-9968-ce1a16198d7f tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1354630520", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:57.603126 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:01:57.603126 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:01:57.640445 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dff0ee8b-119b-4619-9968-ce1a16198d7f tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.051081 Jun 04 21:01:57.650862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1137/2357] 10.222.0.18 () {60 vars in 1145 bytes} [Sat Jun 4 21:01:57 2022] POST /compute/v2.1/flavors => generated 499 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:57.673720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7353a182-7fce-4717-b385-71e4111b056d tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Calling method '.version_select at 0x7f2d02021af0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:57.713677 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7353a182-7fce-4717-b385-71e4111b056d tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] HTTP exception thrown: Image not found. Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7353a182-7fce-4717-b385-71e4111b056d tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Request method failure captured: Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8hEp-Pmf1YjD912dHaiUy4H9lTcvIUoO1_ivn48jfK6gTYoe-nnbb63Aa94thsds8252Jk1o-qLlZ7mwWbcq-TRU--MOCdU40HgWc93sHGB9rDvBYeYSFV9IbJzb46tyA4KwHI4wsAmGKcfMyJqQnrMNNsy9AUH_p4YUMWgIkPRQhc Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ba0538ac4197469b93008ddee8fb38ba Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '-1'} Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.721807 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:57.726056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.735676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7353a182-7fce-4717-b385-71e4111b056d tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:57.736560 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7353a182-7fce-4717-b385-71e4111b056d tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] 10.222.0.18 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.084158 Jun 04 21:01:57.737108 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1138/2358] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:01:57 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:57.758690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bccb030a-1659-4295-9ab6-761a5bea4438 req-ed71b441-fb4e-49c0-bede-340c3c3d6eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c35d6-29be-4969-b399-b35e4ceea667", "name": "network-vif-plugged", "status": "completed", "tag": "1841e45a-a429-4cc2-8e93-ecdde075787a"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:57.768309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bccb030a-1659-4295-9ab6-761a5bea4438 req-ed71b441-fb4e-49c0-bede-340c3c3d6eea service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:57.769756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bccb030a-1659-4295-9ab6-761a5bea4438 req-ed71b441-fb4e-49c0-bede-340c3c3d6eea service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:57.782306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:57.794285 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-97640b5f-8c26-4591-8af6-21b9b34f11e4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.775653 Jun 04 21:01:57.798329 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1221/2359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:57 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:57.815874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a27ba83c-450f-4c7a-9ef7-5069dc3cdbdc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:57.816976 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bccb030a-1659-4295-9ab6-761a5bea4438 req-ed71b441-fb4e-49c0-bede-340c3c3d6eea service nova] Creating event network-vif-plugged:1841e45a-a429-4cc2-8e93-ecdde075787a for instance cf2c35d6-29be-4969-b399-b35e4ceea667 on nch1-master-1 Jun 04 21:01:57.825489 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bccb030a-1659-4295-9ab6-761a5bea4438 req-ed71b441-fb4e-49c0-bede-340c3c3d6eea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077435 Jun 04 21:01:57.826497 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1139/2360] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:57.832972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c3915a1-e590-467a-9d9f-c701a9837919 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Calling method '.version_select at 0x7f2d0bf2b9d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:57.839963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a27ba83c-450f-4c7a-9ef7-5069dc3cdbdc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.034709 Jun 04 21:01:57.860667 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1222/2361] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Jun 4 21:01:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:01:57.870279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:57.871332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:57.879913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:57.882893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:57.883689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:57.884869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:57.885659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:57.924277 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8c3915a1-e590-467a-9d9f-c701a9837919 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] HTTP exception thrown: Image not found. Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c3915a1-e590-467a-9d9f-c701a9837919 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Request method failure captured: Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/2652d826-5055-4f46-93a2-eb0e49957caj HTTP/1.1 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8hEp-Pmf1YjD912dHaiUy4H9lTcvIUoO1_ivn48jfK6gTYoe-nnbb63Aa94thsds8252Jk1o-qLlZ7mwWbcq-TRU--MOCdU40HgWc93sHGB9rDvBYeYSFV9IbJzb46tyA4KwHI4wsAmGKcfMyJqQnrMNNsy9AUH_p4YUMWgIkPRQhc Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ba0538ac4197469b93008ddee8fb38ba Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '2652d826-5055-4f46-93a2-eb0e49957caj'} Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2652d826-5055-4f46-93a2-eb0e49957caj to delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2652d826-5055-4f46-93a2-eb0e49957caj could not be found. Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:57.927417 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:57.932951 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:57.935449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c3915a1-e590-467a-9d9f-c701a9837919 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:57.936597 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c3915a1-e590-467a-9d9f-c701a9837919 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] 10.222.0.18 "DELETE /compute/v2.1/images/2652d826-5055-4f46-93a2-eb0e49957caj" status: 404 len: 62 microversion: 2.1 time: 0.108681 Jun 04 21:01:57.951443 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1140/2362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:57 2022] DELETE /compute/v2.1/images/2652d826-5055-4f46-93a2-eb0e49957caj => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:57.977668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:57.981639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:58.002907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:58.007446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:58.012155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:58.015104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:58.016679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:58.017866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:58.022415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lazy-loading 'fault' on Instance uuid 952e6198-f88b-4266-bc51-a737275da8b2 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:01:58.334248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be44957fa2304f52a8d34bdac9eaca4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '867cd3b05ecb4c93a28ab7a55928789b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:58.350481 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a5a88ac-034d-4057-a957-553e5f744d0e tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 200 len: 1311 microversion: 2.1 time: 0.488178 Jun 04 21:01:58.352264 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1223/2363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:57 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 1311 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:58.357174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-733f6022-76d5-43ba-a141-36ba88f545d3 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Calling method '.version_select at 0x7f2d026ce310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:58.401742 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-733f6022-76d5-43ba-a141-36ba88f545d3 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] HTTP exception thrown: Image not found. Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-733f6022-76d5-43ba-a141-36ba88f545d3 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Request method failure captured: Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/images/837de6e0-ce40-4478-89bd-e9af9b118b801 HTTP/1.1 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hEp-Pmf1YjD912dHaiUy4H9lTcvIUoO1_ivn48jfK6gTYoe-nnbb63Aa94thsds8252Jk1o-qLlZ7mwWbcq-TRU--MOCdU40HgWc93sHGB9rDvBYeYSFV9IbJzb46tyA4KwHI4wsAmGKcfMyJqQnrMNNsy9AUH_p4YUMWgIkPRQhc Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ba0538ac4197469b93008ddee8fb38ba Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '837de6e0-ce40-4478-89bd-e9af9b118b801'} Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 837de6e0-ce40-4478-89bd-e9af9b118b801 to delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 837de6e0-ce40-4478-89bd-e9af9b118b801 could not be found. Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:58.405109 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-733f6022-76d5-43ba-a141-36ba88f545d3 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:58.410211 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-733f6022-76d5-43ba-a141-36ba88f545d3 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] 10.222.0.18 "DELETE /compute/v2.1/images/837de6e0-ce40-4478-89bd-e9af9b118b801" status: 404 len: 62 microversion: 2.1 time: 0.053443 Jun 04 21:01:58.412621 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1224/2364] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:01:58 2022] DELETE /compute/v2.1/images/837de6e0-ce40-4478-89bd-e9af9b118b801 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:58.423146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1731041434", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "ad726c36-eae2-4580-8825-5b0914e7dd91"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:58.561889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:01:59.116012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:59.135254 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7f4c5fe7-0833-4dcf-850b-80c484d2b488 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1308 microversion: 2.1 time: 1.181666 Jun 04 21:01:59.136002 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1141/2365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:57 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1308 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:59.158438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dd3999a-6f2e-467e-bc01-32498aadbe57 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Calling method '.version_select at 0x7f2d01a24430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:59.214989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0dd3999a-6f2e-467e-bc01-32498aadbe57 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] HTTP exception thrown: Image not found. Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dd3999a-6f2e-467e-bc01-32498aadbe57 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Request method failure captured: Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/tempest-invalid-471938542 HTTP/1.1 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8hEp-Pmf1YjD912dHaiUy4H9lTcvIUoO1_ivn48jfK6gTYoe-nnbb63Aa94thsds8252Jk1o-qLlZ7mwWbcq-TRU--MOCdU40HgWc93sHGB9rDvBYeYSFV9IbJzb46tyA4KwHI4wsAmGKcfMyJqQnrMNNsy9AUH_p4YUMWgIkPRQhc Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ba0538ac4197469b93008ddee8fb38ba Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'tempest-invalid-471938542'} Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-471938542 to delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-471938542 could not be found. Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.218282 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:01:59.223928 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:01:59.230406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dd3999a-6f2e-467e-bc01-32498aadbe57 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:01:59.230406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0dd3999a-6f2e-467e-bc01-32498aadbe57 tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] 10.222.0.18 "DELETE /compute/v2.1/images/tempest-invalid-471938542" status: 404 len: 62 microversion: 2.1 time: 0.078792 Jun 04 21:01:59.230406 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1142/2366] 10.222.0.18 () {58 vars in 1202 bytes} [Sat Jun 4 21:01:59 2022] DELETE /compute/v2.1/images/tempest-invalid-471938542 => generated 62 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:01:59.240543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:59.242793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:59.262689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.263297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.273876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.274723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.340221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:01:59.622793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:01:59.623347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:01:59.624015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:01:59.624433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:01:59.625000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:01:59.637561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.638137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.640003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.640628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.671255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:01:59.679473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for user 5b4c3539c5534d2c844944f9be3f9963 and project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:01:59.696607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:01:59.699424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:01:59.749140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:01:59.769379 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2d5925bd-e5fa-44a7-b63a-eb8cd4f38f08 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 0.537975 Jun 04 21:01:59.777392 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1143/2367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:59 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:01:59.789363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:01:59.793645 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b34a06c-ed4c-4c5f-a7be-e4be82e72695 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380385 Jun 04 21:01:59.796634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1225/2368] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:01:59.799101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:01:59.820630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.824670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.825798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.826394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.828890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-48f26c1b-642d-46c6-b5b4-74caa3d243de req-d0bb0f59-8005-4812-8a91-0a7dff09e1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952e6198-f88b-4266-bc51-a737275da8b2", "name": "network-vif-deleted", "tag": "0a786854-5e4e-4a5c-9153-816eca07b370"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:01:59.883871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-48f26c1b-642d-46c6-b5b4-74caa3d243de req-d0bb0f59-8005-4812-8a91-0a7dff09e1a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:01:59.885036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-48f26c1b-642d-46c6-b5b4-74caa3d243de req-d0bb0f59-8005-4812-8a91-0a7dff09e1a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:01:59.931545 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-48f26c1b-642d-46c6-b5b4-74caa3d243de req-d0bb0f59-8005-4812-8a91-0a7dff09e1a8 service nova] Creating event network-vif-deleted:0a786854-5e4e-4a5c-9153-816eca07b370 for instance 952e6198-f88b-4266-bc51-a737275da8b2 on nch2-master-1 Jun 04 21:01:59.950205 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-48f26c1b-642d-46c6-b5b4-74caa3d243de req-d0bb0f59-8005-4812-8a91-0a7dff09e1a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149029 Jun 04 21:01:59.955683 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1226/2369] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:01:59.967052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f46ba916-0e15-4a6c-85fa-2a2775e9423c tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Calling method '.version_select at 0x7f2d0246e820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:00.016076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f46ba916-0e15-4a6c-85fa-2a2775e9423c tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] HTTP exception thrown: Image not found. Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f46ba916-0e15-4a6c-85fa-2a2775e9423c tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Request method failure captured: Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/images/b734761c-939b-4901-b717-700281f43054 HTTP/1.1 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hEp-Pmf1YjD912dHaiUy4H9lTcvIUoO1_ivn48jfK6gTYoe-nnbb63Aa94thsds8252Jk1o-qLlZ7mwWbcq-TRU--MOCdU40HgWc93sHGB9rDvBYeYSFV9IbJzb46tyA4KwHI4wsAmGKcfMyJqQnrMNNsy9AUH_p4YUMWgIkPRQhc Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1da06376b8cf4b54ae700f8bcc8b26ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1da06376b8cf4b54ae700f8bcc8b26ee Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543 Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ba0538ac4197469b93008ddee8fb38ba Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1111813543-project Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b734761c-939b-4901-b717-700281f43054'} Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b734761c-939b-4901-b717-700281f43054 to delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b734761c-939b-4901-b717-700281f43054 could not be found. Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:00.018820 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f46ba916-0e15-4a6c-85fa-2a2775e9423c tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f46ba916-0e15-4a6c-85fa-2a2775e9423c tempest-ImagesDeleteNegativeTestJSON-1111813543 tempest-ImagesDeleteNegativeTestJSON-1111813543-project] 10.222.0.18 "DELETE /compute/v2.1/images/b734761c-939b-4901-b717-700281f43054" status: 404 len: 62 microversion: 2.1 time: 0.062980 Jun 04 21:02:00.023724 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1227/2370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:59 2022] DELETE /compute/v2.1/images/b734761c-939b-4901-b717-700281f43054 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:02:00.048419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:00.049222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] [instance: 952e6198-f88b-4266-bc51-a737275da8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:00.078617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:00.079130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:00.080012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:00.080544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:00.135807 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] HTTP exception thrown: Instance 952e6198-f88b-4266-bc51-a737275da8b2 could not be found. Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Request method failure captured: Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 HTTP/1.1 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8czwOrhoKRvboO60eI0Vn5GG-2wn3ECfG6FwiIB0TpdgydnnAlZddG_G5_2T7Fwa3Ix-xbqD2z7xsvq6o9w7Q6tQukd-jmZRjVcm4O6CfqskOsswC-3ldzkvZdzYghT9zpi9s9haE-Q85cyc2ukRCyraLIPxBYkQfJDvX2_LBZzNOk Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/867cd3b05ecb4c93a28ab7a55928789b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 867cd3b05ecb4c93a28ab7a55928789b Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131796696 Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: be44957fa2304f52a8d34bdac9eaca4f Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131796696-project Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 952e6198-f88b-4266-bc51-a737275da8b2 could not be found. Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '952e6198-f88b-4266-bc51-a737275da8b2'} Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952e6198-f88b-4266-bc51-a737275da8b2 could not be found. Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952e6198-f88b-4266-bc51-a737275da8b2 could not be found. Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:00.138983 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952e6198-f88b-4266-bc51-a737275da8b2 could not be found. Jun 04 21:02:00.142772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:00.145917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] Returning 404 to user: Instance 952e6198-f88b-4266-bc51-a737275da8b2 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:00.152496 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0822f441-648a-41d3-91ff-52592b93ded0 tempest-ServerRescueNegativeTestJSON-131796696 tempest-ServerRescueNegativeTestJSON-131796696-project] 10.222.0.18 "GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2" status: 404 len: 111 microversion: 2.1 time: 0.128762 Jun 04 21:02:00.155555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1228/2371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:00 2022] GET /compute/v2.1/servers/952e6198-f88b-4266-bc51-a737275da8b2 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:00.196766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-096b9728-6c0a-4b4a-8f2d-8bf8d65dff2a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:00.199584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-096b9728-6c0a-4b4a-8f2d-8bf8d65dff2a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:00.645345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-096b9728-6c0a-4b4a-8f2d-8bf8d65dff2a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:00.657640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-096b9728-6c0a-4b4a-8f2d-8bf8d65dff2a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1279 microversion: 2.1 time: 0.496923 Jun 04 21:02:00.674547 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1229/2372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:00 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1279 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:00.683975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:00.686928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:00.716292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:00.717271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:00.722022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:00.722478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:00.836305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:00.865724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-99aa221f-8134-4151-97c9-223997fa3c6f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 1.086590 Jun 04 21:02:00.870733 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1144/2373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:01:59 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:00.894535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:00.899819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:00.913055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:00.915552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:00.917150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:00.917951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:01.736732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:01.751610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fda8535-7c9f-47f2-82a6-3458f71065bf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1315 microversion: 2.1 time: 0.879092 Jun 04 21:02:01.763107 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1145/2374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:00 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:01.765346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-705d9951-1feb-4162-bfeb-2879d29654db req-50f663c5-2ada-4d4e-b941-f484e5d0f6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328b885a-2830-40c9-8726-53e1d9288a4a", "name": "network-vif-plugged", "status": "completed", "tag": "0e1e5687-915f-4676-b561-9d37640fadea"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:01.792426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-705d9951-1feb-4162-bfeb-2879d29654db req-50f663c5-2ada-4d4e-b941-f484e5d0f6d1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:01.794485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-705d9951-1feb-4162-bfeb-2879d29654db req-50f663c5-2ada-4d4e-b941-f484e5d0f6d1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:01.833765 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-705d9951-1feb-4162-bfeb-2879d29654db req-50f663c5-2ada-4d4e-b941-f484e5d0f6d1 service nova] Creating event network-vif-plugged:0e1e5687-915f-4676-b561-9d37640fadea for instance 328b885a-2830-40c9-8726-53e1d9288a4a on nch2-master-1 Jun 04 21:02:01.853994 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-705d9951-1feb-4162-bfeb-2879d29654db req-50f663c5-2ada-4d4e-b941-f484e5d0f6d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087611 Jun 04 21:02:01.856324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1146/2375] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:01.870439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:01.871919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:01.891863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:01.893372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:01.903528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:01.905027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:02.053869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:02.065673 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a30a04ec-a3f4-44d3-a35c-662e84642675 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1308 microversion: 2.1 time: 1.389654 Jun 04 21:02:02.066569 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1230/2376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:00 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1308 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:02.071496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:02.078202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:02.089136 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8dd04a9a-39b4-4b1e-9c2a-9adde969803b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1283 microversion: 2.1 time: 0.230029 Jun 04 21:02:02.100939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:02.115275 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1147/2377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:01 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1283 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:02.122300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1741458280", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0e9df12b-b2a8-4721-98ae-6e3acd63fdc7"}, {"port": "e3d7c39c-58b0-4100-aea2-21c3bb9a51db", "tag": "port-1"}, {"port": "ac7a2d51-6653-42c5-8b27-30685ecc1525", "tag": "port-2"}, {"uuid": "412d2d5e-9d6c-4584-8200-63e12fe93682", "tag": "net-1"}, {"uuid": "412d2d5e-9d6c-4584-8200-63e12fe93682"}, {"uuid": "ef21b932-87c1-4ce8-a310-5481df318950", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ef21b932-87c1-4ce8-a310-5481df318950", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6b1fd212-16d5-4e38-9bf7-191bb6888943", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f599bf47-2ed2-4605-a2b8-f112ebbf3bca", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1440466091"}], "key_name": "tempest-keypair-1404489988", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:02.127944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:02.128415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:02.130262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:02.134177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:02.561441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] validate_networks() for [('0e9df12b-b2a8-4721-98ae-6e3acd63fdc7', None, None, None, None, None), (None, None, 'e3d7c39c-58b0-4100-aea2-21c3bb9a51db', None, None, None), (None, None, 'ac7a2d51-6653-42c5-8b27-30685ecc1525', None, None, None), ('412d2d5e-9d6c-4584-8200-63e12fe93682', None, None, None, None, None), ('412d2d5e-9d6c-4584-8200-63e12fe93682', None, None, None, None, None), ('ef21b932-87c1-4ce8-a310-5481df318950', '10.2.2.100', None, None, None, None), ('ef21b932-87c1-4ce8-a310-5481df318950', '10.2.2.200', None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:02:02.936196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:02.951107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc53eb20-c3fa-4c00-b643-7331743d164c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.879951 Jun 04 21:02:02.952634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1231/2378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:02 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:02.957849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:02.961496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:02.985849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:02.986807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:02.988098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:02.988771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:03.551772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:03.567953 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-901cb10f-a182-4c5c-a17d-73f527443fad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1503 microversion: 2.1 time: 0.609591 Jun 04 21:02:03.569780 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1232/2379] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:02 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:03.588959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:03.589972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:03.617882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:03.621922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:03.625217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:03.631776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:04.060982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:04.073874 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-935133f3-3cad-4a37-b2ba-8db0b29a842f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1488 microversion: 2.1 time: 0.502733 Jun 04 21:02:04.090332 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1233/2380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:03 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1488 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:04.102950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:04.104138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:04.140540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:04.142323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:04.144661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:04.148599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:04.380443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:04.391166 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2cf0b251-4650-4e68-87f3-32ff56ca6d5f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1331 microversion: 2.1 time: 0.299134 Jun 04 21:02:04.401224 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1234/2381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:04 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1331 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:04.416563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:04.417408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:04.437379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:04.438079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:04.439845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:04.440437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:04.525749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:04.534021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'flavor' on Instance uuid cf2c35d6-29be-4969-b399-b35e4ceea667 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:02:05.282508 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39e45b7f-7c3c-476c-94d2-a8d708c281a8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667/action" status: 202 len: 0 microversion: 2.1 time: 0.879345 Jun 04 21:02:05.286283 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1235/2382] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:04 2022] POST /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667/action => generated 0 bytes in 884 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:02:05.722831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-744632284", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "4870e378-f654-464a-ad5b-9a6f74935e62"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:05.841846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] validate_networks() for [('4870e378-f654-464a-ad5b-9a6f74935e62', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:02:07.231009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:02:07.232467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:02:07.233534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:02:07.234296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:02:07.235746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:02:07.258891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:07.264478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:07.265761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:07.266455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:07.339032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Getting quotas for project 01083c40e40446e581220f68d579105d. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:02:07.360641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Getting quotas for user b865a42bb19745bc84c5138c90162e30 and project 01083c40e40446e581220f68d579105d. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:02:07.409521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Going to run 3 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:02:07.414549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:07.517346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=89c2f5dd-583d-461f-b9c1-b8d19636d25a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:07.589639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=7e85b7a5-99eb-40cc-a447-780320a31c78,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:07.733374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dac7d69e-b907-4783-871a-873dff7bb563 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.434768 Jun 04 21:02:07.734872 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1236/2383] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:02:07.740782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:07.741679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:07.768474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:07.769228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:07.770285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:07.771944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:08.179083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:08.187345 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b0bde91-6261-4e44-887e-088d2836bd75 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.451154 Jun 04 21:02:08.192520 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1237/2384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:07 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:08.209694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ccae6efc-2791-4487-8dd0-c803707a54e6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:08.225141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ccae6efc-2791-4487-8dd0-c803707a54e6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:08.226584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ccae6efc-2791-4487-8dd0-c803707a54e6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:08.394682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ccae6efc-2791-4487-8dd0-c803707a54e6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:02:08.585864 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ccae6efc-2791-4487-8dd0-c803707a54e6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.391402 Jun 04 21:02:08.587165 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1238/2385] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:08 2022] POST /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:02:08.622885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:08.636988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:08.647695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:08.654827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:08.658640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:08.659462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:09.868593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:09.884535 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7cf043c9-39fc-4a9f-8160-c3dc901c326d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 1.275237 Jun 04 21:02:09.887946 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1239/2386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:08 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:09.904414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:09.905246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:09.906756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:02:09.907253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:02:09.909734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:02:09.910281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:02:09.914223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:09.914978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:09.915938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:02:09.916071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:09.916695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:09.923243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:09.944943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:09.945482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:09.951430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:09.951908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:09.997105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Getting quotas for project 83e17865ce4e4d2ba7854d03668bfb78. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:02:10.005594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Getting quotas for user 890837d5b27e4471b54c1eac851e88c5 and project 83e17865ce4e4d2ba7854d03668bfb78. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:02:10.170918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:10.196865 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8037dddb-cf81-489a-8daf-f4109a1c988a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.306376 Jun 04 21:02:10.204960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:02:10.207813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8fc4c4dd-1776-41d7-97bd-4c8c6b4ea30d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6b1fd212-16d5-4e38-9bf7-191bb6888943',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f599bf47-2ed2-4605-a2b8-f112ebbf3bca',volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:10.209020 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1240/2387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:09 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:10.222829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f255a7ed-4892-4634-8a4a-8a959aef2285 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0be581f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:10.291869 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f255a7ed-4892-4634-8a4a-8a959aef2285 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/4c31369a-328a-4c6e-85b6-fb8a3105186e" status: 200 len: 661 microversion: 2.1 time: 0.079485 Jun 04 21:02:10.295153 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1241/2388] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:10 2022] GET /compute/v2.1/images/4c31369a-328a-4c6e-85b6-fb8a3105186e => generated 661 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:10.316264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:10.324145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:10.327154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:10.339179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:10.341428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:10.344233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:10.345029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:10.421468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:02:10.508946 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-90406be3-b152-4ecb-bed5-2010b3e82988 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.206315 Jun 04 21:02:10.509548 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1242/2389] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:02:10 2022] GET /compute/v2.1/servers => generated 1015 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:10.524713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:10.526707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:10.536838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:10.542813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:10.543765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:10.545447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:10.730704 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd092e19-5629-4cf4-ab32-888d958f0aa5 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.613855 Jun 04 21:02:10.731379 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1148/2390] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Jun 4 21:02:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 8615 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:02:10.736668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:10.737833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:10.744894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:10.745498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:10.746497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:10.747260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:11.098484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:11.110830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb8ab255-f8b2-401f-938f-753daf08bb94 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.594257 Jun 04 21:02:11.111468 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1243/2391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:10 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:11.129981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c0b9ec8-1844-40f9-8c2e-684f61ce2b29 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0bd2ddc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:11.208020 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c0b9ec8-1844-40f9-8c2e-684f61ce2b29 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/4c31369a-328a-4c6e-85b6-fb8a3105186e" status: 200 len: 661 microversion: 2.1 time: 0.095266 Jun 04 21:02:11.209782 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1244/2392] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:11 2022] GET /compute/v2.1/images/4c31369a-328a-4c6e-85b6-fb8a3105186e => generated 661 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:11.215487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:11.232770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:11.247605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:11.248149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:11.249040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:11.249510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:11.414936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:11.429724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb1a213e-681e-44fc-9165-18a607ee2ec7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.696861 Jun 04 21:02:11.430435 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1149/2393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:10 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:11.447817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eee92457-ec81-49b7-9ae7-1fc28651d318 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:11.450978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eee92457-ec81-49b7-9ae7-1fc28651d318 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:11.463257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:11.476120 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-610ca3a4-f283-468c-9546-b916f67eb646 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1274 microversion: 2.1 time: 0.264907 Jun 04 21:02:11.482350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1245/2394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:11 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:11.492882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:11.494709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:11.518846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:11.519571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:11.523694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:11.526005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:11.621368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eee92457-ec81-49b7-9ae7-1fc28651d318 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:11.630347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eee92457-ec81-49b7-9ae7-1fc28651d318 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:11.632608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eee92457-ec81-49b7-9ae7-1fc28651d318 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:11.637681 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eee92457-ec81-49b7-9ae7-1fc28651d318 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1286 microversion: 2.32 time: 0.205925 Jun 04 21:02:11.639148 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1150/2395] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:11 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:11.644228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:11.645132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:11.653720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:11.654307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:11.655461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:11.656072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:12.246156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:12.256608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-68c3ceec-8b82-41df-baa8-1e1e99355213 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.772522 Jun 04 21:02:12.257435 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1246/2396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:11 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:12.273286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:12.274223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:12.282733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:12.283454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:12.284480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:12.285070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:12.536134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:12.546638 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb5e99ff-7711-4d91-aa8e-1c130a18ce0a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.906011 Jun 04 21:02:12.548068 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1151/2397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:11 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:12.563291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd5e2405-49fd-4e9a-b8f2-adc116518dbd tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d026db280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:12.648180 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd5e2405-49fd-4e9a-b8f2-adc116518dbd tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/486d9d16-1708-4bd5-a2d7-9c4c4c816bf5" status: 200 len: 343 microversion: 2.1 time: 0.098167 Jun 04 21:02:12.648857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1152/2398] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:02:12 2022] GET /compute/v2.1/os-volumes/486d9d16-1708-4bd5-a2d7-9c4c4c816bf5 => generated 343 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:12.654112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:12.672983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:12.680549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:12.681094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:12.681884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:12.682492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:12.765876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:12.786181 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3c83a290-afb5-4da2-92b7-f49df972692a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.513869 Jun 04 21:02:12.788322 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1247/2399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:12 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:12.802735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:12.803532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:12.825851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:12.827760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:12.828677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:12.832678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:13.421352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:13.436600 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9fcb9993-f22b-4728-9ef3-e635f0e945a3 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1280 microversion: 2.1 time: 0.646893 Jun 04 21:02:13.437722 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1248/2400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:12 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1280 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:13.442805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:13.443484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:13.469627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:13.470202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:13.471069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:13.471611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:13.753341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:13.780129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:13.782243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:13.798421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-41504f90-58a8-481b-b4d4-4e9c0a6ccb92 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1594 microversion: 2.32 time: 0.347538 Jun 04 21:02:13.801725 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1249/2401] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:13 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1594 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:13.814490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a6c95c9f-6b9e-4b5d-a2c6-c6e06a86f31d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0237aa60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:13.838305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:13.854730 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0b29570-a644-482e-8c87-9695ae73f656 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 1.204526 Jun 04 21:02:13.856254 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1153/2402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:12 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:13.862470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:13.863777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:13.893789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:13.894596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:13.900388 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a6c95c9f-6b9e-4b5d-a2c6-c6e06a86f31d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a6351c7e-8933-4e7c-8c8d-751f5e045bbe" status: 200 len: 661 microversion: 2.1 time: 0.096033 Jun 04 21:02:13.907413 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1250/2403] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:13 2022] GET /compute/v2.1/images/a6351c7e-8933-4e7c-8c8d-751f5e045bbe => generated 661 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:13.911631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:13.912501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:13.913210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:13.915634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:13.933576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:13.934446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:13.935445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:13.937218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:14.499817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:14.511025 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-acf5d9ca-4c77-41a9-8261-1b5fa041229c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.608486 Jun 04 21:02:14.526131 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1251/2404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:13 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:14.531955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ee3ce96e-6ded-4489-9476-ed7ebb3c2d5d req-93a4ed34-ded9-478f-8fad-36cbf1c5b828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:14.541243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ee3ce96e-6ded-4489-9476-ed7ebb3c2d5d req-93a4ed34-ded9-478f-8fad-36cbf1c5b828 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:14.542054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ee3ce96e-6ded-4489-9476-ed7ebb3c2d5d req-93a4ed34-ded9-478f-8fad-36cbf1c5b828 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:14.562998 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ee3ce96e-6ded-4489-9476-ed7ebb3c2d5d req-93a4ed34-ded9-478f-8fad-36cbf1c5b828 service nova] Creating event network-changed:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:02:14.571044 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ee3ce96e-6ded-4489-9476-ed7ebb3c2d5d req-93a4ed34-ded9-478f-8fad-36cbf1c5b828 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042784 Jun 04 21:02:14.572271 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1252/2405] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:14.578118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:14.579486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:14.587740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:14.588495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:14.589840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:14.590479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:14.946167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:14.958133 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-88a152c5-d83a-4e61-b0ad-1ee578310a69 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 1.100443 Jun 04 21:02:14.958828 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1154/2406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:13 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:14.964232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8e34afa-b7c9-4220-92ca-695552b7fbe5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02a6f670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:15.024282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8e34afa-b7c9-4220-92ca-695552b7fbe5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a6351c7e-8933-4e7c-8c8d-751f5e045bbe" status: 200 len: 661 microversion: 2.1 time: 0.063979 Jun 04 21:02:15.025342 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1155/2407] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:14 2022] GET /compute/v2.1/images/a6351c7e-8933-4e7c-8c8d-751f5e045bbe => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:15.045784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e2a3e9a-6e7b-402d-aed9-e604fb949f3c tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d026db280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:15.154103 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e2a3e9a-6e7b-402d-aed9-e604fb949f3c tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/df11e662-aeda-4b26-b7a4-afbbfa1f55ab" status: 200 len: 344 microversion: 2.1 time: 0.127608 Jun 04 21:02:15.154891 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1156/2408] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:02:15 2022] GET /compute/v2.1/os-volumes/df11e662-aeda-4b26-b7a4-afbbfa1f55ab => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:15.162488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:15.165904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:15.194207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:15.194396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.194836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.195659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.196095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.206567 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ce19f7b-f35e-4756-8a6d-2b632e3b491f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.632704 Jun 04 21:02:15.208747 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1253/2409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:14 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:15.218822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:15.220470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:15.228670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.229495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.230562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.231216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.381397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:15.400599 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4dd19d3b-638b-445d-834c-9fd1340dc2c4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1280 microversion: 2.1 time: 0.244077 Jun 04 21:02:15.401348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1157/2410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:15 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:15.421674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:15.436141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:15.455457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.456184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.457125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.457838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.882260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:15.898382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:15.899934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:15.901104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-67d7d589-3bad-457a-91f1-750b2b9c2f9d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1662 microversion: 2.32 time: 0.691028 Jun 04 21:02:15.901664 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1254/2411] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:15 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1662 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:15.918604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-22a5207d-9d05-4862-9d9e-c228c077ae3c req-ce4ffc82-45ae-4b45-8f22-1b2efbae66d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc", "tag": "c66af543-f5d0-4402-aec2-f006988d10f0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:15.937991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-22a5207d-9d05-4862-9d9e-c228c077ae3c req-ce4ffc82-45ae-4b45-8f22-1b2efbae66d8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:15.938449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-22a5207d-9d05-4862-9d9e-c228c077ae3c req-ce4ffc82-45ae-4b45-8f22-1b2efbae66d8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:15.958534 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-22a5207d-9d05-4862-9d9e-c228c077ae3c req-ce4ffc82-45ae-4b45-8f22-1b2efbae66d8 service nova] Creating event network-changed:c66af543-f5d0-4402-aec2-f006988d10f0 for instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc on nch2-master-1 Jun 04 21:02:15.976795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:15.980784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-22a5207d-9d05-4862-9d9e-c228c077ae3c req-ce4ffc82-45ae-4b45-8f22-1b2efbae66d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065702 Jun 04 21:02:15.981431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1255/2412] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:15.985710 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b8c528d-aa69-4782-a97a-35b901349ee5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.580672 Jun 04 21:02:15.989021 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1158/2413] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:15 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:15.992634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:15.993531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:16.000480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-18895590-099c-4826-b0c9-360ee8c0f726 req-f4d64a95-bd3c-4d6b-b682-e888aff03940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "name": "network-vif-plugged", "status": "completed", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:16.004789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.005350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.008647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.011348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.026783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-18895590-099c-4826-b0c9-360ee8c0f726 req-f4d64a95-bd3c-4d6b-b682-e888aff03940 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.029463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-18895590-099c-4826-b0c9-360ee8c0f726 req-f4d64a95-bd3c-4d6b-b682-e888aff03940 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.069404 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-18895590-099c-4826-b0c9-360ee8c0f726 req-f4d64a95-bd3c-4d6b-b682-e888aff03940 service nova] Creating event network-vif-plugged:eba1e015-a95a-4ab9-aea1-ca6856d3e3bb for instance 6544912e-117f-4311-88e5-885fd318c074 on nch1-master-1 Jun 04 21:02:16.087996 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-18895590-099c-4826-b0c9-360ee8c0f726 req-f4d64a95-bd3c-4d6b-b682-e888aff03940 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097475 Jun 04 21:02:16.089006 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1159/2414] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:16.113781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:16.117179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:16.147593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.148581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.158814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.174153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.643024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:16.653968 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c5ffebc2-6b71-464f-a09a-3eb4b829feef tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.671269 Jun 04 21:02:16.654626 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1256/2415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:15 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:16.674516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:16.675485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:16.683351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.684160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.685119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.686029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.696405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:16.720058 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe75bc14-374f-4e30-9ed0-5358d2bc48f4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.628679 Jun 04 21:02:16.732487 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1160/2416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:16 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:16.738691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:16.739421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:16.764042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.764517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:16.765332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:16.769065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:17.393713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:17.661239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:17.684606 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04790dbd-46cc-4399-8803-840fa8ac76f6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 1.024278 Jun 04 21:02:17.686288 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1257/2417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:16 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:17.700449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4830fae-cc4b-48c1-941d-469b9ef34960 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d023ac820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:17.760128 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4830fae-cc4b-48c1-941d-469b9ef34960 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/64b0a352-345e-442d-acfa-95106d5fec42" status: 200 len: 662 microversion: 2.1 time: 0.072222 Jun 04 21:02:17.762681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1258/2418] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:17 2022] GET /compute/v2.1/images/64b0a352-345e-442d-acfa-95106d5fec42 => generated 662 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:17.782341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-823021dd-e90d-4135-a0c2-a19cf03465bb tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d01a92430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:17.827633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:17.843244 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c2323f2a-ebb3-4dff-94d5-ed9ada6236d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 1.102159 Jun 04 21:02:17.844106 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1161/2419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:16 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:17.864774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:17.866735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:17.879274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:17.884008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:17.885197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:17.888096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:17.916752 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-823021dd-e90d-4135-a0c2-a19cf03465bb tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/9de5126a-5677-4cda-ad59-0adf514e7b31" status: 200 len: 343 microversion: 2.1 time: 0.150473 Jun 04 21:02:17.918313 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1259/2420] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:02:17 2022] GET /compute/v2.1/os-volumes/9de5126a-5677-4cda-ad59-0adf514e7b31 => generated 343 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:17.930196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:17.930815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:17.935065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:17.942266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:17.942714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:17.943879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:17.944884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:18.473868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:18.487051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:18.489779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:18.492509 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3eaebf8e-c3d9-4493-9e4d-1230b76aea7e tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1756 microversion: 2.32 time: 0.637702 Jun 04 21:02:18.507982 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1162/2421] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:17 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1756 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:18.514828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:18.515150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:18.516613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:18.530959 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e648d8aa-d0dc-49ad-9b98-5dba1d62174d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1518 microversion: 2.1 time: 0.610594 Jun 04 21:02:18.538548 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1260/2422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:17 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1518 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:18.545101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:18.545558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:18.545780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:18.546359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:18.546956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:18.547889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:18.560775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:18.561395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:18.563283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:18.565326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:19.039317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:19.053594 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6375f39c-9e0a-485b-b1fe-baa06a3627b1 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.543987 Jun 04 21:02:19.054204 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1163/2423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:18 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:19.068116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19337c44-3525-476a-9100-3d5a4240ce7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01a27310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:19.123357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19337c44-3525-476a-9100-3d5a4240ce7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/64b0a352-345e-442d-acfa-95106d5fec42" status: 200 len: 662 microversion: 2.1 time: 0.067456 Jun 04 21:02:19.124007 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1164/2424] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:19 2022] GET /compute/v2.1/images/64b0a352-345e-442d-acfa-95106d5fec42 => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:19.162078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ca2fa1c-3148-4de1-8199-7e829c59b5fa tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d0bf789d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:19.351261 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ca2fa1c-3148-4de1-8199-7e829c59b5fa tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.202060 Jun 04 21:02:19.352184 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1165/2425] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:02:19 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:19.374584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:19.375635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:19.407062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:19.407649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:19.410488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:19.413560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:19.488992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:19.502549 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1991ad9b-9a97-4ef3-91af-ec95717bf223 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.962268 Jun 04 21:02:19.504047 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1261/2426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:18 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:19.517073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:19.518640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:19.528326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:19.531010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:19.532357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:19.533035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:19.836022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:19.848048 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9619e287-76af-4b5b-a1d1-5eebd127c515 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.494384 Jun 04 21:02:19.849431 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1166/2427] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:19 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:19.855159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b16f9e3c-6a67-4cd1-9f05-d3c4d2a6368a req-b83794bf-ad7b-4e9c-b9dc-8d2080cd42d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c2f5dd-583d-461f-b9c1-b8d19636d25a", "tag": "0f712b9a-5bf3-4dfe-86d9-afaf9f4021c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:19.865857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b16f9e3c-6a67-4cd1-9f05-d3c4d2a6368a req-b83794bf-ad7b-4e9c-b9dc-8d2080cd42d5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:19.866882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b16f9e3c-6a67-4cd1-9f05-d3c4d2a6368a req-b83794bf-ad7b-4e9c-b9dc-8d2080cd42d5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:19.892924 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b16f9e3c-6a67-4cd1-9f05-d3c4d2a6368a req-b83794bf-ad7b-4e9c-b9dc-8d2080cd42d5 service nova] Creating event network-changed:0f712b9a-5bf3-4dfe-86d9-afaf9f4021c0 for instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a on nch2-master-1 Jun 04 21:02:19.901737 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b16f9e3c-6a67-4cd1-9f05-d3c4d2a6368a req-b83794bf-ad7b-4e9c-b9dc-8d2080cd42d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050208 Jun 04 21:02:19.903069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1167/2428] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:19.910043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-398551990", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:19.921450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:19.975995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:19.981431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:02:20.041287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:20.050986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:20.070565 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5c0d9fda-0092-4a3f-8ecb-4a3849805c8b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 0.564567 Jun 04 21:02:20.073696 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1262/2429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:19 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:20.088835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82019a99-a0aa-4404-b28c-3172a7705157 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d0246e670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:20.251169 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82019a99-a0aa-4404-b28c-3172a7705157 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.174767 Jun 04 21:02:20.252460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1263/2430] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 21:02:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:20.258185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:20.259109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:20.268229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.269084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.270190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.270858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.353641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:20.688689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:02:20.689178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:02:20.689797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:02:20.690378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:02:20.691461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:02:20.712282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.712734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.713955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.717042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.719329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:20.733629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:20.742520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:20.743837 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-62e11936-a64a-4cb4-9123-6f2c7f365088 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1838 microversion: 2.32 time: 0.490072 Jun 04 21:02:20.744003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Getting quotas for project 6b1dd7943ab249e6bf2156b54b4c3a20. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:02:20.755887 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1264/2431] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:20 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1838 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:20.757583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:20.758584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:20.766083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Getting quotas for user 61a665da0b8f4dcd8c39570a49b62449 and project 6b1dd7943ab249e6bf2156b54b4c3a20. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:02:20.780736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.780736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.781293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.781731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.787401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:02:20.790754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:20.865923 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-294b0e7b-0d95-45ed-a4d0-812a78c9c920 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961240 Jun 04 21:02:20.866596 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1168/2432] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:02:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:02:20.874703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:20.875653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:20.883885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.884380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.885189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:20.885635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:20.915946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:21.050019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:21.060644 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17964448-432a-47bb-80c4-7ac604beead2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.312978 Jun 04 21:02:21.061769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1265/2433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:20 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:21.069564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77048ed8-cfc8-4249-914b-bbf731bfd78a tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d020c0af0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:21.142343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:21.152699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-659f4933-99ba-43a6-8685-9bcc3b1be089 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.284289 Jun 04 21:02:21.153330 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1169/2434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:20 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:21.160200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:21.161714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:21.181995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.182277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:21.183153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.184057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:21.233230 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-77048ed8-cfc8-4249-914b-bbf731bfd78a tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.170167 Jun 04 21:02:21.234034 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1266/2435] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:02:21 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:21.244251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2ae5324f-6fed-4acd-848c-8a60ca591b02 req-42ef04db-faed-4e48-8b4f-2352b2ec2faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc", "name": "network-vif-plugged", "status": "completed", "tag": "c66af543-f5d0-4402-aec2-f006988d10f0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:21.253902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2ae5324f-6fed-4acd-848c-8a60ca591b02 req-42ef04db-faed-4e48-8b4f-2352b2ec2faa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.254266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2ae5324f-6fed-4acd-848c-8a60ca591b02 req-42ef04db-faed-4e48-8b4f-2352b2ec2faa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:21.290493 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2ae5324f-6fed-4acd-848c-8a60ca591b02 req-42ef04db-faed-4e48-8b4f-2352b2ec2faa service nova] Creating event network-vif-plugged:c66af543-f5d0-4402-aec2-f006988d10f0 for instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc on nch2-master-1 Jun 04 21:02:21.302260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2ae5324f-6fed-4acd-848c-8a60ca591b02 req-42ef04db-faed-4e48-8b4f-2352b2ec2faa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066539 Jun 04 21:02:21.303691 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1267/2436] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:21.313046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:21.315867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:21.326264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.326817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:21.327763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.328465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:21.576781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:21.598982 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e59be63f-e4c3-4e7a-9110-9d13d86bba81 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.441646 Jun 04 21:02:21.600744 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1170/2437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:21 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:21.607664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-140458520", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:21.677164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:02:21.704186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:21.716702 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc6ce5ca-141b-46ff-855e-6509426a6a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.409591 Jun 04 21:02:21.717644 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1268/2438] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:21 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:21.731896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:21.743414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:21.752618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.753241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:21.754118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:21.754792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.379404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:22.388878 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4558c9b-8591-4b93-ace1-95e4247886f0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.669874 Jun 04 21:02:22.389748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1269/2439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:21 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:22.395446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:22.396452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:22.411100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.411851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.412790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.413329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.430203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:02:22.430762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:02:22.431270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:02:22.431919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:02:22.432402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:02:22.443665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.444483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.445384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.445902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.466877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Getting quotas for project 6b1dd7943ab249e6bf2156b54b4c3a20. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:02:22.477036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Getting quotas for user 61a665da0b8f4dcd8c39570a49b62449 and project 6b1dd7943ab249e6bf2156b54b4c3a20. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:02:22.496104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:02:22.499062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:22.582229 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d1d29b87-780e-40a5-8a8e-3eb4ec9a2459 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980292 Jun 04 21:02:22.587820 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1171/2440] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:02:22.593092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c956e281-e0aa-439b-be20-9258fb4e3794 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d026c8310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:22.623047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:22.637316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-570a4be7-6973-4f34-9f40-fa44d394287b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 0.246206 Jun 04 21:02:22.642530 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1270/2441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:22 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:22.653766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1e630586-9592-4778-909f-b2be7012613c req-ecb1c2c5-58c1-4720-b621-a0679b46b6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "a18106de-02a9-4771-a90c-8ae75e40f172"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:22.675272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1e630586-9592-4778-909f-b2be7012613c req-ecb1c2c5-58c1-4720-b621-a0679b46b6a3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.676013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1e630586-9592-4778-909f-b2be7012613c req-ecb1c2c5-58c1-4720-b621-a0679b46b6a3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.719268 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1e630586-9592-4778-909f-b2be7012613c req-ecb1c2c5-58c1-4720-b621-a0679b46b6a3 service nova] Creating event network-changed:a18106de-02a9-4771-a90c-8ae75e40f172 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:22.740337 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1e630586-9592-4778-909f-b2be7012613c req-ecb1c2c5-58c1-4720-b621-a0679b46b6a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093591 Jun 04 21:02:22.741373 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1271/2442] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:22.755551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:22.762435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:22.773122 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c956e281-e0aa-439b-be20-9258fb4e3794 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.183912 Jun 04 21:02:22.773711 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1172/2443] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 21:02:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:22.778821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:22.779448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:22.788232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.793719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.798140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.798860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.819898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.820578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:22.821442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:22.821882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:23.657414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:23.665142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:23.671442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:23.673242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:23.676132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e890afc8-5ecf-4a8f-a4dd-eaa8e8bd2276 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.901340 Jun 04 21:02:23.677300 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1173/2444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:22 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:23.678313 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aed559ce-b418-4da0-a7dd-9a1ebc39b98a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1859 microversion: 2.32 time: 0.931698 Jun 04 21:02:23.688740 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1272/2445] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:22 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1859 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:23.689753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:23.695475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a750b358-f086-4d76-8354-7ba3f57f07f7 req-64df0684-c6b4-487c-bc4d-4956212814f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e85b7a5-99eb-40cc-a447-780320a31c78", "tag": "0ecbde04-8ee8-4968-a9fa-9a21912a9e8c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:23.696140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:23.703256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:23.706842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a750b358-f086-4d76-8354-7ba3f57f07f7 req-64df0684-c6b4-487c-bc4d-4956212814f4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:23.708025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a750b358-f086-4d76-8354-7ba3f57f07f7 req-64df0684-c6b4-487c-bc4d-4956212814f4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:23.708790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:23.711972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:23.712529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:23.727696 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a750b358-f086-4d76-8354-7ba3f57f07f7 req-64df0684-c6b4-487c-bc4d-4956212814f4 service nova] Creating event network-changed:0ecbde04-8ee8-4968-a9fa-9a21912a9e8c for instance 7e85b7a5-99eb-40cc-a447-780320a31c78 on nch1-master-1 Jun 04 21:02:23.735377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a750b358-f086-4d76-8354-7ba3f57f07f7 req-64df0684-c6b4-487c-bc4d-4956212814f4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044474 Jun 04 21:02:23.736630 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1174/2446] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:23.745148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:23.746293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:23.759358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:23.760074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:23.761201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:23.762149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:23.971157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:23.979677 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b487394-f5fe-4109-8037-e3aa2b2cd147 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1213 microversion: 2.1 time: 0.241529 Jun 04 21:02:23.989892 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1175/2447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:23 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:23.995715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:23.996472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:24.003060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.003771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.004690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.005271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.202284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:24.228412 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-22a2c835-a45e-4c71-848f-54ad63e10fb1 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.546465 Jun 04 21:02:24.230448 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1273/2448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:23 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:24.238583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:24.240603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:24.252865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.254514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.256081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.256672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.500733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:24.510666 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3f57f79-2cbe-4f37-aa42-c319bbaa3344 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.519364 Jun 04 21:02:24.522093 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1176/2449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:23 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:24.529276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-792860fb-e022-4996-8a0c-663743565d19 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d0bf5b9d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:24.674662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:24.689631 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-707f7b3f-768f-4474-81e0-9c05ecdd1319 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.457639 Jun 04 21:02:24.691093 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1274/2450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:24 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:24.695951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-792860fb-e022-4996-8a0c-663743565d19 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.171856 Jun 04 21:02:24.698055 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1177/2451] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 21:02:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:24.705231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:24.708609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:24.731877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0f85f2d7-79be-4b5b-8d36-ee73e8bac7ed req-86693df8-388b-433b-8139-cbbdb2ed58d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "name": "network-vif-plugged", "status": "completed", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:24.744502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0f85f2d7-79be-4b5b-8d36-ee73e8bac7ed req-86693df8-388b-433b-8139-cbbdb2ed58d4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.745258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0f85f2d7-79be-4b5b-8d36-ee73e8bac7ed req-86693df8-388b-433b-8139-cbbdb2ed58d4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.754377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.754838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.758080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.758545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.762022 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0f85f2d7-79be-4b5b-8d36-ee73e8bac7ed req-86693df8-388b-433b-8139-cbbdb2ed58d4 service nova] Creating event network-vif-plugged:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:02:24.768467 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0f85f2d7-79be-4b5b-8d36-ee73e8bac7ed req-86693df8-388b-433b-8139-cbbdb2ed58d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075043 Jun 04 21:02:24.770720 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1275/2452] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:24.779872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-454da33b-9293-477f-b17e-3a57d8938bde tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:24.790085 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-454da33b-9293-477f-b17e-3a57d8938bde tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance d5147c22-8774-494d-ba3f-2e84090068ab has no mapping to a cell. Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-454da33b-9293-477f-b17e-3a57d8938bde tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/d5147c22-8774-494d-ba3f-2e84090068ab/action HTTP/1.1 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: {"os-stop": {}} Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance d5147c22-8774-494d-ba3f-2e84090068ab has no mapping to a cell. Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd5147c22-8774-494d-ba3f-2e84090068ab', 'body': {'os-stop': {}}} Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance d5147c22-8774-494d-ba3f-2e84090068ab has no mapping to a cell. Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:24.802226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5147c22-8774-494d-ba3f-2e84090068ab has no mapping to a cell. Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5147c22-8774-494d-ba3f-2e84090068ab has no mapping to a cell. Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-454da33b-9293-477f-b17e-3a57d8938bde tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance d5147c22-8774-494d-ba3f-2e84090068ab has no mapping to a cell. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-454da33b-9293-477f-b17e-3a57d8938bde tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/d5147c22-8774-494d-ba3f-2e84090068ab/action" status: 404 len: 117 microversion: 2.1 time: 0.031796 Jun 04 21:02:24.806078 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1276/2453] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:24 2022] POST /compute/v2.1/servers/d5147c22-8774-494d-ba3f-2e84090068ab/action => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:24.827343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:24.832171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:24.846975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.847777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:24.848764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:24.849613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.301836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.315069 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-71ff9961-b7e0-4c61-a256-e7f1ff726fd7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 0.614849 Jun 04 21:02:25.316808 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1178/2454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:24 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:25.323843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:25.326694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:25.334341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.335160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.336245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.336880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.510165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.529340 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-024123b4-ba4f-4a7c-b592-8aebca83488d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.720505 Jun 04 21:02:25.533216 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1277/2455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:24 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:25.542200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a79d69b4-fdd4-4776-99ca-be893b6ef2ea tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d01aa2310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:25.656465 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a79d69b4-fdd4-4776-99ca-be893b6ef2ea tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.121525 Jun 04 21:02:25.657550 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1278/2456] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 21:02:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:25.665449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:25.666101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:25.678354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.678969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.680052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.681646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.707331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.717616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.719150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.720361 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98fe05f7-5285-4ff0-b432-44db9da114be tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.401827 Jun 04 21:02:25.721157 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1179/2457] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:25 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:25.726108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ba09cb59-bdd7-4119-bc23-e2dcb1871fdf req-f0aff8d0-98a5-413b-b6a1-36db99965697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "e3d7c39c-58b0-4100-aea2-21c3bb9a51db"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:25.735382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ba09cb59-bdd7-4119-bc23-e2dcb1871fdf req-f0aff8d0-98a5-413b-b6a1-36db99965697 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.736002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ba09cb59-bdd7-4119-bc23-e2dcb1871fdf req-f0aff8d0-98a5-413b-b6a1-36db99965697 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.748381 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ba09cb59-bdd7-4119-bc23-e2dcb1871fdf req-f0aff8d0-98a5-413b-b6a1-36db99965697 service nova] Creating event network-changed:e3d7c39c-58b0-4100-aea2-21c3bb9a51db for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:25.754601 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ba09cb59-bdd7-4119-bc23-e2dcb1871fdf req-f0aff8d0-98a5-413b-b6a1-36db99965697 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Jun 04 21:02:25.755820 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1180/2458] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:25.763072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:25.763818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:25.770759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.772073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.773300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.773970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.859306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.872546 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60216605-0e0b-49d1-9aeb-77f5a4307bb9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1275 microversion: 2.1 time: 0.115146 Jun 04 21:02:25.873883 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1181/2459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:25 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:25.880594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:25.882152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:25.889821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.890768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.892784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:25.893601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:25.921083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:25.937246 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b55d441a-676b-42c9-aa17-e8d091ee9d0d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.275024 Jun 04 21:02:25.938420 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1279/2460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:25 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:25.947555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-579a5e20-350a-403c-857b-9305f985e95c tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d0221c0d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:26.088384 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-579a5e20-350a-403c-857b-9305f985e95c tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.148698 Jun 04 21:02:26.096639 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1280/2461] 10.222.0.18 () {58 vars in 1187 bytes} [Sat Jun 4 21:02:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:26.096639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:26.096639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:26.103648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.104101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.104886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.105319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.260674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:26.268927 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-042af550-c13f-4fb3-b885-57ce2a88306b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.393699 Jun 04 21:02:26.279528 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1182/2462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:25 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:26.284874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:26.287278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:26.294493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.296014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.297052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.297729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.552015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:26.565261 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4ea56d1-9613-4cda-93d8-a4beca25ca5a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.473958 Jun 04 21:02:26.565864 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1281/2463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:26 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:26.571332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab34a1be-2cd0-4c4c-9b3e-6c58405a3944 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] Calling method '.version_select at 0x7f2d02112d30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:26.630863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:26.647449 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e396203b-ef1e-49a3-8c60-eea43e60672c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.363094 Jun 04 21:02:26.648702 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1183/2464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:26 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:26.654068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:26.654853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:26.671342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.672190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.673295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.674780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.757004 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab34a1be-2cd0-4c4c-9b3e-6c58405a3944 tempest-VolumesTestJSON-1112445710 tempest-VolumesTestJSON-1112445710-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.189739 Jun 04 21:02:26.758449 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1282/2465] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 21:02:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:26.772504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:26.773445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:26.781803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.782476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:26.783619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:26.786792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:27.594058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:27.603220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c36f21c0-646f-4d16-b7d5-34ffc4956ff8 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 0.953125 Jun 04 21:02:27.603858 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1184/2466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:26 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:27.619332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6379a8cf-74da-46c8-a93c-d639c768a140 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:27.622025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6379a8cf-74da-46c8-a93c-d639c768a140 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: db36e6b1-184a-4505-b97c-c534342374ac] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:27.624062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:27.639316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ddd1ae68-fa7f-4353-a6cd-44329f7ec1ac tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1379 microversion: 2.1 time: 0.879425 Jun 04 21:02:27.641191 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1283/2467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:26 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1379 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:27.641667 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-6379a8cf-74da-46c8-a93c-d639c768a140 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance db36e6b1-184a-4505-b97c-c534342374ac could not be found. Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6379a8cf-74da-46c8-a93c-d639c768a140 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/db36e6b1-184a-4505-b97c-c534342374ac/action HTTP/1.1 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 15 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: {"suspend": {}} Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance db36e6b1-184a-4505-b97c-c534342374ac could not be found. Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'db36e6b1-184a-4505-b97c-c534342374ac', 'body': {'suspend': {}}} Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db36e6b1-184a-4505-b97c-c534342374ac could not be found. Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db36e6b1-184a-4505-b97c-c534342374ac could not be found. Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:27.647702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:27.652164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:27.652164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:27.652164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db36e6b1-184a-4505-b97c-c534342374ac could not be found. Jun 04 21:02:27.652164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:27.652164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6379a8cf-74da-46c8-a93c-d639c768a140 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance db36e6b1-184a-4505-b97c-c534342374ac could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:27.652164 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6379a8cf-74da-46c8-a93c-d639c768a140 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/db36e6b1-184a-4505-b97c-c534342374ac/action" status: 404 len: 111 microversion: 2.1 time: 0.040143 Jun 04 21:02:27.655332 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1185/2468] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:27 2022] POST /compute/v2.1/servers/db36e6b1-184a-4505-b97c-c534342374ac/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:27.657431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:27.658071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:27.665335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:27.665782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:27.666850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:27.667345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b3ac4638-ee10-4586-b18b-5b01341f0d16 req-2003a7ce-78fd-4916-bfcf-0cb592f52268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c2f5dd-583d-461f-b9c1-b8d19636d25a", "name": "network-vif-plugged", "status": "completed", "tag": "0f712b9a-5bf3-4dfe-86d9-afaf9f4021c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:27.667667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:27.704197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b3ac4638-ee10-4586-b18b-5b01341f0d16 req-2003a7ce-78fd-4916-bfcf-0cb592f52268 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:27.705512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b3ac4638-ee10-4586-b18b-5b01341f0d16 req-2003a7ce-78fd-4916-bfcf-0cb592f52268 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:27.734392 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b3ac4638-ee10-4586-b18b-5b01341f0d16 req-2003a7ce-78fd-4916-bfcf-0cb592f52268 service nova] Creating event network-vif-plugged:0f712b9a-5bf3-4dfe-86d9-afaf9f4021c0 for instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a on nch2-master-1 Jun 04 21:02:27.741175 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b3ac4638-ee10-4586-b18b-5b01341f0d16 req-2003a7ce-78fd-4916-bfcf-0cb592f52268 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084423 Jun 04 21:02:27.742125 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1186/2469] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:27.753418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:27.754446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:27.763938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:27.764671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:27.765668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:27.766528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.344172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:28.357925 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ae20506-f2cc-4c2e-b8dc-66a189b424ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.609672 Jun 04 21:02:28.358985 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1187/2470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:27 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:28.370492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:28.372282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:28.385485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:28.391556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.392271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.393898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.394367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.404786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:28.416134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:28.417372 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e0140c0b-3c10-40d8-a703-8f5c623326c4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.772746 Jun 04 21:02:28.424723 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1284/2471] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:27 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:28.429885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:28.430508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:28.453671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.454137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.454944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.456164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.837558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:28.846550 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79a27690-0172-49cd-bb8b-16ea2f76a377 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.420466 Jun 04 21:02:28.847787 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1285/2472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:28 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:28.848255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:28.855500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:28.856308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:28.860118 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-89b082ea-77dd-4844-bfb7-f5a7623c3fd3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.496078 Jun 04 21:02:28.863928 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1188/2473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:28 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:28.864167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.864857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.866120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.866725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.880796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "ac7a2d51-6653-42c5-8b27-30685ecc1525"}, {"name": "network-changed", "server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}, {"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "56fb03d6-a5f3-49d6-96c0-89442b0af796"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:28.908380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.910577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.928684 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] Creating event network-changed:ac7a2d51-6653-42c5-8b27-30685ecc1525 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:28.929288 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] Creating event network-changed:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:02:28.930093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] Creating event network-changed:56fb03d6-a5f3-49d6-96c0-89442b0af796 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:28.940156 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1b8b2ba3-016a-4ed6-8c21-136d57e856f1 req-befd8f16-acdc-4f8f-97b6-f17d669b9e6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.074033 Jun 04 21:02:28.941699 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1189/2474] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:28.947398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:28.948510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:28.956618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.957292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:28.958757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:28.959761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:29.398171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:29.411091 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9647307f-fe10-4537-a933-0911371ce57e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.559965 Jun 04 21:02:29.415332 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1286/2475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:28 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:29.420506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:29.427625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:29.451964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:29.453487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:29.474511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:29.475079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:29.516058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:29.541903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:29.551459 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7fae4d90-66ef-43d3-bb0d-aeb4a4de7168 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 0.608250 Jun 04 21:02:29.556157 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1190/2476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:28 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:29.566292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:29.567160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:29.583769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:29.584084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:29.584896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:29.585340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.058938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:30.080443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:30.090150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-584c9c07-d675-487d-a6fe-2fdac6d9dbe1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.530753 Jun 04 21:02:30.094227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78fa520d-1e15-42e5-ad17-378c13ec4ec3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1528 microversion: 2.1 time: 0.676060 Jun 04 21:02:30.105613 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1191/2477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:29 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:30.107477 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1287/2478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:29 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1528 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:30.114789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:30.115471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:30.124348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:30.128220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:30.154704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.159329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.161352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.162049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.162426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.163385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.163635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.164998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.210702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:30.681764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:30.697760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:30.704193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:30.705716 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b23978b1-c53d-4fe7-ba4f-a847685d6203 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.594752 Jun 04 21:02:30.706813 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1288/2479] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:30 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:30.717704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6035a7ba-6990-468b-80f6-221fd832be5b req-08df7f4f-6b88-4a85-a8e3-89501557231e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e85b7a5-99eb-40cc-a447-780320a31c78", "name": "network-vif-plugged", "status": "completed", "tag": "0ecbde04-8ee8-4968-a9fa-9a21912a9e8c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:30.740428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6035a7ba-6990-468b-80f6-221fd832be5b req-08df7f4f-6b88-4a85-a8e3-89501557231e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.741164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6035a7ba-6990-468b-80f6-221fd832be5b req-08df7f4f-6b88-4a85-a8e3-89501557231e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.763050 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6035a7ba-6990-468b-80f6-221fd832be5b req-08df7f4f-6b88-4a85-a8e3-89501557231e service nova] Creating event network-vif-plugged:0ecbde04-8ee8-4968-a9fa-9a21912a9e8c for instance 7e85b7a5-99eb-40cc-a447-780320a31c78 on nch1-master-1 Jun 04 21:02:30.772962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6035a7ba-6990-468b-80f6-221fd832be5b req-08df7f4f-6b88-4a85-a8e3-89501557231e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064638 Jun 04 21:02:30.776396 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1289/2480] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:30.795483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:30.796463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:30.821833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.822324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:30.823200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:30.823747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.234089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:31.242170 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fba9300f-65eb-4bdb-bb55-4a53fdd19a1e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 1.135326 Jun 04 21:02:31.243127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1192/2481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:30 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:31.256598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:31.257553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:31.270306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.271057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.272441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.273039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.743799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:31.758989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ebfb66d4-52f7-4479-a018-e7143bc073db tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.981077 Jun 04 21:02:31.759927 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1290/2482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:30 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:31.775152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-bb2ffdb7-05e2-4e1a-8676-74ca11b426ac req-5420789a-1a29-4e79-9eca-e6c9a770c862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eea574d-d0ab-4cc1-b9a5-28aafce58c36", "tag": "18069fc6-417f-4f52-bfea-398d71316731"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:31.784023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bb2ffdb7-05e2-4e1a-8676-74ca11b426ac req-5420789a-1a29-4e79-9eca-e6c9a770c862 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.784825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bb2ffdb7-05e2-4e1a-8676-74ca11b426ac req-5420789a-1a29-4e79-9eca-e6c9a770c862 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.805034 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-bb2ffdb7-05e2-4e1a-8676-74ca11b426ac req-5420789a-1a29-4e79-9eca-e6c9a770c862 service nova] Creating event network-changed:18069fc6-417f-4f52-bfea-398d71316731 for instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 on nch2-master-1 Jun 04 21:02:31.811184 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-bb2ffdb7-05e2-4e1a-8676-74ca11b426ac req-5420789a-1a29-4e79-9eca-e6c9a770c862 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040432 Jun 04 21:02:31.812115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1291/2483] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:31.818273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:31.819383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:31.833693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.834223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.835166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.837172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.908034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:31.917419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b457796e-1cce-4cd9-980d-3d9f40559257 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.673051 Jun 04 21:02:31.918551 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1193/2484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:31 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:31.923865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:31.924658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:31.931962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.933538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:31.934722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:31.935173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.091879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.101054 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c05726c-e379-4437-92b0-54d53d2c801a tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1322 microversion: 2.1 time: 0.181233 Jun 04 21:02:32.101670 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1194/2485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:31 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:32.106802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-27de933a-9d22-4e9a-ab4a-a8f54185ea1f req-70cd66e3-90eb-404e-8119-df430f64f809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "619b5a38-1d96-4f73-8e36-188fa8464db2"}, {"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "209128ba-608b-44e4-809f-e85d0a6c87e3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:32.115598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-27de933a-9d22-4e9a-ab4a-a8f54185ea1f req-70cd66e3-90eb-404e-8119-df430f64f809 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.116303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-27de933a-9d22-4e9a-ab4a-a8f54185ea1f req-70cd66e3-90eb-404e-8119-df430f64f809 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.129843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-27de933a-9d22-4e9a-ab4a-a8f54185ea1f req-70cd66e3-90eb-404e-8119-df430f64f809 service nova] Creating event network-changed:619b5a38-1d96-4f73-8e36-188fa8464db2 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:32.130610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-27de933a-9d22-4e9a-ab4a-a8f54185ea1f req-70cd66e3-90eb-404e-8119-df430f64f809 service nova] Creating event network-changed:209128ba-608b-44e4-809f-e85d0a6c87e3 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:32.137125 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-27de933a-9d22-4e9a-ab4a-a8f54185ea1f req-70cd66e3-90eb-404e-8119-df430f64f809 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033443 Jun 04 21:02:32.143621 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1195/2486] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:32.149295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:32.150370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:32.157620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.158291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.159072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.159502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.310477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.319812 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46b4f456-7469-4257-8c8c-af2fd976a245 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1528 microversion: 2.1 time: 0.506060 Jun 04 21:02:32.320640 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1292/2487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:31 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1528 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:32.325565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:32.326113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:32.332896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.333374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.334182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.334731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.349243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.360650 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-12f9d1c7-e965-4939-85b9-90ab5418d3dc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.215666 Jun 04 21:02:32.362080 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1196/2488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:32 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:32.368514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:32.369093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lazy-loading 'flavor' on Instance uuid 6544912e-117f-4311-88e5-885fd318c074 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:02:32.369589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:32.377055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.381571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.382720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.383163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.452963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:32.473243 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f518b76b-02bf-47d4-86bb-e4495ea8e1e0 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 202 len: 0 microversion: 2.1 time: 0.150954 Jun 04 21:02:32.477388 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1293/2489] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:32 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:02:32.481906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f431b51-74f4-442a-a05b-e146319bf6ed tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:32.483126 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:02:32.483126 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:02:32.485385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=20 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:32.504087 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f431b51-74f4-442a-a05b-e146319bf6ed tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/ad726c36-eae2-4580-8825-5b0914e7dd91" status: 202 len: 0 microversion: 2.1 time: 0.028190 Jun 04 21:02:32.505394 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1294/2490] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:32 2022] DELETE /compute/v2.1/flavors/ad726c36-eae2-4580-8825-5b0914e7dd91 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:02:32.512050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:32.513686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:32.522385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.522966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.523907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.524407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.642220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.671196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.675208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.677346 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4154f2ae-41f4-4281-8b5f-8e8c8061a4de tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.313541 Jun 04 21:02:32.690666 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1197/2491] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:32 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:32.696210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87bc5092-b452-436b-9286-12e6699a7dcc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:32.716725 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87bc5092-b452-436b-9286-12e6699a7dcc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024494 Jun 04 21:02:32.718725 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1198/2492] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:02:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:32.734044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:32.735733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:32.744788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.745243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.746111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.746959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.751136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.759879 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-618b8bbb-f84f-4ff6-b4e4-ad5825d326b2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1513 microversion: 2.1 time: 0.252813 Jun 04 21:02:32.760987 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1295/2493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:32 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:32.777128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:32.778120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:32.794458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.795562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.796813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:32.797528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:32.852681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:32.860762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Old instance type tempest-test_resize_flavor_-1354630520, new instance type m1.heat {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:02:32.868473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:02:32.868887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:02:32.869595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:02:32.870348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:02:32.870903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:02:33.019150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c8b93c94-8d33-41af-8b22-8fe33643ba20 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7/action" status: 202 len: 0 microversion: 2.1 time: 0.289802 Jun 04 21:02:33.020314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1199/2494] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:32 2022] POST /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:02:33.026060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bd05ff4e-4868-46a9-9038-7882ca350bc2 req-07bb032a-c374-4fc3-947e-0af4cc21bbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "name": "network-vif-plugged", "status": "completed", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:33.035455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bd05ff4e-4868-46a9-9038-7882ca350bc2 req-07bb032a-c374-4fc3-947e-0af4cc21bbd3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.035941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bd05ff4e-4868-46a9-9038-7882ca350bc2 req-07bb032a-c374-4fc3-947e-0af4cc21bbd3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.058784 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bd05ff4e-4868-46a9-9038-7882ca350bc2 req-07bb032a-c374-4fc3-947e-0af4cc21bbd3 service nova] Creating event network-vif-plugged:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:02:33.066693 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bd05ff4e-4868-46a9-9038-7882ca350bc2 req-07bb032a-c374-4fc3-947e-0af4cc21bbd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044840 Jun 04 21:02:33.072385 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1200/2495] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:33.079295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:33.080286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:33.087346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.087846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.088817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.089456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.133139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:33.141457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d803ae0e-3636-4652-83ca-50e94ecffc7f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1498 microversion: 2.1 time: 0.368098 Jun 04 21:02:33.143166 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1296/2496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:32 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1498 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:02:33.148745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:33.149477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:33.156961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.157647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.158657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.159298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.603623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:33.615185 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b0d998d6-c541-44e6-9caa-d4fad3e2754e tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1537 microversion: 2.1 time: 0.470587 Jun 04 21:02:33.616754 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1297/2497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:33 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1537 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:33.623089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:33.624164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:33.633973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.634918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.635765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.636354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.644483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:33.658318 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-156372d1-b8e3-401e-a890-a44a9e982365 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.583087 Jun 04 21:02:33.672827 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1201/2498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:33 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:33.683814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:33.685127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:33.699735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.703433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:33.704607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:33.710397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.022155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:34.027170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:34.036666 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b674b3c-14e9-4c05-8004-1946bfe705c9 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1515 microversion: 2.1 time: 0.418554 Jun 04 21:02:34.055437 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1298/2499] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:33 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:34.060637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:34.061468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-94aa3bb1-5f14-4f2c-b47c-75326acd8063 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.387254 Jun 04 21:02:34.062419 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1202/2500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:33 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:34.064592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:34.068308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:34.072114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:34.078665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.079123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.079947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.080390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.087699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.088160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.088953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.089409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.753098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:34.763817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:34.765795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:34.767175 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-642553ac-2e5e-4c3f-9711-49c806941103 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.710520 Jun 04 21:02:34.779458 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1299/2501] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:34 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:34.785704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:34.786800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:34.793601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.794092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.794885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.795358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.825681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:34.842913 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-924e8763-9515-4a91-9db7-c30bddc8da13 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1496 microversion: 2.1 time: 0.779218 Jun 04 21:02:34.844151 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1203/2502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:34 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1496 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:34.856086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-71dd1258-4642-49db-b416-b92a3950a3e8 req-9a1e6c9f-8b8f-4f61-b51c-b91bd3ef7715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "3a71217e-dc2e-4548-97ad-5596a76b102e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:34.861565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:34.866253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-71dd1258-4642-49db-b416-b92a3950a3e8 req-9a1e6c9f-8b8f-4f61-b51c-b91bd3ef7715 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.866694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-71dd1258-4642-49db-b416-b92a3950a3e8 req-9a1e6c9f-8b8f-4f61-b51c-b91bd3ef7715 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.888251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-71dd1258-4642-49db-b416-b92a3950a3e8 req-9a1e6c9f-8b8f-4f61-b51c-b91bd3ef7715 service nova] Creating event network-changed:3a71217e-dc2e-4548-97ad-5596a76b102e for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:34.900520 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-71dd1258-4642-49db-b416-b92a3950a3e8 req-9a1e6c9f-8b8f-4f61-b51c-b91bd3ef7715 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054387 Jun 04 21:02:34.911940 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1204/2503] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:34.917926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:34.918650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:34.930777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.931625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:34.933137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:34.934040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:35.252738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:35.262137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7575bdc-3ea3-4d02-8560-600629daa2b4 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 200 len: 1515 microversion: 2.1 time: 0.480804 Jun 04 21:02:35.262740 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1300/2504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:34 2022] GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 1515 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:35.289782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:35.290581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:35.297473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:35.297938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:35.298744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:35.299188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:35.301350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:35.315781 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10fdb65b-99bf-45c0-90c3-9481af8ad5e8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 200 len: 1475 microversion: 2.1 time: 0.402216 Jun 04 21:02:35.316518 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1205/2505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:34 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:35.327991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:35.328960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:35.337250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:35.337964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:35.338958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:35.339854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.097337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:36.106677 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f9795c6-30b4-44d9-bbf2-cb3f2f38e7da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1537 microversion: 2.1 time: 0.821681 Jun 04 21:02:36.107280 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1301/2506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:35 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1537 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:36.120932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:36.121909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:36.128776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.129567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.131029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.131823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.144642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:36.161136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lazy-loading 'flavor' on Instance uuid 6544912e-117f-4311-88e5-885fd318c074 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:02:36.177145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'suspend' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state suspended Jun 04 21:02:36.178885 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ab20dbac-9f6f-4116-8549-08eb5673db1b tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1509 microversion: 2.1 time: 0.861000 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: {"suspend": {}} Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'suspend' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state suspended Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'suspend': {}}} Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state suspended. Cannot suspend while the instance is in this state. Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jun 04 21:02:36.179036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state suspended Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state suspended Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'suspend' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state suspended {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5bd6594f-0f9f-4c80-83fc-59721d649ec4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 148 microversion: 2.1 time: 0.071871 Jun 04 21:02:36.183454 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1302/2507] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:36 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 148 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:02:36.188732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:36.189523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:36.191919 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1206/2508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:35 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1509 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:36.203548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:36.204461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:36.205407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.205929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.206726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.207176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.213481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.214306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.215613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.216240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.698143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:36.708086 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c919bac-d177-41a3-a918-42a724fb2086 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc" status: 200 len: 1515 microversion: 2.1 time: 0.514468 Jun 04 21:02:36.708980 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1207/2509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:36 2022] GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc => generated 1515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:36.713687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-336354686"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:36.714791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:36.723012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.723362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.724499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.724937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.732612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:36.750368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-38228715-db66-4d49-b63f-ad1485138b72 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.568304 Jun 04 21:02:36.751313 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1303/2510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:36 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:36.766269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:36.766991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:36.778260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.778260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:36.778260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:36.789735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.100567 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-88978a5f-32ba-4f48-af91-e07af16ab714 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a/action" status: 202 len: 0 microversion: 2.1 time: 0.390575 Jun 04 21:02:37.101399 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1208/2511] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:36 2022] POST /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:02:37.107050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:37.107723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:37.117049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.117965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.119045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.119760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.141546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:37.237757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ab38aed2-761e-40de-81c0-8311e5642bfd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 202 len: 0 microversion: 2.1 time: 0.134476 Jun 04 21:02:37.238782 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1209/2512] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:37 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:02:37.250604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:37.252239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:37.269456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.269456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.269456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.273453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.290400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:37.293178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:37.306314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:37.308159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:02:37.314816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:37.320518 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f7d3250-9205-47dd-9154-0090019e5b09 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.564548 Jun 04 21:02:37.322376 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1304/2513] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:36 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:37.332493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b863006f-c6f6-4c2d-90ba-5d9a3f818924 req-ce554539-a1fd-4f53-ad22-3940025992ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eea574d-d0ab-4cc1-b9a5-28aafce58c36", "name": "network-vif-plugged", "status": "completed", "tag": "18069fc6-417f-4f52-bfea-398d71316731"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:37.352432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b863006f-c6f6-4c2d-90ba-5d9a3f818924 req-ce554539-a1fd-4f53-ad22-3940025992ee service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.354320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b863006f-c6f6-4c2d-90ba-5d9a3f818924 req-ce554539-a1fd-4f53-ad22-3940025992ee service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.369991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b863006f-c6f6-4c2d-90ba-5d9a3f818924 req-ce554539-a1fd-4f53-ad22-3940025992ee service nova] Creating event network-vif-plugged:18069fc6-417f-4f52-bfea-398d71316731 for instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 on nch2-master-1 Jun 04 21:02:37.379016 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b863006f-c6f6-4c2d-90ba-5d9a3f818924 req-ce554539-a1fd-4f53-ad22-3940025992ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054662 Jun 04 21:02:37.381271 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1305/2514] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:37.392045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0042f97c-aa5f-41b0-999a-ddda28828500 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d021bd670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:37.459585 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0042f97c-aa5f-41b0-999a-ddda28828500 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1413 microversion: 2.1 time: 0.076220 Jun 04 21:02:37.462006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1306/2515] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:37 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:37.478889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:37.482970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:37.502201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.502944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.503924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.504460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87f93daa-194b-4187-9c8d-3d63f7bbc219 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 204 len: 0 microversion: 2.1 time: 0.262779 Jun 04 21:02:37.504704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.505121 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1210/2516] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:37 2022] DELETE /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:02:37.510286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:37.511078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:37.521078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.521867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.522659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.523096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.936209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:37.947331 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8964ce9f-9d0e-46a2-9d2c-ff3b36de3209 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.481264 Jun 04 21:02:37.947975 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1307/2517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:37 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:37.957546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:37.962755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c763ddff-49ec-4ef2-a559-238242a1ae11 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1530 microversion: 2.1 time: 0.456390 Jun 04 21:02:37.964433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:37.965572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:37.971918 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1211/2518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:37 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1530 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:37.974778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.975586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.976717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.977472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.980818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:37.981436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:37.993014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.993912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:37.995194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:37.995672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.444605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:38.452800 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f05c34fd-9ac1-404b-bfff-c6d4d99c1142 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1502 microversion: 2.1 time: 0.493481 Jun 04 21:02:38.453507 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1308/2519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:37 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1502 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:38.458300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:38.458902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:38.465482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:38.466147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.467340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:38.467773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.483995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:38.498245 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-866ba6ec-3d61-48e2-a28a-844450641323 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 200 len: 1521 microversion: 2.1 time: 0.524754 Jun 04 21:02:38.499582 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1212/2520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:37 2022] GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:38.504595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:38.505675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:38.513059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:38.516173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.516173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:38.516173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.852713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:38.868364 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a45d97c3-1a82-4062-a494-9fce9980c6fb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.413593 Jun 04 21:02:38.869344 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1309/2521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:38 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:38.873980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c8e5e5f8-55b1-45f5-848c-76da081521dc tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01a6bd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:38.889826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:38.901642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:38.906519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:38.908153 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77581cfb-86df-4e8e-9f13-14f7b0bc4ce4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.407533 Jun 04 21:02:38.910934 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1213/2522] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:38 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:38.965714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:38.966449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:38.969414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c8e5e5f8-55b1-45f5-848c-76da081521dc tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1413 microversion: 2.1 time: 0.098875 Jun 04 21:02:38.970023 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1310/2523] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:38 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:38.978923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:38.983919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.985337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:38.985979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:38.986122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:38.991035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:39.001117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:39.008080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:39.009054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:39.018871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:39.440622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:39.454918 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f454fdc3-b779-4a5c-83c4-a64c7fcdd3e2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.493679 Jun 04 21:02:39.467046 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1214/2524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:38 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:02:39.475598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:39.477734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:39.488675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:39.490121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:39.491571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:39.492463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:39.873823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:39.882839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8fa2ee69-1a09-464e-8225-70968bc883b4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1530 microversion: 2.1 time: 0.900822 Jun 04 21:02:39.894066 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1311/2525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:38 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1530 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:02:39.900828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:39.901740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:39.910482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:39.911348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:39.912863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:39.914001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.081500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:40.101183 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-062046e7-f54b-42b3-91a4-f17b6b673b12 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 200 len: 1479 microversion: 2.1 time: 0.205884 Jun 04 21:02:40.102884 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1312/2526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:39 2022] GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 1479 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:40.110594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cd32b246-179e-4a5a-a904-4fb9ee01b8bf req-ccba497e-fef1-48fc-a328-4b5447f46e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c2f5dd-583d-461f-b9c1-b8d19636d25a", "name": "network-vif-deleted", "tag": "0f712b9a-5bf3-4dfe-86d9-afaf9f4021c0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:40.125637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:40.137154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db5346c8-a174-42ea-aa2f-feec25178d6b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1502 microversion: 2.1 time: 0.668641 Jun 04 21:02:40.138006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd32b246-179e-4a5a-a904-4fb9ee01b8bf req-ccba497e-fef1-48fc-a328-4b5447f46e3d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.138993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd32b246-179e-4a5a-a904-4fb9ee01b8bf req-ccba497e-fef1-48fc-a328-4b5447f46e3d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.142320 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1215/2527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:39 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1502 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:40.156525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:40.157267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:40.172067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.174479 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cd32b246-179e-4a5a-a904-4fb9ee01b8bf req-ccba497e-fef1-48fc-a328-4b5447f46e3d service nova] Creating event network-vif-deleted:0f712b9a-5bf3-4dfe-86d9-afaf9f4021c0 for instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a on nch2-master-1 Jun 04 21:02:40.174862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.176496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.177335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.193374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cd32b246-179e-4a5a-a904-4fb9ee01b8bf req-ccba497e-fef1-48fc-a328-4b5447f46e3d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087304 Jun 04 21:02:40.195312 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1313/2528] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:40.205959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:40.212551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:40.235278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.236472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.240325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.241991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.729458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:40.740153 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2980b603-7fd1-47b0-9f15-c39fcaf7faae tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1317 microversion: 2.1 time: 0.595563 Jun 04 21:02:40.750735 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1216/2529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:40 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:40.759603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d9d0b923-8e98-477e-812b-22e947c40e77 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d022929d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:40.761265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:40.793253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:40.798293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:40.802243 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-977f66d5-a513-4de7-9eee-a3aa25355a77 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.604616 Jun 04 21:02:40.829262 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1314/2530] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:40 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:40.860824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:40.861763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:40.871048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:40.871786 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d9d0b923-8e98-477e-812b-22e947c40e77 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1413 microversion: 2.1 time: 0.119814 Jun 04 21:02:40.874517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.876343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.881181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.882156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.889578 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1217/2531] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:40 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:40.908628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:40.909252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:40.943081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.950896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:40.951853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:40.952360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.674763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:41.693161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-51a6afc8-e265-4c45-b6d0-a874a556e7ef tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1525 microversion: 2.1 time: 0.791562 Jun 04 21:02:41.696698 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1218/2532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:40 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1525 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:02:41.714140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d51b0823-3501-45ef-8b94-b015835085e7 req-046b41f0-271b-48bb-94c2-db032d153bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328b885a-2830-40c9-8726-53e1d9288a4a", "name": "network-vif-plugged", "status": "completed", "tag": "0e1e5687-915f-4676-b561-9d37640fadea"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:41.739216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:41.759161 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33148d83-43d1-4647-8393-326a65f0c599 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.903949 Jun 04 21:02:41.759901 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1315/2533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:40 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:41.761157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d51b0823-3501-45ef-8b94-b015835085e7 req-046b41f0-271b-48bb-94c2-db032d153bc0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.765540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d51b0823-3501-45ef-8b94-b015835085e7 req-046b41f0-271b-48bb-94c2-db032d153bc0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.777003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:41.780782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:41.800771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.802977 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d51b0823-3501-45ef-8b94-b015835085e7 req-046b41f0-271b-48bb-94c2-db032d153bc0 service nova] Creating event network-vif-plugged:0e1e5687-915f-4676-b561-9d37640fadea for instance 328b885a-2830-40c9-8726-53e1d9288a4a on nch2-master-1 Jun 04 21:02:41.803746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.804761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.811632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.827402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d51b0823-3501-45ef-8b94-b015835085e7 req-046b41f0-271b-48bb-94c2-db032d153bc0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126614 Jun 04 21:02:41.834083 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1219/2534] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:41.854484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:41.855360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:41.865148 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] HTTP exception thrown: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a HTTP/1.1 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '89c2f5dd-583d-461f-b9c1-b8d19636d25a'} Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:41.866899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 404 to user: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-261e4169-0311-40c3-a471-e360c0e5db76 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 404 len: 111 microversion: 2.1 time: 0.103821 Jun 04 21:02:41.871598 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1316/2535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:41 2022] GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:41.875544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.876071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.878393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.878873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.892058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:41.892688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:41.938496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.938956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:41.939776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:41.940221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:42.267433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:42.277889 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75a6e9e3-ac15-4d50-a27d-8db785cb3a7c tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.442245 Jun 04 21:02:42.285783 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1220/2536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:41 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:42.293984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:42.301153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:42.315453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:42.317616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:42.320747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:42.321340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:42.703025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:42.712778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f7ba129-f1d7-4449-a6d8-dd41134673ea tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1467 microversion: 2.1 time: 0.842668 Jun 04 21:02:42.717844 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1317/2537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:41 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1467 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:42.745196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:42.749761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:42.750879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:42.762524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:42.763269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:42.764467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:42.765149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:42.851998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:42.866151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:42.868007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:42.869396 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d509908-ee5d-4a5d-9374-f876263b95cc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.581270 Jun 04 21:02:42.883479 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1221/2538] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:42 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:42.889373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6381e22-47f2-431e-b206-ad90cb4477f9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d02177f70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:42.996032 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65486637-34da-4db8-aa5a-205ede783835 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.266742 Jun 04 21:02:43.004652 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1318/2539] 10.222.0.18 () {58 vars in 1229 bytes} [Sat Jun 4 21:02:42 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:02:43.018317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:43.019481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:43.036356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:43.038477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:43.040307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:43.042286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:43.281878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:43.294534 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09f4c77e-9329-4ecd-9732-29e38d4bdadd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.287588 Jun 04 21:02:43.314005 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1319/2540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:43 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:43.314005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:43.314005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:43.326490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:43.327828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:43.332164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:43.332708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:43.677253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:43.689278 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5c937ba-b15e-4cc2-833a-704be03f354d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1525 microversion: 2.1 time: 0.386027 Jun 04 21:02:43.692445 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1320/2541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:43 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1525 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:43.710856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:43.713662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:43.730217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:43.730968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:43.736776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:43.738107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:44.061472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:44.082254 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a208079d-ead7-48a6-9fe8-d3389d776180 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1466 microversion: 2.1 time: 0.386416 Jun 04 21:02:44.085211 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1321/2542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:43 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:44.098384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:44.101556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:44.127304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:44.128183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:44.129193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:44.133101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:44.587112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:44.599722 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45ab4e45-daff-4317-af81-f79653291c18 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.513330 Jun 04 21:02:44.604434 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1322/2543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:44 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:44.621951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-395557fe-1ed8-4e2e-b28e-07beeae967ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-395557fe-1ed8-4e2e-b28e-07beeae967ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi '2011/01/01' Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 04 21:02:44.625205 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 04 21:02:44.629309 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.635472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-395557fe-1ed8-4e2e-b28e-07beeae967ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:44.637362 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-395557fe-1ed8-4e2e-b28e-07beeae967ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.031699 Jun 04 21:02:44.643195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1323/2544] 10.222.0.18 () {58 vars in 1181 bytes} [Sat Jun 4 21:02:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:02:44.650952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4432c3a-cd17-4e39-bfe7-8074d72cc89f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:44.652001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4432c3a-cd17-4e39-bfe7-8074d72cc89f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 24748f4f-a346-48b5-911f-62fc8f2dc713] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:44.664686 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a4432c3a-cd17-4e39-bfe7-8074d72cc89f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 24748f4f-a346-48b5-911f-62fc8f2dc713 could not be found. Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4432c3a-cd17-4e39-bfe7-8074d72cc89f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/24748f4f-a346-48b5-911f-62fc8f2dc713/action HTTP/1.1 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 15 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: {"unpause": {}} Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 24748f4f-a346-48b5-911f-62fc8f2dc713 could not be found. Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '24748f4f-a346-48b5-911f-62fc8f2dc713', 'body': {'unpause': {}}} Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24748f4f-a346-48b5-911f-62fc8f2dc713 could not be found. Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24748f4f-a346-48b5-911f-62fc8f2dc713 could not be found. Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:44.666610 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:44.670958 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:44.670958 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:44.670958 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24748f4f-a346-48b5-911f-62fc8f2dc713 could not be found. Jun 04 21:02:44.670958 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:44.672339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4432c3a-cd17-4e39-bfe7-8074d72cc89f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 24748f4f-a346-48b5-911f-62fc8f2dc713 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:44.673914 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4432c3a-cd17-4e39-bfe7-8074d72cc89f tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/24748f4f-a346-48b5-911f-62fc8f2dc713/action" status: 404 len: 111 microversion: 2.1 time: 0.028769 Jun 04 21:02:44.675494 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1324/2545] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:44 2022] POST /compute/v2.1/servers/24748f4f-a346-48b5-911f-62fc8f2dc713/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:44.685123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-02d0d1f8-6e17-45ad-b243-2c86c6652424 req-123c6437-0411-4e36-aaa6-c59a0cbcbc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c35d6-29be-4969-b399-b35e4ceea667", "name": "network-vif-plugged", "status": "completed", "tag": "1841e45a-a429-4cc2-8e93-ecdde075787a"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:44.695620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-02d0d1f8-6e17-45ad-b243-2c86c6652424 req-123c6437-0411-4e36-aaa6-c59a0cbcbc65 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:44.696461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-02d0d1f8-6e17-45ad-b243-2c86c6652424 req-123c6437-0411-4e36-aaa6-c59a0cbcbc65 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:44.716344 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-02d0d1f8-6e17-45ad-b243-2c86c6652424 req-123c6437-0411-4e36-aaa6-c59a0cbcbc65 service nova] Creating event network-vif-plugged:1841e45a-a429-4cc2-8e93-ecdde075787a for instance cf2c35d6-29be-4969-b399-b35e4ceea667 on nch1-master-1 Jun 04 21:02:44.722493 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-02d0d1f8-6e17-45ad-b243-2c86c6652424 req-123c6437-0411-4e36-aaa6-c59a0cbcbc65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044918 Jun 04 21:02:44.725444 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1325/2546] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:44.732210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:44.733052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:44.741315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:44.741925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:44.742851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:44.743638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:45.311757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:45.336864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:45.345015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:45.346242 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ba80d36-916c-42ca-9386-c73a4bd045da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.618837 Jun 04 21:02:45.375910 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1326/2547] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:44 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:45.379491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-718861145"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:45.380823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:45.405720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:45.409131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:45.415344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:45.419259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:52.309346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:52.843802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:52.862617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:53.791665 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6381e22-47f2-431e-b206-ad90cb4477f9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1413 microversion: 2.1 time: 10.906348 Jun 04 21:02:53.793025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1222/2548] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:42 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1413 bytes in 10909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:53.807917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:53.812473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:53.819856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:53.827338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:53.829896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:53.831871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:53.832559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:53.874732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:02:53.916793 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a8ecb19-a6b2-44e5-8f97-ef24a8f16e7d tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.122478 Jun 04 21:02:53.918703 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1223/2549] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:02:53 2022] GET /compute/v2.1/servers => generated 681 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:53.923938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:53.925377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:53.934290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:53.935308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:53.937184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:53.937806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.040003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:54.093921 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-27014dbf-2bc8-47b9-8911-50423c55f2a7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "POST /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204/action" status: 202 len: 0 microversion: 2.1 time: 8.723186 Jun 04 21:02:54.095384 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1327/2550] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:45 2022] POST /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204/action => generated 0 bytes in 8726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:02:54.104104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:54.105170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:54.115810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.116851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.117840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.118424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.192444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:54.210967 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60810aa7-f181-4cf0-91ed-4422673929bc tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.290935 Jun 04 21:02:54.212470 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1224/2551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:53 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:54.221652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:54.229014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:54.239410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.240134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.241109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.241687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.479933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:54.520193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2b5d357b-a49f-4b00-a566-c8eff9a27bf7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1525 microversion: 2.1 time: 0.423175 Jun 04 21:02:54.535345 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1328/2552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:54 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1525 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:54.547714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:54.548616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:54.562207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.566177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.566177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.568062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.581152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:54.592140 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d466fed-7d05-4775-8887-e2c809f0c9cf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.377946 Jun 04 21:02:54.593164 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1225/2553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:54 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:54.624040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:54.629548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:54.630278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.servers [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Removing options 'limit' from query {{(pid=137229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 04 21:02:54.630964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:54.643676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.644473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.647384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.648142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.702466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:02:54.807780 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-473200f1-0cb4-40a2-bdff-a72c1c278da0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.193733 Jun 04 21:02:54.812156 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1226/2554] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Jun 4 21:02:54 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:54.837225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-51f35bae-4021-48c5-b16d-85a11cdf0329 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0209e430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:54.932041 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-51f35bae-4021-48c5-b16d-85a11cdf0329 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.118435 Jun 04 21:02:54.932931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1227/2555] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:54 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:54.945194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:54.946081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:54.955395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.956759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:54.959734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:54.959734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.127058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.142702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.146187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.149421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a21522c8-f77b-46f1-8018-a565a5324890 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.612143 Jun 04 21:02:55.163937 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1329/2556] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:54 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:55.170477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e54ed3b3-ddc6-4954-adbc-55850c028c07 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0189c280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.252370 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e54ed3b3-ddc6-4954-adbc-55850c028c07 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1413 microversion: 2.1 time: 0.086668 Jun 04 21:02:55.260138 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1330/2557] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:55.266637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f285b0a9-da9e-457e-b816-feb2ee1794e7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f285b0a9-da9e-457e-b816-feb2ee1794e7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi '-1' Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 04 21:02:55.271299 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 04 21:02:55.276511 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.278867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f285b0a9-da9e-457e-b816-feb2ee1794e7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:55.280643 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f285b0a9-da9e-457e-b816-feb2ee1794e7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.017935 Jun 04 21:02:55.282298 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1331/2558] 10.222.0.18 () {58 vars in 1141 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:02:55.294059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d648077c-15ec-4e8f-8299-ad23f9011914 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d648077c-15ec-4e8f-8299-ad23f9011914 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'testing' Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 04 21:02:55.298206 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 04 21:02:55.302806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.306537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d648077c-15ec-4e8f-8299-ad23f9011914 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:55.307626 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d648077c-15ec-4e8f-8299-ad23f9011914 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018916 Jun 04 21:02:55.308773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1332/2559] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:02:55.319580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f52e3274-8263-4cfb-a766-0758a5c9c615 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.324131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f52e3274-8263-4cfb-a766-0758a5c9c615 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.326438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f52e3274-8263-4cfb-a766-0758a5c9c615 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:55.334995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.compute.servers [None req-f52e3274-8263-4cfb-a766-0758a5c9c615 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Flavor 'non_existing_flavor' could not be found {{(pid=137228) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jun 04 21:02:55.337885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f52e3274-8263-4cfb-a766-0758a5c9c615 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.023938 Jun 04 21:02:55.339074 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1333/2560] 10.222.0.18 () {58 vars in 1177 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:02:55.353879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.360119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.361061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:55.369491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.370791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.371845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.372449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.401714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.412652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c60e5942-f199-4d72-a08a-47d62f9dfac7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.478412 Jun 04 21:02:55.414285 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1228/2561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:54 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:55.438809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:55.439862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:55.451545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.452295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.453460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.454104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.492174 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'unpause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 15 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: {"unpause": {}} Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: exception: Cannot 'unpause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'unpause': {}}} Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state active. Cannot unpause while the instance is in this state. Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:55.495220 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:55.499521 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:55.499521 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:55.499521 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:55.499521 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:55.499521 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:02:55.502294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'unpause' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:55.503435 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1d14601-4805-4812-b0dc-4c0e99cd5d5d tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 145 microversion: 2.1 time: 0.069971 Jun 04 21:02:55.504368 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1229/2562] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:55 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 145 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:02:55.517642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.518621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:55.530142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.531081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.532703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.535154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.585690 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-25929145-7fbd-47ca-aabd-cfad570e71d7 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.235883 Jun 04 21:02:55.588282 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1334/2563] 10.222.0.18 () {58 vars in 1173 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:02:55.600215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.602007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:55.621850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.622315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.623115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:55.623584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:55.957821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.971608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0654d78-b690-4d3b-81fb-bbf096a2673c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1507 microversion: 2.1 time: 0.381800 Jun 04 21:02:55.974825 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1335/2564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:55.979882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:55.991826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.998442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:55.999310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:56.010158 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-104d383f-9492-4ea5-928c-4f876cbffab7 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.499364 Jun 04 21:02:56.012884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.016769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.018448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.020495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.023891 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1230/2565] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.029138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.029987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:56.037434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.038238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.039920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.040678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.134832 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bfaf34c2-b5ea-48ce-a4b0-f62ddaa1ef19 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.158587 Jun 04 21:02:56.135798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1336/2566] 10.222.0.18 () {58 vars in 1183 bytes} [Sat Jun 4 21:02:55 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:02:56.140978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e1888dfc-e14d-4b11-b764-8b85aa10409d req-1a4eea61-244f-4823-82c5-4427ba8c72c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "a18106de-02a9-4771-a90c-8ae75e40f172"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:56.150771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e1888dfc-e14d-4b11-b764-8b85aa10409d req-1a4eea61-244f-4823-82c5-4427ba8c72c0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.151590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e1888dfc-e14d-4b11-b764-8b85aa10409d req-1a4eea61-244f-4823-82c5-4427ba8c72c0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.168138 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e1888dfc-e14d-4b11-b764-8b85aa10409d req-1a4eea61-244f-4823-82c5-4427ba8c72c0 service nova] Creating event network-vif-plugged:a18106de-02a9-4771-a90c-8ae75e40f172 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:56.175400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e1888dfc-e14d-4b11-b764-8b85aa10409d req-1a4eea61-244f-4823-82c5-4427ba8c72c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038054 Jun 04 21:02:56.176431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1337/2567] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:56.184548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84060a1a-5ca2-4837-b26c-9e11c06bfff0 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02085d30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.223648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.236686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd7e05dd-bb2c-4997-83d1-80b6e055184b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.211603 Jun 04 21:02:56.238144 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1231/2568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.244083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.244320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84060a1a-5ca2-4837-b26c-9e11c06bfff0 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.066054 Jun 04 21:02:56.245382 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1338/2569] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.250231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.250951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:56.255500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.256619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:56.259476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.259964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.261932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.262457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.264080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.264758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.265773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.266363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.300253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:02:56.357503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.368685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.369533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.486058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.497527 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a821b21-0af3-4705-9c3a-418ab3f3d013 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.257946 Jun 04 21:02:56.500047 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1232/2570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.507360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.508247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:56.517117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.517644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.518651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.519985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.565581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e33a09bc-544f-4c64-a2d4-787dbaac7e72 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.318645 Jun 04 21:02:56.583970 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1339/2571] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.590132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d3ba41a-bc68-40a5-ada6-1b076eb60906 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0189cb80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.645660 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d3ba41a-bc68-40a5-ada6-1b076eb60906 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1422 microversion: 2.1 time: 0.060052 Jun 04 21:02:56.652933 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1340/2572] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1422 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.652933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c080936e-121d-4e25-a08e-ab7e02a6660e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:56.653217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c080936e-121d-4e25-a08e-ab7e02a6660e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 4fa88218-d3f3-45e8-b091-afe339bd32df] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:56.659170 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-c080936e-121d-4e25-a08e-ab7e02a6660e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 4fa88218-d3f3-45e8-b091-afe339bd32df could not be found. Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c080936e-121d-4e25-a08e-ab7e02a6660e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/4fa88218-d3f3-45e8-b091-afe339bd32df/action HTTP/1.1 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 18 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: {"unshelve": null} Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 4fa88218-d3f3-45e8-b091-afe339bd32df could not be found. Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '4fa88218-d3f3-45e8-b091-afe339bd32df', 'body': {'unshelve': None}} Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa88218-d3f3-45e8-b091-afe339bd32df could not be found. Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa88218-d3f3-45e8-b091-afe339bd32df could not be found. Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:56.661010 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa88218-d3f3-45e8-b091-afe339bd32df could not be found. Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c080936e-121d-4e25-a08e-ab7e02a6660e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 4fa88218-d3f3-45e8-b091-afe339bd32df could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c080936e-121d-4e25-a08e-ab7e02a6660e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/4fa88218-d3f3-45e8-b091-afe339bd32df/action" status: 404 len: 111 microversion: 2.1 time: 0.014555 Jun 04 21:02:56.664855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1341/2573] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:56 2022] POST /compute/v2.1/servers/4fa88218-d3f3-45e8-b091-afe339bd32df/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:56.667995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4fd3222-7a86-4465-b2b2-017d6070fdc5 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.672573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4fd3222-7a86-4465-b2b2-017d6070fdc5 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.673577 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4fd3222-7a86-4465-b2b2-017d6070fdc5 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.009392 Jun 04 21:02:56.674106 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1342/2574] 10.222.0.18 () {58 vars in 1177 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:02:56.685731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-927eba53-0e6d-484b-94fc-8149cc2d7af4 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d023255e0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.734458 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-927eba53-0e6d-484b-94fc-8149cc2d7af4 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 200 len: 1422 microversion: 2.1 time: 0.052733 Jun 04 21:02:56.739672 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1343/2575] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 1422 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:56.744829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.745700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:56.750921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.754869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.755837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.757037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.757941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.763268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.765159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.766364 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-59ee0921-a854-4af7-acbc-8659bd5849fd tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.265169 Jun 04 21:02:56.766974 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1233/2576] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:56.779772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:56.784466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:56.785217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Searching by: {'deleted': False, 'project_id': '01083c40e40446e581220f68d579105d'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:02:56.792056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.792579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.793318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:56.794055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:56.831974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:02:56.866242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f051c1e-7469-497c-99c3-54da6cf04525 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.098154 Jun 04 21:02:56.867439 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1234/2577] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers => generated 681 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:56.873971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1009e32f-d3cf-4f9a-8337-44637a73250a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d02292ee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:57.320357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:57.328377 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d1f9554-0c98-4df1-9504-247d8f91c9c5 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.591687 Jun 04 21:02:57.331072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1344/2578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:56 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:57.346748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:57.347580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:57.354515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.355491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.356727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.357352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.394143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:02:57.523107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-869cda53-d812-40b9-acde-afafb37211ab tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc" status: 204 len: 0 microversion: 2.1 time: 0.179963 Jun 04 21:02:57.524209 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1345/2579] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:57 2022] DELETE /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:02:57.530862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:57.531584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:57.544298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.545231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.546832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.547695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.730634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:57.743061 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4aff889a-a1bc-4745-af1d-22fb1a31e490 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1507 microversion: 2.1 time: 0.216797 Jun 04 21:02:57.744348 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1346/2580] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:57 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:57.763383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:57.764076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:57.775404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.776425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.777443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.778377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.847562 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1009e32f-d3cf-4f9a-8337-44637a73250a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 204 len: 0 microversion: 2.1 time: 0.978470 Jun 04 21:02:57.848206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1235/2581] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:56 2022] DELETE /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 0 bytes in 980 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:02:57.854275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb352d5b-3e22-4474-983e-4ebf8ee1103b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d021f6dc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:57.919496 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb352d5b-3e22-4474-983e-4ebf8ee1103b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.068960 Jun 04 21:02:57.920934 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1236/2582] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:57 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:57.932106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:57.932943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:57.941536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.942279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.943383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:57.944002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:57.981870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:57.992988 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5fdd627b-8e0d-4aef-ae33-d2695a85a717 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.247299 Jun 04 21:02:57.993680 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1347/2583] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:57 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:58.001618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.002131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.008803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.009385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.010185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.010630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.025899 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] HTTP exception thrown: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a HTTP/1.1 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '89c2f5dd-583d-461f-b9c1-b8d19636d25a'} Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:58.027751 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 404 to user: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-275456a9-6b0e-4512-bf54-1b6616d01a13 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 404 len: 111 microversion: 2.1 time: 0.034619 Jun 04 21:02:58.031843 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1348/2584] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:57 2022] DELETE /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:58.034798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.035493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.042193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.042647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.043429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.043898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.127765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:58.136931 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ebd8af0-7106-4daf-9f35-1f9f58e36e47 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.208828 Jun 04 21:02:58.148849 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1237/2585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:57 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:58.148849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.148849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.151048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.151836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.152704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.153133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.182927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:02:58.270081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:58.278083 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1581ccd6-8d93-4f03-b36f-c227284c3812 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 204 len: 0 microversion: 2.1 time: 0.138880 Jun 04 21:02:58.278770 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1238/2586] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:58 2022] DELETE /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:02:58.285000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.286713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.294858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:58.295096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.295722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.296943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.297513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.306135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:58.307645 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d5ce1dc-f341-4100-ade5-8ef6f36a8981 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.276868 Jun 04 21:02:58.308389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1349/2587] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:58 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:58.317559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:58.318537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.327123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.331618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.333278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.334063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.350113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:02:58.372337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:02:58.391133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Cannot 'unshelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action HTTP/1.1 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 18 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: {"unshelve": null} Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: exception: Cannot 'unshelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'unshelve': None}} Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6544912e-117f-4311-88e5-885fd318c074 in vm_state active. Cannot unshelve while the instance is in this state. Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 04 21:02:58.393243 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 409 to user: Cannot 'unshelve' instance 6544912e-117f-4311-88e5-885fd318c074 while it is in vm_state active {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-431c49a5-dbe6-4cd2-9f8b-e57be87993c6 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action" status: 409 len: 146 microversion: 2.1 time: 0.086470 Jun 04 21:02:58.398948 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1350/2588] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:02:58 2022] POST /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074/action => generated 146 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:02:58.411436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c3dc74e8-c588-4971-a93a-63d3736e3167 req-c6ab6ab6-1026-469b-8d55-1690b87250dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "ac7a2d51-6653-42c5-8b27-30685ecc1525"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "e3d7c39c-58b0-4100-aea2-21c3bb9a51db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:58.423801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c3dc74e8-c588-4971-a93a-63d3736e3167 req-c6ab6ab6-1026-469b-8d55-1690b87250dd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.424175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c3dc74e8-c588-4971-a93a-63d3736e3167 req-c6ab6ab6-1026-469b-8d55-1690b87250dd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.443551 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c3dc74e8-c588-4971-a93a-63d3736e3167 req-c6ab6ab6-1026-469b-8d55-1690b87250dd service nova] Creating event network-vif-plugged:ac7a2d51-6653-42c5-8b27-30685ecc1525 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:58.444108 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c3dc74e8-c588-4971-a93a-63d3736e3167 req-c6ab6ab6-1026-469b-8d55-1690b87250dd service nova] Creating event network-vif-plugged:e3d7c39c-58b0-4100-aea2-21c3bb9a51db for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:02:58.450333 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c3dc74e8-c588-4971-a93a-63d3736e3167 req-c6ab6ab6-1026-469b-8d55-1690b87250dd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048788 Jun 04 21:02:58.454098 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1351/2589] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:02:58.462864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.464144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.468739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34441825-f95d-4779-948b-1e1a21da58c0 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "DELETE /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 204 len: 0 microversion: 2.1 time: 0.188256 Jun 04 21:02:58.469781 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1239/2590] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:58 2022] DELETE /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:02:58.475778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.476630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.477616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.478243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.480637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.481417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.496187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.496746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.497715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.498307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.691326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:58.700488 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72078f03-6857-414a-b18d-1e717e8b9b72 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.244675 Jun 04 21:02:58.709937 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1352/2591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:58 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:58.710162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:58.710304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1321458432", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "cb31943d-3a91-4b52-84f6-c98fcd43073f"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:58.716505 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a44f0fe5-afc4-49ae-8d43-fe508669d8d6 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc" status: 200 len: 1521 microversion: 2.1 time: 0.242166 Jun 04 21:02:58.717111 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1240/2592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:58 2022] GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:02:58.721855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:58.722462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:58.732014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.732460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.733296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:58.734474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:58.774949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] validate_networks() for [('cb31943d-3a91-4b52-84f6-c98fcd43073f', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:02:59.013040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.024827 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fac40a1c-35e7-4728-a41c-483890eeab85 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.306476 Jun 04 21:02:59.025966 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1241/2593] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:58 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:59.032996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.034297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.043437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.043916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.044686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.045367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.301597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.311498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40bd1013-f3d7-4747-b663-7ed86856c8f1 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 200 len: 1450 microversion: 2.1 time: 0.283778 Jun 04 21:02:59.312104 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1242/2594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:59 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 1450 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:59.319801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bc345131-6b59-4d1b-9d13-f8e28dc63b75 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01fcf940>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.372569 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bc345131-6b59-4d1b-9d13-f8e28dc63b75 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.059197 Jun 04 21:02:59.373127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1243/2595] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:02:59 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:59.381404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:02:59.381932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:02:59.382530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:02:59.383039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:02:59.384103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:02:59.384316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.384316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.391020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.391671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.392367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.392795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.395047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.395696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.396946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.397507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.419876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:02:59.425902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for user d96f5288364449e3af2f39c71a8c3ef2 and project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:02:59.440195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:02:59.442634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:02:59.489366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8c38b4ed-ace8-4bb6-b9eb-af1743be180d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786790 Jun 04 21:02:59.490019 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1353/2596] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:02:59.495664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a979eb81-5064-4ff8-9e6f-20f167ee4660 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-268965191_updated"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:02:59.497085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a979eb81-5064-4ff8-9e6f-20f167ee4660 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.504981 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a979eb81-5064-4ff8-9e6f-20f167ee4660 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 could not be found. Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a979eb81-5064-4ff8-9e6f-20f167ee4660 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/servers/3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 HTTP/1.1 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 80 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-268965191_updated"}} Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 could not be found. Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-268965191_updated'}}} Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 could not be found. Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 04 21:02:59.507254 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 could not be found. Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 could not be found. Jun 04 21:02:59.511692 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:02:59.513733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a979eb81-5064-4ff8-9e6f-20f167ee4660 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:02:59.514745 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a979eb81-5064-4ff8-9e6f-20f167ee4660 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "PUT /compute/v2.1/servers/3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2" status: 404 len: 111 microversion: 2.1 time: 0.023302 Jun 04 21:02:59.515474 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1354/2597] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:02:59 2022] PUT /compute/v2.1/servers/3e8bc2d8-4f19-4b66-a9a6-a79110cef8b2 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:02:59.525331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.526263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.535653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.537450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.538024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.538630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.574022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.581897 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc0e29d5-3db3-43d7-ae45-dcdc3462dc0c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.202446 Jun 04 21:02:59.595452 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1244/2598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:59 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:59.604984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.605513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.617138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.617951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.618886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.619320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.648498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:02:59.655615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Working on deleting snapshot 9be7ba68-7a3b-4fca-8db5-9a07b8cbe93e from shelved instance... Jun 04 21:02:59.776058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.786914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.788443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.789608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-317dad1b-5a00-443c-9db0-7f340f4e0421 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.269478 Jun 04 21:02:59.800673 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1355/2599] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:02:59 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:02:59.805651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55866661-3dbd-4b09-88c9-a8ade0860dee tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.806269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55866661-3dbd-4b09-88c9-a8ade0860dee tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.872955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55866661-3dbd-4b09-88c9-a8ade0860dee tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:02:59.881370 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55866661-3dbd-4b09-88c9-a8ade0860dee tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1208 microversion: 2.1 time: 0.079483 Jun 04 21:02:59.887952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1356/2600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:59 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:02:59.899088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:02:59.899755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:02:59.906181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.906634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.907417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:02:59.908047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:02:59.931993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:00.074072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:00.083963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e65b38e0-4705-4159-957b-7d70861043ac tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.194400 Jun 04 21:03:00.084555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1357/2601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:02:59 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:00.089718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:00.090331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:00.108833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.109293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.110085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.110533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.265581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:00.275270 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-86077bd0-7aee-49f8-8836-48229adfa75b tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc" status: 200 len: 1521 microversion: 2.1 time: 0.189268 Jun 04 21:03:00.276188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1358/2602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:00 2022] GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:00.289057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:00.290022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:00.296665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.297099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.297871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.298314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.452586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:00.462405 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef9ce828-e611-497d-944d-4e493ee34e52 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.184998 Jun 04 21:03:00.463545 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1359/2603] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:00 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:00.480120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b94c7506-a882-4160-9f34-07041dc16111 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01564550>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:00.497603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Doing local delete in cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=137229) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 04 21:03:00.500134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.500652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.502007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 04 21:03:00.508275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] deallocate_for_instance() {{(pid=137229) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 04 21:03:00.537813 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b94c7506-a882-4160-9f34-07041dc16111 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.061752 Jun 04 21:03:00.538393 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1360/2604] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:00 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:00.551003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b786487e-b428-4ccb-83eb-aee2d4d9d760 req-3050d409-e0c4-4a6e-922e-7cb1ac7259bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "name": "network-vif-plugged", "status": "completed", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}, {"server_uuid": "328b885a-2830-40c9-8726-53e1d9288a4a", "name": "network-vif-unplugged", "status": "completed", "tag": "0e1e5687-915f-4676-b561-9d37640fadea"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:00.575073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b786487e-b428-4ccb-83eb-aee2d4d9d760 req-3050d409-e0c4-4a6e-922e-7cb1ac7259bf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.577288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b786487e-b428-4ccb-83eb-aee2d4d9d760 req-3050d409-e0c4-4a6e-922e-7cb1ac7259bf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.631060 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b786487e-b428-4ccb-83eb-aee2d4d9d760 req-3050d409-e0c4-4a6e-922e-7cb1ac7259bf service nova] Creating event network-vif-plugged:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:03:00.637579 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b786487e-b428-4ccb-83eb-aee2d4d9d760 req-3050d409-e0c4-4a6e-922e-7cb1ac7259bf service nova] Creating event network-vif-unplugged:0e1e5687-915f-4676-b561-9d37640fadea for instance 328b885a-2830-40c9-8726-53e1d9288a4a on nch2-master-1 Jun 04 21:03:00.654784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b786487e-b428-4ccb-83eb-aee2d4d9d760 req-3050d409-e0c4-4a6e-922e-7cb1ac7259bf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.114977 Jun 04 21:03:00.655908 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1361/2605] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:00.668807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc2113db-8ac2-471e-92a4-657f3fda9fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc2113db-8ac2-471e-92a4-657f3fda9fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 HTTP/1.1 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 280 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.678722 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 04 21:03:00.682938 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:00.696720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc2113db-8ac2-471e-92a4-657f3fda9fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:00.701658 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc2113db-8ac2-471e-92a4-657f3fda9fbf tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "PUT /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 400 len: 619 microversion: 2.1 time: 0.040899 Jun 04 21:03:00.702363 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1362/2606] 10.222.0.18 () {60 vars in 1256 bytes} [Sat Jun 4 21:03:00 2022] PUT /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:03:00.711357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:00.713414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:00.720366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:00.743053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.743838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:00.745644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:00.746771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:01.401810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:01.446097 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-554ebbca-fa5a-4807-9513-62f9cd759760 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1542 microversion: 2.1 time: 0.738238 Jun 04 21:03:01.451877 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1363/2607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:00 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1542 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:01.468127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:01.471879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:01.486746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:01.488645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:01.489760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:01.491261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:02.741571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:02.757946 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ffff0faf-0d0f-4568-9bb3-0051654b0632 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 1.304746 Jun 04 21:03:02.759611 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1364/2608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:01 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:02.782021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:02.785649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:02.794745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:02.795611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:02.796612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:02.797656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:03.370615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Updating instance_info_cache with network_info: [] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 21:03:03.731271 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83af50e0-e1e2-44c2-8a5f-0952983c8169 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 204 len: 0 microversion: 2.1 time: 4.134452 Jun 04 21:03:03.732328 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1245/2609] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:02:59 2022] DELETE /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 0 bytes in 4136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:03.746044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:03.747273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:03.756912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:03.758532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:03.760946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:03.761642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.160973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:04.173783 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e6195955-0990-404f-8e6b-deb06ac9a73b tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1266 microversion: 2.1 time: 0.431217 Jun 04 21:03:04.177861 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1246/2610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:03 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1266 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:04.197049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:04.198069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:04.215813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.216674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.217470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.218089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.247053 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] HTTP exception thrown: Instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc could not be found. Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc HTTP/1.1 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc could not be found. Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc'} Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc could not be found. Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc could not be found. Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:04.249308 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc could not be found. Jun 04 21:03:04.254386 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:04.256051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 404 to user: Instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:04.257327 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d9674e6-c412-4177-a83b-196047286b26 tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc" status: 404 len: 111 microversion: 2.1 time: 0.078005 Jun 04 21:03:04.258206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1247/2611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:04 2022] GET /compute/v2.1/servers/a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:04.346744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:04.389328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:04.392825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:04.400528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-193aa761-dc55-4880-92b9-e227e3c9d4d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 1.639363 Jun 04 21:03:04.403731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1365/2612] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:03:02 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:03:04.417582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b3aa0b15-0ee1-40f9-9e38-ede576ab4e0f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01652dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:04.521287 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b3aa0b15-0ee1-40f9-9e38-ede576ab4e0f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.113295 Jun 04 21:03:04.522791 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1366/2613] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:04 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:04.538256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:04.540332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:04.550626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.551687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.553120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.554113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.610747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-34080412-0294-4301-9d93-998dfabb8bba req-da576792-399b-4745-805e-da6bd6a0fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328b885a-2830-40c9-8726-53e1d9288a4a", "name": "network-vif-deleted", "tag": "0e1e5687-915f-4676-b561-9d37640fadea"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:04.631893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-34080412-0294-4301-9d93-998dfabb8bba req-da576792-399b-4745-805e-da6bd6a0fe0c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.632460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-34080412-0294-4301-9d93-998dfabb8bba req-da576792-399b-4745-805e-da6bd6a0fe0c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.652307 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-34080412-0294-4301-9d93-998dfabb8bba req-da576792-399b-4745-805e-da6bd6a0fe0c service nova] Creating event network-vif-deleted:0e1e5687-915f-4676-b561-9d37640fadea for instance 328b885a-2830-40c9-8726-53e1d9288a4a on nch2-master-1 Jun 04 21:03:04.665050 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-34080412-0294-4301-9d93-998dfabb8bba req-da576792-399b-4745-805e-da6bd6a0fe0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.398402 Jun 04 21:03:04.670199 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1248/2614] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:04.682256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "619b5a38-1d96-4f73-8e36-188fa8464db2"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "56fb03d6-a5f3-49d6-96c0-89442b0af796"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "209128ba-608b-44e4-809f-e85d0a6c87e3"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-plugged", "status": "completed", "tag": "3a71217e-dc2e-4548-97ad-5596a76b102e"}, {"server_uuid": "cf2c35d6-29be-4969-b399-b35e4ceea667", "name": "network-vif-unplugged", "status": "completed", "tag": "1841e45a-a429-4cc2-8e93-ecdde075787a"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:04.708975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.709555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.734495 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Creating event network-vif-plugged:619b5a38-1d96-4f73-8e36-188fa8464db2 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:03:04.734998 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Creating event network-vif-plugged:56fb03d6-a5f3-49d6-96c0-89442b0af796 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:03:04.738514 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Creating event network-vif-plugged:209128ba-608b-44e4-809f-e85d0a6c87e3 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:03:04.743015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Creating event network-vif-plugged:3a71217e-dc2e-4548-97ad-5596a76b102e for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:03:04.744420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.server_external_events [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] Unable to find a host for instance cf2c35d6-29be-4969-b399-b35e4ceea667. Dropping event network-vif-unplugged {{(pid=137229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 21:03:04.766830 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-43a269f4-6089-41dc-b8e5-469f48e3d2a3 req-2c194b3f-4b30-4e9c-9218-d2d44867df1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 866 microversion: 2.1 time: 0.087309 Jun 04 21:03:04.768479 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1249/2615] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 866 bytes in 95 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 21:03:04.782409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:04.784761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:04.799105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.804453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:04.807943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:04.808649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.423127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:05.440242 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9d2c144f-29bc-46ad-91ae-4654e2bedc0b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1541 microversion: 2.1 time: 0.913043 Jun 04 21:03:05.441016 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1367/2616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:04 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1541 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:05.472106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:05.483352 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-96a44c40-6dda-4fa8-a510-ad586b56c343 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.713279 Jun 04 21:03:05.485540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1250/2617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:04 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:05.500702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:05.501996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:05.514675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.515135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.516706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.519260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.560407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 HTTP/1.1 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'cf2c35d6-29be-4969-b399-b35e4ceea667'} Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:05.562303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.568846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:05.571894 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a814965d-8bc0-49be-9216-80f2498bc725 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 404 len: 111 microversion: 2.1 time: 0.084966 Jun 04 21:03:05.572777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1251/2618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:05 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:05.600028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:05.601468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 89c2f5dd-583d-461f-b9c1-b8d19636d25a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:05.617713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.618947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.620483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.622115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.664042 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] HTTP exception thrown: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a HTTP/1.1 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '89c2f5dd-583d-461f-b9c1-b8d19636d25a'} Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:05.671790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. Jun 04 21:03:05.676222 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:05.679991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 404 to user: Instance 89c2f5dd-583d-461f-b9c1-b8d19636d25a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:05.683438 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81ee8720-3791-4409-8808-52f3915e13fa tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a" status: 404 len: 111 microversion: 2.1 time: 0.102275 Jun 04 21:03:05.684556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1252/2619] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:05 2022] GET /compute/v2.1/servers/89c2f5dd-583d-461f-b9c1-b8d19636d25a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:05.691641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:05.694736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:05.709814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.712013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.713688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.714419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.724006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:05.821558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b8ba354e-8329-435c-b2e2-8227fba45a41 req-c3ccc9c2-ad3d-48f2-af5d-abc82eeed216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc", "name": "network-vif-deleted", "tag": "c66af543-f5d0-4402-aec2-f006988d10f0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:05.838086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b8ba354e-8329-435c-b2e2-8227fba45a41 req-c3ccc9c2-ad3d-48f2-af5d-abc82eeed216 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.838564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b8ba354e-8329-435c-b2e2-8227fba45a41 req-c3ccc9c2-ad3d-48f2-af5d-abc82eeed216 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.854570 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b8ba354e-8329-435c-b2e2-8227fba45a41 req-c3ccc9c2-ad3d-48f2-af5d-abc82eeed216 service nova] Creating event network-vif-deleted:c66af543-f5d0-4402-aec2-f006988d10f0 for instance a80b409c-9f8f-4e59-a4b0-ed6678d7a3dc on nch2-master-1 Jun 04 21:03:05.860136 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b8ba354e-8329-435c-b2e2-8227fba45a41 req-c3ccc9c2-ad3d-48f2-af5d-abc82eeed216 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.417831 Jun 04 21:03:05.861824 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1368/2620] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:05.869585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:05.870628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:05.877709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.878539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:05.879857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:05.880537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:06.375630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:06.388443 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a18496d7-3152-4a06-96fa-46bcc1c27ae6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 0.702215 Jun 04 21:03:06.402020 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1253/2621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:05 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:06.408099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02a36150-fc67-4a0b-9dce-b324fb0b9ebe tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02a36150-fc67-4a0b-9dce-b324fb0b9ebe tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 HTTP/1.1 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 24 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": ""}} Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074', 'body': {'server': {'name': ''}}} Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '' Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:03:06.416686 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 04 21:03:06.421795 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:06.423849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02a36150-fc67-4a0b-9dce-b324fb0b9ebe tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:06.425303 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02a36150-fc67-4a0b-9dce-b324fb0b9ebe tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "PUT /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 400 len: 108 microversion: 2.1 time: 0.021958 Jun 04 21:03:06.427941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1254/2622] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:03:06 2022] PUT /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:03:06.436078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:06.443604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-289b7a92-e9ed-438b-8a12-c7f9967a0023 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01fcf820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:06.449806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:06.452136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:06.455579 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55833884-bc91-4964-b4b5-c67eaf374349 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1880 microversion: 2.32 time: 0.590397 Jun 04 21:03:06.456414 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1369/2623] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:03:05 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1880 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:03:06.518997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:06.525491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:06.549145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:06.549728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:06.551477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:06.552291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:06.570801 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-289b7a92-e9ed-438b-8a12-c7f9967a0023 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.140738 Jun 04 21:03:06.572919 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1255/2624] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:06 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:06.578493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-259412146", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:06.611811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:06.612255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:06.613112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lazy-loading 'fault' on Instance uuid 7e85b7a5-99eb-40cc-a447-780320a31c78 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:03:06.679584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:03:06.750524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b865a42bb19745bc84c5138c90162e30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01083c40e40446e581220f68d579105d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:06.800197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:06.803161 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e5386c7c-64d5-4bea-995b-eccf378d54db tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 200 len: 1312 microversion: 2.1 time: 0.345226 Jun 04 21:03:06.812207 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1370/2625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:06 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:06.831101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:06.832723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:06.840754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:06.841485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:06.842734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:06.843497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:07.491681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:07.507054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71e140e1-934f-48b0-bb82-4476fb45c7d4 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1505 microversion: 2.1 time: 0.692003 Jun 04 21:03:07.510285 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1371/2626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:06 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:07.517153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:07.517790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:07.529623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:07.530453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:07.531125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:07.531594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.005779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:08.017341 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81c471a8-d60a-4e24-bfd1-bf403f6b4a41 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1473 microversion: 2.1 time: 0.505709 Jun 04 21:03:08.018147 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1372/2627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:07 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1473 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:08.087384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:03:08.088400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:03:08.089502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:03:08.090204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:03:08.090891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:03:08.123255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.125561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.129927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.130851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.176299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:03:08.188361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:03:08.223346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:03:08.226971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:03:08.306485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c4c57f8b-3390-40c3-b87d-cb1521d83e8c req-b625950f-a7a4-4d5d-a3c8-d9bc6a80c5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "name": "network-vif-unplugged", "status": "completed", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:08.341466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c4c57f8b-3390-40c3-b87d-cb1521d83e8c req-b625950f-a7a4-4d5d-a3c8-d9bc6a80c5d9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.346964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c4c57f8b-3390-40c3-b87d-cb1521d83e8c req-b625950f-a7a4-4d5d-a3c8-d9bc6a80c5d9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.369593 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ab77114-7d29-4219-97d5-d915ed9deb03 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795205 Jun 04 21:03:08.381741 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1256/2628] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:03:08.391981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:08.392592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:08.407457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c4c57f8b-3390-40c3-b87d-cb1521d83e8c req-b625950f-a7a4-4d5d-a3c8-d9bc6a80c5d9 service nova] Creating event network-vif-unplugged:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:03:08.416339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.417001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.417964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.419551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.445168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-c4c57f8b-3390-40c3-b87d-cb1521d83e8c req-b625950f-a7a4-4d5d-a3c8-d9bc6a80c5d9 service nova] Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:03:08.470282 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c4c57f8b-3390-40c3-b87d-cb1521d83e8c req-b625950f-a7a4-4d5d-a3c8-d9bc6a80c5d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.448781 Jun 04 21:03:08.472355 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1373/2629] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:08.490967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:08.496599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:08.513130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.513808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:08.515016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:08.515723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.201282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:09.216423 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e19ec29-3876-450c-879a-9ebd74dec2a9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 0.829720 Jun 04 21:03:09.217143 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1257/2630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:08 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:09.222156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e125557-1692-46b4-8414-74e01ee69f2c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01fcfdc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:09.328128 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e125557-1692-46b4-8414-74e01ee69f2c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.109683 Jun 04 21:03:09.328803 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1258/2631] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:09 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:09.347369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:09.347980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] [instance: 7e85b7a5-99eb-40cc-a447-780320a31c78] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:09.363533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.365338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.367102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.372229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.406369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:09.419018 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] HTTP exception thrown: Instance 7e85b7a5-99eb-40cc-a447-780320a31c78 could not be found. Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Request method failure captured: Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 HTTP/1.1 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8hLRWsZlOuz95HDDCY39lqdEjkDJQiqhaY7u2AYxqouDj1LPC_ST8KIF2rbYwb0RhsIrKCFxBf5GHkRQeujCnbNNobAFY1NX19czrllzpoUDpxJVPxcvM929AUUWU_cv3L4mz-qRgPDCfU1-DmsCufvEKywgRGp2y7DmWKwWdEWaRc Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 01083c40e40446e581220f68d579105d Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_01083c40e40446e581220f68d579105d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/01083c40e40446e581220f68d579105d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/01083c40e40446e581220f68d579105d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 01083c40e40446e581220f68d579105d Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-776337451 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: b865a42bb19745bc84c5138c90162e30 Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ListServersNegativeTestJSON-776337451-project Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 7e85b7a5-99eb-40cc-a447-780320a31c78 could not be found. Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '7e85b7a5-99eb-40cc-a447-780320a31c78'} Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e85b7a5-99eb-40cc-a447-780320a31c78 could not be found. Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e85b7a5-99eb-40cc-a447-780320a31c78 could not be found. Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:09.427407 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e85b7a5-99eb-40cc-a447-780320a31c78 could not be found. Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:09.433290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] Returning 404 to user: Instance 7e85b7a5-99eb-40cc-a447-780320a31c78 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:09.434524 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fdd4d2d5-8df6-47d2-a44a-dc01d1d35beb tempest-ListServersNegativeTestJSON-776337451 tempest-ListServersNegativeTestJSON-776337451-project] 10.222.0.18 "GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78" status: 404 len: 111 microversion: 2.1 time: 0.095379 Jun 04 21:03:09.438053 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1259/2632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:09 2022] GET /compute/v2.1/servers/7e85b7a5-99eb-40cc-a447-780320a31c78 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:09.452406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-adfb5cae-fa26-45ff-a917-ef7d40cea242 req-70101582-4bbc-4169-9540-cd163bd9901a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2c35d6-29be-4969-b399-b35e4ceea667", "name": "network-vif-deleted", "tag": "1841e45a-a429-4cc2-8e93-ecdde075787a"}, {"server_uuid": "7e85b7a5-99eb-40cc-a447-780320a31c78", "name": "network-vif-deleted", "tag": "0ecbde04-8ee8-4968-a9fa-9a21912a9e8c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:09.485896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-adfb5cae-fa26-45ff-a917-ef7d40cea242 req-70101582-4bbc-4169-9540-cd163bd9901a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.487745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-adfb5cae-fa26-45ff-a917-ef7d40cea242 req-70101582-4bbc-4169-9540-cd163bd9901a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.510571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:09.512706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.server_external_events [req-adfb5cae-fa26-45ff-a917-ef7d40cea242 req-70101582-4bbc-4169-9540-cd163bd9901a service nova] Unable to find a host for instance cf2c35d6-29be-4969-b399-b35e4ceea667. Dropping event network-vif-deleted {{(pid=137229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 21:03:09.513432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-adfb5cae-fa26-45ff-a917-ef7d40cea242 req-70101582-4bbc-4169-9540-cd163bd9901a service nova] Creating event network-vif-deleted:0ecbde04-8ee8-4968-a9fa-9a21912a9e8c for instance 7e85b7a5-99eb-40cc-a447-780320a31c78 on nch1-master-1 Jun 04 21:03:09.520709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-adfb5cae-fa26-45ff-a917-ef7d40cea242 req-70101582-4bbc-4169-9540-cd163bd9901a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 351 microversion: 2.1 time: 0.080893 Jun 04 21:03:09.522849 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1260/2633] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 351 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 21:03:09.529918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:09.530793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:09.541188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.543134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.544218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.544819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.566279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:09.580075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:09.588323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bf068fc5-4fdd-4991-a779-0caf7c39f8a7 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2833 microversion: 2.32 time: 1.111888 Jun 04 21:03:09.592853 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1374/2634] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:03:08 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2833 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:03:09.616360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:09.626813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:09.648967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.649925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.658071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.658908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.772619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:09.781063 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-61b61b26-d6c1-474d-a608-6aa2082515c2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1218 microversion: 2.1 time: 0.256722 Jun 04 21:03:09.792088 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1261/2635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:09 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:09.797487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:09.810831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:09.815766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:09.827867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.841749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.846129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:09.846826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:09.879006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:10.241129 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1ead90e2-b0da-47c3-a541-0388c67b68d4 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.447463 Jun 04 21:03:10.250366 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1262/2636] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Jun 4 21:03:09 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333/os-interface => generated 1830 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:03:10.254847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:10.255630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:10.273792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:10.274446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:10.275387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:10.276277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:10.318587 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a HTTP/1.1 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '414c25e0-f653-44da-8176-7c2c73883c6a'} Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:10.337248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5d8f35e4-e582-451c-ae6c-6e1c33018869 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 404 len: 111 microversion: 2.1 time: 0.087487 Jun 04 21:03:10.342375 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1263/2637] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:03:10 2022] DELETE /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:10.346692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:10.347308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:10.389624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:10.390077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:10.391407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:10.391878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.265051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:11.279610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3be6dced-93cf-454f-ba62-e7a3529dd5bc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1470 microversion: 2.1 time: 1.684085 Jun 04 21:03:11.285271 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1375/2638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:09 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1470 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:11.306018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7591b0b1-0c07-493f-b555-a00d569b77f6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d015648b0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:11.405510 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7591b0b1-0c07-493f-b555-a00d569b77f6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.106211 Jun 04 21:03:11.415909 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1376/2639] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:11 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:11.428669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:11.429293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 414c25e0-f653-44da-8176-7c2c73883c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:11.466011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:11.466455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.475972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:11.476684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.512425 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a HTTP/1.1 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '414c25e0-f653-44da-8176-7c2c73883c6a'} Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:11.515106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. Jun 04 21:03:11.519274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:11.521369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 414c25e0-f653-44da-8176-7c2c73883c6a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:11.522778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-803b066a-2a06-4b88-99f8-b2982ed4a98e tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a" status: 404 len: 111 microversion: 2.1 time: 0.115651 Jun 04 21:03:11.526690 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1377/2640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:11 2022] GET /compute/v2.1/servers/414c25e0-f653-44da-8176-7c2c73883c6a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:11.532673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:11.533585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:11.542574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:11.543363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.544405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:11.545045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.904630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:11.913888 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-882e380e-b501-41fe-8457-4e9e8cfe3124 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1272 microversion: 2.1 time: 0.385848 Jun 04 21:03:11.915360 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1378/2641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:11 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1272 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:11.920670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:11.921501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:11.937135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:11.938767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.939784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:11.940428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:11.998281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:12.009937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.010463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.011384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.012090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.051213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for project 29ca718638c842a98bb90cc3adb3979f. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:03:12.058389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for user 5b4c3539c5534d2c844944f9be3f9963 and project 29ca718638c842a98bb90cc3adb3979f. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:03:12.238198 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-351f97fc-1852-4d58-ae1b-9bd98b0c5b59 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7/action" status: 202 len: 0 microversion: 2.1 time: 0.321068 Jun 04 21:03:12.241072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1379/2642] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:11 2022] POST /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:03:12.262582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:12.264954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:12.278191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.278865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.282868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.283032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.316089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:03:12.516321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:12.562000 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-215adaf7-d95f-49ec-a3d0-c7958c6e774a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 2.218501 Jun 04 21:03:12.563074 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1264/2643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:10 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 2221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:12.594538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ad685234-d334-4d88-a43f-04f307563c55 req-80de9f66-c728-439f-9f91-8bb270d84d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c98705-74f6-42a6-b0ac-ebe0a3ee932a", "tag": "f8138d24-ebbb-4efc-a3b8-b549bcd75eef"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:12.632581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ad685234-d334-4d88-a43f-04f307563c55 req-80de9f66-c728-439f-9f91-8bb270d84d60 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.634112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ad685234-d334-4d88-a43f-04f307563c55 req-80de9f66-c728-439f-9f91-8bb270d84d60 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.642990 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6f41fe70-e122-4257-abc2-1cd540935fe2 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 204 len: 0 microversion: 2.1 time: 0.399537 Jun 04 21:03:12.643563 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1380/2644] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:03:12 2022] DELETE /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:12.651408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2fb2bc7e-4e23-40da-b070-878d7458099b req-4a650954-c1a1-42be-8450-d584cd2744fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "name": "network-vif-plugged", "status": "completed", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:12.660571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2fb2bc7e-4e23-40da-b070-878d7458099b req-4a650954-c1a1-42be-8450-d584cd2744fb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.661751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2fb2bc7e-4e23-40da-b070-878d7458099b req-4a650954-c1a1-42be-8450-d584cd2744fb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.676121 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2fb2bc7e-4e23-40da-b070-878d7458099b req-4a650954-c1a1-42be-8450-d584cd2744fb service nova] Creating event network-vif-plugged:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:03:12.685100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-2fb2bc7e-4e23-40da-b070-878d7458099b req-4a650954-c1a1-42be-8450-d584cd2744fb service nova] Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:03:12.691987 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2fb2bc7e-4e23-40da-b070-878d7458099b req-4a650954-c1a1-42be-8450-d584cd2744fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046852 Jun 04 21:03:12.693615 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1381/2645] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:12.696610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ad685234-d334-4d88-a43f-04f307563c55 req-80de9f66-c728-439f-9f91-8bb270d84d60 service nova] Creating event network-changed:f8138d24-ebbb-4efc-a3b8-b549bcd75eef for instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a on nch2-master-1 Jun 04 21:03:12.699794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:12.700702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:12.707280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.708497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.709312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.709754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.730420 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ad685234-d334-4d88-a43f-04f307563c55 req-80de9f66-c728-439f-9f91-8bb270d84d60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156781 Jun 04 21:03:12.731711 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1265/2646] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:12.753519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e951a8d-77e5-4091-b626-faa073808c02 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02058820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:12.928789 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5e951a8d-77e5-4091-b626-faa073808c02 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.192003 Jun 04 21:03:12.933475 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1266/2647] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:12 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:12.947527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:12.956773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:12.983139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.986800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:12.994090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:12.995032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:13.478691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:13.487953 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-884dd45f-e39c-41a6-9b6b-6c8466601749 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1469 microversion: 2.1 time: 0.793028 Jun 04 21:03:13.499060 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1382/2648] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:12 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1469 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:13.508704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:13.509394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:13.524441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:13.525256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:13.525679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:13.526121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:13.705290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:13.719377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c8a20cfe-c65f-47b7-a9f9-71b2922587e8 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 0.783899 Jun 04 21:03:13.720194 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1267/2649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:12 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:13.735311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:13.736936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-15584d20-9852-4d13-ba65-b3a73c6c6152 req-d9358ba0-8021-48a1-b368-f5499399f9df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "tag": "a18106de-02a9-4771-a90c-8ae75e40f172"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:13.751260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64e0e6ef-6bb3-4d4c-9ce6-95e126d5c6a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1272 microversion: 2.1 time: 0.258510 Jun 04 21:03:13.752077 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1383/2650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:13 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:13.764425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-15584d20-9852-4d13-ba65-b3a73c6c6152 req-d9358ba0-8021-48a1-b368-f5499399f9df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:13.765132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-15584d20-9852-4d13-ba65-b3a73c6c6152 req-d9358ba0-8021-48a1-b368-f5499399f9df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:13.781048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:13.783059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:13.801916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:13.805282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-15584d20-9852-4d13-ba65-b3a73c6c6152 req-d9358ba0-8021-48a1-b368-f5499399f9df service nova] Creating event network-changed:a18106de-02a9-4771-a90c-8ae75e40f172 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:03:13.805827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:13.810060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:13.810963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:13.818371 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-15584d20-9852-4d13-ba65-b3a73c6c6152 req-d9358ba0-8021-48a1-b368-f5499399f9df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083803 Jun 04 21:03:13.820812 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1268/2651] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:13.949828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a068991e-21f4-4e4e-91b4-96211264ef99 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d020c81f0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:14.034720 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a068991e-21f4-4e4e-91b4-96211264ef99 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.090337 Jun 04 21:03:14.035137 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1269/2652] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:13 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:14.426682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:14.438217 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f48df5b4-477d-41c2-ae0c-6e42ed8f2b50 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 0.675078 Jun 04 21:03:14.442588 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1384/2653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:13 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:14.517869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:14.519020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:14.537705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:14.539752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:14.541188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:14.542588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:14.739731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:14.741532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:14.774264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:14.784005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:14.791331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:14.795567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:14.866623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:14.883420 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8f0f830-0d1d-4368-a3e6-5c42cb1aa7e5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1469 microversion: 2.1 time: 0.372332 Jun 04 21:03:14.884547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1270/2654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:14 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:14.890415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:14.892219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:14.907831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:14.908484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:14.909430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:14.911339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:15.578534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:15.587289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d89a1a96-7b95-48c8-be81-be731fdbdf3d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.701294 Jun 04 21:03:15.591866 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1271/2655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:14 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:15.602161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce803252-a749-491e-862d-98a461f0ef53 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02058430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:15.698957 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce803252-a749-491e-862d-98a461f0ef53 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.103878 Jun 04 21:03:15.699566 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1272/2656] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:15 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:15.714310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:15.714933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:15.736107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:15.736551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:15.737410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:15.737917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:15.794233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:15.812588 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1229a514-ad9a-4b6f-af5f-8c403c4faa1b tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1511 microversion: 2.1 time: 1.076463 Jun 04 21:03:15.819245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1385/2657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:14 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1511 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:15.902801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:15.903884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:15.920817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:15.923372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:15.924498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:15.928759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.434165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:16.449032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:16.455630 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-17d9e0a0-6f49-4c1e-b194-998aeec937fa tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 0.754597 Jun 04 21:03:16.456689 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1273/2658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:15 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:16.467084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-223ab569-06b7-4898-ab06-de5faaa857cc req-656c34ac-2170-4efb-9366-6f5cc8ac8891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6544912e-117f-4311-88e5-885fd318c074", "name": "network-vif-deleted", "tag": "eba1e015-a95a-4ab9-aea1-ca6856d3e3bb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:16.475061 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-701e1b4d-c4c7-413c-aacf-d5f7deb70807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1469 microversion: 2.1 time: 0.576912 Jun 04 21:03:16.476301 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1386/2659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:15 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1469 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:16.495265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-223ab569-06b7-4898-ab06-de5faaa857cc req-656c34ac-2170-4efb-9366-6f5cc8ac8891 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:16.495737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-223ab569-06b7-4898-ab06-de5faaa857cc req-656c34ac-2170-4efb-9366-6f5cc8ac8891 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.515456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-223ab569-06b7-4898-ab06-de5faaa857cc req-656c34ac-2170-4efb-9366-6f5cc8ac8891 service nova] Creating event network-vif-deleted:eba1e015-a95a-4ab9-aea1-ca6856d3e3bb for instance 6544912e-117f-4311-88e5-885fd318c074 on nch1-master-1 Jun 04 21:03:16.526686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-223ab569-06b7-4898-ab06-de5faaa857cc req-656c34ac-2170-4efb-9366-6f5cc8ac8891 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065256 Jun 04 21:03:16.527305 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1274/2660] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:16.608497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:16.609148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:16.620844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:16.623881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.625908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:16.626504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.717708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b7a55e48-464f-48ee-bbf3-4743845ab317 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01fcf280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:16.806892 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b7a55e48-464f-48ee-bbf3-4743845ab317 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.095817 Jun 04 21:03:16.807492 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1275/2661] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:16 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:16.837385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:16.838431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:16.847927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:16.853398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.854738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:16.855535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.900528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:16.901249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:16.902273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lazy-loading 'fault' on Instance uuid 6544912e-117f-4311-88e5-885fd318c074 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:03:17.533812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425dba3904234fc08c2913a4e299b003', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13a926a61e0412c8eae94528aeb0a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:17.544598 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-284fc29e-fc0b-4c29-88e7-c7f604e79a51 tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 200 len: 1306 microversion: 2.1 time: 0.711779 Jun 04 21:03:17.564996 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1276/2662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:16 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 1306 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:17.572118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-36d888f1-513f-40b4-8888-5493adc778c7 req-5eb6d357-c6eb-4191-88c4-36135ce0a870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c98705-74f6-42a6-b0ac-ebe0a3ee932a", "name": "network-vif-plugged", "status": "completed", "tag": "f8138d24-ebbb-4efc-a3b8-b549bcd75eef"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:17.582163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-36d888f1-513f-40b4-8888-5493adc778c7 req-5eb6d357-c6eb-4191-88c4-36135ce0a870 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:17.583282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-36d888f1-513f-40b4-8888-5493adc778c7 req-5eb6d357-c6eb-4191-88c4-36135ce0a870 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:17.605294 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-36d888f1-513f-40b4-8888-5493adc778c7 req-5eb6d357-c6eb-4191-88c4-36135ce0a870 service nova] Creating event network-vif-plugged:f8138d24-ebbb-4efc-a3b8-b549bcd75eef for instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a on nch2-master-1 Jun 04 21:03:17.625474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-36d888f1-513f-40b4-8888-5493adc778c7 req-5eb6d357-c6eb-4191-88c4-36135ce0a870 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058438 Jun 04 21:03:17.626824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1277/2663] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:17.632685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:17.633763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:17.654905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:17.655751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:17.656777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:17.657420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:17.792721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:17.802884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed132893-b240-4b38-9a64-4ca76fa940d4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 1.198145 Jun 04 21:03:17.813776 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1387/2664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:16 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:17.819891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:17.820842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:17.831089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:17.831931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:17.833390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:17.834053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:18.076381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:18.086456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f03d7c7f-8de0-4f9d-9b11-88d8da801f51 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 0.458116 Jun 04 21:03:18.087603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1278/2665] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:17 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:18.110630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a6fbdf76-6096-4950-bb6c-0f85337fd42a tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01fcfdc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:18.151925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:18.200590 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a6fbdf76-6096-4950-bb6c-0f85337fd42a tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.111645 Jun 04 21:03:18.201416 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1279/2666] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:18 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:18.344300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:18.368232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d0fa5e4-bb48-4da3-8019-36f83e6ce02d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1469 microversion: 2.1 time: 0.552988 Jun 04 21:03:18.380190 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1388/2667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:17 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1469 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:18.569748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:18.575838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:18.580733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] [instance: 6544912e-117f-4311-88e5-885fd318c074] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:18.591665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:18.598279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:18.599396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:18.601619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:18.631010 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] HTTP exception thrown: Instance 6544912e-117f-4311-88e5-885fd318c074 could not be found. Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Request method failure captured: Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 HTTP/1.1 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eQuC-5lMGU_RuwNelJCiRRpuNCwAPpulSBQFp0EW-9tYYhy98Kd2uidSTPdXBkmCquGYNuMcm5NDyvjkL1T6p36tKH_f0DeHB1IkpHgZdVFtoVo1dsJFZsrTV-pI41prqD7I-g9vYZwUwPghUMfHrJYjPiMWYX9C4e3806a0jPHnw Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c13a926a61e0412c8eae94528aeb0a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c13a926a61e0412c8eae94528aeb0a4e Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1931291149 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 425dba3904234fc08c2913a4e299b003 Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-1931291149-project Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 6544912e-117f-4311-88e5-885fd318c074 could not be found. Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6544912e-117f-4311-88e5-885fd318c074'} Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6544912e-117f-4311-88e5-885fd318c074 could not be found. Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6544912e-117f-4311-88e5-885fd318c074 could not be found. Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:18.636622 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6544912e-117f-4311-88e5-885fd318c074 could not be found. Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:03:18.642144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] Returning 404 to user: Instance 6544912e-117f-4311-88e5-885fd318c074 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:18.644477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d62d9216-48b7-4526-9386-409afdf986dd tempest-ServersNegativeTestJSON-1931291149 tempest-ServersNegativeTestJSON-1931291149-project] 10.222.0.18 "GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074" status: 404 len: 111 microversion: 2.1 time: 0.075423 Jun 04 21:03:18.651107 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1280/2668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:18 2022] GET /compute/v2.1/servers/6544912e-117f-4311-88e5-885fd318c074 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:03:18.742574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-999ac006-9285-4ba6-b0f9-113383640e5f req-39891253-506e-4392-a044-47adecf2c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b10d229b-8dab-4cce-ae2d-1524e56a3ddd", "tag": "edd2ce05-aeb9-4bd3-bc82-7c47f1fab610"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:18.757778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-999ac006-9285-4ba6-b0f9-113383640e5f req-39891253-506e-4392-a044-47adecf2c8d3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:18.758232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-999ac006-9285-4ba6-b0f9-113383640e5f req-39891253-506e-4392-a044-47adecf2c8d3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:18.781798 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-999ac006-9285-4ba6-b0f9-113383640e5f req-39891253-506e-4392-a044-47adecf2c8d3 service nova] Creating event network-changed:edd2ce05-aeb9-4bd3-bc82-7c47f1fab610 for instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd on nch1-master-1 Jun 04 21:03:18.822545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:18.823198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:18.832150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:18.833358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:18.841430 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-999ac006-9285-4ba6-b0f9-113383640e5f req-39891253-506e-4392-a044-47adecf2c8d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105449 Jun 04 21:03:18.845863 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1389/2669] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:18.856931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:18.856931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:19.071247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:19.083323 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4768ac61-769d-4355-bc94-30ba85343817 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.264627 Jun 04 21:03:19.084931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1281/2670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:18 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:19.114924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:19.116253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:19.125015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:19.125883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:19.126949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:19.127718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:19.216821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4031d985-3569-4c02-9373-c8df95fab0f5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02115160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:19.329849 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4031d985-3569-4c02-9373-c8df95fab0f5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1452 microversion: 2.1 time: 0.118791 Jun 04 21:03:19.331213 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1282/2671] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:19 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:19.388934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:19.389574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:19.411154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:19.411775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:19.417149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:19.417610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:19.444772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:19.459663 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-32806adc-8425-4c21-9ba7-764f06502ad8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1308 microversion: 2.1 time: 0.356632 Jun 04 21:03:19.494376 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1390/2672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:19 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1308 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:19.823976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:19.838218 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02c4e3f2-1259-496b-9c83-524564c111ce tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1469 microversion: 2.1 time: 0.454961 Jun 04 21:03:19.838822 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1283/2673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:19 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1469 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:20.104856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:20.106264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:20.120370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:20.121331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:20.122469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:20.137633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:20.345096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2968c4e1-1b27-4f49-a634-b351de9bae0b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02503280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:20.416147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:20.430683 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c5a813a0-8f45-4f72-880c-6f9a02cf3a1e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.333229 Jun 04 21:03:20.431636 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1391/2674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:20 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:20.475876 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2968c4e1-1b27-4f49-a634-b351de9bae0b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1461 microversion: 2.1 time: 0.135008 Jun 04 21:03:20.477144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:20.478145 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1284/2675] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:20 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1461 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:20.478635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:20.491954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-91c04edb-43ac-439c-ae2d-6481ea993804 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0214e550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:20.524327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:20.528707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:20.530041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:20.535162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:20.585239 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-91c04edb-43ac-439c-ae2d-6481ea993804 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 200 len: 1461 microversion: 2.1 time: 0.097737 Jun 04 21:03:20.587288 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1285/2676] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:20 2022] GET /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:20.611592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:20.613696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:20.626229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:20.626852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:20.628507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:20.629381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.104053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:21.107106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:21.111674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:21.120459 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cca9c652-28a2-407c-9b5b-a2ff398ecc90 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1466 microversion: 2.1 time: 0.525866 Jun 04 21:03:21.123308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1286/2677] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:20 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1466 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:21.137844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:21.138428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:21.139430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:21.141893 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bf86e81-2015-44fe-bb05-f9fac870d0e5 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1488 microversion: 2.1 time: 0.668913 Jun 04 21:03:21.143194 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1392/2678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:20 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1488 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:21.150894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1291896718"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:21.152335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:21.168554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.168912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.169388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.169710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.170205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.170669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.171492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.172480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.410153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:21.423846 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5d39348-dc68-497d-a42f-26b11cd1d82d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1535 microversion: 2.1 time: 0.299163 Jun 04 21:03:21.427145 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1287/2679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:21 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1535 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:21.447808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:21.449300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:21.461967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.462663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.464383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.464784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.500246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lazy-loading 'flavor' on Instance uuid f2c98705-74f6-42a6-b0ac-ebe0a3ee932a {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:03:21.631419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6204b4c4-6baa-417a-88b5-fafe2344f195 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a/action" status: 202 len: 0 microversion: 2.1 time: 0.190838 Jun 04 21:03:21.635044 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1288/2680] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:21 2022] POST /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:03:21.644420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:21.648765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:21.665656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.666118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.671830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.672602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.704420 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ffad31de-54c8-43a7-b3dd-c8721ca57f3b tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "POST /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36/action" status: 202 len: 0 microversion: 2.1 time: 0.558697 Jun 04 21:03:21.715055 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1393/2681] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:21 2022] POST /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:03:21.723903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:21.724617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:21.744863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.745527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:21.746597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:21.747416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:22.033777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:22.071798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:22.084188 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c49106f-8b91-4673-935d-a86a9b6bf005 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.450430 Jun 04 21:03:22.090695 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1289/2682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:21 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:22.099653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:22.105309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8263b148-fe0a-421c-ac1c-69a9f2cddc84 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d021aef70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:22.109880 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ec4a6aa-146c-4b0f-ba37-e26b1ffe2f62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1496 microversion: 2.1 time: 0.393335 Jun 04 21:03:22.110934 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1394/2683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:21 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1496 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:22.166520 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8263b148-fe0a-421c-ac1c-69a9f2cddc84 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 200 len: 1453 microversion: 2.1 time: 0.072384 Jun 04 21:03:22.173604 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1290/2684] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:22 2022] GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:22.445381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:22.446650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:22.460192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:22.461967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:22.463787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:22.464463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:22.770443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:22.783489 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3373b1c4-98dd-40dd-8009-6df00029c10f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1535 microversion: 2.1 time: 0.343563 Jun 04 21:03:22.785352 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1395/2685] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:22 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1535 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:23.102750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:23.103785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:23.112673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.113334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.114622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.115219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.129298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:23.130115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:23.142426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.143738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.148532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.150328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.447455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:23.465149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:23.467468 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9d801128-9716-45a7-bc50-fc19b05fc73a tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 200 len: 1479 microversion: 2.1 time: 0.343233 Jun 04 21:03:23.468384 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1396/2686] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:23 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 1479 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:23.475155 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66c49b1a-cc08-4db3-87d6-db7d07009bad tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.377645 Jun 04 21:03:23.475328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ff1d8da2-190a-4c82-9adc-02b64a7fe0b0 req-b4d0baa6-a169-4e07-a1a8-cef4dace6962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "name": "network-vif-unplugged", "status": "completed", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:23.476108 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1291/2687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:23 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:23.488124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e03b045a-d911-4af2-b308-2c0df4b6dc02 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02177e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:23.493317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ff1d8da2-190a-4c82-9adc-02b64a7fe0b0 req-b4d0baa6-a169-4e07-a1a8-cef4dace6962 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.500411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ff1d8da2-190a-4c82-9adc-02b64a7fe0b0 req-b4d0baa6-a169-4e07-a1a8-cef4dace6962 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.513021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ff1d8da2-190a-4c82-9adc-02b64a7fe0b0 req-b4d0baa6-a169-4e07-a1a8-cef4dace6962 service nova] Creating event network-vif-unplugged:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:03:23.518214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ff1d8da2-190a-4c82-9adc-02b64a7fe0b0 req-b4d0baa6-a169-4e07-a1a8-cef4dace6962 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048837 Jun 04 21:03:23.518974 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1397/2688] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:23.547019 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e03b045a-d911-4af2-b308-2c0df4b6dc02 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 200 len: 1453 microversion: 2.1 time: 0.069388 Jun 04 21:03:23.553097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1292/2689] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:23 2022] GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:23.562763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-75143986"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:23.564412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:23.571360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.572150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.578073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.578781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.809594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-952494580", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:23.891933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] validate_networks() for [('74883b92-980c-45ae-844d-3460212fc4ee', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:03:23.931310 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72f51b68-2330-4e14-a102-f8e596541c4e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a/action" status: 202 len: 0 microversion: 2.1 time: 0.372468 Jun 04 21:03:23.932466 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1293/2690] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:23 2022] POST /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:03:23.938389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:23.939315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:23.948305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.948799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:23.949583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:23.950012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:24.177708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:24.185795 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7a6cea46-fced-463e-b3a9-b148acb89bc0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1535 microversion: 2.1 time: 0.251934 Jun 04 21:03:24.203218 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1294/2691] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:23 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1535 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:24.209052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30987327-e24f-401f-bf53-ab850e91af60 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0bd9c310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:24.280115 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-30987327-e24f-401f-bf53-ab850e91af60 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 200 len: 1438 microversion: 2.1 time: 0.075219 Jun 04 21:03:24.281041 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1295/2692] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:24 2022] GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:24.496586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:24.497342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:24.511134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:24.511697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:24.512452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:24.513079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:24.871620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:03:24.872152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:03:24.872662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:03:24.873095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:03:24.873532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:03:24.893276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:24.894725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:24.896427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:24.897434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:24.897697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:24.906649 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7b7be984-cf0b-4346-b098-230302a68290 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.413793 Jun 04 21:03:24.915993 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1296/2693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:24 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:24.920173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-475d1945-472b-42b3-994f-6e97820e2c20 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02177f70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:24.928452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Getting quotas for project 54d9ccdbd9754f61ab39f91d928842fb. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:03:24.935312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Getting quotas for user 056d2db6425347eabfc1d1cb7802db75 and project 54d9ccdbd9754f61ab39f91d928842fb. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:03:24.949859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:24.951663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:03:24.954707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:03:24.978273 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-475d1945-472b-42b3-994f-6e97820e2c20 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 200 len: 1453 microversion: 2.1 time: 0.069388 Jun 04 21:03:24.979118 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1297/2694] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:24 2022] GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:25.018441 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15de06fd-3a09-4bb1-8da1-ccbc79577378 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.489231 Jun 04 21:03:25.020011 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1398/2695] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:03:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:03:25.038477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-790f9aa4-7de6-4f4a-b06c-97ca76b2596a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:25.039315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-790f9aa4-7de6-4f4a-b06c-97ca76b2596a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:25.131554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-790f9aa4-7de6-4f4a-b06c-97ca76b2596a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:25.140596 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-790f9aa4-7de6-4f4a-b06c-97ca76b2596a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1222 microversion: 2.1 time: 0.111772 Jun 04 21:03:25.153708 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1298/2696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:25 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:25.203390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:25.203912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:25.211218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.211710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:25.212483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.213275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:25.293892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-121eeffd-aa9c-4f9e-942c-bb0dc41a01d7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d02115c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:25.385478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-121eeffd-aa9c-4f9e-942c-bb0dc41a01d7 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 200 len: 1438 microversion: 2.1 time: 0.095243 Jun 04 21:03:25.386792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1299/2697] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:25 2022] GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 1438 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:25.419867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:25.431318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5b136aa-2d34-4277-96b0-1f5e4419796c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1528 microversion: 2.1 time: 0.231745 Jun 04 21:03:25.432671 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1399/2698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:25 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1528 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:25.449943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:25.450873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:25.465611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.466105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:25.467351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.467846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:25.549770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3ae1e13b-8c99-4a1e-8a60-a0153daa34d7 req-8efa1947-bc00-4950-9780-443a223b68fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "name": "network-vif-unplugged", "status": "completed", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:25.569526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3ae1e13b-8c99-4a1e-8a60-a0153daa34d7 req-8efa1947-bc00-4950-9780-443a223b68fe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.570320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3ae1e13b-8c99-4a1e-8a60-a0153daa34d7 req-8efa1947-bc00-4950-9780-443a223b68fe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:25.593988 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3ae1e13b-8c99-4a1e-8a60-a0153daa34d7 req-8efa1947-bc00-4950-9780-443a223b68fe service nova] Creating event network-vif-unplugged:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:03:25.600467 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3ae1e13b-8c99-4a1e-8a60-a0153daa34d7 req-8efa1947-bc00-4950-9780-443a223b68fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059525 Jun 04 21:03:25.602109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1400/2699] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:25.689755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:25.702898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf0f6574-bf70-47ba-be1d-f72b899ca30a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1528 microversion: 2.1 time: 0.258098 Jun 04 21:03:25.704018 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1300/2700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:25 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1528 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:25.723408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c45bf56-9739-40ca-b53a-6fadc48f3cfc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:25.724602 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:03:25.724602 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:03:25.736164 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-9c45bf56-9739-40ca-b53a-6fadc48f3cfc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] HTTP exception thrown: Flavor ad726c36-eae2-4580-8825-5b0914e7dd91 could not be found. Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c45bf56-9739-40ca-b53a-6fadc48f3cfc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Request method failure captured: Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/flavors/ad726c36-eae2-4580-8825-5b0914e7dd91 HTTP/1.1 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ejpHLd6xi89KIVLINuiyvLLypAZdkjahcuQDgDgdaHZgSh_eLW7q-qpDEuztHWZr6oRbUM-FgbuuzP3-z4CFEEIumI6YXJLw5rQrpGTdmHwB1hrTpPgHt_d27Zx2W3iHAoODP_hyQTQG8mhTx9I8xS4X-43cgawOav_r7RsgGxNGU Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 8e8d612beb2b4d758bbae05a31ba753c Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-MigrationsAdminTest-900372530 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8e8d612beb2b4d758bbae05a31ba753c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8d612beb2b4d758bbae05a31ba753c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8e8d612beb2b4d758bbae05a31ba753c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8e8d612beb2b4d758bbae05a31ba753c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-MigrationsAdminTest-900372530 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 8e8d612beb2b4d758bbae05a31ba753c Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-MigrationsAdminTest-900372530 Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-MigrationsAdminTest-900372530-project-admin Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 416e81041f5545889211b6f6f777a5cb Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-MigrationsAdminTest-900372530-project-admin Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: exception: Flavor ad726c36-eae2-4580-8825-5b0914e7dd91 could not be found. Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ad726c36-eae2-4580-8825-5b0914e7dd91'} Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ad726c36-eae2-4580-8825-5b0914e7dd91 could not be found. Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ad726c36-eae2-4580-8825-5b0914e7dd91 could not be found. Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:25.745284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ad726c36-eae2-4580-8825-5b0914e7dd91 could not be found. Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9c45bf56-9739-40ca-b53a-6fadc48f3cfc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Returning 404 to user: Flavor ad726c36-eae2-4580-8825-5b0914e7dd91 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9c45bf56-9739-40ca-b53a-6fadc48f3cfc tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/ad726c36-eae2-4580-8825-5b0914e7dd91" status: 404 len: 109 microversion: 2.1 time: 0.030306 Jun 04 21:03:25.753446 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1401/2701] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:03:25 2022] DELETE /compute/v2.1/flavors/ad726c36-eae2-4580-8825-5b0914e7dd91 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:03:25.917671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-972001761", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:25.924923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:25.926416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:25.938265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.938965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:25.939972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:25.940649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:26.020987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:03:26.437647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:03:26.438558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:03:26.439235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:03:26.441762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:03:26.442383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:03:26.471093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:26.477456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:26.480269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:26.483299 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6eb4d04d-5afa-4b19-8e1b-d89c04ca5dbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.563547 Jun 04 21:03:26.483902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:26.484251 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1402/2702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:25 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:26.493983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:26.503796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6ac7fdca-b278-4efe-97a9-b303404112c7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01528d30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:26.534998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:03:26.550123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Getting quotas for user 5b4c3539c5534d2c844944f9be3f9963 and project 29ca718638c842a98bb90cc3adb3979f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:03:26.568517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:03:26.571551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:03:26.669978 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f3d809a-d5e8-4714-91f2-96a1e656abaf tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757288 Jun 04 21:03:26.670648 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1301/2703] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:03:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:03:26.695471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:26.696306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:26.713184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:26.715922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:26.716945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:26.717386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:26.795303 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6ac7fdca-b278-4efe-97a9-b303404112c7 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 200 len: 1453 microversion: 2.1 time: 0.296891 Jun 04 21:03:26.798321 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1403/2704] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:26 2022] GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 1453 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:26.819634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f4507c7-6efa-451e-b347-5fd23dcabcfb tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d014bde50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:26.981723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:26.991580 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3111b88f-60c6-4962-a4d5-45d6ab04480c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1282 microversion: 2.1 time: 0.312242 Jun 04 21:03:26.997457 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1302/2705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:26 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1282 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:27.008466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c4c054a-5828-40c3-ab40-1904ad24d15f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:27.009113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2c4c054a-5828-40c3-ab40-1904ad24d15f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:27.395491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2c4c054a-5828-40c3-ab40-1904ad24d15f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:27.408487 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c4c054a-5828-40c3-ab40-1904ad24d15f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1212 microversion: 2.1 time: 0.409133 Jun 04 21:03:27.409336 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1303/2706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:26 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1212 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:27.520644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:27.521278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:27.541148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:27.568606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:27.573540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:27.573999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:29.318235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:29.343660 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f328cede-dc49-4e6e-abf7-3e85fff353a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 1.845507 Jun 04 21:03:29.346490 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1304/2707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:27 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:29.362365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7af781e-a323-4448-a162-f814a8ba9204 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d016f80d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:34.913141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:34.943243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:35.934206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=9,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:36.478219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:36.508175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:37.404622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:37.541080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:39.329264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:45.284052 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f4507c7-6efa-451e-b347-5fd23dcabcfb tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 200 len: 1438 microversion: 2.1 time: 18.483675 Jun 04 21:03:45.285918 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1404/2708] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:26 2022] GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 1438 bytes in 18487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:45.292150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f7d2ee3b-d441-4ab2-b656-24a67e751d70 req-fc0acf58-d10c-4dc5-b93d-ba8cc5343f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10d229b-8dab-4cce-ae2d-1524e56a3ddd", "name": "network-vif-plugged", "status": "completed", "tag": "edd2ce05-aeb9-4bd3-bc82-7c47f1fab610"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:45.292437 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7af781e-a323-4448-a162-f814a8ba9204 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 200 len: 1462 microversion: 2.1 time: 15.937148 Jun 04 21:03:45.303082 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1305/2709] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:29 2022] GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 1462 bytes in 15956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:45.306903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f7d2ee3b-d441-4ab2-b656-24a67e751d70 req-fc0acf58-d10c-4dc5-b93d-ba8cc5343f10 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:45.307595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f7d2ee3b-d441-4ab2-b656-24a67e751d70 req-fc0acf58-d10c-4dc5-b93d-ba8cc5343f10 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:45.308726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:45.309409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:45.329509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:45.330147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:45.337458 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f7d2ee3b-d441-4ab2-b656-24a67e751d70 req-fc0acf58-d10c-4dc5-b93d-ba8cc5343f10 service nova] Creating event network-vif-plugged:edd2ce05-aeb9-4bd3-bc82-7c47f1fab610 for instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd on nch1-master-1 Jun 04 21:03:45.344270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:45.344833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:45.346174 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f7d2ee3b-d441-4ab2-b656-24a67e751d70 req-fc0acf58-d10c-4dc5-b93d-ba8cc5343f10 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057359 Jun 04 21:03:45.352111 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1405/2710] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:45.369765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:45.370465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:45.396181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:45.419733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:45.421224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:45.421673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.153219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:46.157392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:46.166801 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c0521fd-8111-4aa3-afc6-9db12b873918 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1322 microversion: 2.1 time: 0.862355 Jun 04 21:03:46.167315 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1306/2711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:45 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1322 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.176941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:46.178414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:46.189551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.190263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.192121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.192770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.195792 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-93f5e75d-8b10-4fa0-bd5e-4c09045885e8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1312 microversion: 2.1 time: 0.840197 Jun 04 21:03:46.198776 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1406/2712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:45 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1312 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.207336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1d75dcfe-d882-407c-b1b1-c3e72838caba req-3e285319-5f0b-40eb-9d7c-518319082db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:46.218039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1d75dcfe-d882-407c-b1b1-c3e72838caba req-3e285319-5f0b-40eb-9d7c-518319082db4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.219565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1d75dcfe-d882-407c-b1b1-c3e72838caba req-3e285319-5f0b-40eb-9d7c-518319082db4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.237502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1d75dcfe-d882-407c-b1b1-c3e72838caba req-3e285319-5f0b-40eb-9d7c-518319082db4 service nova] Creating event network-changed:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:03:46.246395 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1d75dcfe-d882-407c-b1b1-c3e72838caba req-3e285319-5f0b-40eb-9d7c-518319082db4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045531 Jun 04 21:03:46.247252 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1407/2713] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:46.256491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4162b08b-c9a4-4dbe-b658-eb28f2cbb753 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014fc280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:46.323058 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4162b08b-c9a4-4dbe-b658-eb28f2cbb753 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 200 len: 1462 microversion: 2.1 time: 0.074057 Jun 04 21:03:46.324940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1408/2714] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:46 2022] GET /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 1462 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.330011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9b23a244-6565-4198-8a19-50bb5b774a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d014e4ca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:46.399977 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9b23a244-6565-4198-8a19-50bb5b774a11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 200 len: 1447 microversion: 2.1 time: 0.073612 Jun 04 21:03:46.400713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1409/2715] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:46 2022] GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 1447 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.405594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:46.412903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:46.422149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.422607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.423607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.424334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.461859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:46.470272 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25831d15-2a9f-4ab4-8e18-dbcc01b5656d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1314 microversion: 2.1 time: 0.299268 Jun 04 21:03:46.470977 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1307/2716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:46 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.484172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-113c3ec2-0152-4c3a-bb38-16a80d63e974 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d016fcee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:46.550531 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-113c3ec2-0152-4c3a-bb38-16a80d63e974 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 200 len: 1447 microversion: 2.1 time: 0.077762 Jun 04 21:03:46.552039 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1308/2717] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:46 2022] GET /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 1447 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.566645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-511e3e02-698d-437c-ab50-571787f4181f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01689790>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:46.682341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:46.698491 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a9350e0-11ae-4104-85aa-e67bd6f39655 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1467 microversion: 2.1 time: 0.296469 Jun 04 21:03:46.710757 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1410/2718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:46 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:46.722062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-649760633"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:46.723759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:46.730695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.731159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:46.732026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:46.732477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.142585 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b9032dc1-5dac-436b-8f44-352772732db2 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "POST /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204/action" status: 202 len: 0 microversion: 2.1 time: 0.427397 Jun 04 21:03:47.147223 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1411/2719] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:46 2022] POST /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 04 21:03:47.164349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-477483ad-7bd8-4619-a9b6-1ecae6ba6bd3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014e49d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:47.290126 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-477483ad-7bd8-4619-a9b6-1ecae6ba6bd3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.138913 Jun 04 21:03:47.291282 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1412/2720] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:47 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:47.302592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:47.306945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:47.319551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.320607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.322733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.327032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.546399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:47.556192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-598fd0d9-2735-487d-b2f9-c95a898357bc tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1322 microversion: 2.1 time: 0.263228 Jun 04 21:03:47.557307 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1413/2721] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:47 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:47.562950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:47.564210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:47.572645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.573279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.574469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.574915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.722927 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-511e3e02-698d-437c-ab50-571787f4181f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 204 len: 0 microversion: 2.1 time: 1.162549 Jun 04 21:03:47.724501 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1309/2722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:46 2022] DELETE /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 0 bytes in 1165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:47.742458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c98705-74f6-42a6-b0ac-ebe0a3ee932a", "name": "network-vif-plugged", "status": "completed", "tag": "f8138d24-ebbb-4efc-a3b8-b549bcd75eef"}, {"server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "name": "network-vif-plugged", "status": "completed", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}, {"server_uuid": "4eea574d-d0ab-4cc1-b9a5-28aafce58c36", "name": "network-vif-plugged", "status": "completed", "tag": "18069fc6-417f-4f52-bfea-398d71316731"}, {"server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "name": "network-vif-plugged", "status": "completed", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}, {"server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "name": "network-vif-plugged", "status": "completed", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:47.758033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.758667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.780171 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Creating event network-vif-plugged:f8138d24-ebbb-4efc-a3b8-b549bcd75eef for instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a on nch2-master-1 Jun 04 21:03:47.780679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Creating event network-vif-plugged:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:03:47.781360 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Creating event network-vif-plugged:18069fc6-417f-4f52-bfea-398d71316731 for instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 on nch2-master-1 Jun 04 21:03:47.782013 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Creating event network-vif-plugged:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:03:47.782660 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] Creating event network-vif-plugged:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch1-master-1 Jun 04 21:03:47.788758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:47.803851 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b161511b-d273-4ad1-b1cd-205db077186c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1312 microversion: 2.1 time: 0.245310 Jun 04 21:03:47.804999 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1414/2723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:47 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:47.808278 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0ef9ee9d-e283-4022-892d-bc938145b792 req-56100a8c-23b3-4181-8878-8e61a2df7c8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.082147 Jun 04 21:03:47.809343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1310/2724] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:47.810536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:47.811893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:47.823064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.823761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.824716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.825136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.827032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:47.830574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:47.848376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.850639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.851688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:47.852277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:47.883628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:03:48.014200 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fc2387f-7ff3-42d9-809d-025c47a834d6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 204 len: 0 microversion: 2.1 time: 0.202828 Jun 04 21:03:48.016509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1311/2725] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:03:47 2022] DELETE /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:03:48.169083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-774651276", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "cb31943d-3a91-4b52-84f6-c98fcd43073f"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:48.178247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:48.187732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c25c0fc5-8ab8-4433-a48b-ea836d9050c7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1501 microversion: 2.1 time: 0.381422 Jun 04 21:03:48.188368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1415/2726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:47 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1501 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:48.207537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-673ce3bf-05f0-4bb9-b81c-3a252a42fcbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:48.219986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-673ce3bf-05f0-4bb9-b81c-3a252a42fcbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.222057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-673ce3bf-05f0-4bb9-b81c-3a252a42fcbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.235264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] validate_networks() for [('cb31943d-3a91-4b52-84f6-c98fcd43073f', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:03:48.270772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-673ce3bf-05f0-4bb9-b81c-3a252a42fcbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:03:48.343054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-673ce3bf-05f0-4bb9-b81c-3a252a42fcbf tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd/action" status: 202 len: 0 microversion: 2.1 time: 0.140303 Jun 04 21:03:48.347189 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1416/2727] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:48 2022] POST /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:03:48.363128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-237934c0-6b6c-43b7-8a8c-82dda7ed3e32 req-5baec401-254a-4d8d-aa86-51fc74b34b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:48.379575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-237934c0-6b6c-43b7-8a8c-82dda7ed3e32 req-5baec401-254a-4d8d-aa86-51fc74b34b2e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.381123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-237934c0-6b6c-43b7-8a8c-82dda7ed3e32 req-5baec401-254a-4d8d-aa86-51fc74b34b2e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.398403 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-237934c0-6b6c-43b7-8a8c-82dda7ed3e32 req-5baec401-254a-4d8d-aa86-51fc74b34b2e service nova] Creating event network-changed:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch1-master-1 Jun 04 21:03:48.403735 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-237934c0-6b6c-43b7-8a8c-82dda7ed3e32 req-5baec401-254a-4d8d-aa86-51fc74b34b2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058138 Jun 04 21:03:48.404367 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1417/2728] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:48.411289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-23266516-71c4-4074-8075-68c62be45db3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014e4c10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:48.468250 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-23266516-71c4-4074-8075-68c62be45db3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.062584 Jun 04 21:03:48.474408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1418/2729] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:48 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:48.479611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:48.480302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:48.487814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.488571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.489574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.490024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.727371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:48.741027 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a386a89-ffe1-43c6-8b32-4f9b11a5793a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.265301 Jun 04 21:03:48.742460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1419/2730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:48 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:48.748208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:48.749258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:48.760794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.761248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.762233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.763176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.830781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:03:48.833228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:03:48.833918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:03:48.834734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:03:48.835474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:03:48.852086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.853647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.854791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.855983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.890523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:03:48.898828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Getting quotas for user d96f5288364449e3af2f39c71a8c3ef2 and project b0cebb51402146e693490f681342be4f. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:03:48.922168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:03:48.925154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:03:48.941716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:48.953050 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0cd4ec64-dde6-4f49-94c6-6fe1cff486ed tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1322 microversion: 2.1 time: 0.208735 Jun 04 21:03:48.953944 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1420/2731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:48 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:48.960575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:48.961483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:48.970042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.970566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:48.972972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:48.973772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:49.020548 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6921f72b-cb87-453b-bc96-08fe8ffb7e71 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856775 Jun 04 21:03:49.023641 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1312/2732] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:03:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:03:49.045713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ef097e8-feb4-4c69-acc5-09ee0275105f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:49.050497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ef097e8-feb4-4c69-acc5-09ee0275105f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:49.170415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8ef097e8-feb4-4c69-acc5-09ee0275105f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:49.182142 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ef097e8-feb4-4c69-acc5-09ee0275105f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1207 microversion: 2.1 time: 0.146671 Jun 04 21:03:49.182733 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1313/2733] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:49 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1207 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:49.252719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:49.269452 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87636912-2b26-443a-9057-d5f76a726bd3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1312 microversion: 2.1 time: 0.313135 Jun 04 21:03:49.271857 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1421/2734] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:48 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:49.483400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0ad671f-acee-4400-988d-ba4015bf04fa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02058af0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:49.546937 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0ad671f-acee-4400-988d-ba4015bf04fa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.066771 Jun 04 21:03:49.550139 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1314/2735] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:49 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:49.763407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:49.764887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:49.776572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:49.777358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:49.778821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:49.779485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:49.970850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:49.972193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:49.983637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:49.985598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:49.987060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:49.987876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.119266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:50.132390 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce5ab669-c102-48e9-993a-c5a1fed62232 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.375382 Jun 04 21:03:50.133311 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1422/2736] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:49 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:50.202022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:50.202683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:50.214781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.218643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.220909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.221648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.230197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:50.245304 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32d6564c-562d-46d1-9a2d-ee150cd7ddaa tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1322 microversion: 2.1 time: 0.277268 Jun 04 21:03:50.246306 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1315/2737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:49 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:50.301470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:50.304109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:50.311726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.312444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.314235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.314817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.332626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:50.347201 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71d073f7-f735-4cb1-839b-6b6a9c0bab0e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1259 microversion: 2.1 time: 0.149357 Jun 04 21:03:50.359859 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1423/2738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:50 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:50.564634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88d86fb8-6d06-453b-9c90-8a181d600fbc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0158f280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:50.647072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88d86fb8-6d06-453b-9c90-8a181d600fbc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.087931 Jun 04 21:03:50.653352 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1424/2739] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:50 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:50.683533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:50.710391 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a96f7f7a-e539-4806-b137-98457e6c5441 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1462 microversion: 2.1 time: 0.415653 Jun 04 21:03:50.716949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1316/2740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:50 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1462 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:50.733733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:50.734406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:50.745991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.747946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.748792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.749240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.965530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0be8d7ec-bba6-417d-8ffa-4ba502d1ec2d req-fcca5302-a457-4242-a57b-da708efc5f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c98705-74f6-42a6-b0ac-ebe0a3ee932a", "name": "network-vif-unplugged", "status": "completed", "tag": "f8138d24-ebbb-4efc-a3b8-b549bcd75eef"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:50.977364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0be8d7ec-bba6-417d-8ffa-4ba502d1ec2d req-fcca5302-a457-4242-a57b-da708efc5f46 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:50.978480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0be8d7ec-bba6-417d-8ffa-4ba502d1ec2d req-fcca5302-a457-4242-a57b-da708efc5f46 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:50.994323 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0be8d7ec-bba6-417d-8ffa-4ba502d1ec2d req-fcca5302-a457-4242-a57b-da708efc5f46 service nova] Creating event network-vif-unplugged:f8138d24-ebbb-4efc-a3b8-b549bcd75eef for instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a on nch2-master-1 Jun 04 21:03:50.999958 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0be8d7ec-bba6-417d-8ffa-4ba502d1ec2d req-fcca5302-a457-4242-a57b-da708efc5f46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038676 Jun 04 21:03:51.001293 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1317/2741] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:03:51.152434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:51.153190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:51.164574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.168253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.169137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.169583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.470045 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d58a001-766a-436f-abb4-60b05262bb90 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1613 microversion: 2.1 time: 0.740647 Jun 04 21:03:51.470640 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1425/2742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:50 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1613 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:51.478994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:51.486197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:51.500046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.504207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.508876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.509382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.517378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:51.658944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:51.673356 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-058bb0ad-b76e-425a-8cbe-b3b588c845a7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.526354 Jun 04 21:03:51.675323 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1318/2743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:51 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:51.684906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:51.689849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:51.702852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.703417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.704119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.705397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.904957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:51.928321 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-86f99e40-9743-42b9-a2f3-f4ab9b3b9d8e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1265 microversion: 2.1 time: 0.248456 Jun 04 21:03:51.929509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1319/2744] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:51 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:51.946702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:51.947359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:51.957395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.958289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:51.959188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:51.959698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.016275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '416e81041f5545889211b6f6f777a5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d612beb2b4d758bbae05a31ba753c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:52.017044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] flavor_id is None. Assuming migration. {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 04 21:03:52.017690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:03:52.056604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:52.087052 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dfeb2165-410d-45f9-a2c7-1387efa201a8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1516 microversion: 2.1 time: 0.609687 Jun 04 21:03:52.089692 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1426/2745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:51 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1516 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:52.109920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17461523-bcea-4708-981d-54de1d6130d5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014ff430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:52.221390 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17461523-bcea-4708-981d-54de1d6130d5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.124445 Jun 04 21:03:52.224023 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1427/2746] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:52 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:52.234805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-aba26c2a-eb13-4297-b84d-346a881ad787 req-3d2a1ae4-d0ad-4568-8e21-5f1da5feb336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c98705-74f6-42a6-b0ac-ebe0a3ee932a", "name": "network-vif-deleted", "tag": "f8138d24-ebbb-4efc-a3b8-b549bcd75eef"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:52.245854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aba26c2a-eb13-4297-b84d-346a881ad787 req-3d2a1ae4-d0ad-4568-8e21-5f1da5feb336 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.247112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aba26c2a-eb13-4297-b84d-346a881ad787 req-3d2a1ae4-d0ad-4568-8e21-5f1da5feb336 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.271007 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-aba26c2a-eb13-4297-b84d-346a881ad787 req-3d2a1ae4-d0ad-4568-8e21-5f1da5feb336 service nova] Creating event network-vif-deleted:f8138d24-ebbb-4efc-a3b8-b549bcd75eef for instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a on nch2-master-1 Jun 04 21:03:52.279815 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-aba26c2a-eb13-4297-b84d-346a881ad787 req-3d2a1ae4-d0ad-4568-8e21-5f1da5feb336 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052819 Jun 04 21:03:52.281273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1428/2747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:52.297862 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a23d1acd-98f9-4139-8e50-8f9f5c88fec7 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db/action" status: 202 len: 0 microversion: 2.1 time: 0.366298 Jun 04 21:03:52.300052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:52.301615 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1320/2748] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:51 2022] POST /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:03:52.305836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:52.313077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.315180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.315760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:52.317029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.317749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.318248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:52.336102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.336690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.337631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.338212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.348183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lazy-loading 'flavor' on Instance uuid 07d7f180-4657-410f-9dc7-2c7887faa217 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:03:52.499029 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cfa4de8e-05f1-4c30-b766-0f2c63770c30 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action" status: 200 len: 32 microversion: 2.1 time: 0.211986 Jun 04 21:03:52.502984 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1429/2749] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:03:52 2022] POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:03:52.529194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:52.530248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:52.541673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.542472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:52.543910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:52.544613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:53.017262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:53.052840 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7486b384-474d-4bc6-b092-bf1472519a49 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1471 microversion: 2.1 time: 0.745124 Jun 04 21:03:53.056619 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1321/2750] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:52 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1471 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:53.070395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:53.072420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:53.081162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:53.081802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:53.082774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:53.083216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:53.538048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:53.548426 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65246f37-2d4f-4e97-91bf-afc1906ad55d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 1.038964 Jun 04 21:03:53.550565 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1430/2751] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:52 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:53.559704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:53.560470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:53.578121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:53.582433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:53.583814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:53.584954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:54.009960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:54.029037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-49714150-007a-4abd-adc3-5123cd726aae tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.970982 Jun 04 21:03:54.030052 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1322/2752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:53 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:54.048979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-aa943d4d-b674-4fa0-9c55-4a06df9e353b req-b2abd18c-81fa-4a2d-bdc9-5c8200b1e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eea574d-d0ab-4cc1-b9a5-28aafce58c36", "name": "network-vif-unplugged", "status": "completed", "tag": "18069fc6-417f-4f52-bfea-398d71316731"}, {"server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "name": "network-vif-plugged", "status": "completed", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:54.075908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-aa943d4d-b674-4fa0-9c55-4a06df9e353b req-b2abd18c-81fa-4a2d-bdc9-5c8200b1e71e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:54.076357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-aa943d4d-b674-4fa0-9c55-4a06df9e353b req-b2abd18c-81fa-4a2d-bdc9-5c8200b1e71e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:54.114686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-aa943d4d-b674-4fa0-9c55-4a06df9e353b req-b2abd18c-81fa-4a2d-bdc9-5c8200b1e71e service nova] Creating event network-vif-unplugged:18069fc6-417f-4f52-bfea-398d71316731 for instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 on nch2-master-1 Jun 04 21:03:54.115275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-aa943d4d-b674-4fa0-9c55-4a06df9e353b req-b2abd18c-81fa-4a2d-bdc9-5c8200b1e71e service nova] Creating event network-vif-plugged:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:03:54.128639 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-aa943d4d-b674-4fa0-9c55-4a06df9e353b req-b2abd18c-81fa-4a2d-bdc9-5c8200b1e71e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.097156 Jun 04 21:03:54.133289 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1323/2753] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:54.139896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8b2195e-ea45-489f-9719-4c65c5a5913d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02109550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:54.237147 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8b2195e-ea45-489f-9719-4c65c5a5913d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.093693 Jun 04 21:03:54.243034 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1324/2754] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:54 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:54.264703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:54.265622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:54.291730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:54.295636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:54.296806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:54.297208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:54.861459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:54.880870 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2dc25dc9-a10e-4d5e-bf46-6f107ccf7d98 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 1.322858 Jun 04 21:03:54.883615 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1431/2755] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:53 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:54.895118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:54.907225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:54.933825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:54.934312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:54.936871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:54.939422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:55.556787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:55.568652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e7f0332-729e-482c-b293-e16d2cde29d8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1471 microversion: 2.1 time: 1.317419 Jun 04 21:03:55.573415 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1325/2756] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:54 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1471 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:55.591732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:55.593132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:55.614909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:55.618357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:55.619441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:55.622929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:55.625359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:55.661951 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21607b0e-e6c8-45d5-9431-23be369ee7db tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.774122 Jun 04 21:03:55.668554 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1432/2757] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:54 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:55.703567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-177c1373-7f09-4ebe-93af-cb8c92549a25 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014bd9d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:55.901615 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-177c1373-7f09-4ebe-93af-cb8c92549a25 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.228151 Jun 04 21:03:55.902279 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1433/2758] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:55 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:55.921945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:55.922636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:55.932778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:55.933238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:55.934125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:55.934649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:56.299337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:56.329589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:56.333248 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b60803c3-9492-49d2-bd69-3ed6a2c8318f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.757979 Jun 04 21:03:56.334074 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1326/2759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:55 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:56.383828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:56.402805 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2c5de86e-31fe-498f-bf65-556d6d31fe30 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.497570 Jun 04 21:03:56.405675 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1434/2760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:55 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:56.593962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:56.595588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:56.611285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:56.613280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:56.615547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:56.619296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:56.684503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:56.685470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:56.698867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:56.700438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:56.702452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:56.703665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:57.413098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:57.416903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:57.435814 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33bf504e-416e-4d44-8615-5fdb54f3bcb9 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.755254 Jun 04 21:03:57.449032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1435/2761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:56 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:57.464754 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3dc4f9f9-8223-4d9a-895e-1be9d982bed8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1471 microversion: 2.1 time: 0.877242 Jun 04 21:03:57.465458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-590627c1-282c-46df-851e-e31a9f314c31 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01564d30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:57.468029 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1327/2762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:56 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1471 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:57.475588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a76b7ddd-73bb-4576-ae77-6a6ba27e68d6 req-e0ff3be1-d34c-4780-98d8-9fd47cc260b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5359c2f7-4090-46eb-b645-1ba5f3d2637b", "tag": "19d0c7c3-6b0d-46bf-9e13-0d0798845f94"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:03:57.489894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a76b7ddd-73bb-4576-ae77-6a6ba27e68d6 req-e0ff3be1-d34c-4780-98d8-9fd47cc260b3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:57.490583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a76b7ddd-73bb-4576-ae77-6a6ba27e68d6 req-e0ff3be1-d34c-4780-98d8-9fd47cc260b3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:57.503407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a76b7ddd-73bb-4576-ae77-6a6ba27e68d6 req-e0ff3be1-d34c-4780-98d8-9fd47cc260b3 service nova] Creating event network-changed:19d0c7c3-6b0d-46bf-9e13-0d0798845f94 for instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b on nch1-master-1 Jun 04 21:03:57.510154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a76b7ddd-73bb-4576-ae77-6a6ba27e68d6 req-e0ff3be1-d34c-4780-98d8-9fd47cc260b3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039816 Jun 04 21:03:57.511406 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1328/2763] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:03:57.517926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:57.518914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:57.532006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:57.533147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:57.535963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:57.536666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:57.970406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:57.987945 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a89d06b3-94ad-4488-90b0-4567868bacaa tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.474074 Jun 04 21:03:57.991836 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1329/2764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:57 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:58.004885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:58.012390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:58.030655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:58.032289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:58.033339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:58.033925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:58.261797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:58.273016 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-547a9eb8-e7ad-4cb0-bd7d-05715e3f0ea6 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.279521 Jun 04 21:03:58.274818 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1330/2765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:57 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:58.454954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:58.455625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:58.462704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:58.463276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:58.464098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:58.464681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:58.620793 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-590627c1-282c-46df-851e-e31a9f314c31 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 1.166339 Jun 04 21:03:58.623949 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1436/2766] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:57 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:58.630519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:58.631596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:58.639530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:58.640875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:58.642543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:58.643406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:58.658210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:58.675062 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd6cf711-aaea-4719-843a-76b471b43f0b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.222890 Jun 04 21:03:58.676475 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1331/2767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:58 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:58.879843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:58.889209 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8fa0dd08-ee16-4bb9-92ed-c16f187bd653 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.263742 Jun 04 21:03:58.890022 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1437/2768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:58 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:59.010418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:59.011794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:59.014022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:59.027398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:59.028210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:59.029380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:59.029976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:59.180473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:03:59.227575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:59.236101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69e9ec43-cc46-4e1f-9e40-028851b74441 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.230669 Jun 04 21:03:59.248511 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1332/2769] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:59 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:03:59.292491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:59.293873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:59.308874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:59.313723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:59.314722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:59.315399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:59.638332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c1d2ba8-cb8c-4bfb-a45b-781282dcbf6f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d017e6e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:59.654393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:03:59.674951 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd7f3dfc-ab7b-4817-85cf-67672dfee5d9 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.380962 Jun 04 21:03:59.677612 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1438/2770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:59 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:03:59.699893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:03:59.701684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:03:59.711322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:59.712530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:03:59.715789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:03:59.716590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.014711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:00.030252 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3c4dd8ec-4ae5-4235-b733-5a70e029e94b tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.339807 Jun 04 21:04:00.031178 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1439/2771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:03:59 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:00.036389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:00.037006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:00.044083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:00.044814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.045781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:00.046377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.245664 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c1d2ba8-cb8c-4bfb-a45b-781282dcbf6f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.610083 Jun 04 21:04:00.249141 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1333/2772] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:03:59 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:00.254449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:00.255353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:00.263176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:00.263881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.264850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:00.265444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.347105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:00.372375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab33093b-972d-4a2e-b14d-b210c7a4f007 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.339598 Jun 04 21:04:00.374535 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1440/2773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:00 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:00.477937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:00.489032 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3af7cd5b-999f-4a04-9616-7282dc9e91a3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.238653 Jun 04 21:04:00.489866 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1334/2774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:00 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:00.695275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:00.696573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:00.703026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:00.704756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.705874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:00.710553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:00.946008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:00.957607 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5d16051-a8f9-404d-91ac-50600371f816 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.267012 Jun 04 21:04:00.959147 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1441/2775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:00 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:01.049467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:01.050485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:01.058384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:01.059214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:01.060669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:01.061320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:01.262145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b9b7f246-798e-4c21-a2f2-cd0589a18385 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014b4280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:01.314871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:01.328777 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a82bb8bd-5f50-4337-a898-4b06afbab182 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.284261 Jun 04 21:04:01.340207 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b9b7f246-798e-4c21-a2f2-cd0589a18385 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.082224 Jun 04 21:04:01.354851 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1335/2776] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:01 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:01.355386 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1442/2777] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:01 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:01.406758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:01.408432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:01.418699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:01.419440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:01.422019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:01.422748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:01.506866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:01.510601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:01.539918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:01.540644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:01.542698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:01.543636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:01.629295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:01.649167 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-59883bf0-e687-4fa4-9098-becbab30c4ca tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.250724 Jun 04 21:04:01.650959 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1336/2778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:01 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:01.800157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:01.811266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9db1772f-51bd-41bc-a5d2-06b1e0662731 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.308943 Jun 04 21:04:01.825129 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1443/2779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:01 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:01.978867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:01.979966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:02.023209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.024255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.025872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.028875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.244748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:02.255068 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0393b38d-488e-4ac9-9bbe-5e33549892ea tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.282419 Jun 04 21:04:02.256202 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1337/2780] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:01 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:02.366034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:02.369909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb36d9cd-a8b7-403f-bb4d-d0d980f8dd43 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014f84c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:02.373972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:02.401337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.401797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.402612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.405595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.462463 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb36d9cd-a8b7-403f-bb4d-d0d980f8dd43 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.111262 Jun 04 21:04:02.463213 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1444/2781] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:02 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:02.668301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:02.669536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:02.678604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.680903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.684494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.685328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:02.686010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.704064 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e48b5fcc-b37e-47cd-a8e0-f407850b3bab tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.342332 Jun 04 21:04:02.704723 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1338/2782] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:02 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:02.834645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:02.835230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:02.848193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.848683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:02.849491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:02.852779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:03.059951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:03.075329 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-724cdd2f-da9b-4b67-8f5c-0add994979d5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.412227 Jun 04 21:04:03.076335 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1445/2783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:02 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:03.151036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:03.163697 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4cc1e382-3035-45ea-b496-dd8442aaea83 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.334030 Jun 04 21:04:03.164857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1339/2784] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:02 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:03.282689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:03.283589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:03.293866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:03.294725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:03.295729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:03.296606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:03.344846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:03.478712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3b79a839-0962-4808-92e1-de1ba88d5902 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01fcf280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:03.584460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3b79a839-0962-4808-92e1-de1ba88d5902 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.109599 Jun 04 21:04:03.590903 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1340/2785] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:03 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:03.650827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:03.662584 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b545bb3-9a88-4ad8-a4ee-793721d1c752 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.394027 Jun 04 21:04:03.671834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1446/2786] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:03 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:03.722346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:03.724092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:03.733938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:03.735033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:03.736265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:03.736882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:03.912226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:03.925299 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c88c2464-c2be-4b62-9b84-bf47b5379d82 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.207508 Jun 04 21:04:03.926786 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1341/2787] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:03 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:04.093989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:04.094857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:04.107475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.108478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.110917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.111404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.191500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:04.193861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:04.213794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.217684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.224048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.225979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.343820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:04.354168 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-57e93467-7ab9-4ac7-9090-05cc08c71f23 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.264814 Jun 04 21:04:04.358463 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1447/2788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:04 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:04.560759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:04.572059 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-544fb5f5-01e7-4c4c-b4fc-8b1d63323ef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.393690 Jun 04 21:04:04.572733 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1342/2789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:04 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:04.599086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-329b1dd4-7cbf-4d9d-824b-33a193f8b8cd tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0152fca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:04.661546 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-329b1dd4-7cbf-4d9d-824b-33a193f8b8cd tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.066751 Jun 04 21:04:04.662913 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1448/2790] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:04 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:04.680140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:04.680920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:04.696324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.697949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.699560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.700002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.945383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:04.946274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:04.955549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.960527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:04.962230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:04.964546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:05.433569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:05.441738 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da3ab8dd-4a8d-4026-b63e-710960637049 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.501394 Jun 04 21:04:05.446713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1449/2791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:04 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:05.451497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0c0431f6-de5c-4a67-83af-d0a4aab50265 req-e9004225-e341-4835-a42a-fa5495ee92a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5359c2f7-4090-46eb-b645-1ba5f3d2637b", "name": "network-vif-plugged", "status": "completed", "tag": "19d0c7c3-6b0d-46bf-9e13-0d0798845f94"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:05.462068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:05.470678 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-925d1a1b-ce42-4e74-8cf4-722ea2d95730 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.794952 Jun 04 21:04:05.481079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c0431f6-de5c-4a67-83af-d0a4aab50265 req-e9004225-e341-4835-a42a-fa5495ee92a0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:05.481794 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1343/2792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:04 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:05.482034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c0431f6-de5c-4a67-83af-d0a4aab50265 req-e9004225-e341-4835-a42a-fa5495ee92a0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:05.490864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:05.495187 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0c0431f6-de5c-4a67-83af-d0a4aab50265 req-e9004225-e341-4835-a42a-fa5495ee92a0 service nova] Creating event network-vif-plugged:19d0c7c3-6b0d-46bf-9e13-0d0798845f94 for instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b on nch1-master-1 Jun 04 21:04:05.497236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:05.503226 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0c0431f6-de5c-4a67-83af-d0a4aab50265 req-e9004225-e341-4835-a42a-fa5495ee92a0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055179 Jun 04 21:04:05.505415 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1450/2793] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:05.521776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:05.522513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:05.529669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:05.533079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:05.593871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:05.594823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:05.605397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:05.606937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:05.609848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:05.611321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:05.922496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:05.935191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6923c962-1ae5-4a04-94f0-37dba181f31b tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.450456 Jun 04 21:04:05.939419 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1344/2794] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:05 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:05.948310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f2eb276-7382-45dd-9480-cce7f455771f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d017e6ee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:05.977572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:05.990019 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-279ca983-4857-41a1-af76-0f4334589485 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.403355 Jun 04 21:04:05.990822 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1451/2795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:05 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:06.295759 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f2eb276-7382-45dd-9480-cce7f455771f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.354741 Jun 04 21:04:06.296558 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1345/2796] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:05 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:06.460210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:06.461497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:06.471129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=73 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:06.476743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:06.483017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:06.483017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:06.483017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:06.498241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:06.499331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:06.513494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:06.514273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:06.515264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:06.516367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:06.800756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:06.807643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:06.816419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-073db8af-ce27-4dd8-bf1f-74907abf1400 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1307 microversion: 2.1 time: 0.321850 Jun 04 21:04:06.817386 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1346/2797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:06 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1307 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:06.822797 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1c71a742-639d-4cd6-9328-84204c04af71 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.368273 Jun 04 21:04:06.823395 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1452/2798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:06 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:06.965243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:06.965854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:06.980217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:06.980925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:06.981932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:06.994009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:06.998838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:07.009501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:07.010258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:07.027877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:07.028568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:07.031172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:07.031803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:07.260410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:07.269739 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3545ff1a-1aad-4a07-825e-9cd9713bcfd7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.266190 Jun 04 21:04:07.273808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1453/2799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:07 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:07.309241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:07.316590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e6bbc61-880c-4c4d-9f78-a0ffe7519af5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d015289d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:07.331006 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e9bf54f-cb63-42c9-af1c-60ca580a38cc tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.376624 Jun 04 21:04:07.332590 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1347/2800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:06 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:07.476640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e6bbc61-880c-4c4d-9f78-a0ffe7519af5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.169787 Jun 04 21:04:07.480395 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1454/2801] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:07 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:07.840128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:07.841095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:07.841452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:07.844085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:07.855497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:07.870550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:07.872833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:07.879221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:07.881184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:07.881806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:07.882611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:07.884298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:07.884911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.403278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:08.411419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:08.414876 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ace6531f-af1a-42c5-9be4-80649832ae5c tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.578728 Jun 04 21:04:08.420011 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19096ae8-a3d1-47d3-8d46-8cdada58cd11 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1487 microversion: 2.1 time: 0.589740 Jun 04 21:04:08.425550 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1455/2802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:07 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:08.432266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:08.433157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:08.435313 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1348/2803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:07 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1487 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:08.442039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:08.442676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.444415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:08.444547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.447497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:08.448307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:08.458078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:08.458539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.459330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:08.459815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.677811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:08.689610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-304418cd-604e-4c97-a312-74686a58d1d3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.262885 Jun 04 21:04:08.694277 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1456/2804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:08 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:08.699531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1662839402"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:08.710404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:08.725449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:08.728142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.730563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:08.731168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:08.796507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:08.806563 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-065214f3-d634-4a3c-83c9-e062163c94c2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.369492 Jun 04 21:04:08.808206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1349/2805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:08 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:08.822406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-860094a9-abac-45de-aaac-cd5836d71c08 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d017e6430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:08.901089 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-860094a9-abac-45de-aaac-cd5836d71c08 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1452 microversion: 2.1 time: 0.082479 Jun 04 21:04:08.903848 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1350/2806] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:08 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:09.232775 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-31644acf-6bb0-448a-9176-1149e053bd27 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "POST /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b/action" status: 202 len: 0 microversion: 2.1 time: 0.536870 Jun 04 21:04:09.241503 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1457/2807] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:08 2022] POST /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:04:09.253825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a9d533b-5788-4028-93bc-e18e93f2cb18 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d016aadc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.341002 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a9d533b-5788-4028-93bc-e18e93f2cb18 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea" status: 200 len: 1414 microversion: 2.1 time: 0.093595 Jun 04 21:04:09.341905 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1351/2808] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:09.355523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64e45e35-0e43-4427-8c20-4fa3f2203066 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d014fc280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.436006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64e45e35-0e43-4427-8c20-4fa3f2203066 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea" status: 200 len: 1414 microversion: 2.1 time: 0.085485 Jun 04 21:04:09.437779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.438418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:09.442655 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1458/2809] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:09.446541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:09.447002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:09.449637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:09.458888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be164465-67ae-4c75-a2e4-5f02bd550b0f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d015280d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.461260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:09.713978 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be164465-67ae-4c75-a2e4-5f02bd550b0f tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea" status: 204 len: 0 microversion: 2.1 time: 0.262959 Jun 04 21:04:09.715136 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1459/2810] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:09 2022] DELETE /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:04:09.721116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.722825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:09.739436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:09.742757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:09.744121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:09.744724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:09.848414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:09.863585 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3fd2b5b2-bd84-4bf3-936b-47416da56103 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.434666 Jun 04 21:04:09.874095 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1352/2811] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:09.876130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce04eeb0-5fb3-4a25-9168-18e9e746a8b1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d01699d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.910699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ce04eeb0-5fb3-4a25-9168-18e9e746a8b1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Image not found. Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce04eeb0-5fb3-4a25-9168-18e9e746a8b1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea HTTP/1.1 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '465b5ae0-3230-4315-8401-a35623c6e6ea'} Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 465b5ae0-3230-4315-8401-a35623c6e6ea Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:04:09.913628 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 465b5ae0-3230-4315-8401-a35623c6e6ea could not be found. Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:04:09.918730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:09.923088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce04eeb0-5fb3-4a25-9168-18e9e746a8b1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:09.924846 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce04eeb0-5fb3-4a25-9168-18e9e746a8b1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea" status: 404 len: 62 microversion: 2.1 time: 0.056424 Jun 04 21:04:09.925842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1353/2812] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:04:09.932784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:09.933782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:09.942933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:09.943702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:09.944964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:09.945541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:09.974865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:09.983270 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-528cc0fe-9fc5-4580-8a7c-1131dbaa3f37 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.266514 Jun 04 21:04:09.984195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1460/2813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:09.989465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6f04e433-d68c-4b8b-a21f-d9a18326d457 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014fc160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.051332 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6f04e433-d68c-4b8b-a21f-d9a18326d457 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1461 microversion: 2.1 time: 0.065781 Jun 04 21:04:10.052313 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1461/2814] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1461 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:10.059253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.059915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:10.068461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:10.069765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:10.072053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:10.072928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:10.134169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:10.150289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c53400df-51e2-43d9-a793-9e150596ee6d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.222817 Jun 04 21:04:10.163237 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1354/2815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:09 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:10.172752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-47856e7d-8463-41ea-ae89-f75faded9276 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01699280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.246709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-47856e7d-8463-41ea-ae89-f75faded9276 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 200 len: 1461 microversion: 2.1 time: 0.082147 Jun 04 21:04:10.253026 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1355/2816] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:10.267023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.269545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:10.272294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:10.280948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:10.283368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b02ddb5e-d420-4406-83e8-de4c3d78c893 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1499 microversion: 2.1 time: 0.229583 Jun 04 21:04:10.284061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:10.284646 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1462/2817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1499 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:10.286447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:10.286949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:10.508964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:10.520033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c63dee02-b46c-4e65-9e42-a5aa6181c5d1 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1466 microversion: 2.1 time: 0.263521 Jun 04 21:04:10.520608 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1356/2818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1466 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:10.539116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-18f3f62a-defd-4233-a770-4b29e8350265 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014f8b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.677787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-18f3f62a-defd-4233-a770-4b29e8350265 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?changes-since=2022-06-04T21%3A02%3A15Z" status: 200 len: 1902 microversion: 2.1 time: 0.143198 Jun 04 21:04:10.688546 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1463/2819] 10.222.0.18 () {58 vars in 1198 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/images?changes-since=2022-06-04T21%3A02%3A15Z => generated 1902 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:10.692617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aa55e9cc-48f2-4501-9dd1-a145e61d1082 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01699f70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.749465 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aa55e9cc-48f2-4501-9dd1-a145e61d1082 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-623408605" status: 200 len: 484 microversion: 2.1 time: 0.061483 Jun 04 21:04:10.750285 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1357/2820] 10.222.0.18 () {58 vars in 1228 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-623408605 => generated 484 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:04:10.762406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d7da6c8-d63f-4551-ab23-eef979c62a14 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014bd820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.861695 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d7da6c8-d63f-4551-ab23-eef979c62a14 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?server=57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 956 microversion: 2.1 time: 0.103041 Jun 04 21:04:10.862668 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1464/2821] 10.222.0.18 () {58 vars in 1208 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/images?server=57221890-ecf1-4c86-913f-d00bce671204 => generated 956 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:10.875204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00ec0eab-e224-457a-80cf-a8cbe1d26b51 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0214e0d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.887742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:10.889772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:10.899777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:10.900955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:10.901984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:10.902736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:10.940644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00ec0eab-e224-457a-80cf-a8cbe1d26b51 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 485 microversion: 2.1 time: 0.069315 Jun 04 21:04:10.947214 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1358/2822] 10.222.0.18 () {58 vars in 1316 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 485 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:10.952588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bc77700a-ed70-4b76-be1f-55c4afcf33cb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01699280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.020093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bc77700a-ed70-4b76-be1f-55c4afcf33cb tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 485 microversion: 2.1 time: 0.071370 Jun 04 21:04:11.020876 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1359/2823] 10.222.0.18 () {58 vars in 1302 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 485 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:11.045129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.047234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:11.062079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:11.062728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:11.063891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:11.064076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:11.064683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:11.075951 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70b4fa27-691a-4105-a863-24399cb2137f tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.196131 Jun 04 21:04:11.077372 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1465/2824] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:10 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.093262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-422d271c-5684-408a-8af3-701d3d995806 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014e4280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.244474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:11.252767 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74a0414a-4680-4077-9a37-a1fa23cd45b6 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.228626 Jun 04 21:04:11.252992 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-422d271c-5684-408a-8af3-701d3d995806 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.174101 Jun 04 21:04:11.253428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1360/2825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.263674 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1466/2826] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.276908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.277389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-390e2f68-d65e-466f-8a15-f5d1b666ae20 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0152f280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.277795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:11.294075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:11.295292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:11.297520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:11.298772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:11.366381 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-390e2f68-d65e-466f-8a15-f5d1b666ae20 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.092794 Jun 04 21:04:11.367286 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1467/2827] 10.222.0.18 () {58 vars in 1148 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.374127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.375048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:11.382618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:11.384124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:11.385958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:11.386922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:11.543213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:11.554380 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dac00470-1381-477c-bedf-9919636a7fe3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.299754 Jun 04 21:04:11.555817 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1361/2828] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.561894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19cc4f7c-ff21-445b-9718-c6b3bf19ea35 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01687280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.590650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:11.610644 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79ffeb6b-3688-4bbe-b423-91b7b7e59c85 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1505 microversion: 2.1 time: 0.242057 Jun 04 21:04:11.611862 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1468/2829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.637212 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19cc4f7c-ff21-445b-9718-c6b3bf19ea35 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.079895 Jun 04 21:04:11.638102 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1362/2830] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:11.651392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c779ded9-42af-4fe9-9628-a809d7840a64 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014fca60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.743443 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c779ded9-42af-4fe9-9628-a809d7840a64 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?changes-since=2022-06-04T21%3A02%3A05Z" status: 200 len: 6326 microversion: 2.1 time: 0.096954 Jun 04 21:04:11.744132 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1469/2831] 10.222.0.18 () {58 vars in 1219 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images/detail?changes-since=2022-06-04T21%3A02%3A05Z => generated 6326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:11.766495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8a2b942-7c1b-4191-90d5-61f118ded245 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d016fcca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.817364 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8a2b942-7c1b-4191-90d5-61f118ded245 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-623408605" status: 200 len: 664 microversion: 2.1 time: 0.056963 Jun 04 21:04:11.818255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1363/2832] 10.222.0.18 () {58 vars in 1249 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-623408605 => generated 664 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:11.832626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-916cf5eb-1397-4020-a90e-1835991bd88a tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d0152f310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.902930 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-916cf5eb-1397-4020-a90e-1835991bd88a tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1465 microversion: 2.1 time: 0.074209 Jun 04 21:04:11.905041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1470/2833] 10.222.0.18 () {58 vars in 1337 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fv2.1%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1465 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:11.916856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62728ad3-6f74-4f8b-8faa-65322e061fe0 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d016fcf70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:11.992615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62728ad3-6f74-4f8b-8faa-65322e061fe0 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1465 microversion: 2.1 time: 0.079263 Jun 04 21:04:11.993376 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1364/2834] 10.222.0.18 () {58 vars in 1323 bytes} [Sat Jun 4 21:04:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.18%2Fcompute%2Fservers%2F4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1465 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:12.010305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d04fa1e7-e07e-41d6-84d3-71e2bf5876b5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014fca60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.094172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.094869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:12.107607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.109021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.111013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.112039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.119664 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d04fa1e7-e07e-41d6-84d3-71e2bf5876b5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.116437 Jun 04 21:04:12.120523 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1471/2835] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:12.136923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b485afc-493e-453a-8306-b007b0d370e8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014e4550>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.223385 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b485afc-493e-453a-8306-b007b0d370e8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.090503 Jun 04 21:04:12.224670 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1472/2836] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:12.239429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-923acfa7-1bdf-41cc-ac91-7565ae8f0a2d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014b9e50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.305672 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-923acfa7-1bdf-41cc-ac91-7565ae8f0a2d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/926a4015-c327-4be7-9086-5cce1a8e0ebf" status: 200 len: 784 microversion: 2.1 time: 0.062574 Jun 04 21:04:12.305672 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1473/2837] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/images/926a4015-c327-4be7-9086-5cce1a8e0ebf => generated 784 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:04:12.305672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.305944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:12.306058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:12.312849 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e0424e0-0721-408f-b34d-ec9a00e798dd tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.222741 Jun 04 21:04:12.313855 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1365/2838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:12.322823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.322823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.322823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.322823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.329892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3606e41-3007-477e-a960-df3862387299 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d02292040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.398951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3606e41-3007-477e-a960-df3862387299 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.074401 Jun 04 21:04:12.399739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1366/2839] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:12.413483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa5b0657-131f-4ff2-9966-2a0639e6fb55 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01699160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.487719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:12.497718 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d124c19f-6cd9-4c0c-8f08-5478b7f2d5ea tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.198977 Jun 04 21:04:12.500317 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1474/2840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:12.573879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.574717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:12.584840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.585688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.586873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.588264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.744497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:12.754913 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-28e3b962-7441-42e7-9d82-7d461a8d353c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.185848 Jun 04 21:04:12.767969 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1475/2841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:12.775036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:12.775873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:12.783655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.785268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.786880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:12.787794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:12.816213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:13.001798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:13.021129 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa24f52d-b7d0-4a13-b979-b3a749500641 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1505 microversion: 2.1 time: 0.251455 Jun 04 21:04:13.031971 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1476/2842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:12 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:13.333531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:13.334952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:13.344103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:13.344564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:13.345571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:13.345948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:13.427372 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa5b0657-131f-4ff2-9966-2a0639e6fb55 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f" status: 204 len: 0 microversion: 2.1 time: 1.018113 Jun 04 21:04:13.428087 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1367/2843] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:12 2022] DELETE /compute/v2.1/images/129b0c7b-98e7-496c-9571-d32bb7b0088f => generated 0 bytes in 1020 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:13.436839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf956261-0b96-4c19-bbed-317add4bfcf5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d016eb3a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:13.570098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:13.582620 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed946d42-1cda-4ad4-8863-781dd419dc11 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.255623 Jun 04 21:04:13.583661 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1477/2844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:13 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:13.588892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:13.589825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:13.605573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:13.606162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:13.608068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:13.609092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:13.793980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:13.804323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f41081e7-c1d5-42a4-bc74-38351a87a586 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.219306 Jun 04 21:04:13.805245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1478/2845] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:13 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:13.820878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:13.821515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:13.829277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:13.829815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:13.830623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:13.831166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:13.998533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:14.008359 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87d6834c-83f7-4359-afa3-f05164aca57d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1476 microversion: 2.1 time: 0.202005 Jun 04 21:04:14.009394 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1479/2846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:13 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:14.040062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:14.040681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:14.047117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:14.047603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:14.048610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:14.049023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:14.336934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:14.345740 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26998665-64b7-4d66-be9b-57e7c458003e tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1505 microversion: 2.1 time: 0.309134 Jun 04 21:04:14.358645 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1480/2847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:14 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:14.483964 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf956261-0b96-4c19-bbed-317add4bfcf5 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d" status: 204 len: 0 microversion: 2.1 time: 1.051463 Jun 04 21:04:14.485191 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1368/2848] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:13 2022] DELETE /compute/v2.1/images/a49d6c64-2299-411d-9025-206ecb11c99d => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:04:14.495710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5dd8f056-20d4-4b2e-994b-48ed1de76694 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01449160>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:14.601477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:14.602065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:14.621669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:14.622487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:14.623333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:14.623996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.059602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:15.108813 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e45e2fe4-8a97-4da4-bf12-9ff8cebbfca5 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.512144 Jun 04 21:04:15.115351 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1369/2849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:14 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:15.125191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:15.125818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:15.142800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.143163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.144054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.152308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.657677 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5dd8f056-20d4-4b2e-994b-48ed1de76694 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237" status: 204 len: 0 microversion: 2.1 time: 1.166342 Jun 04 21:04:15.659115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1481/2850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:14 2022] DELETE /compute/v2.1/images/3b3a361e-e357-45cf-9c2b-096b74aa8237 => generated 0 bytes in 1168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:15.664295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:15.665165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:15.674379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:15.687225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.688123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.692653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.696335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.708822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-11c03f92-0528-4f97-b164-2a02f8f859eb tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.590082 Jun 04 21:04:15.711092 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1370/2851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:15 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:15.727088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-66d7c44a-b04c-4691-bc30-a412dd93d496 req-886a1ac4-ae49-4e2c-bb5d-4c958251aab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "name": "network-vif-unplugged", "status": "completed", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:15.741721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-66d7c44a-b04c-4691-bc30-a412dd93d496 req-886a1ac4-ae49-4e2c-bb5d-4c958251aab4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.743262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-66d7c44a-b04c-4691-bc30-a412dd93d496 req-886a1ac4-ae49-4e2c-bb5d-4c958251aab4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.760785 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-66d7c44a-b04c-4691-bc30-a412dd93d496 req-886a1ac4-ae49-4e2c-bb5d-4c958251aab4 service nova] Creating event network-vif-unplugged:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:04:15.767399 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-66d7c44a-b04c-4691-bc30-a412dd93d496 req-886a1ac4-ae49-4e2c-bb5d-4c958251aab4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054375 Jun 04 21:04:15.768075 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1371/2852] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:15.783799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:15.785686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:15.792861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.793309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:15.794399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:15.794989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.204143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:16.217568 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9bad34d6-28d6-4ae8-90cd-06e87469a457 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1475 microversion: 2.1 time: 0.557067 Jun 04 21:04:16.218156 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1482/2853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:15 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1475 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:16.224121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:16.225133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:16.233253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.234886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.240706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.240706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.257069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:16.269597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:16.271318 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fbcb8040-623a-4462-9904-00c7319678ad tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1487 microversion: 2.1 time: 0.493073 Jun 04 21:04:16.272438 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1372/2854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:15 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1487 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:16.290161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:16.292569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:16.315333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.317234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.320512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.321742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.612278 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-03071b91-6c0b-447b-876f-878eb1d36ea8 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 204 len: 0 microversion: 2.1 time: 0.392091 Jun 04 21:04:16.615978 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1483/2855] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:16 2022] DELETE /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:16.626437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c80ec43d-e897-4bda-9cdf-5333e4bb815d req-f0982e07-0723-4333-9255-a42b6e8e5449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "name": "network-vif-unplugged", "status": "completed", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:16.643276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c80ec43d-e897-4bda-9cdf-5333e4bb815d req-f0982e07-0723-4333-9255-a42b6e8e5449 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.643952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c80ec43d-e897-4bda-9cdf-5333e4bb815d req-f0982e07-0723-4333-9255-a42b6e8e5449 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.664948 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c80ec43d-e897-4bda-9cdf-5333e4bb815d req-f0982e07-0723-4333-9255-a42b6e8e5449 service nova] Creating event network-vif-unplugged:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch2-master-1 Jun 04 21:04:16.675985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-c80ec43d-e897-4bda-9cdf-5333e4bb815d req-f0982e07-0723-4333-9255-a42b6e8e5449 service nova] Instance d977858e-2f09-4e0d-8854-7353ffe0f1db is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:04:16.688636 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c80ec43d-e897-4bda-9cdf-5333e4bb815d req-f0982e07-0723-4333-9255-a42b6e8e5449 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069228 Jun 04 21:04:16.689580 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1484/2856] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:16.697557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:16.698532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:16.707891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.708514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.709644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.710168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.739411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:16.745843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:16.748878 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b33f6c6-1c7b-4455-b7c8-8449de95a49d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.473961 Jun 04 21:04:16.755786 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1373/2857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:16 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:16.769832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:16.770677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:16.782150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.783107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:16.786932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:16.787873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.047570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:17.059658 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c2247e4-1577-45d0-ad73-747c6fd1e856 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1473 microversion: 2.1 time: 0.302358 Jun 04 21:04:17.061170 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1374/2858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:16 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1473 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:17.067502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:17.068495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:17.076380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.077226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.078417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.079433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.258780 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f0db4a6-13ca-4412-a4cb-14b3d10def68 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 204 len: 0 microversion: 2.1 time: 0.566902 Jun 04 21:04:17.259844 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1485/2859] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:16 2022] DELETE /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:17.327779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:17.342579 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6a951c4-993c-47de-9d72-57c5f97a8c85 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.279527 Jun 04 21:04:17.352364 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1375/2860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:17 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:17.357937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf739696-aa37-4fc3-b0bd-aab3f736e422 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d02292040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:17.384619 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bf739696-aa37-4fc3-b0bd-aab3f736e422 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Image not found. Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf739696-aa37-4fc3-b0bd-aab3f736e422 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea HTTP/1.1 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '465b5ae0-3230-4315-8401-a35623c6e6ea'} Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 465b5ae0-3230-4315-8401-a35623c6e6ea to delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 465b5ae0-3230-4315-8401-a35623c6e6ea could not be found. Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.387418 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:04:17.391924 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:17.393572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf739696-aa37-4fc3-b0bd-aab3f736e422 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:17.395371 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf739696-aa37-4fc3-b0bd-aab3f736e422 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea" status: 404 len: 62 microversion: 2.1 time: 0.041323 Jun 04 21:04:17.396146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1376/2861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:17 2022] DELETE /compute/v2.1/images/465b5ae0-3230-4315-8401-a35623c6e6ea => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:04:17.406965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:17.408529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:17.418710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.419687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.421822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.422513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.469147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:17.507381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:17.550523 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Instance is already in deleting state, ignoring this request Jun 04 21:04:17.551439 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0688c72f-fb62-46bd-be77-85227dc946c8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 204 len: 0 microversion: 2.1 time: 0.149178 Jun 04 21:04:17.552086 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1377/2862] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:17 2022] DELETE /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:17.560850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:17.561462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:17.569409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.569864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.570728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.571147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.676979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:17.678379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:17.693507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.694203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.695213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.695796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.816970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:17.834183 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9177b91a-dd29-4a17-a9c3-9a681e4f9763 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1493 microversion: 2.1 time: 0.277694 Jun 04 21:04:17.836757 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1378/2863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:17 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1493 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:17.852855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:17.853813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:17.862811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.863442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:17.864427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:17.865022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:18.391496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:18.401972 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-34301594-709b-4044-be94-51a73d5cb4b2 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1475 microversion: 2.1 time: 1.140485 Jun 04 21:04:18.403140 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1486/2864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:17 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1475 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:18.408212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0c757b6e-5462-44f4-b69b-704808e0f22f req-c6924618-3de2-45e5-82dc-d638cd2d580f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5359c2f7-4090-46eb-b645-1ba5f3d2637b", "name": "network-vif-plugged", "status": "completed", "tag": "19d0c7c3-6b0d-46bf-9e13-0d0798845f94"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:18.417613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c757b6e-5462-44f4-b69b-704808e0f22f req-c6924618-3de2-45e5-82dc-d638cd2d580f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:18.418254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c757b6e-5462-44f4-b69b-704808e0f22f req-c6924618-3de2-45e5-82dc-d638cd2d580f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:18.430874 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0c757b6e-5462-44f4-b69b-704808e0f22f req-c6924618-3de2-45e5-82dc-d638cd2d580f service nova] Creating event network-vif-plugged:19d0c7c3-6b0d-46bf-9e13-0d0798845f94 for instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b on nch1-master-1 Jun 04 21:04:18.436745 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0c757b6e-5462-44f4-b69b-704808e0f22f req-c6924618-3de2-45e5-82dc-d638cd2d580f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032044 Jun 04 21:04:18.437591 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1487/2865] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:18.444286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:18.445313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:18.452561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:18.453224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:18.454346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:18.454941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:18.668113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:18.676611 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e607f73-dbb4-494e-92ea-55b7b3c1a278 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.828285 Jun 04 21:04:18.686870 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1379/2866] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:17 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:18.691853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:18.692510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:18.713015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:18.713591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:18.714568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:18.715124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:18.981943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:19.006161 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d260a23b-c65b-4e79-92d6-530258e5e18c tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1473 microversion: 2.1 time: 0.567200 Jun 04 21:04:19.007267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1488/2867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:18 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:19.012052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f8646241-9a29-4acb-8f97-d784dc5612e9 req-f65539ea-ccd6-496a-9eac-f5cafb441e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:19.027403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f8646241-9a29-4acb-8f97-d784dc5612e9 req-f65539ea-ccd6-496a-9eac-f5cafb441e90 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.027905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f8646241-9a29-4acb-8f97-d784dc5612e9 req-f65539ea-ccd6-496a-9eac-f5cafb441e90 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:19.065082 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f8646241-9a29-4acb-8f97-d784dc5612e9 req-f65539ea-ccd6-496a-9eac-f5cafb441e90 service nova] Creating event network-changed:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch2-master-1 Jun 04 21:04:19.069053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-f8646241-9a29-4acb-8f97-d784dc5612e9 req-f65539ea-ccd6-496a-9eac-f5cafb441e90 service nova] Instance d977858e-2f09-4e0d-8854-7353ffe0f1db is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:04:19.081967 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f8646241-9a29-4acb-8f97-d784dc5612e9 req-f65539ea-ccd6-496a-9eac-f5cafb441e90 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073024 Jun 04 21:04:19.082657 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1489/2868] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:19.088277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:19.089201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:19.097259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.097778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:19.098540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.098977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:19.295039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:19.305118 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66a4a04f-3947-414f-9de8-4868f0a6cef3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1511 microversion: 2.1 time: 0.621291 Jun 04 21:04:19.314570 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1380/2869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:18 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1511 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:19.420618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:19.421436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:19.431083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.431653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:19.432916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.433552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:19.741002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:19.757982 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66fe52a1-4200-41ce-9b26-634d80b948d3 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1493 microversion: 2.1 time: 0.673673 Jun 04 21:04:19.758874 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1490/2870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:19 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1493 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:19.763949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:19.764572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:19.777785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.778644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:19.787454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:19.787988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.202753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:20.211808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-15a51c47-b1a5-42e2-bb36-5337c968fd69 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1475 microversion: 2.1 time: 0.796233 Jun 04 21:04:20.222206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1381/2871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:19 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1475 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:20.227675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:20.228662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:20.235795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.236752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.238030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.238771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.423764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:20.448304 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-45025453-2e31-4bba-8568-1b4a922be0b3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1431 microversion: 2.1 time: 0.223664 Jun 04 21:04:20.451200 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1382/2872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:20 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1431 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:20.457865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:20.465954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:20.466916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:20.475420 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d3a97505-9bf5-461f-9a2b-6725bffdd503 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.713484 Jun 04 21:04:20.477309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.478244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.479608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.480559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.485251 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1491/2873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:19 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:20.499487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-76508916-ecfe-48b1-a818-ce62cf3fb4ec req-a9ff4bca-fe3d-44e9-9a6f-72c04462394c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5359c2f7-4090-46eb-b645-1ba5f3d2637b", "name": "network-vif-unplugged", "status": "completed", "tag": "19d0c7c3-6b0d-46bf-9e13-0d0798845f94"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:20.526552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-76508916-ecfe-48b1-a818-ce62cf3fb4ec req-a9ff4bca-fe3d-44e9-9a6f-72c04462394c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.529945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-76508916-ecfe-48b1-a818-ce62cf3fb4ec req-a9ff4bca-fe3d-44e9-9a6f-72c04462394c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.560229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:20.564516 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-76508916-ecfe-48b1-a818-ce62cf3fb4ec req-a9ff4bca-fe3d-44e9-9a6f-72c04462394c service nova] Creating event network-vif-unplugged:19d0c7c3-6b0d-46bf-9e13-0d0798845f94 for instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b on nch1-master-1 Jun 04 21:04:20.588041 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-76508916-ecfe-48b1-a818-ce62cf3fb4ec req-a9ff4bca-fe3d-44e9-9a6f-72c04462394c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098763 Jun 04 21:04:20.590693 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1492/2874] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:20.778479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:20.779384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:20.790626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.794304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:20.795286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:20.797722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.570533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:21.582380 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-123ee416-bcbf-4597-8063-78ba01bae99e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1488 microversion: 2.1 time: 1.129680 Jun 04 21:04:21.583987 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1383/2875] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:20 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1488 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:21.589405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:21.590020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:21.597627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.598335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.599130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.599668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.724768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:21.735552 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ec21999-ebd1-4884-b62e-fe20a7e7fa1d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1493 microversion: 2.1 time: 0.962662 Jun 04 21:04:21.736630 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1493/2876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:20 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1493 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:21.753460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c3024e3d-1558-4852-8d40-2287ac945fc9 req-1b922204-df79-4dd6-89e5-43bec2a4f59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eea574d-d0ab-4cc1-b9a5-28aafce58c36", "name": "network-vif-deleted", "tag": "18069fc6-417f-4f52-bfea-398d71316731"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:21.765206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c3024e3d-1558-4852-8d40-2287ac945fc9 req-1b922204-df79-4dd6-89e5-43bec2a4f59a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.766341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c3024e3d-1558-4852-8d40-2287ac945fc9 req-1b922204-df79-4dd6-89e5-43bec2a4f59a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.783494 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c3024e3d-1558-4852-8d40-2287ac945fc9 req-1b922204-df79-4dd6-89e5-43bec2a4f59a service nova] Creating event network-vif-deleted:18069fc6-417f-4f52-bfea-398d71316731 for instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 on nch2-master-1 Jun 04 21:04:21.789785 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c3024e3d-1558-4852-8d40-2287ac945fc9 req-1b922204-df79-4dd6-89e5-43bec2a4f59a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042774 Jun 04 21:04:21.790559 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1494/2877] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:21.796122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:21.797220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:21.807049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.807590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.808406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.809003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.958262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:21.972776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dae64816-2848-4b50-b292-2f71c79905a9 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1431 microversion: 2.1 time: 0.180766 Jun 04 21:04:21.975188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1495/2878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:21 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1431 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:21.982862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:21.984515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:21.993927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.995584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:21.996941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:21.998760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.018880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:22.030888 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f71ead6a-1bb3-4704-a71c-80e50761d266 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1473 microversion: 2.1 time: 0.445415 Jun 04 21:04:22.042393 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1384/2879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:21 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1473 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:22.048942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:22.050038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:22.057948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.058432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.059340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.059867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.093614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:22.194887 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c0709bd-e31c-409a-b56c-5546a9982a8d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 204 len: 0 microversion: 2.1 time: 0.150658 Jun 04 21:04:22.195911 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1385/2880] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:22 2022] DELETE /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:22.205910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:22.206812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:22.213253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.213704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.214542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.215197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.421208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:22.430008 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-399f14ad-c1c6-4018-8d4b-96d6ccde58e7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.453349 Jun 04 21:04:22.431078 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1496/2881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:21 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:22.498359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:22.508817 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed9b1361-01d2-49c7-beba-de0148d304d0 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1494 microversion: 2.1 time: 0.307149 Jun 04 21:04:22.509792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1386/2882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:22 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1494 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:22.754002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:22.755452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:22.762428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.763203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.764409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.765553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.806823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:22.807719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:22.808335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lazy-loading 'fault' on Instance uuid 5359c2f7-4090-46eb-b645-1ba5f3d2637b {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:04:22.868018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:22.877782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cbc1dd8d-c4a9-4e2b-9dbd-06c68efa3a5c tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1297 microversion: 2.1 time: 0.128072 Jun 04 21:04:22.879140 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1497/2883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:22 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:22.992020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:22.992831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:23.011306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.011839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.014113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.015271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.054729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:23.058038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:23.067907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.068862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.069510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lazy-loading 'fault' on Instance uuid 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:04:23.069779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.070763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.072070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.072623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.142390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:23.161036 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38f884c2-28f7-406f-a74b-a66a26a760f3 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 200 len: 1307 microversion: 2.1 time: 0.173653 Jun 04 21:04:23.161955 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1387/2884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:22 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:23.354663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:23.363612 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20e13de0-e9d1-48bc-86d4-0d980366f530 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1473 microversion: 2.1 time: 0.317469 Jun 04 21:04:23.364416 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1498/2885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:23 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:23.448352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:23.448976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:23.468585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.474028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.476016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.476958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.526864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:23.527532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:23.538636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.539527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.540550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.541659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.827682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:23.837764 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc2e63d5-a938-4933-9a06-309f6b18807e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.393222 Jun 04 21:04:23.848166 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1388/2886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:23 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:23.853818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0e57e736-7c0a-4e90-a40e-06525f6a8a0d req-b8e67c2b-6468-4c9b-a51d-8174f025626e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5359c2f7-4090-46eb-b645-1ba5f3d2637b", "name": "network-vif-deleted", "tag": "19d0c7c3-6b0d-46bf-9e13-0d0798845f94"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:23.863643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0e57e736-7c0a-4e90-a40e-06525f6a8a0d req-b8e67c2b-6468-4c9b-a51d-8174f025626e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.864289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0e57e736-7c0a-4e90-a40e-06525f6a8a0d req-b8e67c2b-6468-4c9b-a51d-8174f025626e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.877216 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0e57e736-7c0a-4e90-a40e-06525f6a8a0d req-b8e67c2b-6468-4c9b-a51d-8174f025626e service nova] Creating event network-vif-deleted:19d0c7c3-6b0d-46bf-9e13-0d0798845f94 for instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b on nch1-master-1 Jun 04 21:04:23.883193 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0e57e736-7c0a-4e90-a40e-06525f6a8a0d req-b8e67c2b-6468-4c9b-a51d-8174f025626e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033383 Jun 04 21:04:23.884458 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1389/2887] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:23.894013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:23.899976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:23.900706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:23.915067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.915815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.916616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.918258 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d8ea785a-c07c-4ce3-9717-da83a490bfa2 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1494 microversion: 2.1 time: 0.395192 Jun 04 21:04:23.918968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.930667 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1499/2888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:23 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1494 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:23.990660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:23.990922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:23.992386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lazy-loading 'fault' on Instance uuid 5359c2f7-4090-46eb-b645-1ba5f3d2637b {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:04:24.102676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96f5288364449e3af2f39c71a8c3ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0cebb51402146e693490f681342be4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:24.114702 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d283234f-6976-4dac-9c85-ecb787b4d056 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 200 len: 1297 microversion: 2.1 time: 0.221843 Jun 04 21:04:24.115640 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1390/2889] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:23 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 1297 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:24.179543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:24.180214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 4eea574d-d0ab-4cc1-b9a5-28aafce58c36] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:24.191843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.193953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.195445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.197232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.221848 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] HTTP exception thrown: Instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 could not be found. Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Request method failure captured: Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 HTTP/1.1 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hM_52nwjb1TMEK3bkwwEUT0waPt2JuVhRjUCd75-HhxFb0w64bVMw_srKKHItmOzI8dZy87BBbFZEHx-VWgrkZlA4VVgNMK-YAKQi1_0SoY_Belz7cKjZWlljifHPiyU_YR6u7AxuDUF3Nw2bbtt1TPIc37E_ObeeajuT3hR711NM Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6b1dd7943ab249e6bf2156b54b4c3a20 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListImageFiltersTestJSON-451408587 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListImageFiltersTestJSON-451408587 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6b1dd7943ab249e6bf2156b54b4c3a20 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-451408587 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListImageFiltersTestJSON-451408587-project Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 61a665da0b8f4dcd8c39570a49b62449 Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListImageFiltersTestJSON-451408587-project Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 could not be found. Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '4eea574d-d0ab-4cc1-b9a5-28aafce58c36'} Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 could not be found. Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 could not be found. Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:24.224020 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 could not be found. Jun 04 21:04:24.229506 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:24.230851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Returning 404 to user: Instance 4eea574d-d0ab-4cc1-b9a5-28aafce58c36 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:24.232026 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-646e8d53-5241-4747-8975-ebb67c8569e6 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36" status: 404 len: 111 microversion: 2.1 time: 0.057135 Jun 04 21:04:24.240143 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1500/2890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:24 2022] GET /compute/v2.1/servers/4eea574d-d0ab-4cc1-b9a5-28aafce58c36 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:24.251469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:24.255022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:24.295148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.295631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.298347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.298347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.330989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:24.370531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:24.393910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:24.395052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:24.406890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.407905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.409687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.410505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.453079 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c87259f9-b9d1-4f1e-8e57-67dbe8a7251f tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 204 len: 0 microversion: 2.1 time: 0.212702 Jun 04 21:04:24.458303 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1391/2891] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:24 2022] DELETE /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:24.469877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:24.471009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:24.478446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.478993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.480045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.480557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.761625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:24.770755 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fdf9b1dc-8d43-4ff1-9a91-2c396bbda513 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1470 microversion: 2.1 time: 0.385321 Jun 04 21:04:24.771855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1501/2892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:24 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:24.783130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:24.790887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:24.791607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:24.808127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.808581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.809373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.809814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.816662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-611f0240-450b-4f86-853e-a2a86350bdaa tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1472 microversion: 2.1 time: 0.350267 Jun 04 21:04:24.828188 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1392/2893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:24 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:24.855963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:24.856581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:24.880253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.881464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:24.882282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:24.882721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.101969 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-40a216b6-49ff-4c15-b755-d7564a68d186 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "POST /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db/action" status: 202 len: 0 microversion: 2.1 time: 0.309926 Jun 04 21:04:25.104373 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1502/2894] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:24 2022] POST /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:04:25.110913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:25.116224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.116955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.122143 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1c84af6-7774-4d7a-b997-361264311581 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1522 microversion: 2.1 time: 0.270255 Jun 04 21:04:25.122743 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1393/2895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:24 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:25.135757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.136703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.144752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.147188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.150979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.152054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.152333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.153357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.154845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.155903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.244726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.246265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.247839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'fault' on Instance uuid b10d229b-8dab-4cce-ae2d-1524e56a3ddd {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:04:25.335947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:25.350538 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-054af96a-022d-4ddf-a54c-eb0d584334b3 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 200 len: 1304 microversion: 2.1 time: 0.239796 Jun 04 21:04:25.366811 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1503/2896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 1304 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:25.374858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.378443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 5359c2f7-4090-46eb-b645-1ba5f3d2637b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.389036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:25.389628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.390310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.391366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.393141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.406628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da0f789b-3f26-4511-89c0-4604d01c1807 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 0.276989 Jun 04 21:04:25.407232 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1394/2897] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:25.411470 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b could not be found. Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b HTTP/1.1 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b could not be found. Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '5359c2f7-4090-46eb-b645-1ba5f3d2637b'} Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b could not be found. Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b could not be found. Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.413189 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b could not be found. Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance 5359c2f7-4090-46eb-b645-1ba5f3d2637b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-44d57d3b-3ec3-40a9-915e-06d45c77f6c1 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b" status: 404 len: 111 microversion: 2.1 time: 0.046704 Jun 04 21:04:25.417374 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1504/2898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/5359c2f7-4090-46eb-b645-1ba5f3d2637b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:25.424848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79222dc5-8b0d-4e57-8c3a-b5fb2501ab6d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d016fce50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.468021 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-79222dc5-8b0d-4e57-8c3a-b5fb2501ab6d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Image not found. Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79222dc5-8b0d-4e57-8c3a-b5fb2501ab6d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d HTTP/1.1 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e8144fcc-be75-40f9-a89a-997f3ea3d59d'} Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8144fcc-be75-40f9-a89a-997f3ea3d59d to delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8144fcc-be75-40f9-a89a-997f3ea3d59d could not be found. Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.469907 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79222dc5-8b0d-4e57-8c3a-b5fb2501ab6d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79222dc5-8b0d-4e57-8c3a-b5fb2501ab6d tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d" status: 404 len: 62 microversion: 2.1 time: 0.050461 Jun 04 21:04:25.476248 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1395/2899] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] DELETE /compute/v2.1/images/e8144fcc-be75-40f9-a89a-997f3ea3d59d => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:04:25.484901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.485757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.496170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.496850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.498059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.498812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.527186 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a HTTP/1.1 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f2c98705-74f6-42a6-b0ac-ebe0a3ee932a'} Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.529037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.532890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.535180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.536594 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f3435e9-2fae-460e-b17a-bf3e8ed20e62 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 404 len: 111 microversion: 2.1 time: 0.059339 Jun 04 21:04:25.545158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.546117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: f2c98705-74f6-42a6-b0ac-ebe0a3ee932a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.552672 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1505/2900] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:25 2022] DELETE /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:04:25.554799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.555612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.556647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.557298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.584707 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a HTTP/1.1 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f2c98705-74f6-42a6-b0ac-ebe0a3ee932a'} Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.586615 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance f2c98705-74f6-42a6-b0ac-ebe0a3ee932a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.593258 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ceade503-7030-465b-99cd-e63099b42bec tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a" status: 404 len: 111 microversion: 2.1 time: 0.050423 Jun 04 21:04:25.595403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1396/2901] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/f2c98705-74f6-42a6-b0ac-ebe0a3ee932a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:25.602569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce07e4fd-0a88-4324-9ff7-b29c53dcd3d0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0152fe50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.642868 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-ce07e4fd-0a88-4324-9ff7-b29c53dcd3d0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Image not found. Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce07e4fd-0a88-4324-9ff7-b29c53dcd3d0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe HTTP/1.1 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e5ba3662-5383-469d-8941-3d05d4338ffe'} Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e5ba3662-5383-469d-8941-3d05d4338ffe to delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5ba3662-5383-469d-8941-3d05d4338ffe could not be found. Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.645113 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce07e4fd-0a88-4324-9ff7-b29c53dcd3d0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.650590 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce07e4fd-0a88-4324-9ff7-b29c53dcd3d0 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe" status: 404 len: 62 microversion: 2.1 time: 0.049339 Jun 04 21:04:25.656704 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1506/2902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] DELETE /compute/v2.1/images/e5ba3662-5383-469d-8941-3d05d4338ffe => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:04:25.657727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.658240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.670653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.671125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.673170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.675392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.708161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a HTTP/1.1 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '328b885a-2830-40c9-8726-53e1d9288a4a'} Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.711098 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.715558 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.721811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.723024 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ed98f28-c2e7-4c57-ae64-e64661fb4831 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 404 len: 111 microversion: 2.1 time: 0.070431 Jun 04 21:04:25.724206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1397/2903] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:25 2022] DELETE /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:04:25.733102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.734031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 328b885a-2830-40c9-8726-53e1d9288a4a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.737489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:25.749131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.753440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.756107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.756562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.786617 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a HTTP/1.1 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '328b885a-2830-40c9-8726-53e1d9288a4a'} Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.788630 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance 328b885a-2830-40c9-8726-53e1d9288a4a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e465ef5f-69b3-4f7a-9827-3d7882756032 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a" status: 404 len: 111 microversion: 2.1 time: 0.061700 Jun 04 21:04:25.793912 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1507/2904] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/328b885a-2830-40c9-8726-53e1d9288a4a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:25.801393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf456866-34ab-4ebe-aad0-afe2bedb17d8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '.version_select at 0x7f2d0167c1f0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.831202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bf456866-34ab-4ebe-aad0-afe2bedb17d8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Image not found. Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf456866-34ab-4ebe-aad0-afe2bedb17d8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 HTTP/1.1 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: exception: Image not found. Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f511423f-707d-459c-9569-7650aae62f05'} Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f511423f-707d-459c-9569-7650aae62f05 to delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f511423f-707d-459c-9569-7650aae62f05 could not be found. Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.833708 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf456866-34ab-4ebe-aad0-afe2bedb17d8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Image not found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf456866-34ab-4ebe-aad0-afe2bedb17d8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05" status: 404 len: 62 microversion: 2.1 time: 0.038743 Jun 04 21:04:25.838926 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1398/2905] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] DELETE /compute/v2.1/images/f511423f-707d-459c-9569-7650aae62f05 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:04:25.842493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.842493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.848685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.849145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.850092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.850208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.850539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.850649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.863789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.864041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.865055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.865780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.882003 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 HTTP/1.1 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '3220a33d-d40a-40ba-9569-27179eeb3979'} Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.883994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.887814 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.890418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.891328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f26df120-856a-4153-aedb-67a188b29db8 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 404 len: 111 microversion: 2.1 time: 0.049177 Jun 04 21:04:25.895722 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1399/2906] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:25 2022] DELETE /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:25.906132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:25.906759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] [instance: 3220a33d-d40a-40ba-9569-27179eeb3979] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:25.913818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.914354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.915544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.915930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.932039 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] HTTP exception thrown: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Request method failure captured: Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 HTTP/1.1 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gAbdB7XI0FjIKDYnHKU5tJwG3zID4bHv2RwU6Q6BhsZRL1wxbiH2WdeCB64vQsQ3jNUtRQs3SHIYb71-6QMDhKeRu0OlBae5h2_noLIOaMI134W46kx5wFLuwG3i7a3r2aQ9aT0h-NyWlQtScXLOxuPSb1N_I4l0oIcroyu3PYdg8 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b0cebb51402146e693490f681342be4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b0cebb51402146e693490f681342be4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b0cebb51402146e693490f681342be4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b0cebb51402146e693490f681342be4f Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ImagesTestJSON-1537506522 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96f5288364449e3af2f39c71a8c3ef2 Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ImagesTestJSON-1537506522-project Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '3220a33d-d40a-40ba-9569-27179eeb3979'} Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.933745 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:25.939247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] Returning 404 to user: Instance 3220a33d-d40a-40ba-9569-27179eeb3979 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:25.940023 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3f0880bd-aec2-489f-927a-70bd71e3b419 tempest-ImagesTestJSON-1537506522 tempest-ImagesTestJSON-1537506522-project] 10.222.0.18 "GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979" status: 404 len: 111 microversion: 2.1 time: 0.038015 Jun 04 21:04:25.940600 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1400/2907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/3220a33d-d40a-40ba-9569-27179eeb3979 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:04:25.946193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-126f1c8f-d75e-4080-951e-16e5516b2923 req-19d293fa-9a22-49de-b071-cffe45a66d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b10d229b-8dab-4cce-ae2d-1524e56a3ddd", "name": "network-vif-deleted", "tag": "edd2ce05-aeb9-4bd3-bc82-7c47f1fab610"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:25.956786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-126f1c8f-d75e-4080-951e-16e5516b2923 req-19d293fa-9a22-49de-b071-cffe45a66d25 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:25.957745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-126f1c8f-d75e-4080-951e-16e5516b2923 req-19d293fa-9a22-49de-b071-cffe45a66d25 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:25.973812 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-126f1c8f-d75e-4080-951e-16e5516b2923 req-19d293fa-9a22-49de-b071-cffe45a66d25 service nova] Creating event network-vif-deleted:edd2ce05-aeb9-4bd3-bc82-7c47f1fab610 for instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd on nch1-master-1 Jun 04 21:04:25.989411 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-126f1c8f-d75e-4080-951e-16e5516b2923 req-19d293fa-9a22-49de-b071-cffe45a66d25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046999 Jun 04 21:04:25.990041 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1401/2908] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:26.046524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:26.059850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2f026ce-d428-4477-8083-b71ddcaf2d41 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1472 microversion: 2.1 time: 0.225138 Jun 04 21:04:26.063014 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1508/2909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:25 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:26.147420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:26.150020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:26.179149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:26.180905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:26.183284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:26.184009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:26.370060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:26.370544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:26.385886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:26.386472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:26.387433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:26.387907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:26.435348 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd HTTP/1.1 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b10d229b-8dab-4cce-ae2d-1524e56a3ddd'} Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:26.436972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:26.441268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:26.442759 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0dd63dc0-958c-4896-ac99-1e5564bbb18c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 404 len: 111 microversion: 2.1 time: 0.073524 Jun 04 21:04:26.459113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1509/2910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:26 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:26.464196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:26.464829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:26.472794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:26.473246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:26.474295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:26.475997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:26.845254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:26.868625 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-abfbcef5-a0ad-47bc-a11c-27036993be17 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1502 microversion: 2.1 time: 0.729769 Jun 04 21:04:26.869943 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1402/2911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:26 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1502 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:26.907081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1079186674", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "3dbe467f-caa8-4157-8c4a-8633359f18b8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:27.017583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:27.035749 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b095bf8f-bc0c-4229-8963-4483492df969 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 0.566595 Jun 04 21:04:27.037723 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1510/2912] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:26 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:27.043464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c25f5e0f-1918-4b8a-a2d9-69c5f06d0d10 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'create', calling method: .version_select at 0x7f2d015283a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-851099436", "description": "tempest-description-1730704425"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:27.066641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] validate_networks() for [('3dbe467f-caa8-4157-8c4a-8633359f18b8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:04:28.074481 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c25f5e0f-1918-4b8a-a2d9-69c5f06d0d10 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.035335 Jun 04 21:04:28.075634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1511/2913] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:04:27 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:28.080334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:28.081231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:28.095775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.096422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.097439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.100539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.653527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:28.666796 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f11a790-e4fb-47e2-bd33-0ef95667ee7d tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1472 microversion: 2.1 time: 0.589113 Jun 04 21:04:28.668839 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1512/2914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:28 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1472 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:28.682716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2282d193-f33e-4ab8-8bbb-e3d5c505a76e req-c17838cc-344a-4d9e-a6a0-59ba7a59d7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "name": "network-vif-plugged", "status": "completed", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:28.710930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2282d193-f33e-4ab8-8bbb-e3d5c505a76e req-c17838cc-344a-4d9e-a6a0-59ba7a59d7f0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.712189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2282d193-f33e-4ab8-8bbb-e3d5c505a76e req-c17838cc-344a-4d9e-a6a0-59ba7a59d7f0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.728548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:28.744370 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2282d193-f33e-4ab8-8bbb-e3d5c505a76e req-c17838cc-344a-4d9e-a6a0-59ba7a59d7f0 service nova] Creating event network-vif-plugged:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch2-master-1 Jun 04 21:04:28.755567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-2282d193-f33e-4ab8-8bbb-e3d5c505a76e req-c17838cc-344a-4d9e-a6a0-59ba7a59d7f0 service nova] Instance d977858e-2f09-4e0d-8854-7353ffe0f1db is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:04:28.776756 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2282d193-f33e-4ab8-8bbb-e3d5c505a76e req-c17838cc-344a-4d9e-a6a0-59ba7a59d7f0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104911 Jun 04 21:04:28.778013 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1513/2915] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:28.786321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:28.787685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:28.802775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.803258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.806287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.806752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.834658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:04:28.837345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:04:28.839718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:04:28.841187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:04:28.842135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:04:28.856606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.857957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.859219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:28.859988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:28.938305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:04:28.956533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:28.961547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Getting quotas for user 21ae179d22a140f7a6ebccaeea7932db and project 41a6c9f3ddbf4fb48fc2d1272c612739. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:04:29.015701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:04:29.019277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:04:29.124024 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c63d6ef3-5927-49af-87d9-f4e9126c1095 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.248993 Jun 04 21:04:29.124715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:29.131381 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1403/2916] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:04:29.134923 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-583bca5c-bc48-4ba8-8a28-a6cf705fc770 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 0.353597 Jun 04 21:04:29.135616 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1514/2917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:28 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:29.140681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3589a004-21b2-4a9a-8f37-d5a8cecc31db req-144349df-b4bc-4a0c-a9db-3af9b39e071b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57221890-ecf1-4c86-913f-d00bce671204", "name": "network-vif-deleted", "tag": "78ee4d83-7c36-44b3-b41b-9ab4ed3fc612"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:29.159770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3589a004-21b2-4a9a-8f37-d5a8cecc31db req-144349df-b4bc-4a0c-a9db-3af9b39e071b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:29.160135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-851099436"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:29.161305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3589a004-21b2-4a9a-8f37-d5a8cecc31db req-144349df-b4bc-4a0c-a9db-3af9b39e071b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:29.162265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:29.179153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:29.180413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:29.181254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:29.181883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:29.184410 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3589a004-21b2-4a9a-8f37-d5a8cecc31db req-144349df-b4bc-4a0c-a9db-3af9b39e071b service nova] Creating event network-vif-deleted:78ee4d83-7c36-44b3-b41b-9ab4ed3fc612 for instance 57221890-ecf1-4c86-913f-d00bce671204 on nch2-master-1 Jun 04 21:04:29.193331 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3589a004-21b2-4a9a-8f37-d5a8cecc31db req-144349df-b4bc-4a0c-a9db-3af9b39e071b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054786 Jun 04 21:04:29.194665 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1515/2918] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:29.204042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be7ea57e-d2ce-4ef7-82d6-ea77bca0d718 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:29.205375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be7ea57e-d2ce-4ef7-82d6-ea77bca0d718 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:29.317966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be7ea57e-d2ce-4ef7-82d6-ea77bca0d718 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:29.334282 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be7ea57e-d2ce-4ef7-82d6-ea77bca0d718 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1215 microversion: 2.1 time: 0.138054 Jun 04 21:04:29.336810 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1516/2919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:29 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:29.488681 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Adding security group 793c0937-e1d0-41a3-83a3-a1cb7c35ea1a to port 88fde6d4-99a3-49cb-a71d-3ba74c8e29ad Jun 04 21:04:29.687121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:29.688192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:29.697546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:29.698244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:29.699374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:29.700139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:29.758905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:29.759375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:29.760112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lazy-loading 'fault' on Instance uuid 57221890-ecf1-4c86-913f-d00bce671204 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:04:29.828260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a665da0b8f4dcd8c39570a49b62449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b1dd7943ab249e6bf2156b54b4c3a20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:29.844070 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0420237e-0e10-447c-86f5-99b8a4aa4cdc tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 200 len: 1307 microversion: 2.1 time: 0.161650 Jun 04 21:04:29.845066 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1517/2920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:29 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:30.153664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:30.154598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:30.170605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.171070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.171905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.182180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.269432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ba97949b-8a27-4e7f-8df1-f9a226b912f3 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action" status: 202 len: 0 microversion: 2.1 time: 1.135490 Jun 04 21:04:30.271334 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1404/2921] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:29 2022] POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:04:30.284002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-851099436"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:30.284542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:30.312813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.317321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.319899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.321270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.563809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:30.577705 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-387fd8ac-2f71-4817-b940-e9f1db26315f tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 0.428326 Jun 04 21:04:30.578601 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1518/2922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:30 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:04:30.595733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:30.596770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:30.610344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.614616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.615721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.616365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.837139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:30.854040 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73f5311d-afb7-46af-9c56-996a05eff3e5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1267 microversion: 2.1 time: 0.270532 Jun 04 21:04:30.870890 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1519/2923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:30 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:30.887224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:30.889091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] [instance: 57221890-ecf1-4c86-913f-d00bce671204] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:30.896243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.898926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.901963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:30.902549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:30.958485 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Removing security group 793c0937-e1d0-41a3-83a3-a1cb7c35ea1a from port 88fde6d4-99a3-49cb-a71d-3ba74c8e29ad Jun 04 21:04:30.963081 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] HTTP exception thrown: Instance 57221890-ecf1-4c86-913f-d00bce671204 could not be found. Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Request method failure captured: Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 HTTP/1.1 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8hM_52nwjb1TMEK3bkwwEUT0waPt2JuVhRjUCd75-HhxFb0w64bVMw_srKKHItmOzI8dZy87BBbFZEHx-VWgrkZlA4VVgNMK-YAKQi1_0SoY_Belz7cKjZWlljifHPiyU_YR6u7AxuDUF3Nw2bbtt1TPIc37E_ObeeajuT3hR711NM Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6b1dd7943ab249e6bf2156b54b4c3a20 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListImageFiltersTestJSON-451408587 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6b1dd7943ab249e6bf2156b54b4c3a20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListImageFiltersTestJSON-451408587 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6b1dd7943ab249e6bf2156b54b4c3a20 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-451408587 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListImageFiltersTestJSON-451408587-project Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 61a665da0b8f4dcd8c39570a49b62449 Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListImageFiltersTestJSON-451408587-project Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 57221890-ecf1-4c86-913f-d00bce671204 could not be found. Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '57221890-ecf1-4c86-913f-d00bce671204'} Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57221890-ecf1-4c86-913f-d00bce671204 could not be found. Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57221890-ecf1-4c86-913f-d00bce671204 could not be found. Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:30.970855 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57221890-ecf1-4c86-913f-d00bce671204 could not be found. Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Returning 404 to user: Instance 57221890-ecf1-4c86-913f-d00bce671204 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:30.974917 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d3307a7c-099f-48b9-a829-c07fb5426e13 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204" status: 404 len: 111 microversion: 2.1 time: 0.099607 Jun 04 21:04:30.978947 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1520/2924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:30 2022] GET /compute/v2.1/servers/57221890-ecf1-4c86-913f-d00bce671204 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:30.998525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-755c173d-8aa7-4ccd-afd0-8edb8eda7a01 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d015ac040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:31.825862 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-755c173d-8aa7-4ccd-afd0-8edb8eda7a01 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/images/64b0a352-345e-442d-acfa-95106d5fec42" status: 204 len: 0 microversion: 2.1 time: 0.845496 Jun 04 21:04:31.826533 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1521/2925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:30 2022] DELETE /compute/v2.1/images/64b0a352-345e-442d-acfa-95106d5fec42 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:31.834401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-7bebac5d-c1e6-4983-bb37-8a628e5940fc req-e1e0e160-4b19-4a58-94de-3eaf60e2d195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:31.860168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7bebac5d-c1e6-4983-bb37-8a628e5940fc req-e1e0e160-4b19-4a58-94de-3eaf60e2d195 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:31.860981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7bebac5d-c1e6-4983-bb37-8a628e5940fc req-e1e0e160-4b19-4a58-94de-3eaf60e2d195 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:31.883781 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-7bebac5d-c1e6-4983-bb37-8a628e5940fc req-e1e0e160-4b19-4a58-94de-3eaf60e2d195 service nova] Creating event network-changed:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:04:31.897618 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-7bebac5d-c1e6-4983-bb37-8a628e5940fc req-e1e0e160-4b19-4a58-94de-3eaf60e2d195 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066477 Jun 04 21:04:31.898645 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1522/2926] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:31.910813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:31.911887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:31.922973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:31.924862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:31.926250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:31.930257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:32.665494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:32.673701 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8b7e8a5a-6011-4649-9ff2-b853b3212451 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 0.772765 Jun 04 21:04:32.674337 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1523/2927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:31 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:32.690614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8133123-95c8-4ee0-aeae-8c30211e6c29 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d014ff940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:33.361597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d8133123-95c8-4ee0-aeae-8c30211e6c29 tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/images/a6351c7e-8933-4e7c-8c8d-751f5e045bbe" status: 204 len: 0 microversion: 2.1 time: 0.671838 Jun 04 21:04:33.361597 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1524/2928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:32 2022] DELETE /compute/v2.1/images/a6351c7e-8933-4e7c-8c8d-751f5e045bbe => generated 0 bytes in 675 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:33.369951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:33.370970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:33.385257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:33.386970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:33.396677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:33.398207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:33.620484 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3b3447e0-4717-4e00-ab34-281ae0fec02a tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action" status: 202 len: 0 microversion: 2.1 time: 3.343909 Jun 04 21:04:33.621055 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1405/2929] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:30 2022] POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action => generated 0 bytes in 3346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:04:33.626730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2340d05d-03e7-47fb-808b-21523e4b5e3e tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] Calling method '.version_select at 0x7f2d01605af0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:33.896741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:33.925060 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2566a8e9-a523-46cb-9e18-9f9a437af123 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1273 microversion: 2.1 time: 0.562109 Jun 04 21:04:33.943387 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1525/2930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:33 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1273 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:33.954037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7fb2920d-b5b4-4d80-ba81-c3037a21dec6 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'create', calling method: .version_select at 0x7f2d01528dc0>, body: {"pool": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:34.610129 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2340d05d-03e7-47fb-808b-21523e4b5e3e tempest-ListImageFiltersTestJSON-451408587 tempest-ListImageFiltersTestJSON-451408587-project] 10.222.0.18 "DELETE /compute/v2.1/images/4c31369a-328a-4c6e-85b6-fb8a3105186e" status: 204 len: 0 microversion: 2.1 time: 0.987983 Jun 04 21:04:34.610805 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1406/2931] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:33 2022] DELETE /compute/v2.1/images/4c31369a-328a-4c6e-85b6-fb8a3105186e => generated 0 bytes in 989 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:34.621256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:34.621918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:34.633463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:34.644791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:34.646948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:34.647557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:35.616601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:35.631006 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1538c8b4-41ba-4db8-867d-7ca54a15d6d3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 1.014974 Jun 04 21:04:35.632183 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1407/2932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:34 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:35.645171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-346f73fc-2833-46bb-9494-846be0d2171a req-c8304fd8-97a4-45e0-943f-4c1afa816f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:35.668679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-346f73fc-2833-46bb-9494-846be0d2171a req-c8304fd8-97a4-45e0-943f-4c1afa816f82 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:35.669434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-346f73fc-2833-46bb-9494-846be0d2171a req-c8304fd8-97a4-45e0-943f-4c1afa816f82 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:35.728307 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-346f73fc-2833-46bb-9494-846be0d2171a req-c8304fd8-97a4-45e0-943f-4c1afa816f82 service nova] Creating event network-changed:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:04:35.781458 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-346f73fc-2833-46bb-9494-846be0d2171a req-c8304fd8-97a4-45e0-943f-4c1afa816f82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144610 Jun 04 21:04:35.784006 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1408/2933] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:35.799793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:35.805528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:35.825189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:35.826013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:35.827047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:35.827775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:37.130258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:37.146676 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52f78a83-496d-497c-baaa-5a746469d4b7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1315 microversion: 2.1 time: 1.359948 Jun 04 21:04:37.151398 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1409/2934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:35 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:37.166896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:37.167548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:37.188377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:37.190352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:37.191501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:37.195112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:38.902548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:38.953639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:38.974428 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0f1d66f4-ee40-474b-a3f2-810270306dd0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 1.819575 Jun 04 21:04:38.975220 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1410/2935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:37 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:38.997655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:39.323286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:39.371233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01779ed1-245e-4108-a786-b07faa97abff tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Calling method '.version_select at 0x7f2d016154c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:39.389352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01779ed1-245e-4108-a786-b07faa97abff tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:39.389718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01779ed1-245e-4108-a786-b07faa97abff tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:39.390529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01779ed1-245e-4108-a786-b07faa97abff tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:39.392273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01779ed1-245e-4108-a786-b07faa97abff tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:39.418574 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01779ed1-245e-4108-a786-b07faa97abff tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] 10.222.0.18 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.441969 Jun 04 21:04:39.419785 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1411/2936] 10.222.0.18 () {58 vars in 1121 bytes} [Sat Jun 4 21:04:38 2022] GET /compute/v2.1/limits => generated 511 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:39.436753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:39.437410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:39.452194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:39.456279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:39.457646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:39.461920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:40.282479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:40.305489 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b65c65aa-729f-4be9-b78c-bf60de60e794 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1315 microversion: 2.1 time: 0.884295 Jun 04 21:04:40.306653 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1412/2937] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:39 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:40.314775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b4b23b74-2250-4464-bc55-2480da252393 req-96df9be6-0650-4114-946a-374e96f64b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "name": "network-vif-unplugged", "status": "completed", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:40.328777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b4b23b74-2250-4464-bc55-2480da252393 req-96df9be6-0650-4114-946a-374e96f64b98 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:40.330165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b4b23b74-2250-4464-bc55-2480da252393 req-96df9be6-0650-4114-946a-374e96f64b98 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:40.348802 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b4b23b74-2250-4464-bc55-2480da252393 req-96df9be6-0650-4114-946a-374e96f64b98 service nova] Creating event network-vif-unplugged:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch1-master-1 Jun 04 21:04:40.365695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-b4b23b74-2250-4464-bc55-2480da252393 req-96df9be6-0650-4114-946a-374e96f64b98 service nova] Instance d977858e-2f09-4e0d-8854-7353ffe0f1db is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:04:40.400394 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b4b23b74-2250-4464-bc55-2480da252393 req-96df9be6-0650-4114-946a-374e96f64b98 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092469 Jun 04 21:04:40.402139 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1413/2938] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:40.743998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66ce31bc-7bf4-4e4d-ab73-a8c0f8307b39 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Action: 'create', calling method: .version_select at 0x7f2d0169c790>, body: {"keypair": {"name": "tempest-keypair-1174903856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl6DoKaEiV9OkVrdANcrdFexPABiX71LY12RpwPGLVJ/wl8F2eI0JZe2PzpvWDuA5ZT1BQyC4lFl94T7GEaXS+t0wjUBS9LBPPhZ0o+H5JLsS84+ALyofpdG1uAc7LawA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:40.798627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-66ce31bc-7bf4-4e4d-ab73-a8c0f8307b39 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Getting quotas for project 5c275250b53146a2a6fbd1c15b484560. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:04:40.807259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-66ce31bc-7bf4-4e4d-ab73-a8c0f8307b39 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Getting quotas for user 82f7fda07c394cce95c6f317ad334d68 and project 5c275250b53146a2a6fbd1c15b484560. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:04:40.875296 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66ce31bc-7bf4-4e4d-ab73-a8c0f8307b39 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.469997 Jun 04 21:04:40.877211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1414/2939] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:04:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:40.885698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1797665368", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:40.977160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:04:42.147125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Getting quotas for project 14a59186aa064bcdb8e7551ce8fbb5ac. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:04:42.156659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Getting quotas for user d1efc5e8e97143a0810a7960aadd04bd and project 14a59186aa064bcdb8e7551ce8fbb5ac. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:04:42.172823 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Request method failure captured: Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 1752 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8jl9HsUfbnzUpLfQja4BTCxlLKBg2c0mGrQyU88Otc-Bo_Wnc_tmOwT7h9aSfWhLIKnub3hPbaApnYeOn_xLB-bZoS_lLDJZqujtkYsXq8KfcUZJCsy2uhUQnd5-_4_a7j-JPXakFqaCF6G-D3AVtyphnCfrzKYEHtn-dA6H3PQH8Y Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 14a59186aa064bcdb8e7551ce8fbb5ac Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1015283289 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14a59186aa064bcdb8e7551ce8fbb5ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14a59186aa064bcdb8e7551ce8fbb5ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14a59186aa064bcdb8e7551ce8fbb5ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14a59186aa064bcdb8e7551ce8fbb5ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1015283289 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 14a59186aa064bcdb8e7551ce8fbb5ac Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1015283289 Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d1efc5e8e97143a0810a7960aadd04bd Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1797665368", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:04:42.177290 ncdv-master-1 devstack@n-api.service[137229]: exception: Maximum number of metadata items exceeds 128 Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1797665368', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:04:42.179979 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 04 21:04:42.183994 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:42.189762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:42.192199 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-979c5c3b-3cd1-4881-99f7-8ee952ec256c tempest-AbsoluteLimitsNegativeTestJSON-1015283289 tempest-AbsoluteLimitsNegativeTestJSON-1015283289-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.313918 Jun 04 21:04:42.198221 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1415/2940] 10.222.0.18 () {60 vars in 1147 bytes} [Sat Jun 4 21:04:40 2022] POST /compute/v2.1/servers => generated 87 bytes in 1320 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:04:42.210986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:42.213377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:42.247414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:42.248135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:42.249105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:42.249893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:42.716570 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7fb2920d-b5b4-4d80-ba81-c3037a21dec6 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.771525 Jun 04 21:04:42.727612 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1526/2941] 10.222.0.18 () {60 vars in 1169 bytes} [Sat Jun 4 21:04:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:42.733846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:42.743588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:42.749779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:42.750633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:42.751710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:42.752493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:42.866833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:42.883337 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fdc2a3ea-862e-45d2-9ef0-8adc88188eae tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1469 microversion: 2.1 time: 0.681735 Jun 04 21:04:42.885792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1416/2942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:42 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1469 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:42.904296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b45edc80-07e9-4ced-a5e0-63cf8a8837bf req-0ef61b7d-6428-4730-bb64-e53fc1a32823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}, {"name": "network-changed", "server_uuid": "4930d3cc-8270-4e50-8944-bcb8bab47eca", "tag": "0ed2a412-63ab-4646-ac2a-4798f2f0f0e1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:42.941929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b45edc80-07e9-4ced-a5e0-63cf8a8837bf req-0ef61b7d-6428-4730-bb64-e53fc1a32823 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:42.948244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b45edc80-07e9-4ced-a5e0-63cf8a8837bf req-0ef61b7d-6428-4730-bb64-e53fc1a32823 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:42.981483 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b45edc80-07e9-4ced-a5e0-63cf8a8837bf req-0ef61b7d-6428-4730-bb64-e53fc1a32823 service nova] Creating event network-changed:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch1-master-1 Jun 04 21:04:42.983657 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b45edc80-07e9-4ced-a5e0-63cf8a8837bf req-0ef61b7d-6428-4730-bb64-e53fc1a32823 service nova] Creating event network-changed:0ed2a412-63ab-4646-ac2a-4798f2f0f0e1 for instance 4930d3cc-8270-4e50-8944-bcb8bab47eca on nch1-master-1 Jun 04 21:04:43.000686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b45edc80-07e9-4ced-a5e0-63cf8a8837bf req-0ef61b7d-6428-4730-bb64-e53fc1a32823 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112427 Jun 04 21:04:43.004644 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1417/2943] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:43.019764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.221"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:43.021295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:43.037225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:43.040459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:43.043428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:43.046770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:43.139635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Acquired lock "refresh_cache-07d7f180-4657-410f-9dc7-2c7887faa217" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 21:04:43.399934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:43.408801 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c563fe52-5139-4504-a185-d761ba578d29 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1315 microversion: 2.1 time: 0.679718 Jun 04 21:04:43.413423 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1527/2944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:42 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:43.904026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:43.904669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:43.917663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:43.918421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:43.919274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:43.919760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:44.649333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:44.658021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b556a847-3a4b-4c09-8dd5-1648bf73a7f8 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1462 microversion: 2.1 time: 0.759237 Jun 04 21:04:44.659318 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1528/2945] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:43 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1462 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:44.664226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:44.667224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:44.674481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:44.675211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:44.676230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:44.676851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:45.180313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:45.214505 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3c2f5967-6785-4481-9e08-ac1edea74248 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1315 microversion: 2.1 time: 0.550828 Jun 04 21:04:45.215833 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1529/2946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:44 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:45.233113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:45.235339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:45.257870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:45.258472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:45.259578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:45.259840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:46.920868 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f668d91d-b799-4c79-a055-e6767ae7aec6 tempest-MigrationsAdminTest-900372530 tempest-MigrationsAdminTest-900372530-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1613 microversion: 2.1 time: 1.703213 Jun 04 21:04:46.934812 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1530/2947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:45 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1613 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:46.942310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:46.945458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:46.960860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:46.961801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:46.962833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:46.963646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:47.775791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:47.792910 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8db852d7-e4fa-410c-80d9-377cf297692d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1315 microversion: 2.1 time: 0.861180 Jun 04 21:04:47.804137 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1531/2948] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:46 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:47.816174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:47.816709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:47.841072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:47.846032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:47.849144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:47.851668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:47.934936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:48.128184 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a94bd39-7263-4042-ade9-ccf17e926d1d tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 204 len: 0 microversion: 2.1 time: 0.322398 Jun 04 21:04:48.129311 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1532/2949] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:47 2022] DELETE /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:48.154190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-86a353f9-2297-463d-822f-2ffab9780aeb req-0b8c72ed-7951-4e69-9c7a-a98d712955ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "name": "network-vif-plugged", "status": "completed", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:48.170656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-86a353f9-2297-463d-822f-2ffab9780aeb req-0b8c72ed-7951-4e69-9c7a-a98d712955ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:48.171372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-86a353f9-2297-463d-822f-2ffab9780aeb req-0b8c72ed-7951-4e69-9c7a-a98d712955ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:48.197215 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-86a353f9-2297-463d-822f-2ffab9780aeb req-0b8c72ed-7951-4e69-9c7a-a98d712955ef service nova] Creating event network-vif-plugged:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch1-master-1 Jun 04 21:04:48.203368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-86a353f9-2297-463d-822f-2ffab9780aeb req-0b8c72ed-7951-4e69-9c7a-a98d712955ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072410 Jun 04 21:04:48.206044 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1533/2950] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:48.213183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:48.214091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:48.228936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:48.229396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:48.230198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:48.230643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:48.587132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 21:04:48.957833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:48.963010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:48.974664 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4302a2de-2a99-4a50-8c3c-cd55b179f9f9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1468 microversion: 2.1 time: 0.766743 Jun 04 21:04:48.975261 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1534/2951] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:48 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1468 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:49.403142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:49.564219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Calling method '.version_select at 0x7f2d0be9a790>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:49.715499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:04:49.717589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Neutron security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 21:04:49.717589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] HTTP exception thrown: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.717589 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Request method failure captured: Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/1590fd98-7a7c-4389-b3bc-cb431fcfb273 HTTP/1.1 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8jw-ev8EQYw6dvLycQhsN59FdNyZWl7zQY-AwT822iJxf96eIf_L7me1ywrFcPewtjMywjkoJNfZL1vIvikUJtvhnzNCS_sIdNuIpN0GRF5xoX8IL3IDwgJ5e7N5JRl5gvYZpIMuazSCzTRlbs59g0APf9Bh0Dh1mgXHEPgEvpHUSo Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b660d4778d47463e937498f98177da91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b660d4778d47463e937498f98177da91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5c799c84ab97494bb59cc4a4b4353c51 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1590fd98-7a7c-4389-b3bc-cb431fcfb273'} Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:04:49.718740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Returning 404 to user: Security group 1590fd98-7a7c-4389-b3bc-cb431fcfb273 does not exist Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-268cccd7-b197-4691-b58a-f216758999ea'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83e9b165-8475-4601-b292-0a0a63acc115 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/1590fd98-7a7c-4389-b3bc-cb431fcfb273" status: 404 len: 194 microversion: 2.1 time: 0.743449 Jun 04 21:04:49.725850 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1535/2952] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:04:48 2022] DELETE /compute/v2.1/os-security-groups/1590fd98-7a7c-4389-b3bc-cb431fcfb273 => generated 194 bytes in 745 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:49.730717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a1af20fc-b3b6-4a25-8b45-b1d969694d13 req-b56c9044-4c3c-4587-975a-137ad49cda39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:49.781258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a1af20fc-b3b6-4a25-8b45-b1d969694d13 req-b56c9044-4c3c-4587-975a-137ad49cda39 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:49.781659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a1af20fc-b3b6-4a25-8b45-b1d969694d13 req-b56c9044-4c3c-4587-975a-137ad49cda39 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:49.826685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a1af20fc-b3b6-4a25-8b45-b1d969694d13 req-b56c9044-4c3c-4587-975a-137ad49cda39 service nova] Creating event network-changed:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:04:49.861530 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a1af20fc-b3b6-4a25-8b45-b1d969694d13 req-b56c9044-4c3c-4587-975a-137ad49cda39 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138767 Jun 04 21:04:49.864429 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1536/2953] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:49.870292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:49.871008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:49.913378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:49.913981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:49.914773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:49.915217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:51.333083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:51.350107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cba548fb-34cd-48ec-bbef-940313d0cc54 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1315 microversion: 2.1 time: 1.484175 Jun 04 21:04:51.356051 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1537/2954] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:49 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1315 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:51.363313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-211393717", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8ebaa3e9-eb96-449b-b5f6-d82cff32c68d"}], "security_groups": [{"name": "tempest-securitygroup--41934096"}], "key_name": "tempest-keypair-1174903856", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:51.575079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Updating instance_info_cache with network_info: [{"id": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad", "address": "fa:16:3e:32:1a:2c", "network": {"id": "74883b92-980c-45ae-844d-3460212fc4ee", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-917333073-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "54d9ccdbd9754f61ab39f91d928842fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88fde6d4-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 21:04:51.578819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:51.594175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Releasing lock "refresh_cache-07d7f180-4657-410f-9dc7-2c7887faa217" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 21:04:51.595174 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6e0d0be6-00ad-4ff2-a83d-0bfea7889904 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action" status: 202 len: 0 microversion: 2.1 time: 8.588982 Jun 04 21:04:51.599930 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1418/2955] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:43 2022] POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action => generated 0 bytes in 8594 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 21:04:51.605904 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2222922f-6a4c-4771-ab19-32efebdc2d9a tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004089 Jun 04 21:04:51.606754 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1419/2956] 10.222.0.18 () {58 vars in 1163 bytes} [Sat Jun 4 21:04:51 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 21:04:51.618019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:51.618970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:51.631622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:51.632448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:51.633640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:51.634327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:51.668241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] validate_networks() for [('8ebaa3e9-eb96-449b-b5f6-d82cff32c68d', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:04:51.890870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:51.911193 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4dac3cb3-4c32-4cae-8185-443ddffbc9da tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 200 len: 1426 microversion: 2.1 time: 0.303180 Jun 04 21:04:51.912353 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1420/2957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:51 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 1426 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:51.920335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-555775a9-73cc-4cce-9a24-4f18a1f8a672 req-14d04e3d-338d-4dc8-bf74-05a8ccf72abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4930d3cc-8270-4e50-8944-bcb8bab47eca", "name": "network-vif-plugged", "status": "completed", "tag": "0ed2a412-63ab-4646-ac2a-4798f2f0f0e1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:51.944100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-555775a9-73cc-4cce-9a24-4f18a1f8a672 req-14d04e3d-338d-4dc8-bf74-05a8ccf72abb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:51.944986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-555775a9-73cc-4cce-9a24-4f18a1f8a672 req-14d04e3d-338d-4dc8-bf74-05a8ccf72abb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:51.963600 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-555775a9-73cc-4cce-9a24-4f18a1f8a672 req-14d04e3d-338d-4dc8-bf74-05a8ccf72abb service nova] Creating event network-vif-plugged:0ed2a412-63ab-4646-ac2a-4798f2f0f0e1 for instance 4930d3cc-8270-4e50-8944-bcb8bab47eca on nch1-master-1 Jun 04 21:04:51.972815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-555775a9-73cc-4cce-9a24-4f18a1f8a672 req-14d04e3d-338d-4dc8-bf74-05a8ccf72abb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055558 Jun 04 21:04:51.974479 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1421/2958] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:51.981404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.221"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:52.166825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:52.322434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:52.329493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:52.330255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:52.331484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:52.335579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:53.037787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Acquired lock "refresh_cache-07d7f180-4657-410f-9dc7-2c7887faa217" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 04 21:04:53.579052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Getting quotas for project 5c275250b53146a2a6fbd1c15b484560. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:04:53.589235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Getting quotas for user 82f7fda07c394cce95c6f317ad334d68 and project 5c275250b53146a2a6fbd1c15b484560. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:04:53.608374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:04:53.608868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:04:53.609769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:04:53.610293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:04:53.610820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:04:53.624317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:53.624869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:53.625994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:53.626488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:53.656173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Getting quotas for project 5c275250b53146a2a6fbd1c15b484560. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:04:53.672045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Getting quotas for user 82f7fda07c394cce95c6f317ad334d68 and project 5c275250b53146a2a6fbd1c15b484560. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:04:53.714387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:04:53.721139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:04:53.840650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a1dcbf27-b8b2-454b-bd19-ff0b708f8425 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.480842 Jun 04 21:04:53.841484 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1538/2959] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:04:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 2485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:04:53.855262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6efd1633-8b03-4dda-91d6-490f1a8cf636 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Calling method '.version_select at 0x7f2d021bd700>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:54.389540 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6efd1633-8b03-4dda-91d6-490f1a8cf636 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.546558 Jun 04 21:04:54.390663 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1539/2960] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 21:04:53 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:54.397196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-834b9eb8-e95d-48bb-af03-f13a35e38e54 req-ecff3980-fd35-4663-8056-b98235436b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d977858e-2f09-4e0d-8854-7353ffe0f1db", "name": "network-vif-deleted", "tag": "99181f1c-4446-4319-bd05-aa827dd86a1e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:54.420833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-834b9eb8-e95d-48bb-af03-f13a35e38e54 req-ecff3980-fd35-4663-8056-b98235436b2b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:54.421692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-834b9eb8-e95d-48bb-af03-f13a35e38e54 req-ecff3980-fd35-4663-8056-b98235436b2b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:54.452616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-834b9eb8-e95d-48bb-af03-f13a35e38e54 req-ecff3980-fd35-4663-8056-b98235436b2b service nova] Creating event network-vif-deleted:99181f1c-4446-4319-bd05-aa827dd86a1e for instance d977858e-2f09-4e0d-8854-7353ffe0f1db on nch1-master-1 Jun 04 21:04:54.469041 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-834b9eb8-e95d-48bb-af03-f13a35e38e54 req-ecff3980-fd35-4663-8056-b98235436b2b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075279 Jun 04 21:04:54.472098 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1540/2961] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:54.844670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Building network info cache for instance {{(pid=137229) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} Jun 04 21:04:54.886267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:54.886983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:54.895226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:54.895746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:54.897225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:54.897910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:55.166549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:55.176417 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72045ef2-752a-4baa-a840-f55be4dd3644 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1503 microversion: 2.1 time: 0.701328 Jun 04 21:04:55.177007 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1541/2962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:54 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1503 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:55.190306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:55.191612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: d977858e-2f09-4e0d-8854-7353ffe0f1db] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:55.203735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:55.207062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:55.209908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:55.213273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:55.231290 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] HTTP exception thrown: Instance d977858e-2f09-4e0d-8854-7353ffe0f1db could not be found. Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Request method failure captured: Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db HTTP/1.1 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eiDbxwBUENewOM871-x4ifgzrLhGGz5B2KJ659f0cR1Cbppj7WCT_36KFuGNZgLGtyJujVDfwYmQwDPdkiOpWWaDMuHsabxlIAwaKN5V37WJc83N-nawnoJuJZrnxE_TDDuxeoScsHG6NYg-LEvSXk0xb8PfyrffS211fNJSd-L40 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-MigrationsAdminTest-1933681427 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5b4c3539c5534d2c844944f9be3f9963 Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance d977858e-2f09-4e0d-8854-7353ffe0f1db could not be found. Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd977858e-2f09-4e0d-8854-7353ffe0f1db'} Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d977858e-2f09-4e0d-8854-7353ffe0f1db could not be found. Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d977858e-2f09-4e0d-8854-7353ffe0f1db could not be found. Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:55.243916 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d977858e-2f09-4e0d-8854-7353ffe0f1db could not be found. Jun 04 21:04:55.248077 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:55.255249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Returning 404 to user: Instance d977858e-2f09-4e0d-8854-7353ffe0f1db could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:55.256391 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2437fd0-0ea7-4568-aac9-912cacd72637 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db" status: 404 len: 111 microversion: 2.1 time: 0.072051 Jun 04 21:04:55.256973 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1542/2963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:55 2022] GET /compute/v2.1/servers/d977858e-2f09-4e0d-8854-7353ffe0f1db => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:55.262529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:55.265186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:55.289639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:55.290403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:55.291396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:55.292022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:55.657842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:55.676144 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d61f7506-4b0d-4a57-a943-6f469340fdfe tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1321 microversion: 2.1 time: 0.415837 Jun 04 21:04:55.678297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1543/2964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:55 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:55.708319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51fc64b4-591f-406a-9f3c-9fb7169db684 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Calling method '.version_select at 0x7f2d01544b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:56.003655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Updating instance_info_cache with network_info: [{"id": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad", "address": "fa:16:3e:32:1a:2c", "network": {"id": "74883b92-980c-45ae-844d-3460212fc4ee", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-917333073-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "54d9ccdbd9754f61ab39f91d928842fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap88fde6d4-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137229) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 21:04:56.043417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Releasing lock "refresh_cache-07d7f180-4657-410f-9dc7-2c7887faa217" {{(pid=137229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 04 21:04:56.044852 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25eecd3b-4fc9-4d75-a02a-d21a0243e368 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action" status: 202 len: 0 microversion: 2.1 time: 4.068792 Jun 04 21:04:56.047089 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1422/2965] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:51 2022] POST /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217/action => generated 0 bytes in 4072 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 04 21:04:56.061799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-51fc64b4-591f-406a-9f3c-9fb7169db684 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:04:56.063455 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-51fc64b4-591f-406a-9f3c-9fb7169db684 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 04 21:04:56.063455 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51fc64b4-591f-406a-9f3c-9fb7169db684 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Request method failure captured: Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-groups/bffe10fe-92cf-4058-a72d-8ef5a9d263aa HTTP/1.1 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8jw-ev8EQYw6dvLycQhsN59FdNyZWl7zQY-AwT822iJxf96eIf_L7me1ywrFcPewtjMywjkoJNfZL1vIvikUJtvhnzNCS_sIdNuIpN0GRF5xoX8IL3IDwgJ5e7N5JRl5gvYZpIMuazSCzTRlbs59g0APf9Bh0Dh1mgXHEPgEvpHUSo Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b660d4778d47463e937498f98177da91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b660d4778d47463e937498f98177da91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5c799c84ab97494bb59cc4a4b4353c51 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: exception: Insufficient rights for removing default security group. Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'bffe10fe-92cf-4058-a72d-8ef5a9d263aa'} Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:04:56.066847 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] Jun 04 21:04:56.070743 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.075964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51fc64b4-591f-406a-9f3c-9fb7169db684 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 04 21:04:56.075964 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-28113063-bb69-4c5f-a0e1-b357d2f8cbee'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:56.077297 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-51fc64b4-591f-406a-9f3c-9fb7169db684 tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/bffe10fe-92cf-4058-a72d-8ef5a9d263aa" status: 400 len: 182 microversion: 2.1 time: 0.397845 Jun 04 21:04:56.081196 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1544/2966] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:04:55 2022] DELETE /compute/v2.1/os-security-groups/bffe10fe-92cf-4058-a72d-8ef5a9d263aa => generated 182 bytes in 402 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:04:56.098868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:56.099681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:56.104786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:56.107691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:56.117751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:56.135625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:56.140923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:56.144246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:56.144970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:56.153295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:56.154133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:56.157409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:56.171938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:56.185748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lazy-loading 'flavor' on Instance uuid 4930d3cc-8270-4e50-8944-bcb8bab47eca {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:04:56.273218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:04:56.316650 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-722f81a7-1146-4db0-80d4-48108d54eef9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "POST /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca/action" status: 202 len: 0 microversion: 2.1 time: 0.266715 Jun 04 21:04:56.318156 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1423/2967] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:04:56 2022] POST /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:04:56.338260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c694ff4d-ddde-427b-af31-381614cbefe8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '.version_select at 0x7f2d016eb160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:56.446588 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17482d80-4406-410b-9dd5-40f5496ba641 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 204 len: 0 microversion: 2.1 time: 0.362791 Jun 04 21:04:56.447256 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1545/2968] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:04:56 2022] DELETE /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:04:56.469039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Calling method '.version_select at 0x7f2d0222c3a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:56.725444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:04:56.726852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Neutron security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe not found {{(pid=137228) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 21:04:56.727622 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] HTTP exception thrown: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.727622 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Request method failure captured: Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-security-groups/9f5634d9-c3c1-4968-8dda-c5347de78bbe HTTP/1.1 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8jw-ev8EQYw6dvLycQhsN59FdNyZWl7zQY-AwT822iJxf96eIf_L7me1ywrFcPewtjMywjkoJNfZL1vIvikUJtvhnzNCS_sIdNuIpN0GRF5xoX8IL3IDwgJ5e7N5JRl5gvYZpIMuazSCzTRlbs59g0APf9Bh0Dh1mgXHEPgEvpHUSo Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b660d4778d47463e937498f98177da91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b660d4778d47463e937498f98177da91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5c799c84ab97494bb59cc4a4b4353c51 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '9f5634d9-c3c1-4968-8dda-c5347de78bbe'} Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:04:56.732026 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] Jun 04 21:04:56.736822 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:04:56.748188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Returning 404 to user: Security group 9f5634d9-c3c1-4968-8dda-c5347de78bbe does not exist Jun 04 21:04:56.748188 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-5f8c2ae3-baa6-4f88-9f89-2065c1757102'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:56.752815 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21a65fd5-5e8d-43d8-be46-7bc4afe6abdb tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] 10.222.0.18 "GET /compute/v2.1/os-security-groups/9f5634d9-c3c1-4968-8dda-c5347de78bbe" status: 404 len: 194 microversion: 2.1 time: 0.299358 Jun 04 21:04:56.753390 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1546/2969] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:04:56 2022] GET /compute/v2.1/os-security-groups/9f5634d9-c3c1-4968-8dda-c5347de78bbe => generated 194 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:56.758821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:56.760595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:56.776902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:56.777382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:56.781789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:56.785389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:57.391172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:57.413473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:57.417732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:57.430862 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09e3ce2e-13e7-4eb4-8ec2-8f84cc6aab70 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2951 microversion: 2.32 time: 0.676250 Jun 04 21:04:57.431715 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1547/2970] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:04:56 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2951 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:04:57.437022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:57.438197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:57.446946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:57.447754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:57.450017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:57.450466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:58.047207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:58.071036 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e6cc097-399a-465e-95e1-d1e3d9c7c31f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1511 microversion: 2.1 time: 0.637847 Jun 04 21:04:58.072990 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1548/2971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:57 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:58.099542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:58.100636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:58.110773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:58.112195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:58.118351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:58.118351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.155623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:59.165616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3c14b26-c264-42f1-8bcd-5ccc615797b9 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1534 microversion: 2.1 time: 1.076965 Jun 04 21:04:59.166478 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1549/2972] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:58 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1534 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:59.182839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-10eea584-b86c-4191-9439-774f6bd85af1 req-efd54200-6647-47c1-b0f6-ef78d4588ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:59.192633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-10eea584-b86c-4191-9439-774f6bd85af1 req-efd54200-6647-47c1-b0f6-ef78d4588ca0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.193082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-10eea584-b86c-4191-9439-774f6bd85af1 req-efd54200-6647-47c1-b0f6-ef78d4588ca0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.213881 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-10eea584-b86c-4191-9439-774f6bd85af1 req-efd54200-6647-47c1-b0f6-ef78d4588ca0 service nova] Creating event network-changed:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:04:59.220111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-10eea584-b86c-4191-9439-774f6bd85af1 req-efd54200-6647-47c1-b0f6-ef78d4588ca0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 Jun 04 21:04:59.221286 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1550/2973] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:04:59.226925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:59.227663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:59.236342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.236860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.237650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.238091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.739808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c694ff4d-ddde-427b-af31-381614cbefe8 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "DELETE /compute/v2.1/os-floating-ips/56bfa576-3884-49ca-ab79-1164b66f2741" status: 202 len: 0 microversion: 2.1 time: 3.419882 Jun 04 21:04:59.745316 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1424/2974] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:04:56 2022] DELETE /compute/v2.1/os-floating-ips/56bfa576-3884-49ca-ab79-1164b66f2741 => generated 0 bytes in 3422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:04:59.749851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Action: 'update', calling method: .version_select at 0x7f2d015db790>, body: {"security_group": {"name": "tempest-sg-97977399", "description": "tempest-description-1340652956"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:04:59.894876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:04:59.896225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Neutron security group d90e64a0-dc95-466a-9a45-5dc477909010 not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 21:04:59.897239 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] HTTP exception thrown: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.897239 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Request method failure captured: Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: request: PUT /compute/v2.1/os-security-groups/d90e64a0-dc95-466a-9a45-5dc477909010 HTTP/1.1 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 100 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8jw-ev8EQYw6dvLycQhsN59FdNyZWl7zQY-AwT822iJxf96eIf_L7me1ywrFcPewtjMywjkoJNfZL1vIvikUJtvhnzNCS_sIdNuIpN0GRF5xoX8IL3IDwgJ5e7N5JRl5gvYZpIMuazSCzTRlbs59g0APf9Bh0Dh1mgXHEPgEvpHUSo Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b660d4778d47463e937498f98177da91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b660d4778d47463e937498f98177da91"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b660d4778d47463e937498f98177da91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b660d4778d47463e937498f98177da91 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 5c799c84ab97494bb59cc4a4b4353c51 Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1322053987-project Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: {"security_group": {"name": "tempest-sg-97977399", "description": "tempest-description-1340652956"}} Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'd90e64a0-dc95-466a-9a45-5dc477909010', 'body': {'security_group': {'name': 'tempest-sg-97977399', 'description': 'tempest-description-1340652956'}}} Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:04:59.901804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] Jun 04 21:04:59.906391 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:04:59.911940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] Returning 404 to user: Security group d90e64a0-dc95-466a-9a45-5dc477909010 does not exist Jun 04 21:04:59.911940 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-6bedcf35-c162-4ee4-9399-4661de46d68a'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:04:59.913064 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1043d8ce-033c-44df-8c5c-cf91cc4c05aa tempest-SecurityGroupsNegativeTestJSON-1322053987 tempest-SecurityGroupsNegativeTestJSON-1322053987-project] 10.222.0.18 "PUT /compute/v2.1/os-security-groups/d90e64a0-dc95-466a-9a45-5dc477909010" status: 404 len: 194 microversion: 2.1 time: 0.170516 Jun 04 21:04:59.919113 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1425/2975] 10.222.0.18 () {60 vars in 1289 bytes} [Sat Jun 4 21:04:59 2022] PUT /compute/v2.1/os-security-groups/d90e64a0-dc95-466a-9a45-5dc477909010 => generated 194 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:04:59.927672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:59.934653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:59.939894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:04:59.953393 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb1dfb29-be19-4573-b59e-707c85bfd7d4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 0.730773 Jun 04 21:04:59.953926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:04:59.954047 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1551/2976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:59 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:04:59.958509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.959263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.960394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.962422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.964010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:04:59.964882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:04:59.983131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.983858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:04:59.984806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:04:59.985519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:00.364551 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e80b44a-2d7c-4b30-b44e-c098b5cb7674 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.443994 Jun 04 21:05:00.366873 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1426/2977] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Jun 4 21:04:59 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333/os-interface => generated 1830 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:00.375891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdbd313b-38ad-494d-b491-9ccf8aa0f376 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '.version_select at 0x7f2d015c8820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:00.583958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:00.600653 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-11864f43-fbe1-4d96-b37c-f10a757b06e9 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1494 microversion: 2.1 time: 0.644297 Jun 04 21:05:00.601247 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1552/2978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:04:59 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1494 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:00.611318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:00.613822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:00.630938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:00.631883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:00.636860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:00.640359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:00.963400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:00.983465 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a8bba6e-9a50-4b5e-965c-9b882bb6bd1c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 200 len: 1492 microversion: 2.1 time: 0.379382 Jun 04 21:05:00.987859 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1553/2979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:00 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 1492 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:00.997985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:00.998716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:01.059662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.064619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:01.066074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.068363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:01.191158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:05:01.461361 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e30708c3-e866-404f-9d31-2100000c7ca7 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 204 len: 0 microversion: 2.1 time: 0.469564 Jun 04 21:05:01.469130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1554/2980] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:00 2022] DELETE /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:05:01.474890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:01.492173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:01.514112 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdbd313b-38ad-494d-b491-9ccf8aa0f376 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/793c0937-e1d0-41a3-83a3-a1cb7c35ea1a" status: 202 len: 0 microversion: 2.1 time: 1.144855 Jun 04 21:05:01.515636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1427/2981] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:05:00 2022] DELETE /compute/v2.1/os-security-groups/793c0937-e1d0-41a3-83a3-a1cb7c35ea1a => generated 0 bytes in 1148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:05:01.523124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9d7f8b63-37bd-45d8-9ff6-9f18f270efdc req-877812ef-d9b4-4433-8062-6b25d15953ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b84fdcb2-ae3f-4d90-b855-37f77da455c7", "name": "network-vif-deleted", "tag": "1f9dc190-b3f2-420a-9cdd-dffc4ff28a73"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:01.531242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.531895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:01.533745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.538937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:01.624103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9d7f8b63-37bd-45d8-9ff6-9f18f270efdc req-877812ef-d9b4-4433-8062-6b25d15953ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.627625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9d7f8b63-37bd-45d8-9ff6-9f18f270efdc req-877812ef-d9b4-4433-8062-6b25d15953ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:01.706092 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9d7f8b63-37bd-45d8-9ff6-9f18f270efdc req-877812ef-d9b4-4433-8062-6b25d15953ca service nova] Creating event network-vif-deleted:1f9dc190-b3f2-420a-9cdd-dffc4ff28a73 for instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 on nch1-master-1 Jun 04 21:05:01.728279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:01.733122 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9d7f8b63-37bd-45d8-9ff6-9f18f270efdc req-877812ef-d9b4-4433-8062-6b25d15953ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213899 Jun 04 21:05:01.735413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1428/2982] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:01.771120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:01.779128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:01.808834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.813332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:01.817394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:01.819039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:02.479133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:02.489732 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98454158-20f5-4015-bac6-c61da0d01b8c tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1500 microversion: 2.1 time: 0.750781 Jun 04 21:05:02.500430 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1429/2983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:01 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1500 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:02.506426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:02.507216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:02.520918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:02.522458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:02.524988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:02.526286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:02.554448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:02.568197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d185b711-c6a1-4635-9b05-fd990102df0e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 1.094293 Jun 04 21:05:02.568860 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1555/2984] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:01 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:02.581466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:05:02.582815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:02.583882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b84fdcb2-ae3f-4d90-b855-37f77da455c7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:02.590815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:02.591275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:02.592099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:02.592549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:02.629658 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] HTTP exception thrown: Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 could not be found. Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Request method failure captured: Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 HTTP/1.1 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eiDbxwBUENewOM871-x4ifgzrLhGGz5B2KJ659f0cR1Cbppj7WCT_36KFuGNZgLGtyJujVDfwYmQwDPdkiOpWWaDMuHsabxlIAwaKN5V37WJc83N-nawnoJuJZrnxE_TDDuxeoScsHG6NYg-LEvSXk0xb8PfyrffS211fNJSd-L40 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5b4c3539c5534d2c844944f9be3f9963 Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 could not be found. Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b84fdcb2-ae3f-4d90-b855-37f77da455c7'} Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 could not be found. Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 could not be found. Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:02.631813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 could not be found. Jun 04 21:05:02.636101 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:02.639450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Returning 404 to user: Instance b84fdcb2-ae3f-4d90-b855-37f77da455c7 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:02.644961 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4cbf1f34-3948-4953-a5ce-ca4ad9b99e15 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7" status: 404 len: 111 microversion: 2.1 time: 0.074954 Jun 04 21:05:02.645877 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1556/2985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:02 2022] GET /compute/v2.1/servers/b84fdcb2-ae3f-4d90-b855-37f77da455c7 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:02.654755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4074cd6a-53e8-4816-8497-2e4e7d75e50c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '.version_select at 0x7f2d0222c4c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:02.712209 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4074cd6a-53e8-4816-8497-2e4e7d75e50c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733995133" status: 202 len: 0 microversion: 2.1 time: 0.061207 Jun 04 21:05:02.716420 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1557/2986] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:05:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733995133 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:05:02.754187 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c024045e-5db1-4cf4-8254-0baea273fe4d tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 204 len: 0 microversion: 2.1 time: 0.251816 Jun 04 21:05:02.755530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1430/2987] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:02 2022] DELETE /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:05:02.767012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:02.769444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:02.793001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:02.814734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:02.815990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:02.817280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:03.512574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:03.513297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:03.527864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:03.529953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:03.530369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:03.530817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:03.641847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:03.690509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:03.800322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:03.819169 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26d11a28-8d33-4d52-9c0b-ca03ef4638e0 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1508 microversion: 2.1 time: 1.058685 Jun 04 21:05:03.821494 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1558/2988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:02 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1508 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:03.833475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:03.834656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:03.845198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:03.847457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:03.848578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:03.849469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:04.287285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:04.295930 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e32942d-c766-4dfa-8946-239e4763e822 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1500 microversion: 2.1 time: 0.789290 Jun 04 21:05:04.297281 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1431/2989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:03 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1500 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:04.303708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2a186d14-7108-4c52-af58-4b98766288bd req-3de7c8e6-69d7-4653-883d-440997ad39b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494652d2-da45-44f7-8f2b-963b3f44bbe0", "tag": "16bdcc2c-ea23-4004-a369-8d517594c798"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:04.321520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2a186d14-7108-4c52-af58-4b98766288bd req-3de7c8e6-69d7-4653-883d-440997ad39b6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:04.322245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2a186d14-7108-4c52-af58-4b98766288bd req-3de7c8e6-69d7-4653-883d-440997ad39b6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:04.340717 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2a186d14-7108-4c52-af58-4b98766288bd req-3de7c8e6-69d7-4653-883d-440997ad39b6 service nova] Creating event network-changed:16bdcc2c-ea23-4004-a369-8d517594c798 for instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 on nch2-master-1 Jun 04 21:05:04.348037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2a186d14-7108-4c52-af58-4b98766288bd req-3de7c8e6-69d7-4653-883d-440997ad39b6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049114 Jun 04 21:05:04.349376 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1432/2990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:04.394277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:04.404726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13b2ee81-8993-4b03-ac95-1d7bf2c0ddba tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 0.581848 Jun 04 21:05:04.405319 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1559/2991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:03 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:04.839723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:04.841062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:04.848971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:04.849648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:04.850593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:04.851210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:05.336464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:05.338026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:05.383845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:05.385446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:05.386575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:05.388423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:05.472590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:05.499824 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87efa69b-f71a-45a2-9859-41de208bdc7e tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1508 microversion: 2.1 time: 0.665016 Jun 04 21:05:05.500658 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1433/2992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:04 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1508 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:05.507027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:05.508462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:05.516079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:05.518438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:05.519448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:05.521254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:06.150487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21ae179d22a140f7a6ebccaeea7932db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41a6c9f3ddbf4fb48fc2d1272c612739', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:06.161232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d720008e-30cc-4a40-ac61-eac8fbee8b6f tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 200 len: 1500 microversion: 2.1 time: 0.847843 Jun 04 21:05:06.174276 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1560/2993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:05 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 1500 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:06.266042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:06.277473 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f5a1076-672d-4e91-a684-f9c75d1a5a79 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 0.775294 Jun 04 21:05:06.279064 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1434/2994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:05 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:06.401884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0f61be84-3693-4265-827b-321741bfe959 req-096f9e4e-9a12-4c92-a946-b59f641fb40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4930d3cc-8270-4e50-8944-bcb8bab47eca", "name": "network-vif-deleted", "tag": "0ed2a412-63ab-4646-ac2a-4798f2f0f0e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:06.438914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0f61be84-3693-4265-827b-321741bfe959 req-096f9e4e-9a12-4c92-a946-b59f641fb40f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:06.440116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0f61be84-3693-4265-827b-321741bfe959 req-096f9e4e-9a12-4c92-a946-b59f641fb40f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:06.512139 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0f61be84-3693-4265-827b-321741bfe959 req-096f9e4e-9a12-4c92-a946-b59f641fb40f service nova] Creating event network-vif-deleted:0ed2a412-63ab-4646-ac2a-4798f2f0f0e1 for instance 4930d3cc-8270-4e50-8944-bcb8bab47eca on nch1-master-1 Jun 04 21:05:06.519638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:06.520553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:06.537668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:06.538419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:06.538746 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0f61be84-3693-4265-827b-321741bfe959 req-096f9e4e-9a12-4c92-a946-b59f641fb40f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140509 Jun 04 21:05:06.539648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:06.540255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:06.547532 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1561/2995] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:07.122569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:07.123662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:07.145857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.147068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.150976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.153073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.267538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:05:07.356668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '056d2db6425347eabfc1d1cb7802db75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54d9ccdbd9754f61ab39f91d928842fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:07.364933 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-007cca9c-45c7-4b70-9b95-ca4812100bc7 tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 200 len: 1508 microversion: 2.1 time: 0.850938 Jun 04 21:05:07.371158 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1435/2996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:06 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 1508 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:07.380011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:07.380685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:07.402650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.403101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.403923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.404365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.435244 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca HTTP/1.1 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '4930d3cc-8270-4e50-8944-bcb8bab47eca'} Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:07.436967 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92d3ef23-25e2-4cb5-be46-0e7a96949db4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 404 len: 111 microversion: 2.1 time: 0.066141 Jun 04 21:05:07.448353 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1436/2997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:07 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:07.453301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:07.454001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:07.485800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.487622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.490396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.491262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.491594 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f5e9ef5-e552-4ebb-af1f-aa5ce1cc4e16 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 204 len: 0 microversion: 2.1 time: 0.372466 Jun 04 21:05:07.495467 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1562/2998] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:07 2022] DELETE /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:05:07.515683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:07.516653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:07.529120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.530570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.531719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.532325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.557459 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca HTTP/1.1 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '4930d3cc-8270-4e50-8944-bcb8bab47eca'} Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:07.559682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:07.564200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:07.567657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:07.568792 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e32b276-1c9a-40e0-9316-9614f374ce90 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 404 len: 111 microversion: 2.1 time: 0.060319 Jun 04 21:05:07.569562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1563/2999] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:07 2022] DELETE /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:07.586437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:07.596510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:07.603326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.604054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:07.605025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:07.605704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:08.821957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:08.826964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:SELECT=89,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:08.834408 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-12edec65-b55e-4946-8b8f-5c31c80d3a20 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 1.385147 Jun 04 21:05:08.837223 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1437/3000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:07 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:08.852361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:08.865490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 4930d3cc-8270-4e50-8944-bcb8bab47eca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:08.881332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:08.885164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:08.886125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:08.887824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:08.922632 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca HTTP/1.1 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '4930d3cc-8270-4e50-8944-bcb8bab47eca'} Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:08.933672 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. Jun 04 21:05:08.939341 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:08.944527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 4930d3cc-8270-4e50-8944-bcb8bab47eca could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:08.945709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63235510-b7e0-4555-bf2b-781e09efb4a5 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca" status: 404 len: 111 microversion: 2.1 time: 0.106659 Jun 04 21:05:08.946841 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1438/3001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:08 2022] GET /compute/v2.1/servers/4930d3cc-8270-4e50-8944-bcb8bab47eca => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:08.960112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:08.961724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] [instance: 07d7f180-4657-410f-9dc7-2c7887faa217] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:08.972996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:08.985299 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5ca37a5d-e5fc-4821-b8cc-c508d611a2a3 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1469 microversion: 2.1 time: 1.414345 Jun 04 21:05:08.996937 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1564/3002] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:07 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1469 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:09.005491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.006276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.007380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.008574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3d07c867-e487-4afb-9ea8-f240a61483b3 req-1d026e03-8aec-40c3-aee8-45bc58c41aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d7f180-4657-410f-9dc7-2c7887faa217", "name": "network-vif-deleted", "tag": "88fde6d4-99a3-49cb-a71d-3ba74c8e29ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:09.009111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.033816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3d07c867-e487-4afb-9ea8-f240a61483b3 req-1d026e03-8aec-40c3-aee8-45bc58c41aee service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.034871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3d07c867-e487-4afb-9ea8-f240a61483b3 req-1d026e03-8aec-40c3-aee8-45bc58c41aee service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.050373 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] HTTP exception thrown: Instance 07d7f180-4657-410f-9dc7-2c7887faa217 could not be found. Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Request method failure captured: Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 HTTP/1.1 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8ibFkUsq_wrwv5kB5yDlBkwJm4Wr99Kl4D4DC2FUnROEfQoskUgoe5P3ZtkYCj1gaeJVsQbyMxLcWI9I7qlo95QeBbmyVlCbary3gBm-p_Z-jTJhlk1zGvEaKbo3ppJ3TIRDyY1g6EVal4KsdnwkyU43K6fzacGDfEcuczAtZqGiJc Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 54d9ccdbd9754f61ab39f91d928842fb Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-331780643 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_54d9ccdbd9754f61ab39f91d928842fb"}]}, {"type": "tempest-type-1180897862", "name": "tempest-service-928529620", "endpoints": [{"region": "tempest-region-723929370", "publicURL": "https://url-885326715.com"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54d9ccdbd9754f61ab39f91d928842fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/54d9ccdbd9754f61ab39f91d928842fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54d9ccdbd9754f61ab39f91d928842fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-331780643 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 54d9ccdbd9754f61ab39f91d928842fb Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-331780643 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerRescueTestJSONUnderV235-331780643-project Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 056d2db6425347eabfc1d1cb7802db75 Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-331780643-project Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 07d7f180-4657-410f-9dc7-2c7887faa217 could not be found. Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '07d7f180-4657-410f-9dc7-2c7887faa217'} Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d7f180-4657-410f-9dc7-2c7887faa217 could not be found. Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.055878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d7f180-4657-410f-9dc7-2c7887faa217 could not be found. Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d7f180-4657-410f-9dc7-2c7887faa217 could not be found. Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] Returning 404 to user: Instance 07d7f180-4657-410f-9dc7-2c7887faa217 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.060537 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-18d69327-884e-4e58-a57c-5a068e9c8cbb tempest-ServerRescueTestJSONUnderV235-331780643 tempest-ServerRescueTestJSONUnderV235-331780643-project] 10.222.0.18 "GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217" status: 404 len: 111 microversion: 2.1 time: 0.109320 Jun 04 21:05:09.063629 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3d07c867-e487-4afb-9ea8-f240a61483b3 req-1d026e03-8aec-40c3-aee8-45bc58c41aee service nova] Creating event network-vif-deleted:88fde6d4-99a3-49cb-a71d-3ba74c8e29ad for instance 07d7f180-4657-410f-9dc7-2c7887faa217 on nch2-master-1 Jun 04 21:05:09.068143 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1439/3003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:08 2022] GET /compute/v2.1/servers/07d7f180-4657-410f-9dc7-2c7887faa217 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.074456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.076682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3d07c867-e487-4afb-9ea8-f240a61483b3 req-1d026e03-8aec-40c3-aee8-45bc58c41aee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077188 Jun 04 21:05:09.077394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.080770 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1565/3004] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:09.096547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.097015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.097819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.098461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.129459 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd HTTP/1.1 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b10d229b-8dab-4cce-ae2d-1524e56a3ddd'} Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.131431 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.135635 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.140728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.141967 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-194d9510-fa7f-4bab-8253-391c5d513186 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 404 len: 111 microversion: 2.1 time: 0.072590 Jun 04 21:05:09.152176 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1440/3005] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:09 2022] DELETE /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.152549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.153366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: b10d229b-8dab-4cce-ae2d-1524e56a3ddd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.165806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.166260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.167043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.167481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.186578 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd HTTP/1.1 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b10d229b-8dab-4cce-ae2d-1524e56a3ddd'} Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.188738 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. Jun 04 21:05:09.193028 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.194487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance b10d229b-8dab-4cce-ae2d-1524e56a3ddd could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.196669 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1595c8c2-8a67-4a3e-aa33-bfd9d70e1b02 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd" status: 404 len: 111 microversion: 2.1 time: 0.047565 Jun 04 21:05:09.202827 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1566/3006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:09 2022] GET /compute/v2.1/servers/b10d229b-8dab-4cce-ae2d-1524e56a3ddd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:05:09.211053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.211595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.231068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.231716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.232573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.233023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.290453 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 HTTP/1.1 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'cf2c35d6-29be-4969-b399-b35e4ceea667'} Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.293800 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.298641 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0216d8eb-0c07-4454-b46f-3795077e1ce8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 404 len: 111 microversion: 2.1 time: 0.092480 Jun 04 21:05:09.303930 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1441/3007] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:09 2022] DELETE /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.306948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.308638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: cf2c35d6-29be-4969-b399-b35e4ceea667] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.321149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.324163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.325307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.327832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.371256 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 HTTP/1.1 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'cf2c35d6-29be-4969-b399-b35e4ceea667'} Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.376460 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. Jun 04 21:05:09.382331 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.385242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance cf2c35d6-29be-4969-b399-b35e4ceea667 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.386338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a7752f1-e7db-4610-b44d-b4ed71bdd70d tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667" status: 404 len: 111 microversion: 2.1 time: 0.084168 Jun 04 21:05:09.388146 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1567/3008] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:09 2022] GET /compute/v2.1/servers/cf2c35d6-29be-4969-b399-b35e4ceea667 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.397544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.398349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.406018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.406714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.407951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.408553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.426049 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 HTTP/1.1 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f8bbb0bf-776c-4609-ae09-e9be74061980'} Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.427998 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.433518 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.436098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.437166 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c8d7ba36-0249-4bde-a8c5-7866a390110a tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 404 len: 111 microversion: 2.1 time: 0.045273 Jun 04 21:05:09.438270 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1442/3009] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:09 2022] DELETE /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:05:09.448967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.450745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: f8bbb0bf-776c-4609-ae09-e9be74061980] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.460855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.461318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.462127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.475619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.500462 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 HTTP/1.1 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f8bbb0bf-776c-4609-ae09-e9be74061980'} Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.502105 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance f8bbb0bf-776c-4609-ae09-e9be74061980 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a61cdf71-b867-4235-bcd0-156672465fb8 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980" status: 404 len: 111 microversion: 2.1 time: 0.060648 Jun 04 21:05:09.506336 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1568/3010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:09 2022] GET /compute/v2.1/servers/f8bbb0bf-776c-4609-ae09-e9be74061980 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.512959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.513784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.527076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.530178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.531385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.532979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.589484 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 HTTP/1.1 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '890b5288-ac78-4da0-af4d-6f14bf779530'} Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.593186 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.598226 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.602464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.605350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1980283-7e51-4815-b4ae-a3dd34ff090e tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530" status: 404 len: 111 microversion: 2.1 time: 0.096977 Jun 04 21:05:09.609467 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1443/3011] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:09 2022] DELETE /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.622202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.623113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 890b5288-ac78-4da0-af4d-6f14bf779530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.640852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.642088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.645156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.645818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.696025 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 HTTP/1.1 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '890b5288-ac78-4da0-af4d-6f14bf779530'} Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:09.698275 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. Jun 04 21:05:09.703042 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:09.704579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 890b5288-ac78-4da0-af4d-6f14bf779530 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:09.705996 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c1885bb-e176-42f7-b294-67bada2ff914 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530" status: 404 len: 111 microversion: 2.1 time: 0.091762 Jun 04 21:05:09.707151 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1569/3012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:09 2022] GET /compute/v2.1/servers/890b5288-ac78-4da0-af4d-6f14bf779530 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:09.861606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:09.872396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:09.892507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.893355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:09.893635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:09.905572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:10.005877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:10.007316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:10.020983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:10.023868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:10.036660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:10.037045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:10.673939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:10.695586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7dc6325e-bc7f-404f-94f9-b72f7f787de2 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 0.841252 Jun 04 21:05:10.696776 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1444/3013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:09 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:11.090116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:11.091271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:11.108254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:11.122885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b76dd5fa-9167-4170-8341-51ccb6023031 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1469 microversion: 2.1 time: 1.122432 Jun 04 21:05:11.132709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.134382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.134808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1570/3014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:09 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1469 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:11.136002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.136584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.169758 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 HTTP/1.1 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '87aaf5f4-6faf-4ce7-bdd1-70d1a879d015'} Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:11.171952 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.176724 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.179260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:11.180384 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ddbf0785-0c07-4d3c-a0f9-7d90869bedf4 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 404 len: 111 microversion: 2.1 time: 0.107431 Jun 04 21:05:11.181146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1445/3015] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:11 2022] DELETE /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:05:11.189393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:11.190341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:11.197127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.200262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.201292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.201916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.253156 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 HTTP/1.1 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '87aaf5f4-6faf-4ce7-bdd1-70d1a879d015'} Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.256273 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f8b3d4a3-7a79-4ba8-8ccd-e5775a2faadd tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015" status: 404 len: 111 microversion: 2.1 time: 0.072418 Jun 04 21:05:11.262160 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1571/3016] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:11 2022] GET /compute/v2.1/servers/87aaf5f4-6faf-4ce7-bdd1-70d1a879d015 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:05:11.268380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:11.269010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:11.280845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.282029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.283075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.283704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.330105 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 HTTP/1.1 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '662547fc-144c-4672-93aa-7156e176d296'} Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:11.332107 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.336700 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.343822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:11.344993 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebc2f87f-e150-496c-b593-8d0243ea7341 tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "DELETE /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 404 len: 111 microversion: 2.1 time: 0.082514 Jun 04 21:05:11.346097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1446/3017] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:11 2022] DELETE /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:11.355378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:11.356052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] [instance: 662547fc-144c-4672-93aa-7156e176d296] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:11.372707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.373176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.373975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.384756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.471350 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] HTTP exception thrown: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Request method failure captured: Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 HTTP/1.1 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8fJRA8E8XkGwQ7mVLmQnrxvtPkxA789OvMgPV7ihROw0CpAZwR3yHqka3hk7xxd7M0suuhLFZyCv2uHPBvmkWgFYdrg7-up8Mgp9qm7Pc69Kt7eZAikHEP6IV1w7tY4lFFIC26LE2Lxb8LBNjtT_2rGVYTimV-Xe0-dOUW91QOe7pE Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/41a6c9f3ddbf4fb48fc2d1272c612739"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 41a6c9f3ddbf4fb48fc2d1272c612739 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1275720910 Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 21ae179d22a140f7a6ebccaeea7932db Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1275720910-project Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '662547fc-144c-4672-93aa-7156e176d296'} Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:11.501197 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:11.506812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] Returning 404 to user: Instance 662547fc-144c-4672-93aa-7156e176d296 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:11.509308 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-043e796d-2e4c-467d-be70-58624f1ee2ba tempest-DeleteServersTestJSON-1275720910 tempest-DeleteServersTestJSON-1275720910-project] 10.222.0.18 "GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296" status: 404 len: 111 microversion: 2.1 time: 0.158175 Jun 04 21:05:11.515977 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1572/3018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:11 2022] GET /compute/v2.1/servers/662547fc-144c-4672-93aa-7156e176d296 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:11.714313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:11.714957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:11.726646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.727109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.727946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.728389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.854139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-93f6cae1-dc84-4d19-a8ca-94b90399942f req-2f4e24cc-02e0-4eea-a3b4-e8b21dfb6b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44488ee-6a65-404c-8907-02ee23f75774", "name": "network-vif-deleted", "tag": "471386bb-e273-4917-a745-e543e8ccf6e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:11.879451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-93f6cae1-dc84-4d19-a8ca-94b90399942f req-2f4e24cc-02e0-4eea-a3b4-e8b21dfb6b25 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:11.879959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-93f6cae1-dc84-4d19-a8ca-94b90399942f req-2f4e24cc-02e0-4eea-a3b4-e8b21dfb6b25 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:11.923464 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-93f6cae1-dc84-4d19-a8ca-94b90399942f req-2f4e24cc-02e0-4eea-a3b4-e8b21dfb6b25 service nova] Creating event network-vif-deleted:471386bb-e273-4917-a745-e543e8ccf6e1 for instance b44488ee-6a65-404c-8907-02ee23f75774 on nch1-master-1 Jun 04 21:05:11.953855 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-93f6cae1-dc84-4d19-a8ca-94b90399942f req-2f4e24cc-02e0-4eea-a3b4-e8b21dfb6b25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104074 Jun 04 21:05:11.968208 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1573/3019] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:05:12.166052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:12.167325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:12.188912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:12.190047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:12.208433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:12.209036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:12.340647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:12.341109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:12.341582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lazy-loading 'fault' on Instance uuid b44488ee-6a65-404c-8907-02ee23f75774 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:05:13.184444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:13.200762 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f90870ad-aaef-43eb-8b7e-caa4db92a8b0 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 200 len: 1303 microversion: 2.1 time: 1.053092 Jun 04 21:05:13.202763 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1574/3020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:12 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 1303 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:13.441357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:13.460250 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-017a708b-3e96-4e0c-a13e-efbba4364baa tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 1.750537 Jun 04 21:05:13.461203 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1447/3021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:11 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:14.221401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:14.222180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b44488ee-6a65-404c-8907-02ee23f75774] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:14.238794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.239256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.240263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.240864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.267473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] HTTP exception thrown: Instance b44488ee-6a65-404c-8907-02ee23f75774 could not be found. Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Request method failure captured: Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 HTTP/1.1 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8eiDbxwBUENewOM871-x4ifgzrLhGGz5B2KJ659f0cR1Cbppj7WCT_36KFuGNZgLGtyJujVDfwYmQwDPdkiOpWWaDMuHsabxlIAwaKN5V37WJc83N-nawnoJuJZrnxE_TDDuxeoScsHG6NYg-LEvSXk0xb8PfyrffS211fNJSd-L40 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 5b4c3539c5534d2c844944f9be3f9963 Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b44488ee-6a65-404c-8907-02ee23f75774 could not be found. Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b44488ee-6a65-404c-8907-02ee23f75774'} Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44488ee-6a65-404c-8907-02ee23f75774 could not be found. Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44488ee-6a65-404c-8907-02ee23f75774 could not be found. Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:14.273360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44488ee-6a65-404c-8907-02ee23f75774 could not be found. Jun 04 21:05:14.277819 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:14.282722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Returning 404 to user: Instance b44488ee-6a65-404c-8907-02ee23f75774 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:14.284113 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0c5c52e-bdd6-48c1-bfab-a0d28056734c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774" status: 404 len: 111 microversion: 2.1 time: 0.067458 Jun 04 21:05:14.285809 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1575/3022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:14 2022] GET /compute/v2.1/servers/b44488ee-6a65-404c-8907-02ee23f75774 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:14.293706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:14.293850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:14.302292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.304159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.305453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.306127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.397682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:05:14.486226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:14.487270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:14.499933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.500790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.501865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.503974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.584285 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd85380d-cccc-4498-8445-0c5deba86456 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 204 len: 0 microversion: 2.1 time: 0.294408 Jun 04 21:05:14.587399 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1448/3023] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:14 2022] DELETE /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:05:14.598324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:14.599239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:14.606181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.606915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:14.607635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:14.608157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:15.177430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:15.187502 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-75b3e5bd-efdb-4360-ac0c-35f90a63e3be tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 0.713494 Jun 04 21:05:15.187865 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1576/3024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:14 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:15.265188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:15.293246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43b935b4-9801-419c-bb2d-81a1b1980a80 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1467 microversion: 2.1 time: 0.701247 Jun 04 21:05:15.294454 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1449/3025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:14 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1467 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:15.945290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f9c7c160-2e98-486c-8f5c-5d8cd1093790 req-8e64ad4a-714d-4d57-b318-c0af4d4f3175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494652d2-da45-44f7-8f2b-963b3f44bbe0", "name": "network-vif-plugged", "status": "completed", "tag": "16bdcc2c-ea23-4004-a369-8d517594c798"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:15.982251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f9c7c160-2e98-486c-8f5c-5d8cd1093790 req-8e64ad4a-714d-4d57-b318-c0af4d4f3175 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:15.982803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f9c7c160-2e98-486c-8f5c-5d8cd1093790 req-8e64ad4a-714d-4d57-b318-c0af4d4f3175 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:16.028740 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f9c7c160-2e98-486c-8f5c-5d8cd1093790 req-8e64ad4a-714d-4d57-b318-c0af4d4f3175 service nova] Creating event network-vif-plugged:16bdcc2c-ea23-4004-a369-8d517594c798 for instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 on nch2-master-1 Jun 04 21:05:16.042658 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f9c7c160-2e98-486c-8f5c-5d8cd1093790 req-8e64ad4a-714d-4d57-b318-c0af4d4f3175 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101625 Jun 04 21:05:16.044823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1577/3026] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:16.208295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:16.209026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:16.222877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:16.223337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:16.228604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:16.230016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:16.582659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3a1bc82-0ab8-4d4a-ba8d-5c3ca06a0669 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Action: 'create', calling method: .version_select at 0x7f2d02115c10>, body: {"keypair": {"name": "tempest-keypair-905319868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+MSZxAYOMbRTe3SOJJsUZgRdT6AG+TgcFSLVVbmaTuAQff5krAu5JOz6WMGGv8lz7gaPJEUK+UTMZrMHxvMUFwI/e6j+fA1g1nxB5Ya7P1cqIdC9FH01KDAYZSAJRtEw=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:16.619544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f3a1bc82-0ab8-4d4a-ba8d-5c3ca06a0669 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Getting quotas for project ee106eb4506843ffa58a26f486d2e0dd. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:16.634258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f3a1bc82-0ab8-4d4a-ba8d-5c3ca06a0669 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Getting quotas for user 1e858abe021e480686f6458e5b27ad24 and project ee106eb4506843ffa58a26f486d2e0dd. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:16.707372 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3a1bc82-0ab8-4d4a-ba8d-5c3ca06a0669 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.757249 Jun 04 21:05:16.714416 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1450/3027] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:05:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:05:16.740051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:16.744094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:16.778313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:16.780260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:16.781314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:16.784690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:18.046442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:18.060605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf51ddd0-49b1-4996-a10c-a2e949991b93 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1393 microversion: 2.1 time: 1.859864 Jun 04 21:05:18.062841 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1578/3028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:16 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1393 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:18.191141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:18.213270 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a3c0d7e-028c-4dca-8a70-5388e30e535a tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1467 microversion: 2.1 time: 1.493116 Jun 04 21:05:18.217807 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1451/3029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:16 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1467 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:18.523396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-370f9492-9592-4369-9b3d-e75f9aec90a3 req-06356d09-914d-4c0e-bb2c-a1c113ba5ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5eaee8c-2eae-4b79-8877-9662b743bdc0", "name": "network-vif-deleted", "tag": "f01d8e9d-1098-489c-a951-002d58f61ad8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:18.547723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-370f9492-9592-4369-9b3d-e75f9aec90a3 req-06356d09-914d-4c0e-bb2c-a1c113ba5ab1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:18.548553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-370f9492-9592-4369-9b3d-e75f9aec90a3 req-06356d09-914d-4c0e-bb2c-a1c113ba5ab1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:18.565448 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-370f9492-9592-4369-9b3d-e75f9aec90a3 req-06356d09-914d-4c0e-bb2c-a1c113ba5ab1 service nova] Creating event network-vif-deleted:f01d8e9d-1098-489c-a951-002d58f61ad8 for instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 on nch2-master-1 Jun 04 21:05:18.618682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-370f9492-9592-4369-9b3d-e75f9aec90a3 req-06356d09-914d-4c0e-bb2c-a1c113ba5ab1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063869 Jun 04 21:05:18.621951 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1579/3030] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:19.080244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:19.081061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:19.096909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.121681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:19.124662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.125363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:19.236280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:19.237690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:19.254942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.255405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:19.260577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.266432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:19.336674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:19.370935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.371498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:19.372006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lazy-loading 'fault' on Instance uuid b5eaee8c-2eae-4b79-8877-9662b743bdc0 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:05:19.558130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4c3539c5534d2c844944f9be3f9963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ca718638c842a98bb90cc3adb3979f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:19.580576 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4a7f0f4b-0428-49f7-aa36-010b37262ef5 tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 200 len: 1302 microversion: 2.1 time: 0.346480 Jun 04 21:05:19.594490 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1580/3031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:19 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 1302 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:19.756936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:19.766210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f78bc0e0-1bdf-45bf-9679-bb0f3d584432 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1573 microversion: 2.1 time: 0.692217 Jun 04 21:05:19.780900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1452/3032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:19 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1573 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:19.789454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:19.790025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:19.821646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.821646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:19.821646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:19.821646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:20.050637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f3b97ae2-64c1-4d09-8c74-344cb0bb7c62 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.269631 Jun 04 21:05:20.051393 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1581/3033] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:05:19 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0/os-interface => generated 284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:05:20.601089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:20.601757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] [instance: b5eaee8c-2eae-4b79-8877-9662b743bdc0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:20.620605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:20.621067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:20.624114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:20.624567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:20.658009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] HTTP exception thrown: Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 could not be found. Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Request method failure captured: Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 HTTP/1.1 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8eiDbxwBUENewOM871-x4ifgzrLhGGz5B2KJ659f0cR1Cbppj7WCT_36KFuGNZgLGtyJujVDfwYmQwDPdkiOpWWaDMuHsabxlIAwaKN5V37WJc83N-nawnoJuJZrnxE_TDDuxeoScsHG6NYg-LEvSXk0xb8PfyrffS211fNJSd-L40 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/29ca718638c842a98bb90cc3adb3979f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 29ca718638c842a98bb90cc3adb3979f Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MigrationsAdminTest-1933681427 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 5b4c3539c5534d2c844944f9be3f9963 Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MigrationsAdminTest-1933681427-project Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 could not be found. Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b5eaee8c-2eae-4b79-8877-9662b743bdc0'} Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 could not be found. Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 could not be found. Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:20.660401 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 could not be found. Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] Returning 404 to user: Instance b5eaee8c-2eae-4b79-8877-9662b743bdc0 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:20.667195 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5fd821d0-db34-4e4c-9eff-3d403ea5e61c tempest-MigrationsAdminTest-1933681427 tempest-MigrationsAdminTest-1933681427-project] 10.222.0.18 "GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0" status: 404 len: 111 microversion: 2.1 time: 0.070804 Jun 04 21:05:20.674810 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1453/3034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:20 2022] GET /compute/v2.1/servers/b5eaee8c-2eae-4b79-8877-9662b743bdc0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:22.241321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:22.241947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:22.242779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-99df5b3e-8bfa-4f82-a1a7-43ea329c1b22 req-28fec96a-b9a3-46a8-9149-4872451a1f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "494652d2-da45-44f7-8f2b-963b3f44bbe0", "tag": "16bdcc2c-ea23-4004-a369-8d517594c798"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:22.255498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-99df5b3e-8bfa-4f82-a1a7-43ea329c1b22 req-28fec96a-b9a3-46a8-9149-4872451a1f33 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:22.256090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-99df5b3e-8bfa-4f82-a1a7-43ea329c1b22 req-28fec96a-b9a3-46a8-9149-4872451a1f33 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:22.266085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:22.270026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:22.274152 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-99df5b3e-8bfa-4f82-a1a7-43ea329c1b22 req-28fec96a-b9a3-46a8-9149-4872451a1f33 service nova] Creating event network-changed:16bdcc2c-ea23-4004-a369-8d517594c798 for instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 on nch2-master-1 Jun 04 21:05:22.274884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:22.278122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:22.281545 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-99df5b3e-8bfa-4f82-a1a7-43ea329c1b22 req-28fec96a-b9a3-46a8-9149-4872451a1f33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042258 Jun 04 21:05:22.283134 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1454/3035] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:05:22.686080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-772731304", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1dd88f89-335e-4afc-997b-c592b6bf6332"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:22.778236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] validate_networks() for [('1dd88f89-335e-4afc-997b-c592b6bf6332', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:05:23.422680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:23.434071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88576e05-18ed-43ed-ac83-5efdd459a3c7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1573 microversion: 2.1 time: 1.198465 Jun 04 21:05:23.448293 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1582/3036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:22 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1573 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:24.722045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:24.723831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:24.724590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:24.725222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:24.725778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:24.751905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:24.752822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:24.756318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:24.757985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:24.832975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Getting quotas for project c84706a406b74729ad9fa567b79e26a7. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:24.843549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Getting quotas for user 65d70f6f9632426b8f71b9f3b87b43ec and project c84706a406b74729ad9fa567b79e26a7. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:24.892219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:24.899458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:25.014330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b055c28-1305-4bea-be38-807bb9d8dda5 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.602985 Jun 04 21:05:25.015764 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1455/3037] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:05:25.026604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19dfabb0-379a-4f84-89c3-66f34a899a85 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:25.027233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19dfabb0-379a-4f84-89c3-66f34a899a85 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:25.045127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:25.178944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-19dfabb0-379a-4f84-89c3-66f34a899a85 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:25.185477 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19dfabb0-379a-4f84-89c3-66f34a899a85 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1224 microversion: 2.1 time: 0.161456 Jun 04 21:05:25.212909 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1583/3038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:25 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1224 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:26.218270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:26.220551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:26.240980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:26.242807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:26.245105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:26.246106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:26.376044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:26.408876 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b9432f25-4953-4df3-bbd9-8a5c59f29cfd tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1220 microversion: 2.1 time: 0.199998 Jun 04 21:05:26.423589 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1456/3039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:26 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1220 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:27.434378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:27.435107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:27.451559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:27.452016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:27.452829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:27.453274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:27.615619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:27.632148 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc106c88-2fe0-4ed5-a3bc-7390c9845dc9 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1284 microversion: 2.1 time: 0.201604 Jun 04 21:05:27.638488 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1457/3040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:27 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:27.681700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1240257498", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": "none"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:27.771643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:27.772081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:27.772743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:27.773201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:27.773765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:27.787637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:27.788282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:27.789095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:27.789508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:27.808303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Getting quotas for project 19a8826f63e64a8ca9bcd72dcb21a38b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:27.815031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Getting quotas for user 841b177180eb4dcea5acbd6b2acdd474 and project 19a8826f63e64a8ca9bcd72dcb21a38b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:27.831143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:27.836427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:27.960614 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-814e41ff-272a-468b-aa96-9c461c668e89 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.899776 Jun 04 21:05:27.973488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f954c074-9cd5-4ee5-a1b7-7f58cf94ce56 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:27.974357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f954c074-9cd5-4ee5-a1b7-7f58cf94ce56 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:27.977912 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1584/3041] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:05:27.989395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:28.242075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1273367602", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "55e754c7-380d-4ffe-b491-3246f3e09d1d"}], "security_groups": [{"name": "tempest-securitygroup--1845385259"}], "key_name": "tempest-keypair-905319868", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1c27712d-6df1-47b7-b0cf-47c6b5bea42a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:28.255997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f954c074-9cd5-4ee5-a1b7-7f58cf94ce56 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:28.268028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f954c074-9cd5-4ee5-a1b7-7f58cf94ce56 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:28.269793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f954c074-9cd5-4ee5-a1b7-7f58cf94ce56 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:28.271012 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f954c074-9cd5-4ee5-a1b7-7f58cf94ce56 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1278 microversion: 2.57 time: 0.302413 Jun 04 21:05:28.274241 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1458/3042] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:27 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1278 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:28.588423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] validate_networks() for [('55e754c7-380d-4ffe-b491-3246f3e09d1d', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:05:28.767911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-351f862f-3cf5-40ec-b681-b99ecde9442f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Action: 'update', calling method: .version_select at 0x7f2d015ad4c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:28.927364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-351f862f-3cf5-40ec-b681-b99ecde9442f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:28.927865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-351f862f-3cf5-40ec-b681-b99ecde9442f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:28.929957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-351f862f-3cf5-40ec-b681-b99ecde9442f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:28.932013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-351f862f-3cf5-40ec-b681-b99ecde9442f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.060686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-351f862f-3cf5-40ec-b681-b99ecde9442f tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08" status: 200 len: 240 microversion: 2.36 time: 0.554598 Jun 04 21:05:29.062618 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1459/3043] 10.222.0.18 () {62 vars in 1302 bytes} [Sat Jun 4 21:05:28 2022] PUT /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08 => generated 240 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:05:29.078976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:29.080653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:29.092898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.097684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.099276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.102770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.251751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:29.274971 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f175c6d7-0c7c-4060-ad7b-054143996dbc tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1282 microversion: 2.1 time: 0.210231 Jun 04 21:05:29.275931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1460/3044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:29 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:29.288985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a630a26-8621-4fec-b84f-a124cb26bcb3 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Calling method '.version_select at 0x7f2d015adca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:29.419970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Getting quotas for project ee106eb4506843ffa58a26f486d2e0dd. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:29.434475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Getting quotas for user 1e858abe021e480686f6458e5b27ad24 and project ee106eb4506843ffa58a26f486d2e0dd. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:29.481976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:29.483189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a630a26-8621-4fec-b84f-a124cb26bcb3 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.483740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:29.484270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a630a26-8621-4fec-b84f-a124cb26bcb3 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.484850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:29.486419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:29.486757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a630a26-8621-4fec-b84f-a124cb26bcb3 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.487291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:29.487932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a630a26-8621-4fec-b84f-a124cb26bcb3 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.512673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.513297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.514210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.514747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.540050 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a630a26-8621-4fec-b84f-a124cb26bcb3 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08/detail" status: 200 len: 672 microversion: 2.36 time: 0.262805 Jun 04 21:05:29.549283 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1461/3045] 10.222.0.18 () {60 vars in 1303 bytes} [Sat Jun 4 21:05:29 2022] GET /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08/detail => generated 672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:05:29.552505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:29.554983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:29.558603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Getting quotas for project ee106eb4506843ffa58a26f486d2e0dd. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:29.566904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.571526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Getting quotas for user 1e858abe021e480686f6458e5b27ad24 and project ee106eb4506843ffa58a26f486d2e0dd. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:29.572065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.573043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.576357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.694185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:29.696445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c27712d-6df1-47b7-b0cf-47c6b5bea42a',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:29.716671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:29.735563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:29.737941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:29.739888 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0531d622-9636-4f91-b995-ed3425bddc67 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1330 microversion: 2.57 time: 0.195301 Jun 04 21:05:29.763051 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1462/3046] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:29 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1330 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:29.817433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Action: 'update', calling method: .version_select at 0x7f2d015addc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:29.925047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.925278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.928057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.930290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.969818 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2c59bf37-6635-4e6a-9922-a0ed020ff3a5 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.739032 Jun 04 21:05:29.970505 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1585/3047] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:05:28 2022] POST /compute/v2.1/servers => generated 407 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:05:29.983827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.984193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:29.985051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:29.985525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:30.006577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9f8f92ea-8f06-440f-9339-131b1e5eb0ae tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:30.010011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:30.027377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9f8f92ea-8f06-440f-9339-131b1e5eb0ae tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:30.125097 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e00e1c83-4b5f-41ab-9c0b-554000dab3bd tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08?user_id=a3f8a46083744db7817e11c78a4d13b3" status: 200 len: 240 microversion: 2.36 time: 0.310081 Jun 04 21:05:30.128284 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1463/3048] 10.222.0.18 () {62 vars in 1383 bytes} [Sat Jun 4 21:05:29 2022] PUT /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08?user_id=a3f8a46083744db7817e11c78a4d13b3 => generated 240 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 21:05:30.138981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c167c1d2-4b7d-40db-890a-0de2f2430748 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] Calling method '.version_select at 0x7f2d015a5ee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:30.147932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9f8f92ea-8f06-440f-9339-131b1e5eb0ae tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:30.168592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9f8f92ea-8f06-440f-9339-131b1e5eb0ae tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1121 microversion: 2.1 time: 0.191530 Jun 04 21:05:30.172526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1586/3049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:29 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1121 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:30.292762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:30.293393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:30.302654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:30.303109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:30.308060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:30.308596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:30.342272 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c167c1d2-4b7d-40db-890a-0de2f2430748 tempest-QuotasAdminTestV236-2045185083 tempest-QuotasAdminTestV236-2045185083-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08?user_id=a3f8a46083744db7817e11c78a4d13b3" status: 200 len: 282 microversion: 2.36 time: 0.208707 Jun 04 21:05:30.346442 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1464/3050] 10.222.0.18 () {60 vars in 1363 bytes} [Sat Jun 4 21:05:30 2022] GET /compute/v2.1/os-quota-sets/45b2217342274f14980ebd2ae8689e08?user_id=a3f8a46083744db7817e11c78a4d13b3 => generated 282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 21:05:30.638070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:30.648273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-709b01fe-6286-473a-b894-06b9ab8cca83 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.359279 Jun 04 21:05:30.652962 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1587/3051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:30 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:30.769551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:30.770537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:30.782639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:30.784039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:30.785203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:30.786206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:31.011165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:31.045112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:31.046748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:31.061475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cca54af8-ca17-4136-a8bc-86c862fe8061 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1336 microversion: 2.57 time: 0.305700 Jun 04 21:05:31.070878 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1465/3052] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:30 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1336 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:31.169239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a1562638-c079-4140-88c4-5b365fba35ab req-52edb21f-9fce-4c65-b312-be05685dd6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67", "tag": "c441dbeb-066f-4a42-9929-a15a9124b32d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:31.190000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:31.191664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:31.197217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a1562638-c079-4140-88c4-5b365fba35ab req-52edb21f-9fce-4c65-b312-be05685dd6f2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:31.199886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a1562638-c079-4140-88c4-5b365fba35ab req-52edb21f-9fce-4c65-b312-be05685dd6f2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:31.216365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:31.218110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:31.219095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:31.220260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:31.237917 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a1562638-c079-4140-88c4-5b365fba35ab req-52edb21f-9fce-4c65-b312-be05685dd6f2 service nova] Creating event network-changed:c441dbeb-066f-4a42-9929-a15a9124b32d for instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 on nch1-master-1 Jun 04 21:05:31.269409 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a1562638-c079-4140-88c4-5b365fba35ab req-52edb21f-9fce-4c65-b312-be05685dd6f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103784 Jun 04 21:05:31.280012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1588/3053] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:31.355412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:31.366895 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-490d4b02-db0c-4885-ae5c-ce7c84741036 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1219 microversion: 2.1 time: 0.181823 Jun 04 21:05:31.381417 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1466/3054] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:31 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:31.670498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:31.671870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:31.686400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:31.693129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:31.694308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:31.694916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:32.082174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:32.083342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:32.097971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:32.099481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:32.102355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:32.103015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:32.248683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:32.260338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-32412ce2-0bef-4ea3-9dfa-adf4045caeed tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.594044 Jun 04 21:05:32.273576 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1589/3055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:31 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:32.347629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:32.367318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:32.368862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:32.370053 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ffa80cc-3f52-495e-9246-1e44d3ed9561 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1336 microversion: 2.57 time: 0.293538 Jun 04 21:05:32.389171 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1467/3056] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:32 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1336 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:05:32.392704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:32.393628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:32.402351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:32.403108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:32.404254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:32.405089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:32.629048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:32.649630 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bb4603e-6e11-44af-81e1-e2a8b6b11ec7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1237 microversion: 2.1 time: 0.266872 Jun 04 21:05:32.653406 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1590/3057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:32 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:33.292394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:33.304469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:33.332075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:33.333583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:33.335823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:33.336511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:33.403124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:33.404700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:33.421690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:33.423032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:33.425700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:33.427156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:33.716048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:33.731692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:33.734774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:33.740501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-499a21ed-86a3-472e-bcfd-4b26d86d0c61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1357 microversion: 2.57 time: 0.350805 Jun 04 21:05:33.741694 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1591/3058] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:33 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1357 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:33.759617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:33.760320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:33.772923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:33.774793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:33.777284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:33.779106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:33.956030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:33.992312 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3712ad20-d9bc-4835-96b5-506553b2ab48 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1237 microversion: 2.1 time: 0.249321 Jun 04 21:05:33.994212 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1592/3059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:33 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1237 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:34.002091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:34.005930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:34.019471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:34.026078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:34.027004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:34.028224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:34.028839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:34.032506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a815688-f7ab-43f0-9d97-f67e1b3297fb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.756540 Jun 04 21:05:34.033311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1468/3060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:33 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:34.182936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:34.184592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:34.185756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:34.186397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:34.187199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:34.311862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:34.331913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:34.332510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:34.333827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:34.334407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:34.411191 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-acd14b79-52ea-44ef-9334-e8abb84dba43 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "POST /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a/action" status: 202 len: 1138 microversion: 2.57 time: 0.415490 Jun 04 21:05:34.412578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1593/3061] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Jun 4 21:05:33 2022] POST /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a/action => generated 1138 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 04 21:05:34.431240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:34.431860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:34.444722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:34.445141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:34.445950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:34.446399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:34.616740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:34.666088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:34.669948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:34.676409 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09af33e5-a763-4a26-a265-7a2c095b270f tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.247890 Jun 04 21:05:34.677737 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1469/3062] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:34 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:35.012341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:35.013226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:35.022621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:35.023488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:35.024616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:35.025857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:35.051050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:35.052215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:35.062254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:35.063113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:35.064497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:35.065283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:35.727062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:35.746702 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-29c93351-bbc4-4ca5-884b-b3ed6f84d512 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.739800 Jun 04 21:05:35.747317 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1594/3063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:35 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:35.772752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:35.773716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:35.804214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:35.806304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:35.808403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:35.808923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:35.846799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:35.857516 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7644cc2f-3c8c-42cf-a6ec-68f41a343fd2 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.812162 Jun 04 21:05:35.868217 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1470/3064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:35 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:36.021841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:36.032329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:36.038380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:36.040208 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e5a7fb8-2810-4b44-8397-a506fe1b7a83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.283005 Jun 04 21:05:36.041451 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1595/3065] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:35 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:36.767555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:36.768533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:36.780112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:36.780658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:36.781771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:36.782819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:36.876143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:36.876779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:36.884419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:36.884878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:36.885658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:36.886247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:37.395760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:37.410036 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38df77fc-36cd-4864-8cef-75cfcfa84842 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.649096 Jun 04 21:05:37.420070 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1471/3066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:36 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:37.420070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:37.420070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:37.437611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:37.438036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:37.438969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:37.439419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:37.487071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:37.506390 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d4afde98-7cbe-4533-aa6f-12ec7af71f10 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.634146 Jun 04 21:05:37.507340 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1596/3067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:36 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:37.575059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:37.601429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:37.606364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:37.629033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76789811-277e-465d-b64c-2e7323843d61 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.216752 Jun 04 21:05:37.642281 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1472/3068] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:37 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:37.741801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-616048798", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": "none"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:37.802072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:37.802724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:37.803356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:37.803942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:37.804922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:37.817667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:37.818300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:37.819758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:37.820360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:37.857176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Getting quotas for project 1d1e59ed0baa4711bef7dc6059ed7208. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:37.879188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Getting quotas for user 6c8144dbe9274b64967674258aa62739 and project 1d1e59ed0baa4711bef7dc6059ed7208. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:37.888279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b0f8a311-3fea-46ee-b8cc-f75acf463cd0 req-6836d620-717e-4e13-a9b0-86a9861f708e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "098fce3b-1b6f-4781-95ad-e3c82641d80f", "tag": "f8287e01-20ca-4416-9e07-322a84befbff"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:37.912051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b0f8a311-3fea-46ee-b8cc-f75acf463cd0 req-6836d620-717e-4e13-a9b0-86a9861f708e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:37.913954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b0f8a311-3fea-46ee-b8cc-f75acf463cd0 req-6836d620-717e-4e13-a9b0-86a9861f708e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:37.918207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:37.920967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:37.945028 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b0f8a311-3fea-46ee-b8cc-f75acf463cd0 req-6836d620-717e-4e13-a9b0-86a9861f708e service nova] Creating event network-changed:f8287e01-20ca-4416-9e07-322a84befbff for instance 098fce3b-1b6f-4781-95ad-e3c82641d80f on nch1-master-1 Jun 04 21:05:37.965931 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b0f8a311-3fea-46ee-b8cc-f75acf463cd0 req-6836d620-717e-4e13-a9b0-86a9861f708e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081382 Jun 04 21:05:37.966669 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1473/3069] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:05:38.023146 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e37d6ee8-4990-43c4-bfdc-24a385af0541 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.514472 Jun 04 21:05:38.026017 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1597/3070] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:05:38.038398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-959b7438-f90c-49c5-9e44-a4e18ebecc0f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:38.039663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-959b7438-f90c-49c5-9e44-a4e18ebecc0f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:38.274885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-959b7438-f90c-49c5-9e44-a4e18ebecc0f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:38.290020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-959b7438-f90c-49c5-9e44-a4e18ebecc0f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:38.292178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-959b7438-f90c-49c5-9e44-a4e18ebecc0f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:38.303367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-959b7438-f90c-49c5-9e44-a4e18ebecc0f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "PUT /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1358 microversion: 2.75 time: 0.269356 Jun 04 21:05:38.304596 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1474/3071] 10.222.0.18 () {62 vars in 1296 bytes} [Sat Jun 4 21:05:38 2022] PUT /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:38.322662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e7deb07-6770-4c45-82cb-6b1dd9f95e19 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:38.323319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e7deb07-6770-4c45-82cb-6b1dd9f95e19 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:38.430087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:38.431597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:38.440796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:38.443705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:38.448212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:38.449160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:38.586535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e7deb07-6770-4c45-82cb-6b1dd9f95e19 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:38.601014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e7deb07-6770-4c45-82cb-6b1dd9f95e19 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:38.604251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e7deb07-6770-4c45-82cb-6b1dd9f95e19 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:38.621851 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e7deb07-6770-4c45-82cb-6b1dd9f95e19 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1358 microversion: 2.75 time: 0.302793 Jun 04 21:05:38.625034 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1598/3072] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:38 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:38.632815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:38.633704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:38.654706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:38.655391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:38.658427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:38.666601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:39.057818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.075832 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b525f26a-33df-4b61-bd1f-0fdb5bc8fd22 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.647498 Jun 04 21:05:39.084802 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1475/3073] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:38 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:39.094839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:39.096995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:39.104648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:39.105470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:39.107325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:39.108334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:39.205028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.218237 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b1703cd-285f-4b7e-8735-9bf9b6b18022 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.589912 Jun 04 21:05:39.226789 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1599/3074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:38 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:39.232388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c7a5fde4-3618-435d-870d-9f6c98248000 req-7df3cc83-ea47-461a-8902-aede71f60928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67", "name": "network-vif-plugged", "status": "completed", "tag": "c441dbeb-066f-4a42-9929-a15a9124b32d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:39.246754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c7a5fde4-3618-435d-870d-9f6c98248000 req-7df3cc83-ea47-461a-8902-aede71f60928 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:39.247456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c7a5fde4-3618-435d-870d-9f6c98248000 req-7df3cc83-ea47-461a-8902-aede71f60928 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:39.276807 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c7a5fde4-3618-435d-870d-9f6c98248000 req-7df3cc83-ea47-461a-8902-aede71f60928 service nova] Creating event network-vif-plugged:c441dbeb-066f-4a42-9929-a15a9124b32d for instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 on nch1-master-1 Jun 04 21:05:39.284225 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c7a5fde4-3618-435d-870d-9f6c98248000 req-7df3cc83-ea47-461a-8902-aede71f60928 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055697 Jun 04 21:05:39.284868 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1600/3075] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:39.316315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.325113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.327955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.329818 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c47849d4-4838-4032-8765-3dd769b5c2a1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.243852 Jun 04 21:05:39.343236 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1476/3076] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:39 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:39.651405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:39.652481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:39.662069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:39.662821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:39.663808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:39.664397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:39.742228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:39.835722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.847296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.849013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:39.854236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:39.856629 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-74eaa926-2895-4a7b-bb43-305d02b527b8 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1416 microversion: 2.75 time: 0.213384 Jun 04 21:05:39.860058 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1601/3077] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:39 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1416 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:40.097588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:40.097588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:40.100749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=11 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:40.107217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.108089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.109522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.111199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.244339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:40.245627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:40.261400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.265649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.268972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.271689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.474144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:40.496739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb0a597f-db88-4702-9334-f16f6d37c850 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.404395 Jun 04 21:05:40.498502 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1477/3078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:40 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:40.507073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:40.509055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:40.520879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.522116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.524358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.525209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.662733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:40.684850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:40.687241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:40.690868 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d2be6f6c-8e94-4f56-a6e6-50aa0d379a76 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.190856 Jun 04 21:05:40.691787 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1478/3079] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:40 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:40.733129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:40.742413 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b1d26f7-5197-46d2-8b30-3428985aa2eb tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1324 microversion: 2.1 time: 0.502493 Jun 04 21:05:40.743293 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1602/3080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:40 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:40.882255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:40.883561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:40.891771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.892627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:40.893738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:40.895861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.225028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.242208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.246840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.259750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c895332d-bfcd-44d7-98bf-6495fd7188a3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1416 microversion: 2.75 time: 0.381275 Jun 04 21:05:41.262462 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1479/3081] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:40 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1416 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:41.516054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:41.518315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:41.526183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:41.527002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.528076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:41.528749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.710454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:41.711074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:41.722790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:41.723537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.724533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:41.727581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.780082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.790802 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-38b80061-3c39-4d04-902b-87016bbc2956 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.278652 Jun 04 21:05:41.803491 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1603/3082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:41 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:41.810113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:41.812375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:41.826041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:41.827101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.828604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:41.829333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:41.865586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.879417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.883856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:41.885620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c16dc33f-5155-4a8a-af47-2c8f8766c435 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.179366 Jun 04 21:05:41.887046 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1480/3083] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:41 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:42.132712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:42.148592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd8879e5-a49f-4f6f-a3ed-b5984a221df1 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1520 microversion: 2.1 time: 0.343173 Jun 04 21:05:42.149188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1604/3084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:41 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:42.172606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:42.174058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.182241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.182917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.183969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.184640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.247575 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] HTTP exception thrown: Action 999 not found Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Request method failure captured: Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67/os-instance-actions/999 HTTP/1.1 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8kSZUqGs6OTbBK1DGzDbxsmy5vUiuYwQWMmLZqaNDgZhp7GQYwejEuWbetE7mkIvUlfHhNGku1qk5bNGwdGaLarn7zRUtOMSD0mhapcPE75Pjz7dxnWgwDEYxgRkCLUi2G6zngOZu5sSrrqZ432-vQjR4SfepU2RJbZGYxeSm_m7RA Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c84706a406b74729ad9fa567b79e26a7 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c84706a406b74729ad9fa567b79e26a7 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-InstanceActionsNegativeTestJSON-526038358-project Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 65d70f6f9632426b8f71b9f3b87b43ec Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-526038358-project Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: exception: Action 999 not found Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': 'b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67', 'id': '999'} Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 04 21:05:42.257941 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.263894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Returning 404 to user: Action 999 not found {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:42.264949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5182800f-e06d-4580-8e92-29b779b9eb04 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.102325 Jun 04 21:05:42.266011 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1481/3085] 10.222.0.18 () {58 vars in 1307 bytes} [Sat Jun 4 21:05:42 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67/os-instance-actions/999 => generated 66 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:05:42.277428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-182b1e6f-71f1-46d4-9f83-0415de0d3482 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '.version_select at 0x7f2d02c361f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:42.282896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:42.284005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-182b1e6f-71f1-46d4-9f83-0415de0d3482 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: 5daa733e-f3fb-40f2-8cc2-7964fb437015] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.288747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.296840 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-182b1e6f-71f1-46d4-9f83-0415de0d3482 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] HTTP exception thrown: Instance 5daa733e-f3fb-40f2-8cc2-7964fb437015 could not be found. Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-182b1e6f-71f1-46d4-9f83-0415de0d3482 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Request method failure captured: Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/5daa733e-f3fb-40f2-8cc2-7964fb437015/os-instance-actions HTTP/1.1 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8kSZUqGs6OTbBK1DGzDbxsmy5vUiuYwQWMmLZqaNDgZhp7GQYwejEuWbetE7mkIvUlfHhNGku1qk5bNGwdGaLarn7zRUtOMSD0mhapcPE75Pjz7dxnWgwDEYxgRkCLUi2G6zngOZu5sSrrqZ432-vQjR4SfepU2RJbZGYxeSm_m7RA Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c84706a406b74729ad9fa567b79e26a7 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c84706a406b74729ad9fa567b79e26a7 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-InstanceActionsNegativeTestJSON-526038358-project Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 65d70f6f9632426b8f71b9f3b87b43ec Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-526038358-project Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 5daa733e-f3fb-40f2-8cc2-7964fb437015 could not be found. Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '5daa733e-f3fb-40f2-8cc2-7964fb437015'} Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5daa733e-f3fb-40f2-8cc2-7964fb437015 could not be found. Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:42.300187 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5daa733e-f3fb-40f2-8cc2-7964fb437015 could not be found. Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5daa733e-f3fb-40f2-8cc2-7964fb437015 could not be found. Jun 04 21:05:42.304623 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:05:42.312657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:42.313919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-182b1e6f-71f1-46d4-9f83-0415de0d3482 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Returning 404 to user: Instance 5daa733e-f3fb-40f2-8cc2-7964fb437015 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:42.316741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-182b1e6f-71f1-46d4-9f83-0415de0d3482 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/5daa733e-f3fb-40f2-8cc2-7964fb437015/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.045321 Jun 04 21:05:42.317461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.317902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.318692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.319114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.319929 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1605/3086] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Jun 4 21:05:42 2022] GET /compute/v2.1/servers/5daa733e-f3fb-40f2-8cc2-7964fb437015/os-instance-actions => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:42.329129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:42.331013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.361825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.362591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.363592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.364192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.408124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:05:42.448518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:42.459470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:42.464054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:42.475891 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62e35d69-f94b-4a23-972c-74f41abac8b5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1437 microversion: 2.75 time: 0.196877 Jun 04 21:05:42.479105 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1482/3087] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:42 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1437 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:42.499761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:42.503139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.514236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.515167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.516887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.517534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.522839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:42.599297 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54c6e880-7faf-4906-b040-f96268a93d7a tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 204 len: 0 microversion: 2.1 time: 0.273771 Jun 04 21:05:42.600012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1606/3088] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:42 2022] DELETE /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:05:42.613026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:42.614168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.632450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.633400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.634426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.636006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.923752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:42.937786 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-00bc50e8-e70f-45ea-b77a-d6f290ac1e7e tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1526 microversion: 2.1 time: 0.332924 Jun 04 21:05:42.948524 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1607/3089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:42 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1526 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:42.951440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:42.952396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:42.967089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.967444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:42.968252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:42.968693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.029114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:43.030093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:43.030955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:43.031725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:43.032692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:43.114687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:43.122096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.122554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.123337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.123827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.317920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.333542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.335043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.355629 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5bba40bb-93b1-4213-b87d-ba67936a0bd9 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "POST /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031/action" status: 202 len: 1494 microversion: 2.75 time: 0.860918 Jun 04 21:05:43.367698 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1483/3090] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:05:42 2022] POST /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031/action => generated 1494 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jun 04 21:05:43.383276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:43.384265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:43.394395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.394977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.397375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.398306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.426264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.443528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-91c46fe1-59e3-42c4-867c-85d3cc5abbd1 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.503322 Jun 04 21:05:43.444142 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1608/3091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:42 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:43.458534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:43.460436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:43.476571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.477051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.479150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.480402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.533466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.547960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.551925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.556478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-54f60f83-5385-4269-8013-5cd28a1bd99d tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.184178 Jun 04 21:05:43.558830 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1484/3092] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:43 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:43.650526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.667583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.669690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:43.679424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4362899b-d7dc-43ce-961b-a14b6fec1ac4 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.227404 Jun 04 21:05:43.680814 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1609/3093] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:43 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:43.956888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:43.957676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:43.965490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.966040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:43.967079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:43.967642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.393540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.408388 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83b4b060-231b-4a66-b369-d156b045b7b4 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1526 microversion: 2.1 time: 0.455840 Jun 04 21:05:44.408993 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1485/3094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:43 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1526 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:44.461392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:44.462027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:44.470244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:44.470380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.471141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:44.471615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.576854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:44.577697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:44.584311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:44.584668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.585540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:44.586012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.708581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.726044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.728157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.729416 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-536cc665-4587-46b9-af63-d88eae266422 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.156667 Jun 04 21:05:44.729991 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1486/3095] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:44 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:44.745698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:44.746626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:44.758592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:44.759353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.760367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:44.761022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:44.865388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.874613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.876556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.888328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b44a9175-0594-4e7f-bcf4-bc6ad3472e6f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.144663 Jun 04 21:05:44.889564 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1487/3096] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:44 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:44.889972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:44.918644 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9372a1b1-89be-4dd4-bb7c-2f45f9de5076 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.461737 Jun 04 21:05:44.919243 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1610/3097] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:44 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:45.222647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-58a600a3-793d-4278-a3c9-1f2f498eba33 req-bb983e22-1165-4504-a921-8f2cf7c7c77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67", "name": "network-vif-deleted", "tag": "c441dbeb-066f-4a42-9929-a15a9124b32d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:45.234217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-58a600a3-793d-4278-a3c9-1f2f498eba33 req-bb983e22-1165-4504-a921-8f2cf7c7c77f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.234670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-58a600a3-793d-4278-a3c9-1f2f498eba33 req-bb983e22-1165-4504-a921-8f2cf7c7c77f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.255125 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-58a600a3-793d-4278-a3c9-1f2f498eba33 req-bb983e22-1165-4504-a921-8f2cf7c7c77f service nova] Creating event network-vif-deleted:c441dbeb-066f-4a42-9929-a15a9124b32d for instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 on nch1-master-1 Jun 04 21:05:45.260281 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-58a600a3-793d-4278-a3c9-1f2f498eba33 req-bb983e22-1165-4504-a921-8f2cf7c7c77f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042040 Jun 04 21:05:45.261807 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1488/3098] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:45.383323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c8c3e6ca-f50b-4ecf-816e-ce2f64e0358d req-7932a470-fba4-442b-8b82-f35ef55d3c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098fce3b-1b6f-4781-95ad-e3c82641d80f", "name": "network-vif-plugged", "status": "completed", "tag": "f8287e01-20ca-4416-9e07-322a84befbff"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:45.412819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c8c3e6ca-f50b-4ecf-816e-ce2f64e0358d req-7932a470-fba4-442b-8b82-f35ef55d3c4f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.424791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c8c3e6ca-f50b-4ecf-816e-ce2f64e0358d req-7932a470-fba4-442b-8b82-f35ef55d3c4f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.427832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:45.428563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:45.446355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.446838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.447694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.448156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.479407 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c8c3e6ca-f50b-4ecf-816e-ce2f64e0358d req-7932a470-fba4-442b-8b82-f35ef55d3c4f service nova] Creating event network-vif-plugged:f8287e01-20ca-4416-9e07-322a84befbff for instance 098fce3b-1b6f-4781-95ad-e3c82641d80f on nch1-master-1 Jun 04 21:05:45.507726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c8c3e6ca-f50b-4ecf-816e-ce2f64e0358d req-7932a470-fba4-442b-8b82-f35ef55d3c4f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133827 Jun 04 21:05:45.511195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1611/3099] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:45.559006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.559470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.559957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lazy-loading 'fault' on Instance uuid b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:05:45.691122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d70f6f9632426b8f71b9f3b87b43ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84706a406b74729ad9fa567b79e26a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:45.710289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c9998543-c51a-4521-a04b-b9df34d12f28 tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 200 len: 1314 microversion: 2.1 time: 0.287075 Jun 04 21:05:45.724461 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1489/3100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:45 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:45.753132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:45.753991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:45.762996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.764171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.765215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.765780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.862712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:45.871402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:45.872894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:45.874202 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a232680-8c37-4b18-bac5-c78deb284b60 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.126165 Jun 04 21:05:45.874747 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1612/3101] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:45 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:05:45.909557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:45.910277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:45.917118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.917644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.918523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.919290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.935881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:45.936712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:45.949927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.950383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:45.951160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:45.951856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:46.022619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:46.032801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:46.034713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:46.042405 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-216cf162-0340-45ad-907c-e6086f880abe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.137564 Jun 04 21:05:46.045783 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1490/3102] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:45 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:46.195697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:46.205208 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3cdfcdbe-e31a-4b64-aa19-2466cc14ed7c tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.272916 Jun 04 21:05:46.205888 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1613/3103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:45 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:46.729851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:46.731162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] [instance: b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:46.738977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:46.739439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:46.740436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:46.741044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:46.757775 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] HTTP exception thrown: Instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 could not be found. Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Request method failure captured: Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 HTTP/1.1 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8kSZUqGs6OTbBK1DGzDbxsmy5vUiuYwQWMmLZqaNDgZhp7GQYwejEuWbetE7mkIvUlfHhNGku1qk5bNGwdGaLarn7zRUtOMSD0mhapcPE75Pjz7dxnWgwDEYxgRkCLUi2G6zngOZu5sSrrqZ432-vQjR4SfepU2RJbZGYxeSm_m7RA Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c84706a406b74729ad9fa567b79e26a7 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c84706a406b74729ad9fa567b79e26a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c84706a406b74729ad9fa567b79e26a7 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-526038358 Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-InstanceActionsNegativeTestJSON-526038358-project Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 65d70f6f9632426b8f71b9f3b87b43ec Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-526038358-project Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 could not be found. Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67'} Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 could not be found. Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 could not be found. Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:46.759546 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 could not be found. Jun 04 21:05:46.764257 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:05:46.765916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] Returning 404 to user: Instance b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:05:46.767421 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a77d604-1407-4c55-b93c-9fec4cc7ab7b tempest-InstanceActionsNegativeTestJSON-526038358 tempest-InstanceActionsNegativeTestJSON-526038358-project] 10.222.0.18 "GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67" status: 404 len: 111 microversion: 2.1 time: 0.042036 Jun 04 21:05:46.772025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1491/3104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:46 2022] GET /compute/v2.1/servers/b7910b4f-2fb9-41c6-a7cd-965c5c7d3a67 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:05:46.897114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:46.898009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:46.912732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:46.913198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:46.914000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:46.914441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:46.996635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.025016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.030536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.032455 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17476eb5-35bb-4792-88aa-8e8e148dd8d4 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.142206 Jun 04 21:05:47.033650 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1614/3105] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:46 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:47.066229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:47.066889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:47.073462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:47.074377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:47.075350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:47.076032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:47.176459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.190658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.193351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.203060 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e9a78b3c-3be6-4e4b-8fa3-190d420f7a86 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.140703 Jun 04 21:05:47.217873 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1492/3106] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:47 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:47.225208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:47.225838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:47.242296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:47.242972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:47.243997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:47.244811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:47.604861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:47.613667 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e770a9c2-af64-46cb-b749-b2862f4cd3d0 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1293 microversion: 2.1 time: 0.394377 Jun 04 21:05:47.618414 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1615/3107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:47 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1293 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:48.053518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:48.054437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:48.068226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:48.069127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:48.070372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:48.070972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:48.181853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.201369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.206741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.210719 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6cbc5a25-776b-4c3c-a130-78d95b4702a6 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.162125 Jun 04 21:05:48.225410 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1493/3108] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:48 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:48.228945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:48.229826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:48.232211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:48.243946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:48.244722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:48.245684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:48.246300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:48.343270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.356932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.365208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.374703 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd275f8e-c233-415d-b152-5603a25dcae2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.149613 Jun 04 21:05:48.376091 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1616/3109] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:48 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:48.635335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:48.636165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:48.639359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=40 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:48.656441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:48.656870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:48.657696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:48.658117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:48.975208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:48.987724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32b4ce82-91df-4d63-bd6c-79bf7c51450e tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1484 microversion: 2.1 time: 0.354338 Jun 04 21:05:48.988462 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1494/3110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:48 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1484 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:49.004260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:49.005066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:49.010946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=28 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:49.021815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:49.022278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:49.023087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:49.023622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:49.128881 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a5c1176b-444f-44c6-9edc-2ba02bc31e84 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128683 Jun 04 21:05:49.130235 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1617/3111] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:05:48 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:49.236210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:49.236890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:49.250757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:49.251224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:49.254859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:49.255306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:49.399585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:49.400311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:49.408652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:49.409108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:49.409902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:49.410346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:49.454772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:49.671202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:49.677209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:49.680924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:49.686233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:49.687480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:49.690460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40b98020-5b59-4944-838b-d74344c9b168 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.459772 Jun 04 21:05:49.692594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:49.693246 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1495/3112] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:49 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:49.713515 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-28c93530-a6f5-49a9-9697-98b611faf874 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.317597 Jun 04 21:05:49.715681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1618/3113] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:49 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:05:50.713297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:50.714458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:50.727922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:50.728738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:50.729755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:50.732057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:50.743133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:50.744998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:50.764801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:50.766442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:50.768162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:50.769959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.115497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.123424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.136131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.143351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.146714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.154576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.155722 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dad2e69e-75a3-4214-b148-cd5d5906f8df tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.445680 Jun 04 21:05:51.168782 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1496/3114] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:50 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:51.175650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98a1c914-b7d3-4f10-b5d8-daecfd4b7f73 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.438189 Jun 04 21:05:51.180300 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1619/3115] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:50 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:51.233737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:51.234776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:51.240536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1b2fb717-9a56-4459-bbba-f11b148162ab req-ed0f8fb5-7e5f-427d-956a-50c241e3419f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "098fce3b-1b6f-4781-95ad-e3c82641d80f", "tag": "f8287e01-20ca-4416-9e07-322a84befbff"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:51.258744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.259191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.260064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.260500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.263987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1b2fb717-9a56-4459-bbba-f11b148162ab req-ed0f8fb5-7e5f-427d-956a-50c241e3419f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.264431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1b2fb717-9a56-4459-bbba-f11b148162ab req-ed0f8fb5-7e5f-427d-956a-50c241e3419f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.309774 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1b2fb717-9a56-4459-bbba-f11b148162ab req-ed0f8fb5-7e5f-427d-956a-50c241e3419f service nova] Creating event network-changed:f8287e01-20ca-4416-9e07-322a84befbff for instance 098fce3b-1b6f-4781-95ad-e3c82641d80f on nch1-master-1 Jun 04 21:05:51.326017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1b2fb717-9a56-4459-bbba-f11b148162ab req-ed0f8fb5-7e5f-427d-956a-50c241e3419f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087599 Jun 04 21:05:51.327032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1620/3116] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:05:51.486878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.506167 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e36c696-33a6-432a-9437-70c0b759a916 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1484 microversion: 2.1 time: 0.276985 Jun 04 21:05:51.508062 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1497/3117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:51 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1484 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:51.770717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:51.774563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.780885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Searching by: {'deleted': False, 'project_id': '5c275250b53146a2a6fbd1c15b484560'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:05:51.807668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.808165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.809023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.809463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.865445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:05:51.926178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2997cd2a-20c9-4cb8-8062-2990bb13b1b4 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.161847 Jun 04 21:05:51.927406 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1621/3118] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:05:51 2022] GET /compute/v2.1/servers => generated 333 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:51.941355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:51.948072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:51.952440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Searching by: {'deleted': False, 'project_id': '5c275250b53146a2a6fbd1c15b484560'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:05:51.967181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.969802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:51.971545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:51.972936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:52.048249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:52.057987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:05:52.159993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.174926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:52.175736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:52.180109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:52.181821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:52.185897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:52.186353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:52.189786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:52.191037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:52.354988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.368255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.370184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.371776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3565e46c-b19a-4ec1-bb46-2ff9ffb9d818 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.201347 Jun 04 21:05:52.372879 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1622/3119] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:52 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:52.379318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:52.380234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:52.390233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:52.391274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:52.392530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:52.394681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:52.512060 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-594873fc-222b-4d6b-a032-c389c72f8b86 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.577010 Jun 04 21:05:52.512889 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1498/3120] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:05:51 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:52.538616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.553020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.556801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:52.570815 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e5e7376-1e8c-4d19-9091-fa0e09a10db7 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.196042 Jun 04 21:05:52.571439 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1623/3121] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:52 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:52.580497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f89fb00d-f231-4489-bf0f-80fcb43ad396 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:52.596049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f89fb00d-f231-4489-bf0f-80fcb43ad396 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020496 Jun 04 21:05:52.596642 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1624/3122] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:05:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:05:52.729721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-723190127", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "d856f6dd-011c-4635-b04c-42cde533cf02"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:52.800293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] validate_networks() for [('d856f6dd-011c-4635-b04c-42cde533cf02', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:05:53.394870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:53.395460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:53.404040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.404494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.405265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.405705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.517718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:53.528486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:53.530400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:53.531625 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ebe2d746-4702-49ea-b18a-dc36be910122 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.144363 Jun 04 21:05:53.532739 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1625/3123] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:53 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:53.599297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:53.600026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:53.614257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.614798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.616199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.616828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.637353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:53.637841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:53.638399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:53.638658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:53.639093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:53.661813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.662785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.665567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.666235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.707690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Getting quotas for project 887ac9932d584f4b99b7b168721d9552. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:53.713938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Getting quotas for user e2235426d43a4e98973a97ea8e45c1f4 and project 887ac9932d584f4b99b7b168721d9552. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:53.731813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:53.734492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:53.760738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:53.777135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:53.780785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:53.789694 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f36d1fb2-61a9-4cb6-b288-7672535ead5d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.203250 Jun 04 21:05:53.790923 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1626/3124] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:53 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:05:53.808292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:53.809728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:53.814307 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed12344f-8526-43b4-8d63-5f4b9f8a5ccf tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.296604 Jun 04 21:05:53.815215 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1499/3125] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:05:53.819368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.820012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.820900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:53.821436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:53.901036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-937153198", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "d856f6dd-011c-4635-b04c-42cde533cf02"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:53.903262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:05:54.050322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] validate_networks() for [('d856f6dd-011c-4635-b04c-42cde533cf02', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:05:54.228492 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e1ae3e3-6702-45fe-a6c4-93ebf13f7f2e tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "DELETE /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 204 len: 0 microversion: 2.1 time: 0.431018 Jun 04 21:05:54.229984 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1627/3126] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:05:53 2022] DELETE /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:05:54.244847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:54.245577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:54.256585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:54.257535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:54.259283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:54.260086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:54.919338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:54.940366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-24022cf8-7548-43e6-857d-412a09550662 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1698 microversion: 2.1 time: 0.702233 Jun 04 21:05:54.945005 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1628/3127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:54 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1698 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:05:54.987467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:54.992112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:55.010646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.011109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.015339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.016475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.162612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:55.178797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:55.183389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:55.186882 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-10ffd069-c0fc-4bee-a38c-0dff79e6a247 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.239478 Jun 04 21:05:55.188557 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1629/3128] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:54 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:55.198220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:55.202488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:55.215754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.219038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.222931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.224399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.267133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:55.268572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:55.269337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:55.269947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:55.270613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:55.286419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.287547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.288578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.289386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.322428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Getting quotas for project 887ac9932d584f4b99b7b168721d9552. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:55.329875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Getting quotas for user e2235426d43a4e98973a97ea8e45c1f4 and project 887ac9932d584f4b99b7b168721d9552. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:55.362275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:55.364901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:55.383262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:55.409690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:55.426216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:55.442018 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bf91a1a1-59f8-4bc1-88a5-69529837d2af tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.249521 Jun 04 21:05:55.443029 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1630/3129] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:55 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:55.463460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ae55316-d599-4cf0-92a9-127abbb65567 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577796 Jun 04 21:05:55.465304 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1500/3130] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:05:55.554576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-192281335", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "451", "networks": [{"uuid": "d856f6dd-011c-4635-b04c-42cde533cf02"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:05:55.667163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] validate_networks() for [('d856f6dd-011c-4635-b04c-42cde533cf02', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:05:55.961255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:55.961506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:55.993343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.995025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:55.998091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:55.999635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.545414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:57.562620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c458114-6326-4771-b786-c6f401dc6492 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1698 microversion: 2.1 time: 1.605657 Jun 04 21:05:57.576352 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1501/3131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:55 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1698 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:57.589322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:57.592182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:57.611115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:57.612074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.613172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:57.615607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.625834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:05:57.627356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:05:57.628312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:05:57.629254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:05:57.629846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:05:57.686223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:57.688385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.692009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:57.692652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.746188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Getting quotas for project 887ac9932d584f4b99b7b168721d9552. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:05:57.754931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Getting quotas for user e2235426d43a4e98973a97ea8e45c1f4 and project 887ac9932d584f4b99b7b168721d9552. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:05:57.772613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:05:57.776262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:05:57.800944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:05:57.890626 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-36b806ed-71c7-4f9f-8885-383496727604 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340521 Jun 04 21:05:57.897803 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1631/3132] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:05:57.904724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:57.905919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:57.914384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:57.915083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.916129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:57.918217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:57.921143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:57.947656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:57.949519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:57.950876 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7da81d5-838d-45ed-bcb2-38180897b2e1 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.372126 Jun 04 21:05:57.951646 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1502/3133] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:57 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:57.965303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c32581c-9232-4e1b-a677-490f4de70adc tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:57.966326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c32581c-9232-4e1b-a677-490f4de70adc tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:58.103840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c32581c-9232-4e1b-a677-490f4de70adc tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:58.121481 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c32581c-9232-4e1b-a677-490f4de70adc tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1220 microversion: 2.1 time: 0.164969 Jun 04 21:05:58.122621 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1503/3134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:57 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:58.137227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:58.157308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:58.159106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:58.167241 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20d497ee-758d-43a7-a04b-824517511969 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.267995 Jun 04 21:05:58.170194 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1632/3135] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:57 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:58.585090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:58.589243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:58.605917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:58.612332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:58.615001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:58.615842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:58.974886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:58.975914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:58.990127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:58.990623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:58.991410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:58.991870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:59.277145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:59.299349 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c2128758-abed-4ead-b4f1-3dfa0c378571 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1698 microversion: 2.1 time: 0.719821 Jun 04 21:05:59.314940 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1504/3136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:58 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1698 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:05:59.346078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:59.350404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:59.352528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:59.389175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:59.393986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:05:59.398399 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-94d96dcc-95f0-42ff-9c07-22367d171b19 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.432369 Jun 04 21:05:59.403150 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1633/3137] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:58 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:05:59.429364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:59.430214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:59.431246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:59.432115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:05:59.432718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:59.434784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:05:59.472155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:59.473282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:05:59.474997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:05:59.476631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:00.072367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.084027 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f524e1e1-6fff-447a-bd8f-0ca9a1adaff4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1272 microversion: 2.1 time: 0.765172 Jun 04 21:06:00.084657 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1505/3138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:05:59 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1272 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:00.089669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.102133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1821fac4-a6f6-4319-82e8-141e00c069eb req-d2d9a0e3-1644-412a-bef1-266e6e8661c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "054cf0c3-9df7-4440-a761-e2ece6ffbf67", "tag": "e68410d2-2d72-4245-a948-4d8cdc2756cd"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:00.107314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.112716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.116968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1821fac4-a6f6-4319-82e8-141e00c069eb req-d2d9a0e3-1644-412a-bef1-266e6e8661c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:00.117430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1821fac4-a6f6-4319-82e8-141e00c069eb req-d2d9a0e3-1644-412a-bef1-266e6e8661c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:00.127749 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83e69650-dda9-40c3-a847-7d4ff4ce4061 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.721403 Jun 04 21:06:00.129335 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1634/3139] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:05:59 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:00.150358 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1821fac4-a6f6-4319-82e8-141e00c069eb req-d2d9a0e3-1644-412a-bef1-266e6e8661c4 service nova] Creating event network-changed:e68410d2-2d72-4245-a948-4d8cdc2756cd for instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 on nch1-master-1 Jun 04 21:06:00.161737 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1821fac4-a6f6-4319-82e8-141e00c069eb req-d2d9a0e3-1644-412a-bef1-266e6e8661c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070374 Jun 04 21:06:00.163081 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1506/3140] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:00.337915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:00.339613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:00.351829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:00.352538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:00.354061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:00.355873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:00.414608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:00.429191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:00.430683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:00.445304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:00.446422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:00.447715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:00.450052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:00.655909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.666890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b3ba79ea-946a-4f3b-a705-226b7aec23b7 tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1632 microversion: 2.1 time: 0.348415 Jun 04 21:06:00.668319 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1635/3141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:00 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1632 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:00.724287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.738093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.741519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:00.744309 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-46299d69-fe8d-438d-b1f4-cc44d9624e83 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1366 microversion: 2.57 time: 0.324104 Jun 04 21:06:00.750714 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1507/3142] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:00 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:01.104781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:01.106524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:01.125170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.132952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.133988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.134663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.148950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:01.150369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:01.165995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:01.176874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.177730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.178844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.179618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.455633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:01.489080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:01.493890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:01.543739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d593bd87-5761-43b3-878c-1a2c5e38fa64 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.396536 Jun 04 21:06:01.546308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1508/3143] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:01 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:01.562110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c62fc969-bb1a-4cfe-b995-98d3b196001e req-69ee02d0-6116-4f80-854f-3928acc5b48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "494652d2-da45-44f7-8f2b-963b3f44bbe0", "name": "network-vif-deleted", "tag": "16bdcc2c-ea23-4004-a369-8d517594c798"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:01.585301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c62fc969-bb1a-4cfe-b995-98d3b196001e req-69ee02d0-6116-4f80-854f-3928acc5b48e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.588138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c62fc969-bb1a-4cfe-b995-98d3b196001e req-69ee02d0-6116-4f80-854f-3928acc5b48e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.634101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c62fc969-bb1a-4cfe-b995-98d3b196001e req-69ee02d0-6116-4f80-854f-3928acc5b48e service nova] Creating event network-vif-deleted:16bdcc2c-ea23-4004-a369-8d517594c798 for instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 on nch2-master-1 Jun 04 21:06:01.650114 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c62fc969-bb1a-4cfe-b995-98d3b196001e req-69ee02d0-6116-4f80-854f-3928acc5b48e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098840 Jun 04 21:06:01.652178 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1509/3144] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:01.686691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:01.687440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:01.705732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.708134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.710454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.712478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.807277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:01.809309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:01.809844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lazy-loading 'fault' on Instance uuid 494652d2-da45-44f7-8f2b-963b3f44bbe0 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:02.291876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.304560 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-76df8ced-f521-4af2-8cac-34bc5370e66e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1278 microversion: 2.1 time: 1.204833 Jun 04 21:06:02.308200 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1636/3145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:01 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1278 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:02.314318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:02.315218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:02.324051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:02.324918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:02.325924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:02.326590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:02.518520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.540593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82f7fda07c394cce95c6f317ad334d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c275250b53146a2a6fbd1c15b484560', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.549322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.551792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.554126 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bea860d0-893e-47d3-a60d-cb8524e5d304 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1372 microversion: 2.57 time: 0.244726 Jun 04 21:06:02.555418 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1637/3146] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:02 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:02.567786 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ebeb884-2fe2-4f60-ba62-da5969633f5b tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 200 len: 1359 microversion: 2.1 time: 0.885589 Jun 04 21:06:02.574224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:02.575461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:02.577939 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1510/3147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:01 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 1359 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:02.595768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:02.596514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:02.597597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:02.598733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:02.780391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.804487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.807529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:02.822043 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d8fcae7a-b412-406c-8a12-7face6825233 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.254005 Jun 04 21:06:02.824465 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1638/3148] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:02 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:03.334206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:03.335256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:03.364145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.366907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.368980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.371558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.491005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:03.512194 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87d04b14-b76b-439b-a6c9-6ad4bce8efa4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1278 microversion: 2.1 time: 0.188199 Jun 04 21:06:03.514363 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1511/3149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:03 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:03.591569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:03.595864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:03.596492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] [instance: 494652d2-da45-44f7-8f2b-963b3f44bbe0] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:03.597645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:03.620269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.620727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.621533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.621976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.624391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.624846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.626148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.626148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.665094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] HTTP exception thrown: Instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 could not be found. Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Request method failure captured: Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 HTTP/1.1 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8jmwMVaCD8YSHE1-2ulIwEMOuI0b8kS3bwH0v2IUFTPrvxrq-6280CQIuTS-Mu0o6IbyxlCrYzZKfTeHvdSoqb0wXqvzhhasvguEUBmZplGwjMIu4GaST8ZYY-QRWHKLiqBtxEVfLxinI2oqLKVFg6jFezGqlxbYcBehGJi--cyBHw Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 5c275250b53146a2a6fbd1c15b484560 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1006517561 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_5c275250b53146a2a6fbd1c15b484560"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c275250b53146a2a6fbd1c15b484560"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/5c275250b53146a2a6fbd1c15b484560"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/5c275250b53146a2a6fbd1c15b484560"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1006517561 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 5c275250b53146a2a6fbd1c15b484560 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1006517561 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1006517561-project Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 82f7fda07c394cce95c6f317ad334d68 Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1006517561-project Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 could not be found. Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '494652d2-da45-44f7-8f2b-963b3f44bbe0'} Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 could not be found. Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 could not be found. Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:06:03.672139 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:03.677367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:06:03.677367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:06:03.677367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:06:03.677367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:06:03.677367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 could not be found. Jun 04 21:06:03.677367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:06:03.680570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Returning 404 to user: Instance 494652d2-da45-44f7-8f2b-963b3f44bbe0 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:06:03.686696 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22ee3fc6-a845-4d99-a729-032582eabaca tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0" status: 404 len: 111 microversion: 2.1 time: 0.097200 Jun 04 21:06:03.687571 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1512/3150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:03 2022] GET /compute/v2.1/servers/494652d2-da45-44f7-8f2b-963b3f44bbe0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:06:03.701114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-972391f0-9ca7-4bd0-aa19-e3d2e578285a tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] Calling method '.version_select at 0x7f2d015a50d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:03.738093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-972391f0-9ca7-4bd0-aa19-e3d2e578285a tempest-ServersTestJSON-1006517561 tempest-ServersTestJSON-1006517561-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174903856" status: 202 len: 0 microversion: 2.1 time: 0.041220 Jun 04 21:06:03.741902 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1513/3151] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:06:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174903856 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:06:03.801921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:03.812271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:03.821809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:03.823346 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-50259e27-9a88-4034-8e14-0a2081cb0a6e tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1372 microversion: 2.57 time: 0.238368 Jun 04 21:06:03.824495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1639/3152] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:03 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:03.843627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:03.844843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:03.862322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.863685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:03.864998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:03.868702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:04.060162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:04.073696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:04.075570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:04.093431 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a613805c-bf96-496e-98a8-819d975672fb tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.254858 Jun 04 21:06:04.094410 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1514/3153] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:03 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:04.532345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:04.533012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:04.542240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:04.547950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:04.549582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:04.550043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:04.843276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:04.844483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:04.861780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:04.863328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:04.869711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:04.870539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.148388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.160188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.162810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.164373 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7d82035-01f8-48e1-b12b-fb3ab7a7bda7 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1357 microversion: 2.57 time: 0.326022 Jun 04 21:06:05.178687 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1515/3154] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:04 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:05.189277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:05.190314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:05.196975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:05.211758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.213342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:05.214087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.313227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:05.498090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.515812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.521589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.537565 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-56cce061-38d8-401b-bb4a-5e49ddd1c772 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.356533 Jun 04 21:06:05.539974 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1516/3155] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:05 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:05.554129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:05.555325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:05.574646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:05.576531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.581421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:05.582142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.627234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:06:05.760647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:05.819274 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc69978e-3255-44f1-8b7f-2b9f6aef7e78 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 204 len: 0 microversion: 2.57 time: 0.276430 Jun 04 21:06:05.831456 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1517/3156] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:06:05 2022] DELETE /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:06:05.838868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:05.839694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:05.850344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:05.853114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.854750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:05.855392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:05.910012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:05.918496 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef29269f-5661-497e-a32c-a72cd8e17900 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 1.391832 Jun 04 21:06:05.928930 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1640/3157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:04 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:06.100686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:06.124472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:06.130712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:06.137456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-062b913e-ee6b-4d70-98c1-88a1bacbdd35 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1363 microversion: 2.57 time: 0.299932 Jun 04 21:06:06.138486 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1518/3158] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:05 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:06.566049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:06.566860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:06.582053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:06.587096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:06.588167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:06.588432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:06.783886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:06.804271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:06.812649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:06.825332 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a057320f-d8ab-4a62-9a2c-c1b811d7806c tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.265442 Jun 04 21:06:06.833482 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1641/3159] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:06 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:06.920554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-262df5dc-029c-4e45-b3a4-040854c3a84e req-c48f3f6e-ea43-4338-b2e9-9a0c10408c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f14fd5-d9c4-4330-805e-981592057063", "tag": "f5a6718e-7a96-4486-9a48-4445966d79d0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:06.936347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:06.939808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:06.947962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:06.948734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:06.950694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:06.953304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:06.974564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-262df5dc-029c-4e45-b3a4-040854c3a84e req-c48f3f6e-ea43-4338-b2e9-9a0c10408c83 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:06.977226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-262df5dc-029c-4e45-b3a4-040854c3a84e req-c48f3f6e-ea43-4338-b2e9-9a0c10408c83 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:07.015503 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-262df5dc-029c-4e45-b3a4-040854c3a84e req-c48f3f6e-ea43-4338-b2e9-9a0c10408c83 service nova] Creating event network-changed:f5a6718e-7a96-4486-9a48-4445966d79d0 for instance 46f14fd5-d9c4-4330-805e-981592057063 on nch1-master-1 Jun 04 21:06:07.031165 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-262df5dc-029c-4e45-b3a4-040854c3a84e req-c48f3f6e-ea43-4338-b2e9-9a0c10408c83 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115254 Jun 04 21:06:07.035322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1519/3160] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:07.116533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7b99e85d-3bae-4a3d-a9a5-30ba0b7609e9 req-c0602db9-c5ae-42fa-8765-03804c1f1df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054cf0c3-9df7-4440-a761-e2ece6ffbf67", "name": "network-vif-plugged", "status": "completed", "tag": "e68410d2-2d72-4245-a948-4d8cdc2756cd"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:07.135206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7b99e85d-3bae-4a3d-a9a5-30ba0b7609e9 req-c0602db9-c5ae-42fa-8765-03804c1f1df5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:07.137552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7b99e85d-3bae-4a3d-a9a5-30ba0b7609e9 req-c0602db9-c5ae-42fa-8765-03804c1f1df5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:07.170265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7b99e85d-3bae-4a3d-a9a5-30ba0b7609e9 req-c0602db9-c5ae-42fa-8765-03804c1f1df5 service nova] Creating event network-vif-plugged:e68410d2-2d72-4245-a948-4d8cdc2756cd for instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 on nch1-master-1 Jun 04 21:06:07.182263 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7b99e85d-3bae-4a3d-a9a5-30ba0b7609e9 req-c0602db9-c5ae-42fa-8765-03804c1f1df5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070470 Jun 04 21:06:07.184739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1520/3161] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:06:07.200617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:07.202972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:07.255985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:07.259804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:07.261954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:07.263154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:07.403722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:07.428686 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ee9fe3c-81b4-482a-bb0d-22ccfae1b953 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 0.497004 Jun 04 21:06:07.429264 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1642/3162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:06 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:07.478031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:07.493905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:07.497476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:07.499572 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-16b63d49-c612-4f6c-99f5-7e28978774e3 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1363 microversion: 2.57 time: 0.312469 Jun 04 21:06:07.513560 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1521/3163] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:07 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:07.857929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:07.859541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:07.886727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:07.888093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:07.896576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:07.899428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:07.900550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:07.901193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:08.163112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:08.179847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:08.182029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:08.198795 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7242e894-4cac-49e4-a3f9-53c81186c557 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.340920 Jun 04 21:06:08.199733 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1643/3164] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:07 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:08.455403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:08.458564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:08.468858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:08.472965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:08.473669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:08.474764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:08.475842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:08.520918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:08.521877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:08.546584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:08.547274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:08.548906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:08.549360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:08.680937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:08.681797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:08.682422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lazy-loading 'fault' on Instance uuid ca7f880a-a09d-4ada-b549-b90c5053014a {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:09.223218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.247502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.249465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '841b177180eb4dcea5acbd6b2acdd474', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a8826f63e64a8ca9bcd72dcb21a38b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.259741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-737a3a8d-5d67-4cb9-ad7f-914474b3fc08 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 200 len: 1368 microversion: 2.57 time: 0.741342 Jun 04 21:06:09.262931 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1644/3165] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:08 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 1368 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:09.268167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ee875c8e-cbf1-4e19-810f-1c6216244665 req-b93121fc-4667-4c00-aa0e-703e1d201dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "483cc3e1-24ca-47a3-bda1-7e2f7e975b9b", "tag": "e7e2a769-2c27-412e-91fc-116b842cf6e5"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:09.289312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ee875c8e-cbf1-4e19-810f-1c6216244665 req-b93121fc-4667-4c00-aa0e-703e1d201dcc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:09.289984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ee875c8e-cbf1-4e19-810f-1c6216244665 req-b93121fc-4667-4c00-aa0e-703e1d201dcc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:09.302816 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ee875c8e-cbf1-4e19-810f-1c6216244665 req-b93121fc-4667-4c00-aa0e-703e1d201dcc service nova] Creating event network-changed:e7e2a769-2c27-412e-91fc-116b842cf6e5 for instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b on nch2-master-1 Jun 04 21:06:09.308487 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ee875c8e-cbf1-4e19-810f-1c6216244665 req-b93121fc-4667-4c00-aa0e-703e1d201dcc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044162 Jun 04 21:06:09.310032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1645/3166] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:09.316780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:09.317737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:09.326117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:09.326870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:09.327993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:09.328693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:09.448250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.466063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.470870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.491237 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c86b86ef-9c8a-418b-bf43-a4596a265a06 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.179586 Jun 04 21:06:09.495235 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1646/3167] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:09 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:09.713799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:09.723909 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec57e308-6d2c-4121-bb04-bcc1de5b684e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 1.280267 Jun 04 21:06:09.724739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1522/3168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:08 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:10.283400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:10.284164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] [instance: ca7f880a-a09d-4ada-b549-b90c5053014a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:10.304070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:10.304521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:10.306389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:10.306994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:10.324076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] HTTP exception thrown: Instance ca7f880a-a09d-4ada-b549-b90c5053014a could not be found. Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Request method failure captured: Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a HTTP/1.1 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8kWo9j8ufEGX60XY19KpoanRklTC9-j220Zkrgb_lOLkK-fSHQ9UBB9dQSeqywJbe-7SplJB6Q4h7O7iwPHhX-t9fovIroqcg008rqJ94I9XZfCUnkbuqgd-MfV_olHRx9nq01Yaj1ywFemxu3xjfT_80sKwx0W8WIs-HnxyJjlK6E Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.57 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 19a8826f63e64a8ca9bcd72dcb21a38b Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerShowV257Test-1332911387 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_19a8826f63e64a8ca9bcd72dcb21a38b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19a8826f63e64a8ca9bcd72dcb21a38b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/19a8826f63e64a8ca9bcd72dcb21a38b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/19a8826f63e64a8ca9bcd72dcb21a38b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerShowV257Test-1332911387 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 19a8826f63e64a8ca9bcd72dcb21a38b Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerShowV257Test-1332911387 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerShowV257Test-1332911387-project Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 841b177180eb4dcea5acbd6b2acdd474 Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerShowV257Test-1332911387-project Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ca7f880a-a09d-4ada-b549-b90c5053014a could not be found. Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ca7f880a-a09d-4ada-b549-b90c5053014a'} Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca7f880a-a09d-4ada-b549-b90c5053014a could not be found. Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca7f880a-a09d-4ada-b549-b90c5053014a could not be found. Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:06:10.326573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca7f880a-a09d-4ada-b549-b90c5053014a could not be found. Jun 04 21:06:10.332068 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:10.333554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] Returning 404 to user: Instance ca7f880a-a09d-4ada-b549-b90c5053014a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:06:10.334600 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc40fa73-5329-42dd-b8ea-a699545d5359 tempest-ServerShowV257Test-1332911387 tempest-ServerShowV257Test-1332911387-project] 10.222.0.18 "GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a" status: 404 len: 111 microversion: 2.57 time: 0.058517 Jun 04 21:06:10.338699 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1647/3169] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:10 2022] GET /compute/v2.1/servers/ca7f880a-a09d-4ada-b549-b90c5053014a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:06:10.521059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:10.525491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:10.555382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:10.558787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:10.560564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:10.563420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:10.742025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:10.742969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:10.755344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:10.756145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:10.756778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:10.758184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:10.759054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:10.773420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:10.784355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:10.810351 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f84dc46c-af4d-4bf9-9498-db25edb1acd3 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.296192 Jun 04 21:06:10.812360 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1523/3170] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:10 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:11.548649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:11.564229 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-adc0d239-d9f9-4792-a368-1b78c6547817 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 0.826323 Jun 04 21:06:11.565548 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1648/3171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:10 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:11.834571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:11.835191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:11.843047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:11.843984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:11.845056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:11.845686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:12.029207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:12.041846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:12.050034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:12.067197 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-33687d73-d437-442b-b6b3-76072517fbd2 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.234615 Jun 04 21:06:12.072128 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1524/3172] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:11 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:12.583690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:12.584865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:12.602563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:12.603310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:12.606740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:12.610136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:13.095695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:13.097136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:13.120511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:13.121914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:13.127281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:13.128145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:13.398839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:13.410560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:13.413207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:13.421366 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b43515f-6264-41a3-b9de-a22919be57ef tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.334306 Jun 04 21:06:13.422768 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1525/3173] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:13 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:13.535724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:13.550917 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ada5373c-0b2b-4c7d-a5c2-989be66cf6e8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 0.972413 Jun 04 21:06:13.552833 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1649/3174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:12 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:14.444317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:14.445373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:14.459423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:14.460896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:14.463457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:14.470737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:14.572248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:14.574100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:14.574648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:14.587696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:14.593453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:14.595596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:14.597819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:14.598641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:14.599703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:14.606588 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df69f4f1-fdb0-4c15-ab46-c2dcd6f7dffe tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1446 microversion: 2.75 time: 0.166561 Jun 04 21:06:14.608010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1526/3175] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:14 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1446 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:14.842240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:14.852103 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f29605f7-2797-4161-920c-698c8cdd59f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 0.285330 Jun 04 21:06:14.853278 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1650/3176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:14 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:15.635819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:15.635819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:15.655370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:15.657486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:15.661716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:15.662526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:15.873405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:15.875894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:15.899194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:15.901922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:15.902303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:15.904299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:15.904771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:15.913996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:15.921477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:15.941466 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1417209e-cc0c-434d-aa97-4f67adc5e04d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1452 microversion: 2.75 time: 0.318397 Jun 04 21:06:15.942635 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1527/3177] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:15 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1452 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:16.166939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:16.177916 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46c1a188-5657-489f-8c41-d0a3ba537268 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 0.308916 Jun 04 21:06:16.179024 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1651/3178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:15 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:16.812275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-281931cc-a7ec-42a4-8c48-13d14f3c00ac req-8aa531f6-fa3c-47bb-b635-01d91ee760f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483cc3e1-24ca-47a3-bda1-7e2f7e975b9b", "name": "network-vif-plugged", "status": "completed", "tag": "e7e2a769-2c27-412e-91fc-116b842cf6e5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:16.832644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-281931cc-a7ec-42a4-8c48-13d14f3c00ac req-8aa531f6-fa3c-47bb-b635-01d91ee760f8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:16.833526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-281931cc-a7ec-42a4-8c48-13d14f3c00ac req-8aa531f6-fa3c-47bb-b635-01d91ee760f8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:16.858949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-281931cc-a7ec-42a4-8c48-13d14f3c00ac req-8aa531f6-fa3c-47bb-b635-01d91ee760f8 service nova] Creating event network-vif-plugged:e7e2a769-2c27-412e-91fc-116b842cf6e5 for instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b on nch2-master-1 Jun 04 21:06:16.873475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-281931cc-a7ec-42a4-8c48-13d14f3c00ac req-8aa531f6-fa3c-47bb-b635-01d91ee760f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065581 Jun 04 21:06:16.876573 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1528/3179] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:06:16.962643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:16.963328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:16.978598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:16.981165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:17.003222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:17.004106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:17.207978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:17.210119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:17.222503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:17.223681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:17.225963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:17.226792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:17.277213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:17.289862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:17.303240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:17.320143 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f40fb2e-4a51-4edf-838f-3de8b90c7e5f tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1452 microversion: 2.75 time: 0.360584 Jun 04 21:06:17.322391 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1652/3180] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:16 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1452 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:17.688670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:17.698608 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c6f6a83-6c84-4aac-b34d-014718247616 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1320 microversion: 2.1 time: 0.506242 Jun 04 21:06:17.704053 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1529/3181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:17 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:18.350230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:18.351993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:18.387140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:18.388137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:18.389297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:18.391552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:18.405096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:18.607843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:18.628215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:18.637576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:18.652730 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e3d5e93-d294-4977-a4d1-2bf356861ded tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1437 microversion: 2.75 time: 0.312268 Jun 04 21:06:18.655953 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1653/3182] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:18 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1437 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:18.720656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:18.721284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:18.744137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:18.745292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:18.746292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:18.746957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.104356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:19.124048 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c89103d5-2e59-467c-881d-267fa507d3f4 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1511 microversion: 2.1 time: 0.406548 Jun 04 21:06:19.135544 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1654/3183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:18 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:19.145555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-bd6a612f-00b5-42b6-b958-1f43c52b4297 req-ed14cbcc-0987-4cfe-9b94-c7080aea1ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f14fd5-d9c4-4330-805e-981592057063", "name": "network-vif-plugged", "status": "completed", "tag": "f5a6718e-7a96-4486-9a48-4445966d79d0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:19.166221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bd6a612f-00b5-42b6-b958-1f43c52b4297 req-ed14cbcc-0987-4cfe-9b94-c7080aea1ceb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.169101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bd6a612f-00b5-42b6-b958-1f43c52b4297 req-ed14cbcc-0987-4cfe-9b94-c7080aea1ceb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.200224 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-bd6a612f-00b5-42b6-b958-1f43c52b4297 req-ed14cbcc-0987-4cfe-9b94-c7080aea1ceb service nova] Creating event network-vif-plugged:f5a6718e-7a96-4486-9a48-4445966d79d0 for instance 46f14fd5-d9c4-4330-805e-981592057063 on nch1-master-1 Jun 04 21:06:19.237108 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-bd6a612f-00b5-42b6-b958-1f43c52b4297 req-ed14cbcc-0987-4cfe-9b94-c7080aea1ceb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101456 Jun 04 21:06:19.246700 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1655/3184] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:19.272099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:19.272923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:19.356687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.362454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.366120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.366632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.367329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:19.368802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:19.391085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.392201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.393851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.395593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.594258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:06:19.596379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:06:19.598531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:06:19.602387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:06:19.603004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:06:19.786490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:19.807221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.807709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:19.811231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:19.812410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:20.014220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:20.034500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d12e8aa3-e117-40f1-8ef3-cf93ae97c560 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1511 microversion: 2.1 time: 0.780754 Jun 04 21:06:20.038288 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1656/3185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:19 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1511 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:20.085457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:20.086290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:20.124213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:20.126729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:20.129618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:20.136152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:20.347927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:20.404915 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8260d8e4-97fa-45af-94bb-e99dbfe47d03 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031/action" status: 202 len: 1940 microversion: 2.75 time: 1.730951 Jun 04 21:06:20.407996 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1530/3186] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:06:18 2022] POST /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031/action => generated 1940 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Jun 04 21:06:20.440204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:20.442057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:20.460303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:20.462262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:20.464458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:20.464927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:20.605387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:20.619214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae29ea2e-1d29-4e5a-bb8f-ac41cd49ea24 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1320 microversion: 2.1 time: 0.566477 Jun 04 21:06:20.619984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:20.620342 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1657/3187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:20 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1320 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:20.650121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-265deee8-402d-4171-bcf0-eda24fedf037 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.220740 Jun 04 21:06:20.663343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1531/3188] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:20 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:21.639164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:21.640473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:21.648541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:21.649324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:21.650354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:21.651031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:21.671078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:21.671830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:21.694281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:21.695274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:21.696626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:21.697263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:21.948992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:21.985663 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c14e2242-caff-4a30-9353-e299ff0f9475 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.319018 Jun 04 21:06:21.998417 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1532/3189] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:21 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:22.127993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:22.139060 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3644ca01-707b-4250-8870-26d8420c30c9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1510 microversion: 2.1 time: 0.505867 Jun 04 21:06:22.140431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1658/3190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:21 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:22.160207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:22.166765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:22.167707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:22.197856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:22.198316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:22.199129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:22.201516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:22.299292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:22.324724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:22.416158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:22.424749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:22.425423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:22.635562 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cdd02dc9-bec3-445a-aaa0-e40c84a35f9d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.479429 Jun 04 21:06:22.641473 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1533/3191] 10.222.0.18 () {58 vars in 1166 bytes} [Sat Jun 4 21:06:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:22.674654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:22.714154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:22.716391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-723190127', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:22.737249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:22.737940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:22.746743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:22.747420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:22.941314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:23.007583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:23.009463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:23.034091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.035972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.041055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.041978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.074487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:23.084226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.085368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.284774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:23.293445 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-488dda64-8832-49c5-b807-58900b159a72 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-723190127" status: 200 len: 1514 microversion: 2.1 time: 0.632171 Jun 04 21:06:23.294497 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1659/3192] 10.222.0.18 () {58 vars in 1260 bytes} [Sat Jun 4 21:06:22 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-723190127 => generated 1514 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:23.314422 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-39d0c2b6-b94f-421e-87c4-03700723219a tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.311183 Jun 04 21:06:23.315386 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1534/3193] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:23 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:23.321581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:23.327485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:23.328610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:23.336667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.337745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.338890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.340034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.491499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:23.540712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1414076115", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "734d6c7a-4f5d-4c98-bda1-643db6b73b86"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:23.565614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:23.577343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.578014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.613769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] validate_networks() for [('734d6c7a-4f5d-4c98-bda1-643db6b73b86', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:06:23.888318 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02d5e879-0bfc-45f9-a3e8-af327db9cf19 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 0.571467 Jun 04 21:06:23.888949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1535/3194] 10.222.0.18 () {58 vars in 1172 bytes} [Sat Jun 4 21:06:23 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:23.912748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:23.916471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:23.917160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.servers [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Removing options 'limit' from query {{(pid=137229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 04 21:06:23.918130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:23.923442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:23.925393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.926059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.927200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.927849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:23.977088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:23.984647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:23.985209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.561127 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85bd3809-4897-488a-a5d7-5b2da6dea865 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.653666 Jun 04 21:06:24.561805 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1536/3195] 10.222.0.18 () {58 vars in 1160 bytes} [Sat Jun 4 21:06:23 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:24.568440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:24.569315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:24.589843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:24.591166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.594322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:24.597604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.628229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:06:24.628841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:06:24.629136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:06:24.629761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:06:24.630339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:06:24.658146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:24.659501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.662455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:24.663409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.724458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Getting quotas for project 22890ef5f2374c7580a9ab7bea24fb6f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:06:24.734989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Getting quotas for user 0b94e34548fe42b0b1e5a0addb3a8962 and project 22890ef5f2374c7580a9ab7bea24fb6f. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:06:24.752726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:06:24.762240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:06:24.848273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543337 Jun 04 21:06:24.849965 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1660/3196] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:06:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:06:24.855645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:24.860213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:24.861451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:24.869421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:24.877147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.878486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:24.879196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:24.950094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:25.006971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:25.042673 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-308a7568-67a7-418b-88a0-bd04c8419317 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.479139 Jun 04 21:06:25.043264 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1537/3197] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:24 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:25.066012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e9966443-8b0d-4bd1-9605-705d8897abe1 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:25.066616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e9966443-8b0d-4bd1-9605-705d8897abe1 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:25.153753 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65865002-fc8f-4993-a22d-ce4039efb184 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.302291 Jun 04 21:06:25.155935 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1661/3198] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:06:24 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:25.195617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e9966443-8b0d-4bd1-9605-705d8897abe1 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:25.205335 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e9966443-8b0d-4bd1-9605-705d8897abe1 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1217 microversion: 2.1 time: 0.146843 Jun 04 21:06:25.220100 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1538/3199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:25 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:25.225095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:25.240777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:25.244423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.servers [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Removing options 'limit' from query {{(pid=137229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 04 21:06:25.245039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:25.264689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.265310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.266312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.266918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.291300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a338421-e418-4c10-b91b-a119fbdaf37f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: .version_select at 0x7f2d01b61ca0>, body: {"keypair": {"name": "tempest-keypair-765814108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeRntSmE65Jx0Vp5gEfRA7hiSJbWAjJ4TkxaJwbtqUQtx/pvOtr+sOp5YaGMnjtFKJH8nztx4hTAhqu5luzoOt56XF8PEl+nlf7t2JB93DJw5tjVu+QFWZtpRZQc5gYCw=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:25.335748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1a338421-e418-4c10-b91b-a119fbdaf37f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for project cfea83c42bb443459619d4d679aa1769. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:06:25.365765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:25.385493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:25.392016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1a338421-e418-4c10-b91b-a119fbdaf37f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for user f290b5d01a074e2c9859488bd4ff1162 and project cfea83c42bb443459619d4d679aa1769. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:06:25.487175 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5ae124b1-6f30-42cc-ad6a-92b5a57545a2 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.277692 Jun 04 21:06:25.493673 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1539/3200] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Jun 4 21:06:25 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:25.498473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a338421-e418-4c10-b91b-a119fbdaf37f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.340781 Jun 04 21:06:25.499373 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1662/3201] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:06:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:25.507375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:25.517620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:25.519151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:25.526604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.528170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.529955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.530822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.587882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:25.695796 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-61307c07-ec47-4afe-92f7-13d3a9e1d46f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.199229 Jun 04 21:06:25.698854 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1540/3202] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:06:25 2022] GET /compute/v2.1/servers => generated 1009 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:25.713712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:25.718488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:25.719879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:25.741456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.744842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.745997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.746624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.856801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:25.936464 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82bbfca8-e9e3-4a64-9c56-57e4a2c9bf78 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.229152 Jun 04 21:06:25.949362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:25.952952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:25.953692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.servers [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Removing options 'limit' from query {{(pid=137229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 04 21:06:25.954512 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1663/3203] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:06:25 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:25.955747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:25.970649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.972170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:25.973298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:25.973911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.025900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-028617d0-be54-46f1-a044-4cf9ff2b42f7 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.080301 Jun 04 21:06:26.026445 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1541/3204] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Jun 4 21:06:25 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:26.039633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:26.044855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:26.045577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-723190127', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:26.062477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.062936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.067497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:26.067497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:26.067761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.067761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.087154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.094450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.099426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.100489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.215460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:26.309624 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-362d3ec4-fb13-4201-8426-fb93144e186a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-723190127" status: 200 len: 345 microversion: 2.1 time: 0.274527 Jun 04 21:06:26.310896 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1664/3205] 10.222.0.18 () {58 vars in 1239 bytes} [Sat Jun 4 21:06:26 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-723190127 => generated 345 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:26.323312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:26.326472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:26.327389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:26.336419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.337258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.338431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.339166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.372041 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-57621279-7b42-428d-a6ed-0af3a8cbbc48 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.312750 Jun 04 21:06:26.374372 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1542/3206] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:26 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:26.382499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5946c53c-e861-474c-8c3c-3c747715a369 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:26.394326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5946c53c-e861-474c-8c3c-3c747715a369 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.395057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5946c53c-e861-474c-8c3c-3c747715a369 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.509948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5946c53c-e861-474c-8c3c-3c747715a369 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Going to try to stop instance {{(pid=137229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:06:26.574848 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5946c53c-e861-474c-8c3c-3c747715a369 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "POST /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67/action" status: 202 len: 0 microversion: 2.1 time: 0.197690 Jun 04 21:06:26.575846 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1543/3207] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:06:26 2022] POST /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:06:26.590765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:26.592571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:26.609344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.610609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:26.612585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:26.613511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:27.069631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:27.084547 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-664fc881-937a-4eae-96dd-5fe289b47cbe tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1269 microversion: 2.1 time: 0.771889 Jun 04 21:06:27.101037 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1665/3208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:26 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1269 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:27.244533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:27.260599 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-beb31b28-4bbb-442f-8d5e-245c4162b139 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.679545 Jun 04 21:06:27.261089 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1544/3209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:26 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:27.402153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:27.403797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:27.420529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:27.421112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:27.422374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:27.428072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:27.682560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:27.733841 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-271c98b5-bf6e-46b7-8907-246f4a1b94ac tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.339857 Jun 04 21:06:27.749165 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1666/3210] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:27 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:28.104959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:28.105997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:28.123156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:28.123714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:28.124629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:28.125111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:28.280498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:28.282106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:28.299030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:28.299880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:28.300965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:28.301799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:28.306015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:28.332276 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff95e4a9-4251-4b7b-a530-ba38f6312499 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1275 microversion: 2.1 time: 0.228928 Jun 04 21:06:28.343260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1545/3211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:28 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:28.603268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:28.613738 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f2caf4cd-e415-4920-bdd8-a90caa37859e tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.339053 Jun 04 21:06:28.625042 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1667/3212] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:28 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:28.756361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:28.756992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:28.767892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:28.768367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:28.772103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:28.772560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:29.011008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:29.082189 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79bf2866-af55-464a-900e-bb7415d8cc58 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.330706 Jun 04 21:06:29.090320 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1546/3213] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:28 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:29.351658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:29.353128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:29.368678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:29.369421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:29.370392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:29.372529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:29.638187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:29.638832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:29.670549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:29.671394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:29.674186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:29.681596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:29.692681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:29.790133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:29.810592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3af22bf0-5657-4714-ae98-bc6162e168fd tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.464354 Jun 04 21:06:29.811237 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1668/3214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:29 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:29.935271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-265031483", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c946d160-9d42-4fd6-818b-110d6e0b1e76"}], "security_groups": [{"name": "tempest-securitygroup--344989830"}], "key_name": "tempest-keypair-765814108", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:30.043543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:30.054220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c13d607-79ed-4f2a-8cb3-e0c6699dd836 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.426305 Jun 04 21:06:30.055797 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1547/3215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:29 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:30.112007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:30.113054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:30.121030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:30.121934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:30.122958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:30.123806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:30.142756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] validate_networks() for [('c946d160-9d42-4fd6-818b-110d6e0b1e76', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:06:30.290475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:30.314254 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-495e3673-3687-4ece-87f8-8a4e0e655f89 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.207755 Jun 04 21:06:30.315900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1548/3216] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:30 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:30.407612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c3b65ba2-4bb4-4684-bbc9-1b070bc50f7b req-0e8b7341-2976-4edc-a193-f119cb69d374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "411c64a2-f412-4f44-9c44-1254efe28903", "tag": "5634c4d4-78dd-4e20-868e-1db5580f3070"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:30.436234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c3b65ba2-4bb4-4684-bbc9-1b070bc50f7b req-0e8b7341-2976-4edc-a193-f119cb69d374 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:30.437152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c3b65ba2-4bb4-4684-bbc9-1b070bc50f7b req-0e8b7341-2976-4edc-a193-f119cb69d374 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:30.459693 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c3b65ba2-4bb4-4684-bbc9-1b070bc50f7b req-0e8b7341-2976-4edc-a193-f119cb69d374 service nova] Creating event network-changed:5634c4d4-78dd-4e20-868e-1db5580f3070 for instance 411c64a2-f412-4f44-9c44-1254efe28903 on nch2-master-1 Jun 04 21:06:30.472947 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c3b65ba2-4bb4-4684-bbc9-1b070bc50f7b req-0e8b7341-2976-4edc-a193-f119cb69d374 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075049 Jun 04 21:06:30.476316 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1549/3217] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:30.831128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:30.836281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:30.866343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:30.867428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:30.868353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:30.868844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.072162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:06:31.074382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:06:31.075112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:06:31.075836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:06:31.076475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:06:31.091548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:31.092137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.094184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:31.095735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.125798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for project cfea83c42bb443459619d4d679aa1769. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:06:31.134018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for user f290b5d01a074e2c9859488bd4ff1162 and project cfea83c42bb443459619d4d679aa1769. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:06:31.163897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:06:31.166620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:06:31.217250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:31.230566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4bb401ba-3220-4764-b2e2-db4f7d33ae73 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.405168 Jun 04 21:06:31.231854 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1550/3218] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:30 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:31.245950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:31.250659 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c86dd199-e12a-4dce-b586-8dd6f827447b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.319783 Jun 04 21:06:31.251205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:31.251543 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1669/3219] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:06:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:06:31.269449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:31.270220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.271677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-102121be-24b7-43f1-aba2-d84a0191dedd tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:31.272122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:31.272721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.273946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-102121be-24b7-43f1-aba2-d84a0191dedd tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:31.524985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-102121be-24b7-43f1-aba2-d84a0191dedd tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:31.538773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-102121be-24b7-43f1-aba2-d84a0191dedd tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1236 microversion: 2.1 time: 0.280535 Jun 04 21:06:31.539470 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1670/3220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:31 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1236 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:31.544163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:31.544788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:31.561886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:31.581749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:31.582234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.582389 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e0ca4ed-799c-471b-9656-546b72a10f8c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.348204 Jun 04 21:06:31.583038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:31.583673 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1551/3221] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:31 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:31.593724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:31.726293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:31.737503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:31.775650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1cac1aa7-7c94-4443-aed6-f9f5fb309d96 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.234878 Jun 04 21:06:31.788056 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1671/3222] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:31 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:32.249637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:32.250395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:32.264167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.265628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.268073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.269323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.556771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:32.557425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:32.612853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.613323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.620228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.620827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.647249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:32.659732 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3527893e-f317-48bc-90e3-2c7ff3874694 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.414750 Jun 04 21:06:32.663894 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1552/3223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:32 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:32.671658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:32.676919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:32.691876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.692337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.693211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.693641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.845711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:32.855241 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3058f310-af68-421e-861c-35596fbd576f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1288 microversion: 2.1 time: 0.302676 Jun 04 21:06:32.856715 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1672/3224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:32 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1288 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:32.864024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:32.865004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:32.874713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.875563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:32.876976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:32.877957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:33.027032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:33.051995 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f33bcbbe-330e-493f-8700-73c5922dd3a1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.193502 Jun 04 21:06:33.053038 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1673/3225] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:32 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:33.155161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:33.169616 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d588bedb-d2b5-439e-a77a-57757e9d7619 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.504419 Jun 04 21:06:33.188072 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1553/3226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:32 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:33.692328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:33.694483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:33.704040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:33.706233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:33.706939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:33.707464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:33.875978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:33.877244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:33.890267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:33.890267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:33.892726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:33.893950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:34.058650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:34.073541 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77dda3fa-5c86-43dc-9e6f-83e7a419a386 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1294 microversion: 2.1 time: 0.202962 Jun 04 21:06:34.075119 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1554/3227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:33 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1294 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:34.083720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:34.089681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:34.106713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:34.109521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:34.110526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:34.116172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:34.116172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:34.121456 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab33d61a-a3cb-4e96-b70b-77bb259c1c56 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.444866 Jun 04 21:06:34.131549 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1674/3228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:33 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:34.192178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:34.193922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:34.204118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:34.204864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:34.207401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:34.208065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:34.351012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:34.375482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81487f0e-b2ce-41af-a7e9-ca2fc30b4514 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.296351 Jun 04 21:06:34.376131 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1555/3229] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:34 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:34.619098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:34.632067 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5c646ac5-8233-44e2-b665-4d5a59541f5a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.445543 Jun 04 21:06:34.633758 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1675/3230] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:34 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:35.097464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:35.098620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:35.110990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.111910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.114971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.116011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.140434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:35.141132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:35.158182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.158924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.161527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.162038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.203045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:35.616793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:35.625944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:35.635108 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d1937f1-788f-4ae8-8d5b-7080af728566 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.545743 Jun 04 21:06:35.644977 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1556/3231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:35 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:35.651778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c68e6c19-9fe7-44aa-b4ba-ee17d2015af3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.514276 Jun 04 21:06:35.653424 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1676/3232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:35 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:35.661186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:35.662056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:35.672194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.672801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.673998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.674625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.681493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:35.681493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:35.706431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.709607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.711798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:35.712769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:35.852666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:35.878709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f69e92a3-3de4-4526-85f7-c5b65bc7f4b1 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.241004 Jun 04 21:06:35.879775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1557/3233] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:35 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:36.024449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:36.035124 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9344f3f9-921b-4705-b091-759172ad5c83 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.380230 Jun 04 21:06:36.039654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1677/3234] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:35 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:36.550453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ae7baf23-35f5-41ac-8619-7675030e192f req-75075bae-c3dc-4997-a7cc-9bcfbf71b66d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e", "tag": "5b26a2ed-455a-43c0-a30d-6c49466dbc5b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:36.563435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:36.568767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ae7baf23-35f5-41ac-8619-7675030e192f req-75075bae-c3dc-4997-a7cc-9bcfbf71b66d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:36.569449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ae7baf23-35f5-41ac-8619-7675030e192f req-75075bae-c3dc-4997-a7cc-9bcfbf71b66d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:36.583271 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ae7baf23-35f5-41ac-8619-7675030e192f req-75075bae-c3dc-4997-a7cc-9bcfbf71b66d service nova] Creating event network-changed:5b26a2ed-455a-43c0-a30d-6c49466dbc5b for instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e on nch1-master-1 Jun 04 21:06:36.602031 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ae7baf23-35f5-41ac-8619-7675030e192f req-75075bae-c3dc-4997-a7cc-9bcfbf71b66d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060510 Jun 04 21:06:36.606331 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1558/3235] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:36.653347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:36.653942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:36.664454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:36.665544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:36.671482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:36.672663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:36.677182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:36.678543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:36.686051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:36.686731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:36.696794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:36.697539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:37.320254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:37.329222 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-320171ca-7ffa-4796-8ac7-457f2a39986e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.679574 Jun 04 21:06:37.329749 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1678/3236] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:36 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:37.334530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:37.335148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:37.344841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:37.345539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:37.346535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:37.347127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:37.448097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:37.463072 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-abca52d3-fbbf-4630-92c5-cf74cedd2988 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.795613 Jun 04 21:06:37.473793 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1559/3237] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:36 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:37.484702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:37.485363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:37.494819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:37.495497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:37.496840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:37.497560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:37.512772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:37.546118 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9eadd8d6-4626-4300-ad8d-ca7baef63d1e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.214864 Jun 04 21:06:37.556718 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1679/3238] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:37 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:37.700692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:37.724875 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38ab09b1-2b31-48b4-8cf7-6be82543d507 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.253674 Jun 04 21:06:37.725859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1560/3239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:37 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:37.784751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0b385817-35a7-40c8-bc96-00e41bf182a4 req-39991a87-7feb-4011-b6c8-86a2a8095c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411c64a2-f412-4f44-9c44-1254efe28903", "name": "network-vif-plugged", "status": "completed", "tag": "5634c4d4-78dd-4e20-868e-1db5580f3070"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:37.821025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0b385817-35a7-40c8-bc96-00e41bf182a4 req-39991a87-7feb-4011-b6c8-86a2a8095c61 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:37.823468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0b385817-35a7-40c8-bc96-00e41bf182a4 req-39991a87-7feb-4011-b6c8-86a2a8095c61 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:37.844383 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0b385817-35a7-40c8-bc96-00e41bf182a4 req-39991a87-7feb-4011-b6c8-86a2a8095c61 service nova] Creating event network-vif-plugged:5634c4d4-78dd-4e20-868e-1db5580f3070 for instance 411c64a2-f412-4f44-9c44-1254efe28903 on nch2-master-1 Jun 04 21:06:37.857071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0b385817-35a7-40c8-bc96-00e41bf182a4 req-39991a87-7feb-4011-b6c8-86a2a8095c61 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077627 Jun 04 21:06:37.858232 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1680/3240] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:06:38.349281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:38.351658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:38.370704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.371539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.372367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.372818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.482251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:38.483694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:38.494366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.494832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.495661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.496102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.664474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:38.680266 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0160f79c-dcf3-4a98-abf2-ec810eea9eb7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.334794 Jun 04 21:06:38.680904 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1561/3241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:38 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:38.685394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:38.686014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:38.704625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.708150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.709197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.709645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.768120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:38.782280 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-acc72e36-091b-484e-89ae-83463b0cb070 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1317 microversion: 2.1 time: 0.304351 Jun 04 21:06:38.782901 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1681/3242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:38 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:38.804345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:38.807492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:38.827440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.829305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.832096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:38.832600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:38.856813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:38.883699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ee623c8-ac83-497a-8e5d-cba4d4ae785c tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.201499 Jun 04 21:06:38.885129 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1562/3243] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:38 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:39.160067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:39.174050 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-24993297-42fc-4f17-a32e-087019ce149c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.389910 Jun 04 21:06:39.184315 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1682/3244] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:38 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:39.702419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:39.703331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:39.719636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:39.720477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:39.722015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:39.722581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:39.799616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:39.800948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:39.808241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:39.809386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:39.810366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:39.811013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.245971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:40.253379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:40.267779 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b0303f20-72aa-43b9-8299-7006d42dd2f8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1507 microversion: 2.1 time: 0.471968 Jun 04 21:06:40.273345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:40.278368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c170ea02-c2df-4964-bb2c-ec0485276ed6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.583638 Jun 04 21:06:40.284431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1683/3245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:39 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:40.287834 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1563/3246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:39 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:40.294596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:40.295456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:40.304416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.305221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.306209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.306640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.311683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:40.315387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:40.344163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.344977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.347218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.349137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.484913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:40.537457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-76ef1d41-0ac1-49a2-b307-9ce919846f3e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.235017 Jun 04 21:06:40.538451 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1684/3247] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:40 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:40.554242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:40.555319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:40.564850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.566128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.567064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.567800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.610219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:40.611305 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ccb0f65-2dfe-422c-b95e-711576a5d800 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903/os-instance-actions/req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb" status: 200 len: 313 microversion: 2.1 time: 0.070714 Jun 04 21:06:40.611997 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1685/3248] 10.222.0.18 () {58 vars in 1418 bytes} [Sat Jun 4 21:06:40 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903/os-instance-actions/req-a5ed4e7b-f1b7-425b-9e66-13154aa9d7eb => generated 313 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:40.625845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:40.627606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:40.635256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.635779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.636567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.637194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.660638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:40.676634 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ac74d60-ed7d-4dc4-8c5c-305ddd9fcba1 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.386312 Jun 04 21:06:40.680454 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1564/3249] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:40 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:40.758380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:40.780170 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-49455770-9eb5-4359-96b0-ea55571c35b3 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "POST /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903/action" status: 202 len: 0 microversion: 2.1 time: 0.157496 Jun 04 21:06:40.784562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1686/3250] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:06:40 2022] POST /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:06:40.799857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:40.801118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:40.820622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.823895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:40.825077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:40.826786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.110871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:41.127561 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a766085-d0a9-4a14-8862-9968d6e4c388 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1509 microversion: 2.1 time: 0.337826 Jun 04 21:06:41.138548 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1565/3251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:40 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:41.295600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=12 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:41.300934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:41.301870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:41.319951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:41.322636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.323583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:41.324029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.536423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=20 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:41.558622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:41.559527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:41.570851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:41.573742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.575533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:41.577061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.637788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:41.647387 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e6d64d42-8e3f-4fd9-8c40-2d9bcad7671c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.353578 Jun 04 21:06:41.648025 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1687/3252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:41 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:41.699210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:41.700225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:41.722138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:41.722824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.723832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:41.724436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:41.781673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:41.849610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dc4fa83f-b533-4d4b-a7bb-3a103ca96019 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.294561 Jun 04 21:06:41.893206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1566/3253] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:41 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:42.148839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:42.149940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:42.159486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:42.164604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:42.171261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:42.177865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:42.183651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:42.200596 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2006bc12-4a43-43c2-b6fe-43b600818e55 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.503828 Jun 04 21:06:42.202711 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1688/3254] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:41 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:42.423528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:42.432412 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b1c9c606-543a-403c-a45a-7271c8c8cd9b tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1514 microversion: 2.1 time: 0.288927 Jun 04 21:06:42.432987 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1567/3255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:42 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:42.666567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:42.667232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:42.688771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:42.689312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:42.690530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:42.691012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:42.894477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:42.895873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:42.907163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:42.910574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:42.912941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:42.917390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:43.028017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:43.046584 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-301e3930-dc7d-4eee-bb5e-4b1a6b49dc9d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.384923 Jun 04 21:06:43.047595 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1689/3256] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:42 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:43.090869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:43.136600 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b9a7181-1182-4035-b9c0-07f46214154b tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.244744 Jun 04 21:06:43.151099 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1568/3257] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:42 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:43.220546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:43.221580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:43.235893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:43.236960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:43.237709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:43.238150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:43.464532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:43.465645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:43.478045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:43.479011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:43.481292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:43.482510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:43.612898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:43.623934 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0a6bbfd-0ba0-49ec-96f9-aed17200e43a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.408875 Jun 04 21:06:43.628745 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1690/3258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:43 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:43.943857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:43.959795 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9498f6bb-8350-4395-a617-36557be95026 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1507 microversion: 2.1 time: 0.508226 Jun 04 21:06:43.960690 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1569/3259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:43 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:43.978017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '.version_select at 0x7f2d0185f430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:43.978712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:43.994512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:43.995235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:43.996396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:43.996906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.064565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:44.065619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:44.077216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.080055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.082992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.083459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.113101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e6dc4fdb-f8c8-4625-919f-e2b471d9d45f tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.137626 Jun 04 21:06:44.115216 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1691/3260] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Jun 4 21:06:43 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903/os-instance-actions => generated 611 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:44.137767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:44.140265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:44.153775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.155065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.161496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.162306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.260770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:06:44.410385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:44.410663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:44.422898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d305f1b-e84d-41ba-a046-eeab04eea502 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.362409 Jun 04 21:06:44.433731 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a960d87c-5e19-4c78-b8b8-a24a49031de8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "DELETE /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 204 len: 0 microversion: 2.1 time: 0.307904 Jun 04 21:06:44.435136 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1692/3261] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:06:44 2022] DELETE /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:06:44.440777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1570/3262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:44 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:44.446111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:44.447053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:44.447272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:44.448122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:44.456994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.457457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.458249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.458691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.459155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.459788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.461366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.462244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.674294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:44.720525 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7cc30869-9aeb-461a-8aee-d5beeb52e06e tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.282420 Jun 04 21:06:44.730887 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1693/3263] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:44 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:44.753482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:44.754113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:44.769813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.770270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.773725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:44.778343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:44.781211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:44.790980 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34a27d22-41a3-46a8-a33a-198b3ff13e4e tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1513 microversion: 2.1 time: 0.348750 Jun 04 21:06:44.792142 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1571/3264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:44 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:44.981546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:44.992378 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa94d3c7-2cd4-45b7-a472-45dae6e36b22 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.269233 Jun 04 21:06:45.008687 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1694/3265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:44 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:45.136503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fe02e178-e1b5-41d5-b4a8-222551a4188c req-d4a233fe-581d-43cd-9edb-e000b5d60d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e", "name": "network-vif-plugged", "status": "completed", "tag": "5b26a2ed-455a-43c0-a30d-6c49466dbc5b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:45.153053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe02e178-e1b5-41d5-b4a8-222551a4188c req-d4a233fe-581d-43cd-9edb-e000b5d60d43 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.153898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe02e178-e1b5-41d5-b4a8-222551a4188c req-d4a233fe-581d-43cd-9edb-e000b5d60d43 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:45.181349 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fe02e178-e1b5-41d5-b4a8-222551a4188c req-d4a233fe-581d-43cd-9edb-e000b5d60d43 service nova] Creating event network-vif-plugged:5b26a2ed-455a-43c0-a30d-6c49466dbc5b for instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e on nch1-master-1 Jun 04 21:06:45.190927 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fe02e178-e1b5-41d5-b4a8-222551a4188c req-d4a233fe-581d-43cd-9edb-e000b5d60d43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061019 Jun 04 21:06:45.192134 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1572/3266] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:06:45.447281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:45.448047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:45.458960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.459544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:45.460408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.460843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:45.726012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:45.734991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8589e75b-5f58-4b1b-a95e-f5c0e916b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.293975 Jun 04 21:06:45.736377 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1695/3267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:45 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:45.746586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:45.747346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:45.755982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.756686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:45.757477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.758166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:45.809151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:45.810169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:45.817443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.818192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:45.819229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:45.819916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:46.307400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:46.332956 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8b190021-1eea-4926-84a4-1bb2fd8794b4 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.591381 Jun 04 21:06:46.333992 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1573/3268] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:45 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:46.339240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:46.340143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:46.344742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:46.349166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:46.350064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:46.351127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:46.351813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:46.594505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:46.604848 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7710bf7f-3229-4315-b88e-f9599be70b94 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1513 microversion: 2.1 time: 0.799881 Jun 04 21:06:46.605437 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1696/3269] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:45 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1513 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:46.756954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:46.758270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:46.766200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:46.766922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:46.768875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:46.769277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:46.863406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:46.872836 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-64e4864d-8b66-4364-a92c-2cc15edf2e64 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1521 microversion: 2.1 time: 0.537446 Jun 04 21:06:46.874737 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1574/3270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:46 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:47.151762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:47.165159 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9e63c41-318c-4e1a-8262-43ec116e674c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1361 microversion: 2.1 time: 0.413877 Jun 04 21:06:47.165544 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1697/3271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:46 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:47.365029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:47.365803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:47.374331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.375337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:47.376603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.377485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:47.547159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:47.570343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f2f7d101-73fb-4973-b431-1719aadcf497 req-900207c3-4235-4ceb-b76f-aa386d8ee3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "411c64a2-f412-4f44-9c44-1254efe28903", "name": "network-vif-deleted", "tag": "5634c4d4-78dd-4e20-868e-1db5580f3070"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:47.584097 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f16d56b0-590a-46b1-9ee6-03afaa8ccf25 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.230543 Jun 04 21:06:47.586276 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1575/3272] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:47 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:47.603973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f2f7d101-73fb-4973-b431-1719aadcf497 req-900207c3-4235-4ceb-b76f-aa386d8ee3d3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.605465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f2f7d101-73fb-4973-b431-1719aadcf497 req-900207c3-4235-4ceb-b76f-aa386d8ee3d3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:47.623072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f2f7d101-73fb-4973-b431-1719aadcf497 req-900207c3-4235-4ceb-b76f-aa386d8ee3d3 service nova] Creating event network-vif-deleted:5634c4d4-78dd-4e20-868e-1db5580f3070 for instance 411c64a2-f412-4f44-9c44-1254efe28903 on nch2-master-1 Jun 04 21:06:47.625373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:47.626129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:47.631114 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f2f7d101-73fb-4973-b431-1719aadcf497 req-900207c3-4235-4ceb-b76f-aa386d8ee3d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065042 Jun 04 21:06:47.632481 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1698/3273] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:47.640805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.642388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:47.644831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.647753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:47.799830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94e34548fe42b0b1e5a0addb3a8962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22890ef5f2374c7580a9ab7bea24fb6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:47.809782 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10ccb5bb-9a9a-4ca3-bdbf-d9a9ed884646 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 200 len: 1302 microversion: 2.1 time: 0.190881 Jun 04 21:06:47.810885 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1576/3274] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:47 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 1302 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:47.894561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:47.895376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:47.913464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.913927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:47.915258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:47.915828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.186774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:48.187563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:48.206625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.206824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.210598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.211375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.333148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:48.344017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c15378e-294f-402b-b89a-b5e6ec0be401 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1498 microversion: 2.1 time: 0.454789 Jun 04 21:06:48.344601 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1699/3275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:47 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1498 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:48.362671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:48.370013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:48.371955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:48.378497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.379186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.380527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.381763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.419020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:48.462508 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37cc1764-3180-4152-8425-cd925d2b8676 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.104508 Jun 04 21:06:48.464183 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1700/3276] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Jun 4 21:06:48 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:06:48.477295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-263b322e-e8db-46eb-8e56-3aa76eb5ffb8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:48.488265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-263b322e-e8db-46eb-8e56-3aa76eb5ffb8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.488914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-263b322e-e8db-46eb-8e56-3aa76eb5ffb8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.525275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-263b322e-e8db-46eb-8e56-3aa76eb5ffb8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Going to try to start instance {{(pid=137228) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:06:48.532074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:48.539311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:48.551709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f47179d7-2bce-4c9a-8494-e3acb3dd932d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1546 microversion: 2.1 time: 0.370038 Jun 04 21:06:48.555995 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1577/3277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:48 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1546 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:48.572420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:48.573191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:48.582542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.583241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.584706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.585914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.625253 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-263b322e-e8db-46eb-8e56-3aa76eb5ffb8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "POST /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67/action" status: 202 len: 0 microversion: 2.1 time: 0.154155 Jun 04 21:06:48.626489 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1701/3278] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:06:48 2022] POST /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:06:48.636027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:48.636975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:48.652895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.653670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.654839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.656547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.733502 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-39f7dcc5-29a2-42b0-82ae-35b9ddf1eb91 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162524 Jun 04 21:06:48.735026 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1578/3279] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:06:48 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:48.753551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:48.754222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:48.772161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.773616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.775280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.776230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.816135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:48.851613 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d173ca5e-66c7-437e-bfc9-d571acb9b6ea tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.223610 Jun 04 21:06:48.852981 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1702/3280] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:48 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:48.867036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:48.868257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] [instance: 411c64a2-f412-4f44-9c44-1254efe28903] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:48.874841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.875825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.877005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:48.877625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:48.898786 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] HTTP exception thrown: Instance 411c64a2-f412-4f44-9c44-1254efe28903 could not be found. Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Request method failure captured: Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 HTTP/1.1 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8lOj7cBcJmVmat9Yn4xavEzCliYToFFb5YyZBBKTmhQ45OHzWQHa7e7FvINqkE7cQkSKNrlh10c_emmU0-oJea8mhAqH4peOxz2juD8J9Q9Fn7emrfdxL0SEV8UFveeu1B3y7qhdgoKZ2rebZIuu8MU9N6nOVirswQSjsoIFZDIwZg Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 22890ef5f2374c7580a9ab7bea24fb6f Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-InstanceActionsTestJSON-988603129 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_22890ef5f2374c7580a9ab7bea24fb6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/22890ef5f2374c7580a9ab7bea24fb6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/22890ef5f2374c7580a9ab7bea24fb6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/22890ef5f2374c7580a9ab7bea24fb6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-InstanceActionsTestJSON-988603129 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 22890ef5f2374c7580a9ab7bea24fb6f Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-InstanceActionsTestJSON-988603129 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-InstanceActionsTestJSON-988603129-project Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 0b94e34548fe42b0b1e5a0addb3a8962 Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-InstanceActionsTestJSON-988603129-project Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 411c64a2-f412-4f44-9c44-1254efe28903 could not be found. Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '411c64a2-f412-4f44-9c44-1254efe28903'} Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 411c64a2-f412-4f44-9c44-1254efe28903 could not be found. Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 411c64a2-f412-4f44-9c44-1254efe28903 could not be found. Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:06:48.901496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 411c64a2-f412-4f44-9c44-1254efe28903 could not be found. Jun 04 21:06:48.908268 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:06:48.913710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] Returning 404 to user: Instance 411c64a2-f412-4f44-9c44-1254efe28903 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:06:48.914638 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3565fd60-ab34-403b-81b6-9fd3f53032c8 tempest-InstanceActionsTestJSON-988603129 tempest-InstanceActionsTestJSON-988603129-project] 10.222.0.18 "GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903" status: 404 len: 111 microversion: 2.1 time: 0.059857 Jun 04 21:06:48.920375 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1703/3281] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:48 2022] GET /compute/v2.1/servers/411c64a2-f412-4f44-9c44-1254efe28903 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:06:49.114579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:49.123939 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90aff6e1-65ca-49e8-906e-49751746d1b6 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1507 microversion: 2.1 time: 0.387126 Jun 04 21:06:49.125249 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1579/3282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:48 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:49.878433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:49.879095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:49.893945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:49.894302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:49.895101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:49.896584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:50.040576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:50.064519 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6668cd7-92e2-4445-912c-628482f7516d tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.191736 Jun 04 21:06:50.065373 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1704/3283] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:49 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:50.147485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:50.149421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:50.160582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:50.161350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:50.162972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:50.164199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:50.208383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:50.627901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2a85fd41-6ce3-485f-804a-b7a661ac147d req-7c84edcf-6d8a-4639-80e9-6836c0aa4fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e", "tag": "5b26a2ed-455a-43c0-a30d-6c49466dbc5b"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:50.642820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2a85fd41-6ce3-485f-804a-b7a661ac147d req-7c84edcf-6d8a-4639-80e9-6836c0aa4fb3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:50.643308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2a85fd41-6ce3-485f-804a-b7a661ac147d req-7c84edcf-6d8a-4639-80e9-6836c0aa4fb3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:50.678954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:50.688094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f11d6aea-f814-416b-a54f-1c529b7e0429 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1507 microversion: 2.1 time: 0.548723 Jun 04 21:06:50.693634 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2a85fd41-6ce3-485f-804a-b7a661ac147d req-7c84edcf-6d8a-4639-80e9-6836c0aa4fb3 service nova] Creating event network-changed:5b26a2ed-455a-43c0-a30d-6c49466dbc5b for instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e on nch1-master-1 Jun 04 21:06:50.694127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1580/3284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:50 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:50.707233 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2a85fd41-6ce3-485f-804a-b7a661ac147d req-7c84edcf-6d8a-4639-80e9-6836c0aa4fb3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083199 Jun 04 21:06:50.708907 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1705/3285] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:51.085389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:51.086903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:51.097204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:51.104876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:51.106183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:51.106956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:51.725152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:51.727792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:51.729134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:51.759892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:51.761354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:51.767410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:51.770880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:51.779198 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04ad1e03-d2a2-4319-9ea2-8c7d9854d3a2 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1927 microversion: 2.75 time: 0.698300 Jun 04 21:06:51.780600 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1581/3286] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:51 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1927 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:52.355549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:52.382458 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2347a3ab-648b-4c41-9669-7db622cf0470 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1511 microversion: 2.1 time: 0.673708 Jun 04 21:06:52.383267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1706/3287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:51 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1511 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:52.408860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:52.418006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:52.418539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.servers [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Removing options 'limit' from query {{(pid=137229) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 04 21:06:52.419493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:52.422818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.424054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.425685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.426718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.429753 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0bf3820e-baf0-44a6-b7b4-246270065490 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.028304 Jun 04 21:06:52.439996 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1582/3288] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Jun 4 21:06:52 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:06:52.442749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:52.443379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:52.456974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.460059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.461539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.464446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.799035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:52.803924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:52.804699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:52.817185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.817756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.818413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.818841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.831979 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-28a09ac8-433a-438a-8e98-c8b1ed16ab6a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1511 microversion: 2.1 time: 0.370503 Jun 04 21:06:52.835374 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1707/3289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:52 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1511 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:52.860125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:52.862248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:52.875444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.876311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:52.877395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:52.878086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:53.000770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:53.073407 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af367de1-2f19-4aa4-b4bb-0103bc1768e6 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1933 microversion: 2.75 time: 0.275470 Jun 04 21:06:53.074450 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1583/3290] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:52 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1933 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:53.207718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:53.221299 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f3dbe4e5-a3ed-41da-a6bb-08b89689771b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1510 microversion: 2.1 time: 0.372820 Jun 04 21:06:53.223135 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1708/3291] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:52 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:53.243864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:53.244669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:53.256438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:53.256968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:53.257786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:53.258876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:53.640832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:53.656550 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-05bbc567-882a-4742-8bf4-50f3118f04bd tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1511 microversion: 2.1 time: 0.418349 Jun 04 21:06:53.657184 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1584/3292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:53 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:53.686093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:53.691760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:53.699180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:53.902955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:53.905781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:53.906903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:53.907687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.019972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:54.097538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:54.098245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:54.110771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.111229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.112286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.112964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.128348 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-899c2ab2-dc7f-49bf-977c-0f1386b93aee tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 345 microversion: 2.1 time: 0.456005 Jun 04 21:06:54.143909 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1709/3293] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Jun 4 21:06:53 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 345 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:06:54.156453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:54.157098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:54.170319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.170886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.171951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.172605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.293721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:54.367832 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10d3db67-18e2-4780-be7b-3fdb328b36b8 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1933 microversion: 2.75 time: 0.273958 Jun 04 21:06:54.383450 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1585/3294] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:54 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1933 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:54.548883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:54.560556 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6fdee28-abd6-4ae3-8f5e-1901d91962a3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1511 microversion: 2.1 time: 0.414832 Jun 04 21:06:54.562193 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1710/3295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:54 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1511 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:54.586654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:54.587261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:54.596815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.597281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.600626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.602437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.799315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:54.813541 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd4ec15b-2421-47e2-8d98-e22b2f57c428 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1510 microversion: 2.1 time: 0.233170 Jun 04 21:06:54.814138 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1586/3296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:54 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:54.832623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:54.833571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:54.840940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.841796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:54.844161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:54.844862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.023116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.034839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b18f8a50-d054-4dca-b225-4f4aa5bffce9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1511 microversion: 2.1 time: 0.208723 Jun 04 21:06:55.036636 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1711/3297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:54 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1511 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:55.053564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:55.058010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.059339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:55.065456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.066096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.067191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.067865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.101561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:55.175608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.206642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.208894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.398261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:55.401891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:55.418669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.421165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.423321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.424076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.554831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] Lazy-loading 'services' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:55.582301 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e56e9d24-4fd6-45d3-b115-6ac325958d61 tempest-ServersAdmin275Test-1790562942 tempest-ServersAdmin275Test-1790562942-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1918 microversion: 2.75 time: 0.196063 Jun 04 21:06:55.589681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1712/3298] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:55 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1918 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:55.628850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:55.628850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:55.633718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.635799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.637249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.638007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.674799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:06:55.801803 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b0f45960-bf72-4dda-a25c-ad2d4996554a tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "DELETE /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 204 len: 0 microversion: 2.75 time: 0.184183 Jun 04 21:06:55.803072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1713/3299] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:06:55 2022] DELETE /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 04 21:06:55.812472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:55.813314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:55.819989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.820539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.822114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:55.822628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:55.847369 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-851552e3-60da-494b-b932-d182348f0957 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 0.798777 Jun 04 21:06:55.862505 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1587/3300] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:06:55 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:55.867943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:55.871966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.883408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:55.951411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.967708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.972822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:55.985796 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8cbb3864-124d-41c3-9e2a-8338f781820d tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1443 microversion: 2.75 time: 0.176993 Jun 04 21:06:55.986749 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1714/3301] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:55 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:56.066739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.067704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.069407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.071007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.215384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1479232697", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "9d7ecb95-3154-4798-8555-ea26b7029440"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:06:56.263801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:56.344544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] validate_networks() for [('9d7ecb95-3154-4798-8555-ea26b7029440', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:06:56.357740 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a562e88b-1e1a-45ff-8b0c-f7144789980d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.493671 Jun 04 21:06:56.358723 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1588/3302] 10.222.0.18 () {58 vars in 1149 bytes} [Sat Jun 4 21:06:55 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:56.374206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:56.378688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:56.380277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:56.387780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.388237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.389147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.390212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.494722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:56.564610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c9001805-2f4b-4ff4-b511-437856521403 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.193729 Jun 04 21:06:56.564610 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1589/3303] 10.222.0.18 () {58 vars in 1211 bytes} [Sat Jun 4 21:06:56 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:56.575143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:56.578797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:56.579475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:56.594036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.594480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.595686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.596423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.701234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:56.778301 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4814609-3601-4f87-99f9-495c05403394 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.206845 Jun 04 21:06:56.785097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1590/3304] 10.222.0.18 () {58 vars in 1195 bytes} [Sat Jun 4 21:06:56 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:06:56.803097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:56.803097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:56.803097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': '-723190127', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:56.806973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.807420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.808231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.808659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:56.916842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:56.962000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:06:56.963020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:06:56.963965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:06:56.965496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:06:56.966176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:06:56.993084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:56.997149 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9b4f160e-7040-4a4e-a7e8-5ecf9e0aca6c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-723190127" status: 200 len: 345 microversion: 2.1 time: 0.210776 Jun 04 21:06:56.998193 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1591/3305] 10.222.0.18 () {58 vars in 1155 bytes} [Sat Jun 4 21:06:56 2022] GET /compute/v2.1/servers?name=-723190127 => generated 345 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:57.002688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.004397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.005307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.008362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:57.009142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:57.017187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.017642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.018499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.019104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.072625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Getting quotas for project 4695654467fe498e8535cd245a1de975. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:06:57.081125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Getting quotas for user fb1e49a5a78544f0b59e135153a8771c and project 4695654467fe498e8535cd245a1de975. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:06:57.101909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:06:57.104719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:06:57.120036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.136369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.140414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.161002 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76eceb0c-f00e-4bae-9c12-7bde0b86cbcd tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1443 microversion: 2.75 time: 0.158841 Jun 04 21:06:57.163618 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1592/3306] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:57 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:57.177661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:57.189344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.191380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:57.193845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-892f73f1-89e6-414d-ab6c-ab65789bd717 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.205533 Jun 04 21:06:57.194582 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1715/3307] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:06:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:06:57.203984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.204442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.205612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.206214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.221869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac384d8a-4ef7-4ad3-b5c0-420329e796c4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:57.223327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ac384d8a-4ef7-4ad3-b5c0-420329e796c4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:57.367968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:57.379982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac384d8a-4ef7-4ad3-b5c0-420329e796c4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.388299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac384d8a-4ef7-4ad3-b5c0-420329e796c4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.390741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac384d8a-4ef7-4ad3-b5c0-420329e796c4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.392776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ac384d8a-4ef7-4ad3-b5c0-420329e796c4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1259 microversion: 2.21 time: 0.183843 Jun 04 21:06:57.393829 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1716/3308] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:57 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:57.475482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dbb56daa-b39a-49e6-9826-2e5dfe06e80d tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.309504 Jun 04 21:06:57.476112 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1593/3309] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Jun 4 21:06:57 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:57.491996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:57.498803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:57.499883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-72319012', 'deleted': False, 'project_id': '887ac9932d584f4b99b7b168721d9552'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:06:57.506294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.507037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.508057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.508687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.610017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:57.615331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:06:57.726555 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65a90373-856a-4e8e-bc8e-9210a819002c tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-72319012" status: 200 len: 345 microversion: 2.1 time: 0.241326 Jun 04 21:06:57.740329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:57.741468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:57.741937 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1717/3310] 10.222.0.18 () {58 vars in 1225 bytes} [Sat Jun 4 21:06:57 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-72319012 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:06:57.751231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.751946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.753113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.753708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.786876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:06:57.793870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:06:57.922147 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-604326c7-a492-4816-bc74-72f055a633c0 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 204 len: 0 microversion: 2.1 time: 0.185990 Jun 04 21:06:57.923027 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1594/3311] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:06:57 2022] DELETE /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:06:57.946974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:57.950726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:57.968661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.969365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:57.970682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:57.971443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:58.187339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:58.188400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:58.195412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:58.195963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:58.196831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:58.197411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:58.201595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.211223 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6a13db6-85d1-4174-b59c-2781ece77ea8 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1517 microversion: 2.1 time: 0.283375 Jun 04 21:06:58.211853 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1718/3312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:57 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1517 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:06:58.243941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:58.244874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:58.245558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lazy-loading 'fault' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:58.309782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.330958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.332644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.340653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c1e53aa-81f2-455b-9b4f-880f86a6e555 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1448 microversion: 2.75 time: 0.157405 Jun 04 21:06:58.341246 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1595/3313] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:58 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:06:58.419145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:58.421735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:58.430057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:58.430919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:58.432030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:58.432692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:58.520024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.532764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.535550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:58.536945 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0fa7cd3f-05b2-4b70-a984-0eb8f338fa25 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1311 microversion: 2.21 time: 0.128757 Jun 04 21:06:58.537503 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1719/3314] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:58 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:59.234700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:59.235321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:59.274265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.274714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.275559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.276386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.368513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:59.369794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:59.377956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.381227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.385913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.387270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.465458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.467988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.468807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lazy-loading 'fault' on Instance uuid 58220ddd-a383-40bd-b825-32a628257031 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:06:59.662625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:59.674493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:59.679115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8144dbe9274b64967674258aa62739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1e59ed0baa4711bef7dc6059ed7208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:59.693839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13d6a99c-f6ab-475a-ac5e-2790d04be4d5 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 200 len: 1448 microversion: 2.75 time: 0.336046 Jun 04 21:06:59.713496 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1720/3315] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:59 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 1448 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:06:59.725839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:06:59.728491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:06:59.744885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.745334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.746365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:06:59.747211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:06:59.926674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:06:59.941478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4b92575b-4f9f-405f-abfc-377d4d032f10 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1517 microversion: 2.1 time: 0.712371 Jun 04 21:06:59.942090 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1596/3316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:06:59 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1517 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:00.135026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:00.145295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:00.148120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:00.149520 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0f151cbf-da99-4300-97c2-6b0b9fdea6bd tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.434645 Jun 04 21:07:00.150250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1721/3317] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:06:59 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:00.499603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-960b3bf8-d135-42b9-b9da-c24b2cedba37 req-2c9d98ee-4d87-4278-b39d-b9347ba433b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "483cc3e1-24ca-47a3-bda1-7e2f7e975b9b", "name": "network-vif-deleted", "tag": "e7e2a769-2c27-412e-91fc-116b842cf6e5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:00.540265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-960b3bf8-d135-42b9-b9da-c24b2cedba37 req-2c9d98ee-4d87-4278-b39d-b9347ba433b1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:00.542390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-960b3bf8-d135-42b9-b9da-c24b2cedba37 req-2c9d98ee-4d87-4278-b39d-b9347ba433b1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:00.575300 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-960b3bf8-d135-42b9-b9da-c24b2cedba37 req-2c9d98ee-4d87-4278-b39d-b9347ba433b1 service nova] Creating event network-vif-deleted:e7e2a769-2c27-412e-91fc-116b842cf6e5 for instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b on nch2-master-1 Jun 04 21:07:00.585423 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-960b3bf8-d135-42b9-b9da-c24b2cedba37 req-2c9d98ee-4d87-4278-b39d-b9347ba433b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092442 Jun 04 21:07:00.586482 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1597/3318] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:00.726457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:00.727214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] [instance: 58220ddd-a383-40bd-b825-32a628257031] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:00.739575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:00.740747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:00.743193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:00.744272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:00.772419 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] HTTP exception thrown: Instance 58220ddd-a383-40bd-b825-32a628257031 could not be found. Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Request method failure captured: Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 HTTP/1.1 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8kg973LI3emvUVdF-NIVXMjbdpZ3dBbGfAPIijPk4l_ZDUHk6dkFiOmnyzYy-j1Hmf63bPJc8DckpSQaTRfYkfjw_dpL0QL3aZr8I4fbL0Uq5IegfkoRwazrhgFpRsCDDjFtfpLUeziYf2OZ0gEDOXzjLbZVdpTF5cJuNR8aw-nuso Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.75 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1d1e59ed0baa4711bef7dc6059ed7208 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdmin275Test-514924300 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1d1e59ed0baa4711bef7dc6059ed7208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d1e59ed0baa4711bef7dc6059ed7208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1d1e59ed0baa4711bef7dc6059ed7208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1d1e59ed0baa4711bef7dc6059ed7208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdmin275Test-514924300 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1d1e59ed0baa4711bef7dc6059ed7208 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdmin275Test-514924300 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdmin275Test-514924300-project Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6c8144dbe9274b64967674258aa62739 Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdmin275Test-514924300-project Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 58220ddd-a383-40bd-b825-32a628257031 could not be found. Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '58220ddd-a383-40bd-b825-32a628257031'} Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58220ddd-a383-40bd-b825-32a628257031 could not be found. Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58220ddd-a383-40bd-b825-32a628257031 could not be found. Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:00.775167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58220ddd-a383-40bd-b825-32a628257031 could not be found. Jun 04 21:07:00.780384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:00.782718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] Returning 404 to user: Instance 58220ddd-a383-40bd-b825-32a628257031 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:00.783758 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8c68e0e1-e94b-472d-8be1-8e313a564800 tempest-ServersAdmin275Test-514924300 tempest-ServersAdmin275Test-514924300-project] 10.222.0.18 "GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031" status: 404 len: 111 microversion: 2.75 time: 0.065549 Jun 04 21:07:00.789767 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1722/3319] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:00 2022] GET /compute/v2.1/servers/58220ddd-a383-40bd-b825-32a628257031 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:00.960943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:00.962133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:00.975816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:00.976933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:00.980538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:00.981306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:01.055954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:01.056415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:01.056907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lazy-loading 'fault' on Instance uuid 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:07:01.170804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:01.172281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:01.183086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:01.184866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:01.189123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:01.190281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:01.190417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:01.210078 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a16ab6fd-82d7-4d28-8ad6-d91ad6c8f159 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 200 len: 1310 microversion: 2.1 time: 0.254085 Jun 04 21:07:01.213956 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1598/3320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:00 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:01.422591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4e98a1fc-28a7-45c9-a606-245fc1920989 req-ef82ae5a-37ca-4ff0-ba78-7ec50a1d7163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f9dacc-035c-4dda-9218-2d109b7d5edd", "tag": "d575caa6-5166-4905-9ea8-fddde415ecfc"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:01.445642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e98a1fc-28a7-45c9-a606-245fc1920989 req-ef82ae5a-37ca-4ff0-ba78-7ec50a1d7163 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:01.446603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e98a1fc-28a7-45c9-a606-245fc1920989 req-ef82ae5a-37ca-4ff0-ba78-7ec50a1d7163 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:01.473221 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4e98a1fc-28a7-45c9-a606-245fc1920989 req-ef82ae5a-37ca-4ff0-ba78-7ec50a1d7163 service nova] Creating event network-changed:d575caa6-5166-4905-9ea8-fddde415ecfc for instance c5f9dacc-035c-4dda-9218-2d109b7d5edd on nch1-master-1 Jun 04 21:07:01.478435 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4e98a1fc-28a7-45c9-a606-245fc1920989 req-ef82ae5a-37ca-4ff0-ba78-7ec50a1d7163 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064137 Jun 04 21:07:01.479062 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1599/3321] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:01.987319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:02.017421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:02.019683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:02.021627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ee69754-d8a3-420b-ba99-5cf25aeb5d90 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.856154 Jun 04 21:07:02.028312 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1723/3322] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:01 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:02.232781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:02.234638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:02.250612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:02.250612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:02.250839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:02.251474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:02.276055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] HTTP exception thrown: Instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b could not be found. Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Request method failure captured: Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b HTTP/1.1 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8kv_6Z5-kqSRG04i5FaeL_Vexm5YkjWj-hTuA30o8OV8TdeV5IjEKDA09hDVLPZ2gpBq-KdPRQfqw3lFpMioDYwgWskoj_xcJNWHw47AcyQYsyd-ntCTW7daYQU2f5H1hxgEdSzkpSOVtFS_GZrtBhSv5GyMI1wzoncDoQ6SGE98yI Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 887ac9932d584f4b99b7b168721d9552 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_887ac9932d584f4b99b7b168721d9552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 887ac9932d584f4b99b7b168721d9552 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ListServerFiltersTestJSON-955455273-project Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e2235426d43a4e98973a97ea8e45c1f4 Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ListServerFiltersTestJSON-955455273-project Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b could not be found. Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '483cc3e1-24ca-47a3-bda1-7e2f7e975b9b'} Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b could not be found. Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b could not be found. Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:02.278019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b could not be found. Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Returning 404 to user: Instance 483cc3e1-24ca-47a3-bda1-7e2f7e975b9b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:02.286984 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-18fec44f-9751-4e1e-b391-a934d48fa9c3 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b" status: 404 len: 111 microversion: 2.1 time: 0.052373 Jun 04 21:07:02.288732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:02.289308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:02.291803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:02.293619 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1600/3323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:02 2022] GET /compute/v2.1/servers/483cc3e1-24ca-47a3-bda1-7e2f7e975b9b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:02.298031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:02.298723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:02.299537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:02.300173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:02.330227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:07:02.483867 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b45054a9-0353-4306-a9e3-a283229ddc00 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 204 len: 0 microversion: 2.1 time: 0.198393 Jun 04 21:07:02.484693 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1724/3324] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:07:02 2022] DELETE /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:07:02.495852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:02.496554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:02.503631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:02.504388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:02.505668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:02.506330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:02.784399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:02.800050 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b972089-bdf4-44f2-9dd3-62b594ad240f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1516 microversion: 2.1 time: 0.309196 Jun 04 21:07:02.801982 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1601/3325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:02 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:03.042634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:03.044877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:03.062831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:03.063606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:03.064670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:03.065393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:03.279075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:03.291828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:03.293376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:03.294682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-601c3b10-fe41-4046-982e-2a9acda40a54 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.257097 Jun 04 21:07:03.295302 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1725/3326] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:03 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:03.820756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:03.821911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:03.840055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:03.840055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:03.840055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:03.840055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:04.154200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:04.165109 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e83df24d-1352-408f-9a7d-ab0690b8211f tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1516 microversion: 2.1 time: 0.350286 Jun 04 21:07:04.166929 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1602/3327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:03 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1516 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:04.316549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:04.318509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:04.329459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:04.330016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:04.331302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:04.333262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:04.588472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:04.600569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:04.602992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:04.604714 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b0b29a3-3e10-4cce-bb2a-27dc6ff1d377 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.295063 Jun 04 21:07:04.605960 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1726/3328] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:04 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:05.171923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:05.193623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:05.194549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:05.222694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.224225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.226916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.230125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.490902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:05.491420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:05.499794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.500389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.501824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.503659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.550279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:07:05.690518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:05.698656 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5ad16242-bc0e-4b0b-8ea8-3952040aa5bc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 204 len: 0 microversion: 2.32 time: 0.696792 Jun 04 21:07:05.700217 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1603/3329] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:05 2022] DELETE /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 04 21:07:05.724240 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-507eae5d-1a0f-40ee-994b-f51288bd3994 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1516 microversion: 2.1 time: 0.538236 Jun 04 21:07:05.733772 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1727/3330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:05 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:05.753227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:05.754318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:05.787556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d310ac6f-25a7-4681-b9b7-d250741f32b3 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:05.788493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.788949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.789731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.790162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.790785 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:05.790785 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:07:05.794321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d310ac6f-25a7-4681-b9b7-d250741f32b3 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.795220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d310ac6f-25a7-4681-b9b7-d250741f32b3 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.798418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d310ac6f-25a7-4681-b9b7-d250741f32b3 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.802021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d310ac6f-25a7-4681-b9b7-d250741f32b3 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.876433 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d310ac6f-25a7-4681-b9b7-d250741f32b3 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.173562 Jun 04 21:07:05.877687 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1604/3331] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:07:05 2022] GET /compute/v2.1/os-services => generated 947 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:05.887261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:05.888814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:05.900378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.900911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:05.901872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:05.902333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.292743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.304073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.305710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.306977 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-826cd48d-450a-4dc6-937e-d158c9d2025b tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.571813 Jun 04 21:07:06.307577 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1728/3332] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:05 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:06.319898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3fdd364f-d2cd-45a8-a0ee-92ea1aa5271e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.322646 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:06.322646 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:07:06.324724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fdd364f-d2cd-45a8-a0ee-92ea1aa5271e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.326081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fdd364f-d2cd-45a8-a0ee-92ea1aa5271e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.327930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fdd364f-d2cd-45a8-a0ee-92ea1aa5271e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.329344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fdd364f-d2cd-45a8-a0ee-92ea1aa5271e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.363270 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3fdd364f-d2cd-45a8-a0ee-92ea1aa5271e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.054167 Jun 04 21:07:06.364195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1729/3333] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:06.378645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61300e45-936b-4f30-b249-4f7b6312e3cb tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.380550 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:06.380550 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:07:06.382576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61300e45-936b-4f30-b249-4f7b6312e3cb tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.383132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61300e45-936b-4f30-b249-4f7b6312e3cb tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.384081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61300e45-936b-4f30-b249-4f7b6312e3cb tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.385536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61300e45-936b-4f30-b249-4f7b6312e3cb tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.416508 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61300e45-936b-4f30-b249-4f7b6312e3cb tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.043352 Jun 04 21:07:06.417595 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1730/3334] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:06.432344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f44a6c60-f2cb-4c90-b61a-719267e0dc45 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.434543 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:06.434543 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:07:06.437134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f44a6c60-f2cb-4c90-b61a-719267e0dc45 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.438394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f44a6c60-f2cb-4c90-b61a-719267e0dc45 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.439872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f44a6c60-f2cb-4c90-b61a-719267e0dc45 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.440962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f44a6c60-f2cb-4c90-b61a-719267e0dc45 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.461505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.475025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.477039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.478718 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d265d88-40db-4085-afb5-33a5a92d3214 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2957 microversion: 2.32 time: 0.599615 Jun 04 21:07:06.486375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f44a6c60-f2cb-4c90-b61a-719267e0dc45 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.059302 Jun 04 21:07:06.487784 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1731/3335] 10.222.0.18 () {58 vars in 1195 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:06.493148 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1605/3336] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:05 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2957 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:06.505740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f979fe69-aeb9-4c6a-b455-8e1e76017f08 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.506907 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:06.506907 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:07:06.508670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f979fe69-aeb9-4c6a-b455-8e1e76017f08 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.509417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f979fe69-aeb9-4c6a-b455-8e1e76017f08 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.510538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f979fe69-aeb9-4c6a-b455-8e1e76017f08 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.511153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f979fe69-aeb9-4c6a-b455-8e1e76017f08 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.541777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f979fe69-aeb9-4c6a-b455-8e1e76017f08 tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.043476 Jun 04 21:07:06.542673 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1732/3337] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/os-services => generated 947 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:07:06.556782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e1aef9c0-a71d-435a-8e76-01e4c0f8718e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.558414 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:06.558414 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:07:06.560144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1aef9c0-a71d-435a-8e76-01e4c0f8718e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.561007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1aef9c0-a71d-435a-8e76-01e4c0f8718e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.561923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1aef9c0-a71d-435a-8e76-01e4c0f8718e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.562642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1aef9c0-a71d-435a-8e76-01e4c0f8718e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.593365 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e1aef9c0-a71d-435a-8e76-01e4c0f8718e tempest-ServicesAdminNegativeTestJSON-1625452127 tempest-ServicesAdminNegativeTestJSON-1625452127-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.042237 Jun 04 21:07:06.594391 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1606/3338] 10.222.0.18 () {58 vars in 1197 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:06.747893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.749006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:06.765185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.766085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.767073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.771476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.856558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac6cb991-2bfe-44fe-8799-f9e07fb003b7 tempest-ServicesAdminNegativeTestJSON-1869624824 tempest-ServicesAdminNegativeTestJSON-1869624824-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:06.857948 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:07:06.857948 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:07:06.859138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac6cb991-2bfe-44fe-8799-f9e07fb003b7 tempest-ServicesAdminNegativeTestJSON-1869624824 tempest-ServicesAdminNegativeTestJSON-1869624824-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a5084e793dce42d580e48f258b41ec50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0859d5ace14f4d8e65cddcc54a9eea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac6cb991-2bfe-44fe-8799-f9e07fb003b7 tempest-ServicesAdminNegativeTestJSON-1869624824 tempest-ServicesAdminNegativeTestJSON-1869624824-project] Request method failure captured: Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8l4RQWg_QX73OzNexsQIqdGdp_k6rj0f0VZQ742k4HJ-AwEkYgu2CqD7J6UxC2Rajp1wvMjhJRKSznB7Ks_phossSKPrJGj80Ya0B7QVc1lh8TtZlc_C4mDY_leARLrhjuCM5AqJpFc1TN7DSdFPCS3MeszRcIFlZefIFsYZFOuKCA Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0d0859d5ace14f4d8e65cddcc54a9eea Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1869624824 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0d0859d5ace14f4d8e65cddcc54a9eea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d0859d5ace14f4d8e65cddcc54a9eea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0d0859d5ace14f4d8e65cddcc54a9eea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0d0859d5ace14f4d8e65cddcc54a9eea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1869624824 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0d0859d5ace14f4d8e65cddcc54a9eea Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1869624824 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServicesAdminNegativeTestJSON-1869624824-project Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: a5084e793dce42d580e48f258b41ec50 Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1869624824-project Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: action_args: {} Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise self.value Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 04 21:07:06.861157 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 04 21:07:06.866353 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:06.868892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac6cb991-2bfe-44fe-8799-f9e07fb003b7 tempest-ServicesAdminNegativeTestJSON-1869624824 tempest-ServicesAdminNegativeTestJSON-1869624824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:06.870654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ac6cb991-2bfe-44fe-8799-f9e07fb003b7 tempest-ServicesAdminNegativeTestJSON-1869624824 tempest-ServicesAdminNegativeTestJSON-1869624824-project] 10.222.0.18 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.268583 Jun 04 21:07:06.873619 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1733/3339] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/os-services => generated 112 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:06.876078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:06.887604 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e74dd9c0-3393-4dfa-9f0a-7e5f8a34818a tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1474 microversion: 2.1 time: 0.143671 Jun 04 21:07:06.894070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f0ad6026-9d0e-434a-94fb-32c31aa38b83 req-c154e1cd-2cfa-4811-8c75-c6e3317db10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f14fd5-d9c4-4330-805e-981592057063", "name": "network-vif-deleted", "tag": "f5a6718e-7a96-4486-9a48-4445966d79d0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:06.899850 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1607/3340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:06 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1474 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:07:06.917831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f0ad6026-9d0e-434a-94fb-32c31aa38b83 req-c154e1cd-2cfa-4811-8c75-c6e3317db10b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:06.918565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f0ad6026-9d0e-434a-94fb-32c31aa38b83 req-c154e1cd-2cfa-4811-8c75-c6e3317db10b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:06.931999 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f0ad6026-9d0e-434a-94fb-32c31aa38b83 req-c154e1cd-2cfa-4811-8c75-c6e3317db10b service nova] Creating event network-vif-deleted:f5a6718e-7a96-4486-9a48-4445966d79d0 for instance 46f14fd5-d9c4-4330-805e-981592057063 on nch1-master-1 Jun 04 21:07:06.938367 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f0ad6026-9d0e-434a-94fb-32c31aa38b83 req-c154e1cd-2cfa-4811-8c75-c6e3317db10b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063333 Jun 04 21:07:06.939399 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1734/3341] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:07.325649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:07.326349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:07.334534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:07.335310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:07.336761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:07.337297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:07.503390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:07.504641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:07.508745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:07.517904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:07.518486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:07.520029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:07.520477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:07.544743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:07.558777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:07.560836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:07.562699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77204559-c3a1-4f19-866d-cf92223ca624 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.240925 Jun 04 21:07:07.563460 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1608/3342] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:07 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:07.802480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:07.812965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:07.814807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:07.815797 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60e07917-924b-4f7e-a26e-2f3a5ccbe953 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2957 microversion: 2.32 time: 0.318491 Jun 04 21:07:07.816348 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1735/3343] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:07 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2957 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:07.907049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:07.907907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:07.911919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:07.915979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:07.916549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:07.917342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:07.918008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:08.061732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:08.069861 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0b956d81-a147-4bf2-870f-8a4348fbfe61 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1474 microversion: 2.1 time: 0.167506 Jun 04 21:07:08.082465 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1609/3344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:07 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1474 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:08.583547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:08.584892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:08.594028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:08.594823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:08.595744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:08.596296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:08.851331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:08.852097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:08.869971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:08.875539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:08.877036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:08.877825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:08.924119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:09.167227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.170061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:09.181820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.188356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.192830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de594ed7-3d1b-437b-9980-df1af12bc0c9 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.613585 Jun 04 21:07:09.194972 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1736/3345] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:08 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:09.228868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:09.230290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:09.249988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:09.250777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:09.251919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:09.254830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:09.324988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:09.325720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:09.326863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lazy-loading 'fault' on Instance uuid 46f14fd5-d9c4-4330-805e-981592057063 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:07:09.527305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.538375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-028bcb64-150d-4e7c-9711-296dd1759024 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 200 len: 1310 microversion: 2.1 time: 0.330101 Jun 04 21:07:09.553761 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1737/3346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:09 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 1310 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:09.564040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b38a65b9-9d6b-4719-9289-0fdad2934b1c req-5f9e700d-f60e-4fe1-b4bc-3a4eec40e64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f9dacc-035c-4dda-9218-2d109b7d5edd", "name": "network-vif-plugged", "status": "completed", "tag": "d575caa6-5166-4905-9ea8-fddde415ecfc"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:09.577178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b38a65b9-9d6b-4719-9289-0fdad2934b1c req-5f9e700d-f60e-4fe1-b4bc-3a4eec40e64b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:09.578541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b38a65b9-9d6b-4719-9289-0fdad2934b1c req-5f9e700d-f60e-4fe1-b4bc-3a4eec40e64b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:09.597751 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b38a65b9-9d6b-4719-9289-0fdad2934b1c req-5f9e700d-f60e-4fe1-b4bc-3a4eec40e64b service nova] Creating event network-vif-plugged:d575caa6-5166-4905-9ea8-fddde415ecfc for instance c5f9dacc-035c-4dda-9218-2d109b7d5edd on nch1-master-1 Jun 04 21:07:09.608874 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b38a65b9-9d6b-4719-9289-0fdad2934b1c req-5f9e700d-f60e-4fe1-b4bc-3a4eec40e64b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051834 Jun 04 21:07:09.610797 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1738/3347] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:09.661460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.677720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.680223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:09.682164 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3f0f1e8a-c566-4bbf-9e11-8e6e31d02833 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2957 microversion: 2.32 time: 0.848608 Jun 04 21:07:09.684238 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1610/3348] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:08 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2957 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:10.013686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:10.019899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:10.021623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Searching by: {'deleted': False, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:07:10.036523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.037233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.037853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.039924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.083498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.multi_cell_list [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137228) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:07:10.125346 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2379b75-2ef4-46c5-8a04-7bd7546ec160 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.125836 Jun 04 21:07:10.126346 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1739/3349] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:07:09 2022] GET /compute/v2.1/servers => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:10.144257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:10.162455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:10.163558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Searching by: {'deleted': False, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:07:10.197143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.197143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.197143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.197143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.214330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:10.215231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:10.228945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.229967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.231294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.232053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.304269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:07:10.445923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:10.477245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.477688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.707756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:10.725296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:10.728463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:10.730856 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed93c26b-b3b4-4f22-9700-6e5b82d4abbe tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1359 microversion: 2.21 time: 0.521595 Jun 04 21:07:10.732161 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1740/3350] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:10 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1359 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:10.741832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:10.742992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 46f14fd5-d9c4-4330-805e-981592057063] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:10.754144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.756100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.757551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.758549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.800562 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] HTTP exception thrown: Instance 46f14fd5-d9c4-4330-805e-981592057063 could not be found. Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Request method failure captured: Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 HTTP/1.1 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8kv_6Z5-kqSRG04i5FaeL_Vexm5YkjWj-hTuA30o8OV8TdeV5IjEKDA09hDVLPZ2gpBq-KdPRQfqw3lFpMioDYwgWskoj_xcJNWHw47AcyQYsyd-ntCTW7daYQU2f5H1hxgEdSzkpSOVtFS_GZrtBhSv5GyMI1wzoncDoQ6SGE98yI Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 887ac9932d584f4b99b7b168721d9552 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_887ac9932d584f4b99b7b168721d9552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 887ac9932d584f4b99b7b168721d9552 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListServerFiltersTestJSON-955455273-project Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: e2235426d43a4e98973a97ea8e45c1f4 Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListServerFiltersTestJSON-955455273-project Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 46f14fd5-d9c4-4330-805e-981592057063 could not be found. Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '46f14fd5-d9c4-4330-805e-981592057063'} Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f14fd5-d9c4-4330-805e-981592057063 could not be found. Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f14fd5-d9c4-4330-805e-981592057063 could not be found. Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:10.805333 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f14fd5-d9c4-4330-805e-981592057063 could not be found. Jun 04 21:07:10.817391 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:10.820763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Returning 404 to user: Instance 46f14fd5-d9c4-4330-805e-981592057063 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:10.822006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b279b86c-ad21-4ae3-a77a-e653f93918e9 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063" status: 404 len: 111 microversion: 2.1 time: 0.088393 Jun 04 21:07:10.823191 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1741/3351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:10 2022] GET /compute/v2.1/servers/46f14fd5-d9c4-4330-805e-981592057063 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:10.831730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:10.832841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:10.843315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.844050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:10.845152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:10.846092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.276592 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ddf349b4-aa9a-416e-9614-8bf2672dfaf9 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.140478 Jun 04 21:07:11.278182 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1611/3352] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:07:10 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:11.284326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:11.285173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:11.299801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:11.300650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.301706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:11.302171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.346257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:07:11.505445 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b1027d57-167e-435b-8b59-cb86e71a9ffa tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "DELETE /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 204 len: 0 microversion: 2.1 time: 0.224987 Jun 04 21:07:11.507805 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1612/3353] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:07:11 2022] DELETE /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:07:11.527612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ef80714-474f-4e2e-bd79-87341cfc070a tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:11.562478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ef80714-474f-4e2e-bd79-87341cfc070a tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040659 Jun 04 21:07:11.569857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1613/3354] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:07:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:11.583040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:11.585614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:11.586364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:11.604216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:11.604748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:11.605563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.605941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:11.608063 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eadde358-d2a1-4db4-be56-7bc7c182d2d3 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2936 microversion: 2.32 time: 0.782506 Jun 04 21:07:11.608231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1742/3355] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:10 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2936 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:11.608892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:11.610245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.751712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:11.752409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:11.767937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:11.769001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.770733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:11.772643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:11.978793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:11.988474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cef40fdb-9ea2-4baf-841c-8d1a0d949033 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1517 microversion: 2.1 time: 0.417060 Jun 04 21:07:11.989118 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1614/3356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:11 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1517 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:12.006915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b8bd9e7-d91b-481a-a26f-dbb6477a2f26 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d0bde83a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:12.084102 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4b8bd9e7-d91b-481a-a26f-dbb6477a2f26 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc" status: 200 len: 637 microversion: 2.1 time: 0.089843 Jun 04 21:07:12.085092 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1615/3357] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:11 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc => generated 637 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:12.092836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:12.092836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:12.102890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.103365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.104419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.104869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.153313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:12.154794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:07:12.166990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:12.168766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:12.169961 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5042d2dc-21f2-4704-8198-b4c04bc269e4 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1552 microversion: 2.21 time: 0.424111 Jun 04 21:07:12.180450 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1743/3358] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:11 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1552 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:12.186255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1fdaa0a0-aa53-45e3-b4ae-9404f5408ed3 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d00fed550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:12.257175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1fdaa0a0-aa53-45e3-b4ae-9404f5408ed3 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:12.263580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1fdaa0a0-aa53-45e3-b4ae-9404f5408ed3 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:12.318864 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c8296f1-b147-484a-879e-45bd48330738 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "DELETE /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 204 len: 0 microversion: 2.1 time: 0.232257 Jun 04 21:07:12.319709 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1616/3359] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:07:12 2022] DELETE /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:07:12.326647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:12.327379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:12.334917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.335382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.336401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.337082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.374555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:07:12.503356 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ab2304b-f3a3-4945-ab7d-146ef0454273 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 204 len: 0 microversion: 2.21 time: 0.181239 Jun 04 21:07:12.504599 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1617/3360] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:12 2022] DELETE /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:07:12.512097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:12.513632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:12.523287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.524199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.525163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.526162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.759923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:12.772043 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a17b473-1b9d-4007-9b84-9d0a069a9cc7 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1609 microversion: 2.1 time: 0.265209 Jun 04 21:07:12.779981 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1618/3361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:12 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1609 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:12.785582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:12.787450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:12.796238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.796731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.797519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.797958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.802708 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1fdaa0a0-aa53-45e3-b4ae-9404f5408ed3 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.621065 Jun 04 21:07:12.803344 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1744/3362] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:12 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:12.811990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:12.812574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:12.824476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.824919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:12.825705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:12.826365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:13.037648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.049981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.051535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.057090 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1886d86b-113e-4e39-896a-2f7f921f0514 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1558 microversion: 2.21 time: 0.275718 Jun 04 21:07:13.068131 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1619/3363] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:12 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1558 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:13.073050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8acf31e3-1bbf-4e18-a11f-711c4af838d4 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d023b7670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:13.313345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.329126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.330325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.331829 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2266343-4bc9-4861-8bf9-a94db617b609 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2915 microversion: 2.32 time: 0.527475 Jun 04 21:07:13.332794 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1745/3364] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:12 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2915 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:13.345180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:13.346143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:13.366595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:13.367055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:13.371710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:13.372202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:13.642508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:13.655971 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0791d40b-230a-4705-aae1-cf6e39dfb084 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1517 microversion: 2.1 time: 0.320969 Jun 04 21:07:13.656994 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1746/3365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:13 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:13.676309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a0c810a1-bb6c-4af7-903f-4b38ec135eeb req-1786b2bc-7a9e-45df-a341-8a8cef74bc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-unplugged", "status": "completed", "tag": "56fb03d6-a5f3-49d6-96c0-89442b0af796"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:13.699393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a0c810a1-bb6c-4af7-903f-4b38ec135eeb req-1786b2bc-7a9e-45df-a341-8a8cef74bc88 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:13.700492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a0c810a1-bb6c-4af7-903f-4b38ec135eeb req-1786b2bc-7a9e-45df-a341-8a8cef74bc88 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:13.716389 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a0c810a1-bb6c-4af7-903f-4b38ec135eeb req-1786b2bc-7a9e-45df-a341-8a8cef74bc88 service nova] Creating event network-vif-unplugged:56fb03d6-a5f3-49d6-96c0-89442b0af796 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:13.722842 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a0c810a1-bb6c-4af7-903f-4b38ec135eeb req-1786b2bc-7a9e-45df-a341-8a8cef74bc88 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064340 Jun 04 21:07:13.728136 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1747/3366] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:13.737990 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8acf31e3-1bbf-4e18-a11f-711c4af838d4 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "DELETE /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.677696 Jun 04 21:07:13.738588 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1620/3367] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Jun 4 21:07:13 2022] DELETE /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata/os_version => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:07:13.748442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4a374dd-b2cf-4a77-a2d9-e8d1be353c38 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d00fedd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:13.795986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:13.797201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:13.816689 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4a374dd-b2cf-4a77-a2d9-e8d1be353c38 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 37 microversion: 2.1 time: 0.071887 Jun 04 21:07:13.817278 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1748/3368] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:07:13 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 37 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:13.829587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bc58a90-07dd-4be6-bc97-662d8472fb41 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d00f8a670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:13.831994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:13.836500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:13.839121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:13.839910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:13.911727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1bc58a90-07dd-4be6-bc97-662d8472fb41 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:13.921217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1bc58a90-07dd-4be6-bc97-662d8472fb41 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:14.035330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.048967 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7e1697be-835e-453a-a028-fd04ff4bce71 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1609 microversion: 2.1 time: 0.262571 Jun 04 21:07:14.050524 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1621/3369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:13 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1609 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:14.076678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:14.077835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:14.086711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.087543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.088811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.089476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.336610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.340145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bc58a90-07dd-4be6-bc97-662d8472fb41 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.515124 Jun 04 21:07:14.341549 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1749/3370] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:13 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:14.349323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.352305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.352933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-148a6e29-c539-470b-896f-bfd58c82d8b7 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d010495e0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:14.355053 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-607e915b-b7cf-400a-acb1-81431dda7128 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1558 microversion: 2.21 time: 0.283152 Jun 04 21:07:14.355752 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1622/3371] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:14 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1558 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:14.360759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:14.361714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:14.370487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.371273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.372388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.373038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.410812 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-148a6e29-c539-470b-896f-bfd58c82d8b7 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.062758 Jun 04 21:07:14.412398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1750/3372] 10.222.0.18 () {58 vars in 1289 bytes} [Sat Jun 4 21:07:14 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata/os_distro => generated 33 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:14.425110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bed68a4-a105-4b67-bd36-0db7a5ecac90 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d0103f8b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:14.496020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7bed68a4-a105-4b67-bd36-0db7a5ecac90 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:14.511222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7bed68a4-a105-4b67-bd36-0db7a5ecac90 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:14.659944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.695995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.698084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.706320 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5d80c357-4b59-400f-b08f-bea57eaac994 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2868 microversion: 2.32 time: 0.349335 Jun 04 21:07:14.707134 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1623/3373] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:14 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2868 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:14.713715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:14.714269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:14.726162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.726618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.727451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.727923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.745694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:14.937374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bed68a4-a105-4b67-bd36-0db7a5ecac90 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.516574 Jun 04 21:07:14.938712 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1751/3374] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:14 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:14.946413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-04a26f1b-bed4-4cfd-ae29-8f8f1cf66464 req-2eb7b3ef-8a55-4662-a15c-05c9eb65aa77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-deleted", "tag": "56fb03d6-a5f3-49d6-96c0-89442b0af796"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:14.961436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-04a26f1b-bed4-4cfd-ae29-8f8f1cf66464 req-2eb7b3ef-8a55-4662-a15c-05c9eb65aa77 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:14.962310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-04a26f1b-bed4-4cfd-ae29-8f8f1cf66464 req-2eb7b3ef-8a55-4662-a15c-05c9eb65aa77 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:14.970966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:14.980071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-04a26f1b-bed4-4cfd-ae29-8f8f1cf66464 req-2eb7b3ef-8a55-4662-a15c-05c9eb65aa77 service nova] Creating event network-vif-deleted:56fb03d6-a5f3-49d6-96c0-89442b0af796 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:14.982937 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-289286e3-0eff-4968-99b3-118a94712739 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1517 microversion: 2.1 time: 0.274514 Jun 04 21:07:14.983805 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1624/3375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:14 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:14.988718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db1c1989-f576-421d-bf8b-d690b42dcb91 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d0bf86310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:14.993492 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-04a26f1b-bed4-4cfd-ae29-8f8f1cf66464 req-2eb7b3ef-8a55-4662-a15c-05c9eb65aa77 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052157 Jun 04 21:07:14.994730 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1752/3376] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:15.060825 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db1c1989-f576-421d-bf8b-d690b42dcb91 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.075613 Jun 04 21:07:15.061943 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1625/3377] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:07:14 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:15.067948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:15.068301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:15.077448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e839200c-b0b5-4ee2-a31a-60eca63168ad tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d029cd5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:15.086190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:15.086695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:15.088270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:15.088724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:15.177480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e839200c-b0b5-4ee2-a31a-60eca63168ad tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:15.186639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e839200c-b0b5-4ee2-a31a-60eca63168ad tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:15.431961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:15.446775 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55f473c1-a322-40ef-9950-f1da55274832 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1609 microversion: 2.1 time: 0.383722 Jun 04 21:07:15.448327 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1753/3378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:15 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1609 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:15.453269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:15.453936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:15.460470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:15.460927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:15.461708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:15.462151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:15.519275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e839200c-b0b5-4ee2-a31a-60eca63168ad tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.447083 Jun 04 21:07:15.520429 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1626/3379] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:15 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:15.530920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62463ed7-1b63-4635-b8bf-57d08b69a9bf tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d0be6faf0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:15.595953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-62463ed7-1b63-4635-b8bf-57d08b69a9bf tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:15.602135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-62463ed7-1b63-4635-b8bf-57d08b69a9bf tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:15.725736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:15.743115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:15.745263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:15.746812 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-072b5acd-c127-4875-ae76-25a838a13ca2 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1558 microversion: 2.21 time: 0.297513 Jun 04 21:07:15.747381 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1754/3380] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:15 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1558 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:15.766899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:15.767969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:15.776430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:15.777116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:15.778282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:15.779292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.040390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:16.050443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:16.051950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:16.053557 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e65e24da-6c5a-4b2f-a48a-77829e1ecf61 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2868 microversion: 2.32 time: 0.293372 Jun 04 21:07:16.054784 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1755/3381] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:15 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2868 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:16.059780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-unplugged", "status": "completed", "tag": "209128ba-608b-44e4-809f-e85d0a6c87e3"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-unplugged", "status": "completed", "tag": "619b5a38-1d96-4f73-8e36-188fa8464db2"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-unplugged", "status": "completed", "tag": "a18106de-02a9-4771-a90c-8ae75e40f172"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-unplugged", "status": "completed", "tag": "3a71217e-dc2e-4548-97ad-5596a76b102e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:16.069439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.070145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.079780 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62463ed7-1b63-4635-b8bf-57d08b69a9bf tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.553361 Jun 04 21:07:16.080455 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1627/3382] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:15 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 64 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:16.083919 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Creating event network-vif-unplugged:209128ba-608b-44e4-809f-e85d0a6c87e3 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:16.084605 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Creating event network-vif-unplugged:619b5a38-1d96-4f73-8e36-188fa8464db2 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:16.085111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Creating event network-vif-unplugged:a18106de-02a9-4771-a90c-8ae75e40f172 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:16.085733 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] Creating event network-vif-unplugged:3a71217e-dc2e-4548-97ad-5596a76b102e for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:16.087351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:16.088171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:16.093143 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-dec46b73-7fbb-4b3f-a6d2-951202a7d397 req-365f5c8e-7a89-47ae-a518-4c839c436e24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.035475 Jun 04 21:07:16.098150 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1756/3383] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:16.099464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.100806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.101794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.103216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.103624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ccf53598-9c65-4195-92cb-51677f45f2a1 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d0108fe50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:16.173134 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ccf53598-9c65-4195-92cb-51677f45f2a1 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.073442 Jun 04 21:07:16.173734 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1757/3384] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:07:16 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 64 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:16.183960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2dc035ea-02a0-4c00-a735-efe07610d516 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d00fae1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:16.237736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2dc035ea-02a0-4c00-a735-efe07610d516 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:16.249099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2dc035ea-02a0-4c00-a735-efe07610d516 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:16.278050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:16.564551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:16.574694 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e5a8f1fe-6264-47cb-8600-c0d4fbd0bf7b tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1517 microversion: 2.1 time: 0.493010 Jun 04 21:07:16.575603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1628/3385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:16 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:16.583301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:16.584249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:16.599275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.600052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.601105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.601645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.775109 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2dc035ea-02a0-4c00-a735-efe07610d516 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.594820 Jun 04 21:07:16.779659 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1758/3386] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:16 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 21:07:16.783939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:16.784785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:16.798944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.802073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:16.803178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:16.805430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:17.314206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:17.323211 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4021e5dc-0e73-4e79-b92b-32a2aa7d2734 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1609 microversion: 2.1 time: 0.746047 Jun 04 21:07:17.327900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1629/3387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:16 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1609 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:17.336490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dff659a5-e381-4fd6-bb2f-d4986232df62 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update', calling method: .version_select at 0x7f2d0375dca0>, body: {"meta": {"os_version": "alt"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:17.399252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:17.411863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:17.414135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:17.416101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a03bfe20-a6ec-4685-ad11-5b81dbf4f149 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1558 microversion: 2.21 time: 0.638559 Jun 04 21:07:17.429649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-dff659a5-e381-4fd6-bb2f-d4986232df62 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:17.432090 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1759/3388] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:16 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1558 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:17.443288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:17.444829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:17.462380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-dff659a5-e381-4fd6-bb2f-d4986232df62 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:17.485200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:17.486101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:17.487136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:17.489087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:17.968502 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dff659a5-e381-4fd6-bb2f-d4986232df62 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.639227 Jun 04 21:07:17.969270 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1630/3389] 10.222.0.18 () {60 vars in 1312 bytes} [Sat Jun 4 21:07:17 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata/os_version => generated 31 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:17.981347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:17.983163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:17.991312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:17.992498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:17.993540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:17.994209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.006859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.020403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.022278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.023589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1348ea5-c9d3-4524-8a1c-7d9c7ed08bac tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2707 microversion: 2.32 time: 0.590074 Jun 04 21:07:18.032688 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1760/3390] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:17 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2707 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:18.051645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7063871e-5a66-4603-b1ad-340874236a50 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d00fae310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:18.135732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7063871e-5a66-4603-b1ad-340874236a50 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 58 microversion: 2.1 time: 0.101789 Jun 04 21:07:18.136327 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1761/3391] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:07:18 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 58 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:18.146729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44bc971a-6ed6-4bea-a90c-f5ccd5942b00 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'update_all', calling method: .version_select at 0x7f2d00faedc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:18.212373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-44bc971a-6ed6-4bea-a90c-f5ccd5942b00 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:18.225065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-44bc971a-6ed6-4bea-a90c-f5ccd5942b00 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:18.334589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2235426d43a4e98973a97ea8e45c1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '887ac9932d584f4b99b7b168721d9552', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.376358 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7b2d6230-85c1-4fa0-8da4-30957cd81b05 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 200 len: 1475 microversion: 2.1 time: 0.397950 Jun 04 21:07:18.379430 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1631/3392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:17 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:18.412916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:18.413549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:18.435044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:18.435352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.436402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:18.437225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.714523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.724311 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ab8cf26-437c-4f8d-b815-30949f5f8153 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1541 microversion: 2.1 time: 0.337031 Jun 04 21:07:18.731795 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1632/3393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:18 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1541 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:18.743027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:18.746054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:18.764977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:18.766406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.767396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:18.768072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.926854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.928471 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-44bc971a-6ed6-4bea-a90c-f5ccd5942b00 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.785869 Jun 04 21:07:18.933654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1762/3394] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:18 2022] PUT /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 61 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 21:07:18.938910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.939090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-9256dd8d-de67-4f17-b286-95ccbfb657f9 req-513a49fa-ed23-43a9-b48a-3f066e7c2a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "054cf0c3-9df7-4440-a761-e2ece6ffbf67", "name": "network-vif-deleted", "tag": "e68410d2-2d72-4245-a948-4d8cdc2756cd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:18.940381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:18.941808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-282058bc-ffeb-4192-9020-e247675d0c97 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1516 microversion: 2.21 time: 0.208652 Jun 04 21:07:18.942618 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1633/3395] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:18 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:18.948822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e999918b-d76c-4e77-8d71-f1646acf4d10 req-a8ed0e46-286a-492a-a553-578fc36cd6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-deleted", "tag": "a18106de-02a9-4771-a90c-8ae75e40f172"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:18.953780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9256dd8d-de67-4f17-b286-95ccbfb657f9 req-513a49fa-ed23-43a9-b48a-3f066e7c2a73 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:18.954236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9256dd8d-de67-4f17-b286-95ccbfb657f9 req-513a49fa-ed23-43a9-b48a-3f066e7c2a73 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.963540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e999918b-d76c-4e77-8d71-f1646acf4d10 req-a8ed0e46-286a-492a-a553-578fc36cd6a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:18.964348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e999918b-d76c-4e77-8d71-f1646acf4d10 req-a8ed0e46-286a-492a-a553-578fc36cd6a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:18.980776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e999918b-d76c-4e77-8d71-f1646acf4d10 req-a8ed0e46-286a-492a-a553-578fc36cd6a8 service nova] Creating event network-vif-deleted:a18106de-02a9-4771-a90c-8ae75e40f172 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:18.982516 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-9256dd8d-de67-4f17-b286-95ccbfb657f9 req-513a49fa-ed23-43a9-b48a-3f066e7c2a73 service nova] Creating event network-vif-deleted:e68410d2-2d72-4245-a948-4d8cdc2756cd for instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 on nch1-master-1 Jun 04 21:07:18.993581 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e999918b-d76c-4e77-8d71-f1646acf4d10 req-a8ed0e46-286a-492a-a553-578fc36cd6a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048708 Jun 04 21:07:18.994414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-9256dd8d-de67-4f17-b286-95ccbfb657f9 req-513a49fa-ed23-43a9-b48a-3f066e7c2a73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059310 Jun 04 21:07:18.994775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1634/3396] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:18.995445 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1763/3397] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:19.000822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a16d783a-9f4a-4e97-a080-4dbe78a6bc7b tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Action: 'create', calling method: .version_select at 0x7f2d0be6a280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:19.045070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:19.046164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:19.067260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.070891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.072027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.073228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.112507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a16d783a-9f4a-4e97-a080-4dbe78a6bc7b tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:19.130659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a16d783a-9f4a-4e97-a080-4dbe78a6bc7b tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Getting quotas for user b5d0dd90346a416b9d7f94e499a47f2c and project 0de4591a80b94ed9adfc9ea9649585c9. Resources: dict_keys(['metadata_items']) {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:19.712759 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a16d783a-9f4a-4e97-a080-4dbe78a6bc7b tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "POST /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.716319 Jun 04 21:07:19.714188 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1635/3398] 10.222.0.18 () {60 vars in 1280 bytes} [Sat Jun 4 21:07:18 2022] POST /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 85 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:19.734920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:19.739840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] [instance: 054cf0c3-9df7-4440-a761-e2ece6ffbf67] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:19.755025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.757552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.759364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.760039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.777264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] HTTP exception thrown: Instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 could not be found. Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Request method failure captured: Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 HTTP/1.1 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8kv_6Z5-kqSRG04i5FaeL_Vexm5YkjWj-hTuA30o8OV8TdeV5IjEKDA09hDVLPZ2gpBq-KdPRQfqw3lFpMioDYwgWskoj_xcJNWHw47AcyQYsyd-ntCTW7daYQU2f5H1hxgEdSzkpSOVtFS_GZrtBhSv5GyMI1wzoncDoQ6SGE98yI Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 887ac9932d584f4b99b7b168721d9552 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_887ac9932d584f4b99b7b168721d9552"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/887ac9932d584f4b99b7b168721d9552"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 887ac9932d584f4b99b7b168721d9552 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-955455273 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ListServerFiltersTestJSON-955455273-project Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e2235426d43a4e98973a97ea8e45c1f4 Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ListServerFiltersTestJSON-955455273-project Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 could not be found. Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '054cf0c3-9df7-4440-a761-e2ece6ffbf67'} Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 could not be found. Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 could not be found. Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:19.785923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 could not be found. Jun 04 21:07:19.790544 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:19.793115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] Returning 404 to user: Instance 054cf0c3-9df7-4440-a761-e2ece6ffbf67 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:19.806021 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f876025c-f11d-44f4-a420-105415ec6543 tempest-ListServerFiltersTestJSON-955455273 tempest-ListServerFiltersTestJSON-955455273-project] 10.222.0.18 "GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67" status: 404 len: 111 microversion: 2.1 time: 0.077873 Jun 04 21:07:19.815715 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1636/3399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:19 2022] GET /compute/v2.1/servers/054cf0c3-9df7-4440-a761-e2ece6ffbf67 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:19.822171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69dab860-90de-429a-87cc-eceb8c1e54b7 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] Calling method '.version_select at 0x7f2d025f4d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:19.839260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:19.851782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:19.856700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:19.861369 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad5a343a-8b44-4f13-81e2-a907a40edf80 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2421 microversion: 2.32 time: 0.820673 Jun 04 21:07:19.871979 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1764/3400] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:19 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2421 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:19.890415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:19.891672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:19.902121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69dab860-90de-429a-87cc-eceb8c1e54b7 tempest-ImagesMetadataTestJSON-578654528 tempest-ImagesMetadataTestJSON-578654528-project] 10.222.0.18 "GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.084914 Jun 04 21:07:19.912512 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1637/3401] 10.222.0.18 () {58 vars in 1259 bytes} [Sat Jun 4 21:07:19 2022] GET /compute/v2.1/images/4f704cd7-b8da-4851-8648-b6d1b543d4dc/metadata => generated 85 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:07:19.914303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.915856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.918682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.924196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.960901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:19.962896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:19.990503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:19.992227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:19.996228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:20.000462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:20.055727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=18 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:20.114372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e858abe021e480686f6458e5b27ad24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee106eb4506843ffa58a26f486d2e0dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:20.116689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:20.127818 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-43aea406-cec3-4d62-9c6e-0a285dd12df4 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 200 len: 1252 microversion: 2.1 time: 0.250563 Jun 04 21:07:20.128579 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1765/3402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:19 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 1252 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:20.147981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:20.148433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:20.148895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lazy-loading 'fault' on Instance uuid c5f9dacc-035c-4dda-9218-2d109b7d5edd {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:07:20.246352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=18 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:20.899406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:20.900274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:20.922581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:20.929011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:20.931278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:20.939947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:21.390362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:21.418359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:21.433316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb1e49a5a78544f0b59e135153a8771c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4695654467fe498e8535cd245a1de975', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:21.437514 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe978387-cc8e-4cde-824e-71fc0ca1e38c tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 200 len: 1349 microversion: 2.21 time: 1.479688 Jun 04 21:07:21.443728 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1638/3403] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:19 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 1349 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:21.471816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:21.473217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] [instance: 098fce3b-1b6f-4781-95ad-e3c82641d80f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:21.495182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:21.498460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:21.503881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:21.504635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:21.550811 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] HTTP exception thrown: Instance 098fce3b-1b6f-4781-95ad-e3c82641d80f could not be found. Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Request method failure captured: Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f HTTP/1.1 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8kLA6t1XKha_Dee02bZK6foMaNnx3EArhOKlf7nlexZKVd6T9WLjv_pkqkexeLiUGdP6-b-TKSxsRX-JinGj8Q6B9Wf3cKC73JVhgz0Fux9AVIZ21fTQpUiYAE4hgJUoEkwE28p5DXUh9fA2LZi9qJDg3yGE_fxiIW0Z_F6J4hFm3c Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ee106eb4506843ffa58a26f486d2e0dd Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestBootFromVolume-1641932473 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ee106eb4506843ffa58a26f486d2e0dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee106eb4506843ffa58a26f486d2e0dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ee106eb4506843ffa58a26f486d2e0dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ee106eb4506843ffa58a26f486d2e0dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestBootFromVolume-1641932473 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ee106eb4506843ffa58a26f486d2e0dd Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1641932473 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestBootFromVolume-1641932473-project Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 1e858abe021e480686f6458e5b27ad24 Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestBootFromVolume-1641932473-project Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 098fce3b-1b6f-4781-95ad-e3c82641d80f could not be found. Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '098fce3b-1b6f-4781-95ad-e3c82641d80f'} Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 098fce3b-1b6f-4781-95ad-e3c82641d80f could not be found. Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 098fce3b-1b6f-4781-95ad-e3c82641d80f could not be found. Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:21.556068 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 098fce3b-1b6f-4781-95ad-e3c82641d80f could not be found. Jun 04 21:07:21.561383 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:21.562890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Returning 404 to user: Instance 098fce3b-1b6f-4781-95ad-e3c82641d80f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:21.565694 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ad31ae3f-260e-4846-bbc0-60168912fca6 tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f" status: 404 len: 111 microversion: 2.1 time: 0.118523 Jun 04 21:07:21.567636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1639/3404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:21 2022] GET /compute/v2.1/servers/098fce3b-1b6f-4781-95ad-e3c82641d80f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:07:21.574124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0543e53d-e3a5-404d-94f1-ebf0280f4391 req-2b1aa352-05e2-4a2c-9765-b61c1f09e67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f9dacc-035c-4dda-9218-2d109b7d5edd", "name": "network-vif-deleted", "tag": "d575caa6-5166-4905-9ea8-fddde415ecfc"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:21.589628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:21.599890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0543e53d-e3a5-404d-94f1-ebf0280f4391 req-2b1aa352-05e2-4a2c-9765-b61c1f09e67c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:21.600335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0543e53d-e3a5-404d-94f1-ebf0280f4391 req-2b1aa352-05e2-4a2c-9765-b61c1f09e67c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:21.646179 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0543e53d-e3a5-404d-94f1-ebf0280f4391 req-2b1aa352-05e2-4a2c-9765-b61c1f09e67c service nova] Creating event network-vif-deleted:d575caa6-5166-4905-9ea8-fddde415ecfc for instance c5f9dacc-035c-4dda-9218-2d109b7d5edd on nch1-master-1 Jun 04 21:07:21.665584 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0543e53d-e3a5-404d-94f1-ebf0280f4391 req-2b1aa352-05e2-4a2c-9765-b61c1f09e67c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090723 Jun 04 21:07:21.668180 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1640/3405] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:21.673452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bbea4163-703d-4573-989d-d757aa32701b tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] Calling method '.version_select at 0x7f2d0248fa60>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:21.733555 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bbea4163-703d-4573-989d-d757aa32701b tempest-ServersTestBootFromVolume-1641932473 tempest-ServersTestBootFromVolume-1641932473-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905319868" status: 202 len: 0 microversion: 2.1 time: 0.064051 Jun 04 21:07:21.740500 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1641/3406] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:07:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905319868 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:07:21.759484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-28b114f1-884a-4c47-81cf-2826ea3011f9 req-ed8d8b8e-40d3-4904-b1f5-7d28ee7b80a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098fce3b-1b6f-4781-95ad-e3c82641d80f", "name": "network-vif-deleted", "tag": "f8287e01-20ca-4416-9e07-322a84befbff"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:21.780285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-28b114f1-884a-4c47-81cf-2826ea3011f9 req-ed8d8b8e-40d3-4904-b1f5-7d28ee7b80a1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:21.780731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-28b114f1-884a-4c47-81cf-2826ea3011f9 req-ed8d8b8e-40d3-4904-b1f5-7d28ee7b80a1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:21.818319 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-28b114f1-884a-4c47-81cf-2826ea3011f9 req-ed8d8b8e-40d3-4904-b1f5-7d28ee7b80a1 service nova] Creating event network-vif-deleted:f8287e01-20ca-4416-9e07-322a84befbff for instance 098fce3b-1b6f-4781-95ad-e3c82641d80f on nch1-master-1 Jun 04 21:07:21.835582 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-28b114f1-884a-4c47-81cf-2826ea3011f9 req-ed8d8b8e-40d3-4904-b1f5-7d28ee7b80a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091779 Jun 04 21:07:21.838491 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1642/3407] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:21.950516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:21.963352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:21.978366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:21.982214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-efb14408-5c55-4063-936e-4a64aa55e8da tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2374 microversion: 2.32 time: 1.091887 Jun 04 21:07:21.992701 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1766/3408] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:20 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2374 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:22.501941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:22.505428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:22.533914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.535067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.537322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.538938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.586406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] HTTP exception thrown: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Request method failure captured: Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd HTTP/1.1 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8lvLMlWc5dwO8Uwj-qU58qGIgukDyOYIUSx28XM9p3Z9yDxJ7PbrbtVcfE7o9X-wntj9LWsFmogZJcelZOi4-SA3GkxWc6nAWk3qmOh05JYBahXo_g_heqzbGhVeH6Wu6ka0vjJApCjFHxjE4IpTHfCK_JBmWY4NotXSsvBGDPV8f0 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.21 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4695654467fe498e8535cd245a1de975 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4695654467fe498e8535cd245a1de975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4695654467fe498e8535cd245a1de975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4695654467fe498e8535cd245a1de975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4695654467fe498e8535cd245a1de975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4695654467fe498e8535cd245a1de975 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-InstanceActionsV221TestJSON-737313718-project Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb1e49a5a78544f0b59e135153a8771c Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-InstanceActionsV221TestJSON-737313718-project Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'c5f9dacc-035c-4dda-9218-2d109b7d5edd'} Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.611812 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.616909 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.622640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Returning 404 to user: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:22.627196 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-17fd8fa4-f454-4edf-8aa0-5422744df4af tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 404 len: 111 microversion: 2.21 time: 0.167887 Jun 04 21:07:22.633701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1643/3409] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:22 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 04 21:07:22.643918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '.version_select at 0x7f2d00f9edc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:22.644657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:22.662308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.668751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.670575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.672898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.834404 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f15ffc75-4060-4bbf-9230-26742f91b9ee tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.195815 Jun 04 21:07:22.837802 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1767/3410] 10.222.0.18 () {60 vars in 1336 bytes} [Sat Jun 4 21:07:22 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd/os-instance-actions => generated 611 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:07:22.851824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:22.852329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:22.863776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.866391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.871852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.873963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.918962 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] HTTP exception thrown: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Request method failure captured: Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd HTTP/1.1 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8lvLMlWc5dwO8Uwj-qU58qGIgukDyOYIUSx28XM9p3Z9yDxJ7PbrbtVcfE7o9X-wntj9LWsFmogZJcelZOi4-SA3GkxWc6nAWk3qmOh05JYBahXo_g_heqzbGhVeH6Wu6ka0vjJApCjFHxjE4IpTHfCK_JBmWY4NotXSsvBGDPV8f0 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.21 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4695654467fe498e8535cd245a1de975 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4695654467fe498e8535cd245a1de975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4695654467fe498e8535cd245a1de975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4695654467fe498e8535cd245a1de975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4695654467fe498e8535cd245a1de975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4695654467fe498e8535cd245a1de975 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-InstanceActionsV221TestJSON-737313718-project Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: fb1e49a5a78544f0b59e135153a8771c Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-InstanceActionsV221TestJSON-737313718-project Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'c5f9dacc-035c-4dda-9218-2d109b7d5edd'} Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:22.924879 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Returning 404 to user: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7fe38efb-b217-48f1-8144-bb19d536ab60 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 404 len: 111 microversion: 2.21 time: 0.080419 Jun 04 21:07:22.931406 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1644/3411] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:22 2022] DELETE /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:22.938181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:22.939177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] [instance: c5f9dacc-035c-4dda-9218-2d109b7d5edd] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:22.961013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.964594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.968792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:22.969247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:22.998112 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] HTTP exception thrown: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:23.007445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:23.008739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Request method failure captured: Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd HTTP/1.1 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8lvLMlWc5dwO8Uwj-qU58qGIgukDyOYIUSx28XM9p3Z9yDxJ7PbrbtVcfE7o9X-wntj9LWsFmogZJcelZOi4-SA3GkxWc6nAWk3qmOh05JYBahXo_g_heqzbGhVeH6Wu6ka0vjJApCjFHxjE4IpTHfCK_JBmWY4NotXSsvBGDPV8f0 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.21 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4695654467fe498e8535cd245a1de975 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4695654467fe498e8535cd245a1de975"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4695654467fe498e8535cd245a1de975"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4695654467fe498e8535cd245a1de975"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4695654467fe498e8535cd245a1de975"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4695654467fe498e8535cd245a1de975 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-737313718 Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-InstanceActionsV221TestJSON-737313718-project Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: fb1e49a5a78544f0b59e135153a8771c Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-InstanceActionsV221TestJSON-737313718-project Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c5f9dacc-035c-4dda-9218-2d109b7d5edd'} Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:23.014582 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. Jun 04 21:07:23.020551 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:23.033095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:23.034995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] Returning 404 to user: Instance c5f9dacc-035c-4dda-9218-2d109b7d5edd could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:23.040681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:23.041156 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f42dfbe5-9378-44f1-8f02-4a0cb22ce659 tempest-InstanceActionsV221TestJSON-737313718 tempest-InstanceActionsV221TestJSON-737313718-project] 10.222.0.18 "GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd" status: 404 len: 111 microversion: 2.21 time: 0.104814 Jun 04 21:07:23.047479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:23.048186 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1768/3412] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:22 2022] GET /compute/v2.1/servers/c5f9dacc-035c-4dda-9218-2d109b7d5edd => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:23.048894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:23.629909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:23.645678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:23.653153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:23.654616 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fda245c5-0727-4178-8fb3-ee55b86b3343 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2327 microversion: 2.32 time: 0.651520 Jun 04 21:07:23.663190 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1645/3413] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:23 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2327 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:23.965814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cd8cb1b4-b670-4814-821c-edb6f62bbab1 req-e8744638-a3b4-4f86-8ff2-6bbe27f4e818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-deleted", "tag": "209128ba-608b-44e4-809f-e85d0a6c87e3"}, {"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-deleted", "tag": "619b5a38-1d96-4f73-8e36-188fa8464db2"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:23.985926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd8cb1b4-b670-4814-821c-edb6f62bbab1 req-e8744638-a3b4-4f86-8ff2-6bbe27f4e818 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:23.986383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd8cb1b4-b670-4814-821c-edb6f62bbab1 req-e8744638-a3b4-4f86-8ff2-6bbe27f4e818 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:24.006986 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cd8cb1b4-b670-4814-821c-edb6f62bbab1 req-e8744638-a3b4-4f86-8ff2-6bbe27f4e818 service nova] Creating event network-vif-deleted:209128ba-608b-44e4-809f-e85d0a6c87e3 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:24.007850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cd8cb1b4-b670-4814-821c-edb6f62bbab1 req-e8744638-a3b4-4f86-8ff2-6bbe27f4e818 service nova] Creating event network-vif-deleted:619b5a38-1d96-4f73-8e36-188fa8464db2 for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:24.016227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cd8cb1b4-b670-4814-821c-edb6f62bbab1 req-e8744638-a3b4-4f86-8ff2-6bbe27f4e818 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053489 Jun 04 21:07:24.017403 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1769/3414] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:24.684010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:24.684905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:24.695749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:24.700542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:24.701716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:24.702727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:24.843978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:24.856888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:24.858706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:24.859974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5158e55e-0683-4631-b3fa-cd59b753d962 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 2032 microversion: 2.32 time: 0.181724 Jun 04 21:07:24.862568 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1770/3415] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:24 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 2032 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:24.941030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1803776758", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:25.134094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] validate_networks() for None {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:07:25.880490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:25.881798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:25.892113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:25.892651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:25.893452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:25.893898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:26.241406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:26.254147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:26.255984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '890837d5b27e4471b54c1eac851e88c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83e17865ce4e4d2ba7854d03668bfb78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:26.257528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a7e9d18f-b008-4bd1-aba9-72e30b1c92ed tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 200 len: 1605 microversion: 2.32 time: 0.381264 Jun 04 21:07:26.258294 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1771/3416] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:25 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 1605 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:26.263009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3e35d61d-7716-42f9-99b8-94914147a683 req-0142f2dd-8191-4fa9-a21e-b5bba12413a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3791bdf-45fd-46bc-a29d-9740947a4333", "name": "network-vif-deleted", "tag": "3a71217e-dc2e-4548-97ad-5596a76b102e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:26.272683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:07:26.276484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:07:26.279777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:07:26.280927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:07:26.282257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3e35d61d-7716-42f9-99b8-94914147a683 req-0142f2dd-8191-4fa9-a21e-b5bba12413a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:26.282538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:07:26.285513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3e35d61d-7716-42f9-99b8-94914147a683 req-0142f2dd-8191-4fa9-a21e-b5bba12413a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:26.300891 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3e35d61d-7716-42f9-99b8-94914147a683 req-0142f2dd-8191-4fa9-a21e-b5bba12413a4 service nova] Creating event network-vif-deleted:3a71217e-dc2e-4548-97ad-5596a76b102e for instance a3791bdf-45fd-46bc-a29d-9740947a4333 on nch1-master-1 Jun 04 21:07:26.306408 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3e35d61d-7716-42f9-99b8-94914147a683 req-0142f2dd-8191-4fa9-a21e-b5bba12413a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046684 Jun 04 21:07:26.307343 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1772/3417] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:26.315572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:26.316250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:26.317478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:26.318082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:26.375984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Getting quotas for project 2de85e590d5e45c9bca587e74b6689d6. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:26.383731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Getting quotas for user 465cff93c4244a4794784ad2885c02e7 and project 2de85e590d5e45c9bca587e74b6689d6. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:26.407663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:07:26.415131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:07:26.553806 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0bc5999a-c7f8-4726-a89b-586ed9c1edad tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882520 Jun 04 21:07:26.554445 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1646/3418] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:07:26.565645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-94e32c8d-da5e-4790-ab31-365f26af34e9 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:26.566371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-94e32c8d-da5e-4790-ab31-365f26af34e9 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:26.719440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-94e32c8d-da5e-4790-ab31-365f26af34e9 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:26.730372 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-94e32c8d-da5e-4790-ab31-365f26af34e9 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1217 microversion: 2.1 time: 0.169229 Jun 04 21:07:26.732991 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1773/3419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:26 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:27.279301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:27.279964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:27.303128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:27.303882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:27.307124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:27.307683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:27.390259 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] HTTP exception thrown: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Request method failure captured: Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 HTTP/1.1 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gW-D2rOewUQ9lygg26xeQ7iO1A5uT3E-95E1kSy-Hpt535IWl2FeyBDhPXcyRtDXsjtwhk6dcnvODGUr4Ky4K0VH0puB2c1g1spXmXW1GBCTYEM_pB7zySDQQ3dDnGUVD03BDbnM6cHLd6GcYQld7yMJXuFGke4NsW7BaenwqbfUo Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.32 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 83e17865ce4e4d2ba7854d03668bfb78 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 83e17865ce4e4d2ba7854d03668bfb78 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TaggedBootDevicesTest-1959467912-project Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 890837d5b27e4471b54c1eac851e88c5 Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TaggedBootDevicesTest-1959467912-project Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a3791bdf-45fd-46bc-a29d-9740947a4333'} Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:27.393319 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:27.398010 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:27.403058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Returning 404 to user: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:27.404359 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-751320e6-c20b-4287-9d79-d5ccb6799f6d tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 404 len: 111 microversion: 2.32 time: 0.130725 Jun 04 21:07:27.405629 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1647/3420] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:27 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:27.413727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31db30e4-af47-47af-b84d-b6dbb99a69fc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '.version_select at 0x7f2d00f23040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:27.453123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:27.453632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:27.459979 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-31db30e4-af47-47af-b84d-b6dbb99a69fc tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404489988" status: 204 len: 0 microversion: 2.32 time: 0.049878 Jun 04 21:07:27.464037 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1774/3421] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 21:07:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404489988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:07:27.487324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:27.490224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:27.491129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:27.498199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:27.588830 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-efeff27c-16de-4ae4-addb-243cdd99a4d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/ips" status: 200 len: 145 microversion: 2.1 time: 0.139665 Jun 04 21:07:27.602663 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1648/3422] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:07:27 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/ips => generated 145 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:27.755073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:27.755839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:27.771938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:27.772144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:27.773055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:27.773497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:28.036963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:28.056836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f28167dd-786f-45ff-a7c1-a94157bb9ba0 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1213 microversion: 2.1 time: 0.308801 Jun 04 21:07:28.061533 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1775/3423] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:27 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1213 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:28.861748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1295094957", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": "none"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:29.000556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:07:29.000984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:07:29.001462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:07:29.002411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:07:29.003002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:07:29.016586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:29.016732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:29.017558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:29.024154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:29.076079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Getting quotas for project 301e9cee0f0e46c88a533a74a81cc2e3. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:29.084646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Getting quotas for user 3d8e16f578424cd4835085ce387ec659 and project 301e9cee0f0e46c88a533a74a81cc2e3. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:29.093545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:29.103865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:29.140716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:29.141502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:29.143587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:29.148264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:29.155450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:07:29.160117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:07:29.304709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c9d27f6-fee8-48a2-adf5-64912f6211bb tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.758450 Jun 04 21:07:29.309337 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1649/3424] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:07:29.347660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:29.382642 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e0316f2b-c43d-4d07-b882-f06d7ab8bfa2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1275 microversion: 2.1 time: 0.305012 Jun 04 21:07:29.386795 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1776/3425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:29 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1275 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:29.407007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b384e5a-c8aa-4d31-a726-efc8576f12fe tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:29.409633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b384e5a-c8aa-4d31-a726-efc8576f12fe tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:29.666892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-82fd4639-9f00-477d-bd8e-1479de1c0e14 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-175689731", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:29.669168 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-82fd4639-9f00-477d-bd8e-1479de1c0e14 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] HTTP exception thrown: min_count must be <= max_count Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-82fd4639-9f00-477d-bd8e-1479de1c0e14 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Request method failure captured: Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 183 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mQp_dxjQJhcBavAZjRCmANwYI6SvqBKveDPS6cFtZgMTwruC0FydGQdIAMy4f3b3_Ko1DMSMGIcwzEr1QDgBxjoKEqw21_8AE_WqjJVP89ELMTFdNIz3Yhn8bVtRAn_Q6p7dxxk3ss52pFUJ-tnwoovrpiUJY7Vrmj_JJVk3wERwk Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a05b0ff80704e7aa65514929f859836"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 03c2041367a149d4873248ba09b2c591 Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-175689731", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: exception: min_count must be <= max_count Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-175689731', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 04 21:07:29.670673 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:29.675874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-82fd4639-9f00-477d-bd8e-1479de1c0e14 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Returning 400 to user: min_count must be <= max_count {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:29.675874 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-82fd4639-9f00-477d-bd8e-1479de1c0e14 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.357859 Jun 04 21:07:29.675874 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1650/3426] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:29 2022] POST /compute/v2.1/servers => generated 74 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:07:29.996204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aea0e972-9cb3-4754-834d-ea1d2e1713f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-411084792", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "max_count": 0}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aea0e972-9cb3-4754-834d-ea1d2e1713f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Request method failure captured: Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 167 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mQp_dxjQJhcBavAZjRCmANwYI6SvqBKveDPS6cFtZgMTwruC0FydGQdIAMy4f3b3_Ko1DMSMGIcwzEr1QDgBxjoKEqw21_8AE_WqjJVP89ELMTFdNIz3Yhn8bVtRAn_Q6p7dxxk3ss52pFUJ-tnwoovrpiUJY7Vrmj_JJVk3wERwk Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a05b0ff80704e7aa65514929f859836"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 03c2041367a149d4873248ba09b2c591 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-411084792", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "max_count": 0}} Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-411084792', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'max_count': 0}}} Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 0 Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:07:30.000303 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 04 21:07:30.005697 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.014647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aea0e972-9cb3-4754-834d-ea1d2e1713f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:30.015884 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aea0e972-9cb3-4754-834d-ea1d2e1713f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024875 Jun 04 21:07:30.016735 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1651/3427] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:29 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 21:07:30.138021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57381f17-9ef6-435d-9d34-7000aa3133ba tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-694030501", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "max_count": 2.5}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57381f17-9ef6-435d-9d34-7000aa3133ba tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Request method failure captured: Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 169 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mQp_dxjQJhcBavAZjRCmANwYI6SvqBKveDPS6cFtZgMTwruC0FydGQdIAMy4f3b3_Ko1DMSMGIcwzEr1QDgBxjoKEqw21_8AE_WqjJVP89ELMTFdNIz3Yhn8bVtRAn_Q6p7dxxk3ss52pFUJ-tnwoovrpiUJY7Vrmj_JJVk3wERwk Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a05b0ff80704e7aa65514929f859836"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 03c2041367a149d4873248ba09b2c591 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-694030501", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "max_count": 2.5}} Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-694030501', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'max_count': 2.5}}} Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 2.5 Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:07:30.144375 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.150018 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.153887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57381f17-9ef6-435d-9d34-7000aa3133ba tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:30.155073 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-57381f17-9ef6-435d-9d34-7000aa3133ba tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026492 Jun 04 21:07:30.163475 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1652/3428] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:30 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:30.232226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d203b80-8896-403f-bab3-9bb99e8804f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-735464869", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 0}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d203b80-8896-403f-bab3-9bb99e8804f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Request method failure captured: Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 167 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mQp_dxjQJhcBavAZjRCmANwYI6SvqBKveDPS6cFtZgMTwruC0FydGQdIAMy4f3b3_Ko1DMSMGIcwzEr1QDgBxjoKEqw21_8AE_WqjJVP89ELMTFdNIz3Yhn8bVtRAn_Q6p7dxxk3ss52pFUJ-tnwoovrpiUJY7Vrmj_JJVk3wERwk Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a05b0ff80704e7aa65514929f859836"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 03c2041367a149d4873248ba09b2c591 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-735464869", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 0}} Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-735464869', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'min_count': 0}}} Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 0 Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:07:30.236295 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 04 21:07:30.240953 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.245495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d203b80-8896-403f-bab3-9bb99e8804f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:30.248711 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d203b80-8896-403f-bab3-9bb99e8804f3 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022428 Jun 04 21:07:30.249287 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1653/3429] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:30 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 21:07:30.341764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4200a2a5-79bc-4473-8ac7-1becafe99e05 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1962235206", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 2.5}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4200a2a5-79bc-4473-8ac7-1becafe99e05 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Request method failure captured: Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 170 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mQp_dxjQJhcBavAZjRCmANwYI6SvqBKveDPS6cFtZgMTwruC0FydGQdIAMy4f3b3_Ko1DMSMGIcwzEr1QDgBxjoKEqw21_8AE_WqjJVP89ELMTFdNIz3Yhn8bVtRAn_Q6p7dxxk3ss52pFUJ-tnwoovrpiUJY7Vrmj_JJVk3wERwk Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a05b0ff80704e7aa65514929f859836"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a05b0ff80704e7aa65514929f859836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a05b0ff80704e7aa65514929f859836 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1066008631 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 03c2041367a149d4873248ba09b2c591 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1066008631-project Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1962235206", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 2.5}} Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1962235206', 'imageRef': '926a4015-c327-4be7-9086-5cce1a8e0ebf', 'flavorRef': '452', 'min_count': 2.5}}} Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi 2.5 Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:07:30.345840 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 04 21:07:30.351313 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:30.355024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4200a2a5-79bc-4473-8ac7-1becafe99e05 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:30.357822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4200a2a5-79bc-4473-8ac7-1becafe99e05 tempest-MultipleCreateNegativeTestJSON-1066008631 tempest-MultipleCreateNegativeTestJSON-1066008631-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022695 Jun 04 21:07:30.359844 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1654/3430] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:30 2022] POST /compute/v2.1/servers => generated 139 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 21:07:30.409777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:30.413919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:30.433005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:30.435323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:30.440566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:30.441019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:30.582952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b384e5a-c8aa-4d31-a726-efc8576f12fe tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:30.591481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b384e5a-c8aa-4d31-a726-efc8576f12fe tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:30.593415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b384e5a-c8aa-4d31-a726-efc8576f12fe tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:30.595141 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b384e5a-c8aa-4d31-a726-efc8576f12fe tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1281 microversion: 2.47 time: 1.204392 Jun 04 21:07:30.596336 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1777/3431] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:29 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1281 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:30.678311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:30.688482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a1cb149-d376-4731-94d9-71525e575a61 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1275 microversion: 2.1 time: 0.286070 Jun 04 21:07:30.690572 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1655/3432] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:30 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:30.981631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95700618-6da4-4410-8224-5fe706fb560d"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:30.983502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:30.994967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:30.995419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:30.996237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:30.996985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:31.559947 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f9472da-945e-445a-ab52-20d265c14f77 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.583986 Jun 04 21:07:31.562254 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1778/3433] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:07:30 2022] POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:31.618958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:31.620724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:31.648484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:31.648945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:31.649741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:31.650154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:31.707984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:31.709389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:31.716820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:31.717619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:31.718583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:31.719192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:32.266690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:32.275872 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3feee21-b865-408a-99f1-cd72fe3c6d65 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1275 microversion: 2.1 time: 0.573117 Jun 04 21:07:32.287179 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1779/3434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:31 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1275 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:07:32.356199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:32.409254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:32.411386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:32.412642 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e99a61d2-e029-46d2-9d48-e0c6ddb4e351 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1339 microversion: 2.47 time: 0.801810 Jun 04 21:07:32.418089 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1656/3435] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:31 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1339 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:33.296478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:33.298632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:33.309638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:33.311024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:33.313126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:33.314456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:33.434406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:33.434997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:33.449682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:33.451476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:33.452688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:33.454745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:33.656872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:33.675281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:33.680912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:33.684137 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6ae38c7-1811-4796-8e5b-f2ae6a81cad4 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1339 microversion: 2.47 time: 0.255373 Jun 04 21:07:33.687115 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1657/3436] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:33 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:34.013590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:34.050642 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6ea7de44-7898-4d78-8138-33309b7b0aff tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.759307 Jun 04 21:07:34.066228 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1780/3437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:33 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:34.664605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1541376655", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": "none"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:34.706653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:34.708086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:34.716057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:34.717034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:34.718110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:34.718712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:34.740302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:07:34.740734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:07:34.741514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:07:34.741932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:07:34.742347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:07:34.764990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:34.765453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:34.768864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:34.769832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:34.809842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Getting quotas for project f3a52f1d9032436f907a2d30636b5d3d. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:34.820593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Getting quotas for user c06fd081dccd4e10bdbb3c7871be811f and project f3a52f1d9032436f907a2d30636b5d3d. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:34.838817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:07:34.846421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:07:34.881320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:34.900695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:34.904781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:34.907466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b9c337a5-4dd6-4fa7-9dc2-9c816dda78c5 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1360 microversion: 2.47 time: 0.204756 Jun 04 21:07:34.908726 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1781/3438] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:34 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1360 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:34.941847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-531397537"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:34.943171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:34.944352 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2b6ccf2f-6d3f-4cfc-b778-8a8e324e46f8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.491271 Jun 04 21:07:34.947567 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1658/3439] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:07:34.955204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:34.955340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:34.956046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:34.956477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:34.974650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cf141f2e-9c71-447c-85fd-f077650a930c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:34.978875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cf141f2e-9c71-447c-85fd-f077650a930c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:35.248857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cf141f2e-9c71-447c-85fd-f077650a930c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:35.251932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=37 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:35.264361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cf141f2e-9c71-447c-85fd-f077650a930c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:35.266504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cf141f2e-9c71-447c-85fd-f077650a930c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:35.275934 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cf141f2e-9c71-447c-85fd-f077650a930c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1278 microversion: 2.54 time: 0.311404 Jun 04 21:07:35.277127 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1659/3440] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:34 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1278 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:35.282579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:35.283205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:35.304552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:35.305035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:35.308004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:35.309308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:35.723410 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e2f4aed4-2df4-484f-8d0a-d4077b1751bf tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "POST /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3/action" status: 202 len: 52 microversion: 2.47 time: 0.796103 Jun 04 21:07:35.725301 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1782/3441] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:07:34 2022] POST /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3/action => generated 52 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jun 04 21:07:35.752137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1b7eda97-9164-4beb-8ae7-37a455423ad7 req-75c795b2-63a6-4692-9261-303d0c9f2ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:35.778808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1b7eda97-9164-4beb-8ae7-37a455423ad7 req-75c795b2-63a6-4692-9261-303d0c9f2ffe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:35.780854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1b7eda97-9164-4beb-8ae7-37a455423ad7 req-75c795b2-63a6-4692-9261-303d0c9f2ffe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:35.798811 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1b7eda97-9164-4beb-8ae7-37a455423ad7 req-75c795b2-63a6-4692-9261-303d0c9f2ffe service nova] Creating event network-changed:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:07:35.806106 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1b7eda97-9164-4beb-8ae7-37a455423ad7 req-75c795b2-63a6-4692-9261-303d0c9f2ffe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079005 Jun 04 21:07:35.808210 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1783/3442] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:35.822679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:35.823632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:35.844393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:35.845564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:35.848931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:35.849638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:35.938166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:07:36.004365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.015158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:36.048394 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c28e9a1-859c-4814-a794-022db13073dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.765765 Jun 04 21:07:36.052352 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1660/3443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:35 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:36.225527 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89734f20-214f-4a22-83a5-1633a21a0e10 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 204 len: 0 microversion: 2.47 time: 0.406670 Jun 04 21:07:36.226186 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1784/3444] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:35 2022] DELETE /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:07:36.237616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:36.239253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:36.256337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:36.258331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:36.260230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:36.264100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:36.300359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1faf096d-b9fb-4d69-87c6-7b71a67127ae tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:36.303379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1faf096d-b9fb-4d69-87c6-7b71a67127ae tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:36.366878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:36.460927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1faf096d-b9fb-4d69-87c6-7b71a67127ae tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.468995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1faf096d-b9fb-4d69-87c6-7b71a67127ae tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.489021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1faf096d-b9fb-4d69-87c6-7b71a67127ae tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.493943 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1faf096d-b9fb-4d69-87c6-7b71a67127ae tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1278 microversion: 2.54 time: 0.196874 Jun 04 21:07:36.515173 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1785/3445] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:36 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1278 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:36.520656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7afb6bc3-2b49-416f-8233-0e07078892a2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:36.538340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7afb6bc3-2b49-416f-8233-0e07078892a2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:36.538804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7afb6bc3-2b49-416f-8233-0e07078892a2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:36.590622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7afb6bc3-2b49-416f-8233-0e07078892a2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:07:36.597612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.613075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.620297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:36.626452 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-89d60809-d9ef-40d9-a23f-3f13a4f3c3dd tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1366 microversion: 2.47 time: 0.395616 Jun 04 21:07:36.627535 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1661/3446] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:36 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:37.068603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:37.069946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:37.089637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.090072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.090541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.090967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.582377 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7afb6bc3-2b49-416f-8233-0e07078892a2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action" status: 202 len: 0 microversion: 2.1 time: 1.065245 Jun 04 21:07:37.583015 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1786/3447] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:07:36 2022] POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:07:37.591150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:37.594993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:37.612201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.612664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.613468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.614029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.778679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:37.787387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:37.788943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:37.790124 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-663b84f1-5dc6-4e7b-8137-02958cca822d tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1348 microversion: 2.54 time: 0.205811 Jun 04 21:07:37.790669 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1787/3448] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:37 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1348 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:37.796836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:37.797629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:37.827973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.829167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.830228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.830682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.834713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:37.847093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50a58edf-bcf3-43df-931a-fb2df74d8434 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.782515 Jun 04 21:07:37.847878 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1662/3449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:37 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:37.861776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:37.862401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:37.883293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.883703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:37.884496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:37.884940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.015209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:38.024715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:38.026537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:38.027903 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2cde86f0-38b7-4216-ac81-7b6b81517f12 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1366 microversion: 2.47 time: 0.170363 Jun 04 21:07:38.028481 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1663/3450] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:37 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:38.127141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:38.149869 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f432f494-ff4d-4120-9b2b-3bfe33076fb6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.354413 Jun 04 21:07:38.151172 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1788/3451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:37 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:38.239265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:38.239912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:38.246495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.249852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.250679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.251242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.272491 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] HTTP exception thrown: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Request method failure captured: Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 HTTP/1.1 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8gW-D2rOewUQ9lygg26xeQ7iO1A5uT3E-95E1kSy-Hpt535IWl2FeyBDhPXcyRtDXsjtwhk6dcnvODGUr4Ky4K0VH0puB2c1g1spXmXW1GBCTYEM_pB7zySDQQ3dDnGUVD03BDbnM6cHLd6GcYQld7yMJXuFGke4NsW7BaenwqbfUo Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.32 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 83e17865ce4e4d2ba7854d03668bfb78 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 83e17865ce4e4d2ba7854d03668bfb78 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TaggedBootDevicesTest-1959467912-project Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 890837d5b27e4471b54c1eac851e88c5 Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TaggedBootDevicesTest-1959467912-project Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'a3791bdf-45fd-46bc-a29d-9740947a4333'} Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:38.274170 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Returning 404 to user: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:38.280553 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fb065f30-08d7-454c-8b08-ae779095ca23 tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 404 len: 111 microversion: 2.32 time: 0.043393 Jun 04 21:07:38.281683 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1664/3452] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:07:38 2022] DELETE /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:38.287667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:38.288626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] [instance: a3791bdf-45fd-46bc-a29d-9740947a4333] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:38.302442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.303437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.304723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.305432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.332734 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] HTTP exception thrown: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Request method failure captured: Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 HTTP/1.1 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8gW-D2rOewUQ9lygg26xeQ7iO1A5uT3E-95E1kSy-Hpt535IWl2FeyBDhPXcyRtDXsjtwhk6dcnvODGUr4Ky4K0VH0puB2c1g1spXmXW1GBCTYEM_pB7zySDQQ3dDnGUVD03BDbnM6cHLd6GcYQld7yMJXuFGke4NsW7BaenwqbfUo Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.32 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 83e17865ce4e4d2ba7854d03668bfb78 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/83e17865ce4e4d2ba7854d03668bfb78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 83e17865ce4e4d2ba7854d03668bfb78 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1959467912 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TaggedBootDevicesTest-1959467912-project Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 890837d5b27e4471b54c1eac851e88c5 Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TaggedBootDevicesTest-1959467912-project Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a3791bdf-45fd-46bc-a29d-9740947a4333'} Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:38.335603 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] Returning 404 to user: Instance a3791bdf-45fd-46bc-a29d-9740947a4333 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2047a1d3-591d-4d2a-8b3e-fe687c68861a tempest-TaggedBootDevicesTest-1959467912 tempest-TaggedBootDevicesTest-1959467912-project] 10.222.0.18 "GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333" status: 404 len: 111 microversion: 2.32 time: 0.055367 Jun 04 21:07:38.340859 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1789/3453] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:38 2022] GET /compute/v2.1/servers/a3791bdf-45fd-46bc-a29d-9740947a4333 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:38.811647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:38.812377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:38.829610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.830013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.835115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.835912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.869888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:38.870512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:38.883176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.884609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:38.886450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:38.889816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:39.514717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:39.530777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:39.536836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:39.538944 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22d61539-d531-4db2-8e19-65f949515025 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1336 microversion: 2.54 time: 0.731876 Jun 04 21:07:39.539884 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1665/3454] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:38 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1336 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:39.575281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:39.581347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:39.596397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:39.609922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:39.613029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:39.614793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:39.733163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:39.746885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:39.747385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lazy-loading 'fault' on Instance uuid 8e620b71-1fde-4439-9397-01d5ae5c5da3 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:07:39.839624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:39.857015 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e3e536d-9d5e-4b5d-80c8-bf3a00f2fd30 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.991669 Jun 04 21:07:39.863174 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1790/3455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:38 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:39.876856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:39.880533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:39.903121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:39.903500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:39.909830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:39.910335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:39.988751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.001297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.004336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d8e16f578424cd4835085ce387ec659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301e9cee0f0e46c88a533a74a81cc2e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.006247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b3987bc-3b62-4055-aad5-a838ee7cce62 tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 200 len: 1371 microversion: 2.47 time: 0.460464 Jun 04 21:07:40.007529 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1666/3456] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:39 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 1371 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:40.394923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.411202 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba3fbd3d-3915-489b-8698-a0b05d24e15d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.546202 Jun 04 21:07:40.412067 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1791/3457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:39 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:40.558565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:40.559321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:40.569507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:40.573885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:40.574947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:40.575692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:40.777689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.786698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.788327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:40.789772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f508e8a0-9619-4e0f-b493-fb01ab165e1c tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1357 microversion: 2.54 time: 0.235327 Jun 04 21:07:40.790543 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1667/3458] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:40 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:40.814033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-104dcdb2-9471-4015-9953-b962fa9f1166 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Action: 'create', calling method: .version_select at 0x7f2d00ec58b0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1850074620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKQNktnYKf68soomNPXhyERd8MwuNb1nBXz/gHy5oBGNcj9fyby+0J5UIP6kzSK5N2Tz3nlNAusZcH/ynM7k06PUdnCCwxSN8S2uEGIGiN0i7soXEnQRd6BisbjRiQIZg=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:40.829391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=27 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:40.831050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-104dcdb2-9471-4015-9953-b962fa9f1166 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Getting quotas for project f3a52f1d9032436f907a2d30636b5d3d. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:40.838008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-104dcdb2-9471-4015-9953-b962fa9f1166 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Getting quotas for user c06fd081dccd4e10bdbb3c7871be811f and project f3a52f1d9032436f907a2d30636b5d3d. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:40.880455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:40.881708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:40.906110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:40.906560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:40.907300 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-104dcdb2-9471-4015-9953-b962fa9f1166 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.096455 Jun 04 21:07:40.909164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:40.909164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:40.915672 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1792/3459] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 21:07:40 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 21:07:40.926891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1850074620", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:40.930907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:40.946361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:40.949681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:40.950521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:40.951083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.041679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:41.167110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:07:41.167599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:07:41.168482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:07:41.169573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:07:41.171843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:07:41.309845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:41.321466 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1da91296-94a7-4e8d-8716-d13a518168ac tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.444928 Jun 04 21:07:41.322676 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1668/3460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:40 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:41.326485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:41.334245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.335092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.336080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.336682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.342833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:41.344133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] [instance: 8e620b71-1fde-4439-9397-01d5ae5c5da3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:41.369070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.369699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.372157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.373270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.383942 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cf119ff2-3696-4a63-b982-e48b340f16e2 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "POST /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e/action" status: 202 len: 1140 microversion: 2.54 time: 0.463776 Jun 04 21:07:41.383942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1793/3461] 10.222.0.18 () {62 vars in 1319 bytes} [Sat Jun 4 21:07:40 2022] POST /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e/action => generated 1140 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 04 21:07:41.413305 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] HTTP exception thrown: Instance 8e620b71-1fde-4439-9397-01d5ae5c5da3 could not be found. Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Request method failure captured: Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 HTTP/1.1 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mQF7tA25OduvkJZWbE273tAgTAmKsFoqDcCAByX5chVJL0e9h6P-9jPc13kmBe2n8kjl6_RfAfE_PWI9SyXk6arsbixOmRL2IcGcF-sBPozSXLjx_EcyqG3IjVci-4dbYQY_ACwx3ZFyiRIMoXi-FYrJKba1JLXNjzqmhydc441zM Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.47 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 301e9cee0f0e46c88a533a74a81cc2e3 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersAaction247Test-934378092 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_301e9cee0f0e46c88a533a74a81cc2e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/301e9cee0f0e46c88a533a74a81cc2e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/301e9cee0f0e46c88a533a74a81cc2e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/301e9cee0f0e46c88a533a74a81cc2e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersAaction247Test-934378092 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 301e9cee0f0e46c88a533a74a81cc2e3 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersAaction247Test-934378092 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersAaction247Test-934378092-project Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3d8e16f578424cd4835085ce387ec659 Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersAaction247Test-934378092-project Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 8e620b71-1fde-4439-9397-01d5ae5c5da3 could not be found. Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '8e620b71-1fde-4439-9397-01d5ae5c5da3'} Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e620b71-1fde-4439-9397-01d5ae5c5da3 could not be found. Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e620b71-1fde-4439-9397-01d5ae5c5da3 could not be found. Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:07:41.415520 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e620b71-1fde-4439-9397-01d5ae5c5da3 could not be found. Jun 04 21:07:41.422244 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:07:41.425166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] Returning 404 to user: Instance 8e620b71-1fde-4439-9397-01d5ae5c5da3 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:07:41.426076 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f8259a5-1a48-4e4b-a3bc-6e5e0782e84c tempest-ServersAaction247Test-934378092 tempest-ServersAaction247Test-934378092-project] 10.222.0.18 "GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3" status: 404 len: 111 microversion: 2.47 time: 0.102055 Jun 04 21:07:41.430206 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1669/3462] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:41 2022] GET /compute/v2.1/servers/8e620b71-1fde-4439-9397-01d5ae5c5da3 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:07:41.437536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:41.438362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:41.445462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.447628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.448705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.449344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.604469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-325058257", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "99e771a0-e10b-4b48-9a48-d9965a86dd4c"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:41.610740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:41.629720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:41.632345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:41.634402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-540fe2f1-3714-4811-9309-eb2b071a9145 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.203070 Jun 04 21:07:41.644348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1670/3463] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:41 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:41.660657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:41.662358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:41.681419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:41.683859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.684705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.686220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:41.686876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:41.691732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] validate_networks() for [('99e771a0-e10b-4b48-9a48-d9965a86dd4c', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:07:42.021710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:42.040863 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3a14e2bc-f2ac-4267-80e7-81e8b878775f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.392142 Jun 04 21:07:42.041749 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1671/3464] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:41 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:42.263894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bd0cd2c6-af68-4ee4-847b-ad1f20c14945 req-1aba2152-7cb7-43a9-ac03-8b3d68c0cbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "name": "network-vif-plugged", "status": "completed", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:42.278523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bd0cd2c6-af68-4ee4-847b-ad1f20c14945 req-1aba2152-7cb7-43a9-ac03-8b3d68c0cbe0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.279323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bd0cd2c6-af68-4ee4-847b-ad1f20c14945 req-1aba2152-7cb7-43a9-ac03-8b3d68c0cbe0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.296114 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bd0cd2c6-af68-4ee4-847b-ad1f20c14945 req-1aba2152-7cb7-43a9-ac03-8b3d68c0cbe0 service nova] Creating event network-vif-plugged:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:07:42.301907 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bd0cd2c6-af68-4ee4-847b-ad1f20c14945 req-1aba2152-7cb7-43a9-ac03-8b3d68c0cbe0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044431 Jun 04 21:07:42.303742 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1672/3465] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:07:42.327896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:07:42.328389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:07:42.328814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:07:42.329215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:07:42.329635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:07:42.342055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:42.347128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:42.347956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.351004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.353077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.353744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.380196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.380775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.381622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.382069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.388281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Getting quotas for project 14f851d439ae4167af07518e3b1354ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:42.394891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Getting quotas for user ecdc2e5bf2e3492bb5320e054641ec3c and project 14f851d439ae4167af07518e3b1354ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:42.419210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:07:42.422015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:07:42.507851 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-57c624f7-41fc-440d-9194-4f611b6a0388 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122906 Jun 04 21:07:42.508681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1794/3466] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:07:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:07:42.531477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a8a6dba8-b493-42cf-a32a-4ba87f572f39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:42.534992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a8a6dba8-b493-42cf-a32a-4ba87f572f39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:42.813904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a8a6dba8-b493-42cf-a32a-4ba87f572f39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:42.835500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a8a6dba8-b493-42cf-a32a-4ba87f572f39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1217 microversion: 2.1 time: 0.320374 Jun 04 21:07:42.848674 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1795/3467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:42 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:07:42.872132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:42.878454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:42.906433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.907307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.910024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:42.910550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:42.939449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:42.969215 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dff44c1f-15ea-44c5-9858-6d92bd25af90 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.627572 Jun 04 21:07:42.970729 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1673/3468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:42 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:43.060633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:43.061340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:43.094284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:43.094860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:43.098441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:43.099055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:43.119238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:43.132629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:43.134053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:43.135272 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7fd04315-5bfb-42cb-8041-c6a7fea6631e tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.284138 Jun 04 21:07:43.135845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1796/3469] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:42 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:43.424576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:43.435077 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-08cdcd8d-256f-4536-b1b5-5d65eb4b137f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.379858 Jun 04 21:07:43.442571 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1674/3470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:43 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:43.857389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:43.858016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:43.866220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:43.867107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:43.868340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:43.869023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:43.962321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:43.975046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9d54d226-144f-44ce-a029-782aadfe7ea2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1269 microversion: 2.1 time: 0.121585 Jun 04 21:07:43.985986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1797/3471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:43 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:43.987558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:43.988416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:43.998822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:43.999964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:44.001678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:44.002761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:44.157402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:44.158277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:44.167752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:44.168720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:44.169862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:44.170672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:44.220646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:44.235214 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50d6a358-4408-4571-aa55-264e015e0500 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1317 microversion: 2.1 time: 0.252468 Jun 04 21:07:44.238654 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1675/3472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:43 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:44.385453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:44.399460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:44.401329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:44.403718 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1d2ee8fd-6d88-4221-b483-769a2ce021e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.252565 Jun 04 21:07:44.416407 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1798/3473] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:44 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:44.453504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:44.454858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:44.472342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:44.473281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:44.475449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:44.476236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:44.746881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:44.760045 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-07d24250-f2b1-4a03-862c-1ed929049b73 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.311007 Jun 04 21:07:44.761255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1676/3474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:44 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:44.993557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:44.995286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:45.035029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.035999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.037509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.038227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.158946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:45.171053 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-069e6736-0272-4db8-b16e-fd9eb9831ea5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1275 microversion: 2.1 time: 0.181328 Jun 04 21:07:45.183232 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1799/3475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:44 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:45.255721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:45.257529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:45.271668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:45.276788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.278694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.279935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.280578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.304763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:45.425949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:45.427412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:45.471076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.473989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.475371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.477609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.628491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:45.644532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:45.646650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:45.647923 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5737b79b-fd07-418a-86e7-e2c7bb0af0ee tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.225915 Jun 04 21:07:45.648495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1800/3476] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:45 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:45.694049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:45.703566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b250ec1-3669-4e94-a5eb-bc0b5fb0a51f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1466 microversion: 2.1 time: 0.452611 Jun 04 21:07:45.704186 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1677/3477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:45 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1466 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:45.724581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-326615297", "metadata": {"image_type": "test"}}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:45.725801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:45.743127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.743607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.744405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.744845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.774386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:45.780795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:45.781555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:45.801869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Getting quotas for project 2de85e590d5e45c9bca587e74b6689d6. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:45.804173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.804625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.807550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:45.808013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:45.809730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Getting quotas for user 465cff93c4244a4794784ad2885c02e7 and project 2de85e590d5e45c9bca587e74b6689d6. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:46.074680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:46.095942 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0eab3dca-3b23-422b-a0a3-015876761a90 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.321490 Jun 04 21:07:46.106219 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1678/3478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:45 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:46.196667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:46.197689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:46.213718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:46.214451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:46.220848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:46.221298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:46.233366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e5edccf1-7f66-47c2-885d-86747f87eeec tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "POST /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556/action" status: 202 len: 0 microversion: 2.1 time: 0.515588 Jun 04 21:07:46.235444 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1801/3479] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:07:45 2022] POST /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:07:46.266596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9f668a6c-0508-4af8-99aa-f5b7b0713146 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019e4dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:46.322751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:46.329439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:46.332156 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e08ea6cb-14ca-45b1-879e-ee7cc48b85ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1275 microversion: 2.1 time: 0.143031 Jun 04 21:07:46.335145 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1679/3480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:46 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:46.343946 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9f668a6c-0508-4af8-99aa-f5b7b0713146 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.089125 Jun 04 21:07:46.344868 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1802/3481] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:46 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:46.667780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:46.668742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:46.676974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:46.677875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:46.680501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:46.681220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:46.780526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:46.790878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:46.792809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:46.794814 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e23ff0a-86ad-4e54-a5d6-c676568f286a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.132074 Jun 04 21:07:46.795859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1680/3482] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:46 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:47.115900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:47.116470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:47.131239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:47.135543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:47.136738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:47.137360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:47.351986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:47.352535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:47.369662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:47.370123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:47.388624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:47.389705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:47.399263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:47.417843 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bcc7dc18-e328-40bf-8a28-87b05bed386f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.307170 Jun 04 21:07:47.421066 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1803/3483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:47 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:07:47.430792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f482004-d423-45f2-bce7-82127a3c426f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0107d670>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:47.507343 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f482004-d423-45f2-bce7-82127a3c426f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.084803 Jun 04 21:07:47.507826 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1804/3484] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:47 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:47.563691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:47.600990 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-742ecd30-bc35-428d-bf89-51f7adf14d99 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1275 microversion: 2.1 time: 0.253203 Jun 04 21:07:47.603273 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1681/3485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:47 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:07:47.817904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:47.818873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:47.838144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:47.838639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:47.841965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:47.843074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:47.985111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:48.030725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:48.035245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:48.036595 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d9e07f3-51be-4efa-824e-40d852174571 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.225325 Jun 04 21:07:48.051524 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1805/3486] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:47 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:48.440288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:48.440992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:48.455588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:48.460919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:48.462008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:48.465867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:48.495757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-679779493", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "d4c6a948-91b3-4a87-82fc-449162007fe1"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:48.561396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] validate_networks() for [('d4c6a948-91b3-4a87-82fc-449162007fe1', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:07:48.805185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:48.822890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dfca646f-2372-4238-9818-1ec3abe90680 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1721 microversion: 2.1 time: 0.388735 Jun 04 21:07:48.828238 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1806/3487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:48 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:48.838615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4db09368-2838-493f-afa4-cd513fbb1839 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01049280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:48.885709 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4db09368-2838-493f-afa4-cd513fbb1839 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.050882 Jun 04 21:07:48.886577 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1807/3488] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:48 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:48.894129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:48.895018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:48.901960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:48.902421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:48.903212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:48.903739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.136157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.149953 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7626b274-eb8b-4aa9-a299-cc549ecfc1d1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.260049 Jun 04 21:07:49.159218 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1808/3489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:48 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:49.159218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:49.169481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:49.181360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:49.181830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.182781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:49.183853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.186775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:07:49.187205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:07:49.187712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:07:49.188175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:07:49.188585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:07:49.201321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:49.201929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.203257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:49.203738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.223037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Getting quotas for project 3fae3157a11e4b7ab621512cec5442b5. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:07:49.229690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Getting quotas for user 797aa51baad940e08e46a861b76e4af6 and project 3fae3157a11e4b7ab621512cec5442b5. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:07:49.260092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:07:49.263205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:07:49.300829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.323859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.325882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.329617 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2def903-c414-41d1-a3b9-4b46fc640ce4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.176975 Jun 04 21:07:49.332451 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1809/3490] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:49 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:49.367822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-53a2f5c5-4a46-49e0-845c-ef411c5c0b82 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.126787 Jun 04 21:07:49.377772 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1682/3491] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:07:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:07:49.382423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-810aaf65-7d35-4620-a79c-9a93dac67aa6 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:49.383669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-810aaf65-7d35-4620-a79c-9a93dac67aa6 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:49.456851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-810aaf65-7d35-4620-a79c-9a93dac67aa6 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.467997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-810aaf65-7d35-4620-a79c-9a93dac67aa6 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.469553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-810aaf65-7d35-4620-a79c-9a93dac67aa6 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:49.470854 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-810aaf65-7d35-4620-a79c-9a93dac67aa6 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1261 microversion: 2.26 time: 0.092489 Jun 04 21:07:49.481214 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1810/3492] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:49 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:49.844608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:49.845464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:49.859962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:49.860684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.863196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:49.866115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:49.902276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c7bfa924-d8f9-4209-bc4d-4202310671df tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d00fed940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:49.984732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c7bfa924-d8f9-4209-bc4d-4202310671df tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.088719 Jun 04 21:07:49.985374 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1811/3493] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:49 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:50.166565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:50.167216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:50.178820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:50.179298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:50.180154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:50.184273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:50.610468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:50.622107 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b8f59d8-29cd-42e8-8a1d-ade52a4c4ec5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1698 microversion: 2.1 time: 0.781581 Jun 04 21:07:50.634212 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1683/3494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:49 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1698 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:50.649386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:50.650014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:50.679371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:50.691694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:50.692749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:50.693513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:50.826819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:50.841358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:50.843349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:50.848528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c78cca33-3674-4289-9883-e4ee5996adf4 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.214646 Jun 04 21:07:50.861042 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1684/3495] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:50 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:50.873717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:50.874653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:50.892511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:50.893228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:50.894263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:50.894907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:50.940554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:50.951046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e554babf-3ed3-41c6-9178-9cc48ef2a70f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.788275 Jun 04 21:07:50.960873 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1812/3496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:50 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:50.985697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eccf11b9-7634-4cdc-93ba-d103b901bee2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:51.010489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eccf11b9-7634-4cdc-93ba-d103b901bee2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:51.011356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eccf11b9-7634-4cdc-93ba-d103b901bee2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:51.064005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eccf11b9-7634-4cdc-93ba-d103b901bee2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Going to try to start instance {{(pid=137228) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:07:51.205436 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eccf11b9-7634-4cdc-93ba-d103b901bee2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.242507 Jun 04 21:07:51.209484 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1813/3497] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:07:50 2022] POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:07:51.216577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:51.219537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c2fe334-2830-48b2-ab3b-2982d9108ef6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d018df040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:51.236261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:51.239576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:51.246679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7103db1-7132-4b61-a778-17ed4b5127f0 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1313 microversion: 2.26 time: 0.380792 Jun 04 21:07:51.250657 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1685/3498] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:50 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:51.260583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:51.263902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:51.287045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:51.288827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:51.290119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:51.295300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:51.306389 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c2fe334-2830-48b2-ab3b-2982d9108ef6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.097090 Jun 04 21:07:51.311209 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1814/3499] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:51 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:51.333869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e3de252d-4dda-4d5a-88cb-5e7722f5a775 req-07ce1e19-2f1c-49ec-9996-83aa6ba1c426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ba73aa-fbc6-409e-927f-babb129b426f", "tag": "e80b5629-a1fb-4e80-9942-82c35b283706"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:51.377419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e3de252d-4dda-4d5a-88cb-5e7722f5a775 req-07ce1e19-2f1c-49ec-9996-83aa6ba1c426 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:51.384682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e3de252d-4dda-4d5a-88cb-5e7722f5a775 req-07ce1e19-2f1c-49ec-9996-83aa6ba1c426 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:51.452005 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e3de252d-4dda-4d5a-88cb-5e7722f5a775 req-07ce1e19-2f1c-49ec-9996-83aa6ba1c426 service nova] Creating event network-changed:e80b5629-a1fb-4e80-9942-82c35b283706 for instance 06ba73aa-fbc6-409e-927f-babb129b426f on nch1-master-1 Jun 04 21:07:51.478000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e3de252d-4dda-4d5a-88cb-5e7722f5a775 req-07ce1e19-2f1c-49ec-9996-83aa6ba1c426 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163914 Jun 04 21:07:51.481922 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1815/3500] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:51.869125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:51.872689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:51.897273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:51.911757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:51.916330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:51.917596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:52.374533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:52.503174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.522237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.523945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.525187 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4affafdb-ab86-4b70-b287-38c91ab0aec1 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.661627 Jun 04 21:07:52.535542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1816/3501] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:51 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:52.535542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:52.535542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:52.555457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:52.555946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:52.556760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:52.557205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:52.621798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.636446 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-004147f7-8f8f-41d3-bf53-ccaa5cd3e1f6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1707 microversion: 2.1 time: 1.384298 Jun 04 21:07:52.646676 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1686/3502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:51 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1707 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:52.646676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-cebd8551-5d06-4a2c-9116-29c4e4d86f88 req-5f0afb1d-3e19-4699-986d-a236236e925b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "name": "network-vif-plugged", "status": "completed", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:52.672179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cebd8551-5d06-4a2c-9116-29c4e4d86f88 req-5f0afb1d-3e19-4699-986d-a236236e925b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:52.674088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cebd8551-5d06-4a2c-9116-29c4e4d86f88 req-5f0afb1d-3e19-4699-986d-a236236e925b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:52.692313 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-cebd8551-5d06-4a2c-9116-29c4e4d86f88 req-5f0afb1d-3e19-4699-986d-a236236e925b service nova] Creating event network-vif-plugged:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:07:52.706856 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-cebd8551-5d06-4a2c-9116-29c4e4d86f88 req-5f0afb1d-3e19-4699-986d-a236236e925b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066884 Jun 04 21:07:52.721091 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1687/3503] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:52.731460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:52.733504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:52.741505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:52.742535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:52.743729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:52.744568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:52.937812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.949549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.951217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:52.953652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d4a6c39-25a9-4dff-9f1d-b03f9fb68b30 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1319 microversion: 2.26 time: 0.229845 Jun 04 21:07:52.955039 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1688/3504] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:52 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:52.972045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a553b46-88e4-4e4c-8783-8d44e086cb24 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0be6f310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:53.047524 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a553b46-88e4-4e4c-8783-8d44e086cb24 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.091242 Jun 04 21:07:53.048238 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1689/3505] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:52 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:53.065045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:53.080625 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39266f85-556d-4fdf-9193-fe903510b8b1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.553249 Jun 04 21:07:53.081370 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1817/3506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:52 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:53.547655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:53.548560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:53.563530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:53.564387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:53.565460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:53.566127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:53.654770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:53.655846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:53.664592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:53.665879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:53.667123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:53.667750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:53.734397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:53.745782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:53.755051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:53.756509 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc0b448e-5dc7-40c9-9a04-25c0621dbeba tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.214139 Jun 04 21:07:53.770430 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1690/3507] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:53 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:53.982350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:53.983044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:53.990590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:53.992044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:53.993109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:53.994770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:54.361649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.370829 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-10f7f863-04e6-4337-963c-bb083f90e422 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1707 microversion: 2.1 time: 0.720369 Jun 04 21:07:54.380751 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1818/3508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:53 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1707 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:54.387052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16ad5c8e-5758-433f-a2fb-c0d43deb52ce tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d00fedc10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:54.464967 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-16ad5c8e-5758-433f-a2fb-c0d43deb52ce tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.082283 Jun 04 21:07:54.467310 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1819/3509] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:54 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:54.475175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:54.481270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:54.504018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:54.505644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:54.506715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:54.507851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:54.609310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.631700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.633975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.635385 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-218998e8-ea32-4f95-8661-01e64fb41fa9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 0.658223 Jun 04 21:07:54.636184 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1691/3510] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:53 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:54.776317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:54.777714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:54.795864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:54.796520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:54.797542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:54.798158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:54.954640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.965130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.967101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:54.969403 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a943f04d-fbfc-4738-a52a-b592c360ec14 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.197114 Jun 04 21:07:54.970447 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1692/3511] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:54 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:55.114292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:55.126717 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5e4ec3af-782a-494c-8769-aa18873723d4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.658064 Jun 04 21:07:55.136799 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1820/3512] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:54 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:55.392039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:55.392669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:55.478471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:55.479263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:55.479605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e28f4d35-b636-4455-9263-ae1fb582d4f6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d00fed8b0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:55.513026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:55.515691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:55.548488 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e28f4d35-b636-4455-9263-ae1fb582d4f6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.072293 Jun 04 21:07:55.549658 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1821/3513] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:55 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:55.655965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:55.657159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:55.670782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:55.677624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:55.679432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:55.680125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:56.741863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:56.750828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:56.752391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:56.765262 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81a26420-efe4-4299-a354-9b9353bc3ae5 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 1.113405 Jun 04 21:07:56.783597 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1822/3514] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:55 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:07:56.784021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:56.786209 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ff20c6d-141c-4ccd-ab86-b6e932cd486e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1707 microversion: 2.1 time: 1.401729 Jun 04 21:07:56.792151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:56.793165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:56.800209 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1693/3515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:55 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1707 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:56.804324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:56.805424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:56.806244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:56.813393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:56.814013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:56.815500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:56.816041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:56.816190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:56.817342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:56.828309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:57.041707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:57.049310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:57.057265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:57.067086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:57.087261 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd4d4fef-e25d-4935-be9d-c201b9822df8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.312937 Jun 04 21:07:57.088487 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1823/3516] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:56 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:57.095957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-793f926a-9346-457a-8944-44257d34be12 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019e4040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:57.150645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:57.165240 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e11192ef-11e6-47ac-b724-b3513076752c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.363681 Jun 04 21:07:57.170780 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1694/3517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:56 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:57.187647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-07edc64c-93d8-4761-b36f-915bb68fcc56 req-9b1c069f-1187-492f-af31-8d00bb86f20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5f5204-e1b7-4472-8683-75412bedc83f", "tag": "d98325fa-3b20-4191-af5e-8aa1f761945f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:57.191193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-793f926a-9346-457a-8944-44257d34be12 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.101298 Jun 04 21:07:57.199295 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1824/3518] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:57 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:57.212614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-07edc64c-93d8-4761-b36f-915bb68fcc56 req-9b1c069f-1187-492f-af31-8d00bb86f20f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:57.213267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-07edc64c-93d8-4761-b36f-915bb68fcc56 req-9b1c069f-1187-492f-af31-8d00bb86f20f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:57.252369 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-07edc64c-93d8-4761-b36f-915bb68fcc56 req-9b1c069f-1187-492f-af31-8d00bb86f20f service nova] Creating event network-changed:d98325fa-3b20-4191-af5e-8aa1f761945f for instance 9c5f5204-e1b7-4472-8683-75412bedc83f on nch1-master-1 Jun 04 21:07:57.277917 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-07edc64c-93d8-4761-b36f-915bb68fcc56 req-9b1c069f-1187-492f-af31-8d00bb86f20f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104681 Jun 04 21:07:57.286940 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1695/3519] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:07:57.796815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:57.797634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:57.806616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:57.807784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:57.808217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:57.808785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:57.809888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:57.810780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:57.821957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:57.822450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:57.823246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:57.823715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:58.259550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.279432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e26b526-4bc2-48ea-89fd-942f673bc61f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1711 microversion: 2.1 time: 0.476856 Jun 04 21:07:58.290859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1696/3520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:57 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1711 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:58.295488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.296563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:58.297189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:58.305082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.306636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.307055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:58.307861 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5bada404-e8e1-47bd-9ff8-a6ad305ee49c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 0.515743 Jun 04 21:07:58.308712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:58.309109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1825/3521] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:57 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:58.315186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:58.316152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:58.323873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:58.324112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:58.324733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:58.325271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:58.325981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:58.326604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:58.474552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.502785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.504454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.511740 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-092c54a8-af89-422f-9ba1-cbbc433481fd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.226384 Jun 04 21:07:58.524550 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1697/3522] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:58 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:58.543922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34cae60a-db18-4bd4-bc75-c80bcd389f63 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01997e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:58.599085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:58.605148 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34cae60a-db18-4bd4-bc75-c80bcd389f63 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.076396 Jun 04 21:07:58.606178 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1698/3523] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:58 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:58.612115 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-03ae7d37-211e-4344-8d21-ae676acf8b24 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.301332 Jun 04 21:07:58.613120 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1826/3524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:58 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:59.329933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:59.331604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:59.345232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:59.346672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:59.349037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.350103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.351709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.352942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.434949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-90e31aeb-a4d0-463b-840b-b0295e78e00b req-50ad4734-878b-43e1-9bf1-a2f3e1d72416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ba73aa-fbc6-409e-927f-babb129b426f", "name": "network-vif-plugged", "status": "completed", "tag": "e80b5629-a1fb-4e80-9942-82c35b283706"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:07:59.459838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-90e31aeb-a4d0-463b-840b-b0295e78e00b req-50ad4734-878b-43e1-9bf1-a2f3e1d72416 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.460458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-90e31aeb-a4d0-463b-840b-b0295e78e00b req-50ad4734-878b-43e1-9bf1-a2f3e1d72416 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.466343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=13 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:59.481773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-90e31aeb-a4d0-463b-840b-b0295e78e00b req-50ad4734-878b-43e1-9bf1-a2f3e1d72416 service nova] Creating event network-vif-plugged:e80b5629-a1fb-4e80-9942-82c35b283706 for instance 06ba73aa-fbc6-409e-927f-babb129b426f on nch1-master-1 Jun 04 21:07:59.489094 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-90e31aeb-a4d0-463b-840b-b0295e78e00b req-50ad4734-878b-43e1-9bf1-a2f3e1d72416 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058228 Jun 04 21:07:59.490863 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1827/3525] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:07:59.535741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:59.537058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:59.549959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.550419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.551226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.557886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.667610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:59.688199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:59.697397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:59.699263 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0e08b17-17ea-4920-9384-c922ccc44f8d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 0.373526 Jun 04 21:07:59.700472 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1699/3526] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:59 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:59.709565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8b09e807-7597-46b7-a9d8-3f192fc9a843 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01997670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:59.771657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:59.774033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8b09e807-7597-46b7-a9d8-3f192fc9a843 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.067994 Jun 04 21:07:59.775293 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1700/3527] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:07:59 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:07:59.781939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:07:59.782577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:07:59.788885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.791884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:59.792082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.792867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:07:59.794909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:07:59.795290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:07:59.796887 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cda20b93-d66b-47c9-beca-030a9c8fa4fa tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.266530 Jun 04 21:07:59.798108 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1828/3528] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:07:59 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:07:59.823686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:07:59.995338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:00.006747 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a2dcf174-7a70-4516-a006-fd103e3e0f3d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.229058 Jun 04 21:08:00.007544 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1701/3529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:07:59 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:00.720310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:00.722117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:00.732254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:00.733281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:00.734427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:00.735188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:00.787672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8dc4125f-eb55-4c01-a1e0-34ac31741c0a tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d022dbf70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:00.851006 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8dc4125f-eb55-4c01-a1e0-34ac31741c0a tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.067228 Jun 04 21:08:00.852222 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1702/3530] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:00 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:00.866889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:00.871561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:00.886308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:00.887314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:00.888515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:00.889216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:01.137325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.150220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.154426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.156037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.162517 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fb216d66-3f76-42e2-a5e6-e340faefabfd tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.308343 Jun 04 21:08:01.163150 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1703/3531] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:00 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:01.163870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.165850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.167260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff866cee-bec1-4b64-9c92-f47236405223 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 0.451515 Jun 04 21:08:01.179925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1829/3532] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:00 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:01.202623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:01.209014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:01.220448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:01.221333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:01.222513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:01.223142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:01.549691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:01.570434 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22d66d04-81ae-468c-a94f-fa6c05e87b80 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1317 microversion: 2.1 time: 0.405936 Jun 04 21:08:01.573250 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1704/3533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:01 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:01.866707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1d8df20a-c710-484b-9d2f-c16a8304b3c7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d018dfb80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:01.946077 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1d8df20a-c710-484b-9d2f-c16a8304b3c7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.084173 Jun 04 21:08:01.946705 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1830/3534] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:01 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:02.182266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:02.183034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:02.198943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:02.199455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:02.212325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:02.217841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:02.220376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:02.222104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:02.223123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:02.223595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:02.226653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:02.227104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:02.737759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:02.749426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:02.752006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:02.755628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-561b1621-1a52-4d09-a7f3-b6349a99f42a tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.575188 Jun 04 21:08:02.772176 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1705/3535] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:02 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:02.782670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:02.785702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:02.806914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:02.816556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:02.820676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:02.822953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:03.172121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:03.191861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:03.193929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:03.198182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-778d2b00-565c-4cf0-aff8-b81ad3208658 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 1.004312 Jun 04 21:08:03.200340 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1831/3536] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:02 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:03.208905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3dec7ca9-e517-4e1a-8b8f-f87a6d136037 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019624c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:03.219534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:03.251873 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b0605bc-4c72-4c6a-b092-7a32b8715084 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1507 microversion: 2.1 time: 0.474892 Jun 04 21:08:03.267447 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1706/3537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:02 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:03.273740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:03.274604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:03.282843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:03.283712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:03.284649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:03.285230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:03.330997 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3dec7ca9-e517-4e1a-8b8f-f87a6d136037 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.129122 Jun 04 21:08:03.331894 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1832/3538] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:03 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:03.779491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:03.780322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:03.795367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:03.798181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:03.799604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:03.803810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.033548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.064873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.066821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.073396 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de7ffea9-3a85-418b-a173-11ce8ab05310 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.298285 Jun 04 21:08:04.077290 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1833/3539] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:03 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:08:04.092374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a5e820ad-5e4a-4eb0-be99-3e416f2c8cb6 req-edc25e54-1fde-4f90-a969-515a4087e2ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5f5204-e1b7-4472-8683-75412bedc83f", "name": "network-vif-plugged", "status": "completed", "tag": "d98325fa-3b20-4191-af5e-8aa1f761945f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:04.123582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a5e820ad-5e4a-4eb0-be99-3e416f2c8cb6 req-edc25e54-1fde-4f90-a969-515a4087e2ec service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.123957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a5e820ad-5e4a-4eb0-be99-3e416f2c8cb6 req-edc25e54-1fde-4f90-a969-515a4087e2ec service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.139665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a5e820ad-5e4a-4eb0-be99-3e416f2c8cb6 req-edc25e54-1fde-4f90-a969-515a4087e2ec service nova] Creating event network-vif-plugged:d98325fa-3b20-4191-af5e-8aa1f761945f for instance 9c5f5204-e1b7-4472-8683-75412bedc83f on nch1-master-1 Jun 04 21:08:04.146294 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a5e820ad-5e4a-4eb0-be99-3e416f2c8cb6 req-edc25e54-1fde-4f90-a969-515a4087e2ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065123 Jun 04 21:08:04.147188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1834/3540] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:04.186856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.210210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-64f71005-10d6-4462-b913-0216200c84ca tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1507 microversion: 2.1 time: 0.940785 Jun 04 21:08:04.218411 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1707/3541] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:03 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1507 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:04.225441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:04.227318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:04.239388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:04.245646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.246532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.248828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.249531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.253389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:04.283035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.283499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.284392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.284771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.486649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:08:04.487409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:08:04.489293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:08:04.489875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:08:04.490487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:08:04.615227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:04.621906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.622588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.629584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.630250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.723290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68dd82e3-d51e-45cc-b979-ea303aab2dea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "POST /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f/action" status: 202 len: 1109 microversion: 2.1 time: 0.482012 Jun 04 21:08:04.733567 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1708/3542] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:08:04 2022] POST /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f/action => generated 1109 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jun 04 21:08:04.738624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-224d5d11-d4b0-4850-8064-492c5f9cb651 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019f6700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:04.817483 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-224d5d11-d4b0-4850-8064-492c5f9cb651 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.082643 Jun 04 21:08:04.818319 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1709/3543] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:04 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:04.830117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:04.834074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:04.861821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.871605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.872209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.879946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:04.880719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:04.884109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.890285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:04.893690 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-660135f8-2a2c-4384-906c-e00d626577ac tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1361 microversion: 2.26 time: 0.679763 Jun 04 21:08:04.896162 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1835/3544] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:04 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1361 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:08:05.096613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:05.097415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:05.113818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:05.114469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:05.115450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:05.117888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:05.369362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:05.397902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:05.404796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:05.406568 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-12c30277-09f3-4166-b890-8137563c7bb8 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.314159 Jun 04 21:08:05.415783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:05.425416 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a0ac9f5d-df72-4c03-9064-58c7d9e92226 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.605078 Jun 04 21:08:05.425416 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1710/3545] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:04 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:05.426026 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1836/3546] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:05 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:08:05.832015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-08cd136e-74a4-414b-a2a9-0c2b5835ec44 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0be78d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:05.899559 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-08cd136e-74a4-414b-a2a9-0c2b5835ec44 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.072244 Jun 04 21:08:05.900156 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1711/3547] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:05 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:05.923244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:05.924879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:05.937766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:05.938490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:05.939594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:05.940347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.177948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.190310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.193492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.197782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8869ee93-a313-4b8e-aeeb-588ee4c5129f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1544 microversion: 2.26 time: 0.284812 Jun 04 21:08:06.199800 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1837/3548] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:05 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:06.230939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019e9040>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:06.266982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.271361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.273144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:06.291300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.292124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.293772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.296535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.354639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.355549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.389285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.389745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.444177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:06.447774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:06.452102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:06.459295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:06.473501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.474226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.479188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.479988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.499914 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4f306fb2-2ed5-4761-8a47-550ac73fe266 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1844379994" status: 201 len: 0 microversion: 2.26 time: 0.272548 Jun 04 21:08:06.510928 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1712/3549] 10.222.0.18 () {62 vars in 1379 bytes} [Sat Jun 4 21:08:06 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1844379994 => generated 0 bytes in 286 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 04 21:08:06.523843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:06.525034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:06.552092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.555346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.557050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.558237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.817961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.829493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.831063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.832232 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fbd56afe-9612-4c34-83b8-c6b6d2cf8651 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.319924 Jun 04 21:08:06.853609 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1713/3550] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:06 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:06.859247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-748661c4-cbfc-44c4-ab92-ea7c265a5656 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d01943dc0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:06.880441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-748661c4-cbfc-44c4-ab92-ea7c265a5656 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.881201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-748661c4-cbfc-44c4-ab92-ea7c265a5656 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.902431 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-748661c4-cbfc-44c4-ab92-ea7c265a5656 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1844379994" status: 204 len: 0 microversion: 2.26 time: 0.047227 Jun 04 21:08:06.903622 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1714/3551] 10.222.0.18 () {60 vars in 1360 bytes} [Sat Jun 4 21:08:06 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1844379994 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:06.916498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019433a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:06.933724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.936108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.937131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:06.946975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.947926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.948968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:06.949699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:06.957218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:06.965941 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4eab236-de0e-4271-9910-82fc75bab95f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.526783 Jun 04 21:08:06.966945 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1838/3552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:06 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:06.972296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82678a73-fb25-4f6e-86ad-d63e6ccb80a3 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0189ca60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.057608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.058049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.081342 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82678a73-fb25-4f6e-86ad-d63e6ccb80a3 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.110884 Jun 04 21:08:07.088108 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1839/3553] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:06 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:07.104798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:07.138864 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d3071ba-c50b-422b-a530-7896760e207c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 204 len: 0 microversion: 2.26 time: 0.227826 Jun 04 21:08:07.139877 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1715/3554] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Jun 4 21:08:06 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:07.154167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-415c2e73-27d8-4983-bcfd-7b95dfc11685 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019bf430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.192803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415c2e73-27d8-4983-bcfd-7b95dfc11685 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.193283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415c2e73-27d8-4983-bcfd-7b95dfc11685 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.232457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-415c2e73-27d8-4983-bcfd-7b95dfc11685 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 200 len: 12 microversion: 2.26 time: 0.087287 Jun 04 21:08:07.237744 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1840/3555] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 21:08:07 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 12 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:07.244320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019f6e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.253160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:07.261875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.262367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.263599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:07.272404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.272854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.273631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.274274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.308056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.309076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.329910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.331984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.367492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:07.409054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:07.446017 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0dda8cf1-7914-4cd1-b592-39003cfdfa12 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1058869959" status: 201 len: 0 microversion: 2.26 time: 0.206574 Jun 04 21:08:07.446926 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1716/3556] 10.222.0.18 () {62 vars in 1379 bytes} [Sat Jun 4 21:08:07 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1058869959 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 04 21:08:07.456495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-019ce1ce-4a54-4e41-b50d-3e6ce5740679 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d0189c1f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.470505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-019ce1ce-4a54-4e41-b50d-3e6ce5740679 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.470974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-019ce1ce-4a54-4e41-b50d-3e6ce5740679 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.499776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-019ce1ce-4a54-4e41-b50d-3e6ce5740679 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 200 len: 36 microversion: 2.26 time: 0.047380 Jun 04 21:08:07.502780 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1841/3557] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 21:08:07 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 36 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:07.512833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d0bd5f3a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.530909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.533087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.535767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:07.554804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.555759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.561141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.563009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.627686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.628135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.674315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:07.707451 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e36b82bb-309e-4a75-83c7-cd97a8131003 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1058869959" status: 204 len: 0 microversion: 2.26 time: 0.199163 Jun 04 21:08:07.708108 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1717/3558] 10.222.0.18 () {60 vars in 1363 bytes} [Sat Jun 4 21:08:07 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1058869959 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:07.720669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0445e61e-9a72-4b25-988e-4329c9071766 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d01a6b3a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.747262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0445e61e-9a72-4b25-988e-4329c9071766 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.748286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0445e61e-9a72-4b25-988e-4329c9071766 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.766159 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0445e61e-9a72-4b25-988e-4329c9071766 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 200 len: 12 microversion: 2.26 time: 0.053546 Jun 04 21:08:07.767424 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1842/3559] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 21:08:07 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:07.778631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019434c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.797396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.799995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.800739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:07.824446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.825521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.826472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.827136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.860414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:07.861071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:07.881152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.881944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.885117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.885740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.927593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:07.928470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:07.943009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:07.966972 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6715dc2-178d-4d46-88c7-1b96bcce2f71 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 204 len: 0 microversion: 2.26 time: 0.192729 Jun 04 21:08:07.968853 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1718/3560] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Jun 4 21:08:07 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 04 21:08:07.985058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019e9d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.007021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.007473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.012213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:08.012978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.027669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.030089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.031110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.033330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.062764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:08.072093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:08.080627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-44215ac6-057e-4f37-9e03-61a02a5fb6e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.228056 Jun 04 21:08:08.095635 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1843/3561] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:07 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:08.105228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.106709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.117586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.118483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.128335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.129689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.129845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.130520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.131649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.132292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.189185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:08.222913 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7cf18a4e-56c2-4b0d-8aeb-e6e51574a908 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-534192651" status: 201 len: 0 microversion: 2.26 time: 0.248536 Jun 04 21:08:08.224386 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1719/3562] 10.222.0.18 () {62 vars in 1376 bytes} [Sat Jun 4 21:08:07 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-534192651 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 04 21:08:08.230825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-073e5a32-e991-4aab-afc0-95db67d318f6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d023b70d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.293244 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-073e5a32-e991-4aab-afc0-95db67d318f6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1423 microversion: 2.1 time: 0.067350 Jun 04 21:08:08.294493 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1720/3563] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:08 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:08.305512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d0be6a430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.326268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.326726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.327220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.345566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.346395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.347382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.347853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.398073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.398959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.413163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.414064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.419957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:08.429401 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b3a8c0b-d988-4b99-b249-e2b3aafbf44d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.332110 Jun 04 21:08:08.430832 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1844/3564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:08 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:08.464671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:08.493429 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-29c6c325-41ea-4cc1-9907-ea28db5afc76 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1129569" status: 201 len: 0 microversion: 2.26 time: 0.196410 Jun 04 21:08:08.494148 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1721/3565] 10.222.0.18 () {62 vars in 1370 bytes} [Sat Jun 4 21:08:08 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1129569 => generated 0 bytes in 199 msecs (HTTP/1.1 201) 10 headers in 483 bytes (1 switches on core 0) Jun 04 21:08:08.504513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d0189c700>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.516351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.516793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.517293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.535382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.536906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.539841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.540876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.577640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.578225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.597963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:08.617311 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81b00b67-802c-4770-adee-3d1a4ee23966 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 204 len: 0 microversion: 2.26 time: 0.117154 Jun 04 21:08:08.622895 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1845/3566] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Jun 4 21:08:08 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:08.630416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fd358aa-0346-408d-8e65-4777d80534f1 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d01943e50>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.645495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fd358aa-0346-408d-8e65-4777d80534f1 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.646340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fd358aa-0346-408d-8e65-4777d80534f1 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.661304 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7fd358aa-0346-408d-8e65-4777d80534f1 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 200 len: 12 microversion: 2.26 time: 0.036405 Jun 04 21:08:08.662249 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1722/3567] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 21:08:08 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:08.679133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d0189c1f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.692421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.692947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.693672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.703466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.704347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.705369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.706305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.734174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.734850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.739047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:08.751713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:08.771487 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-adc5e13e-74e0-428b-b6e1-c04f19173d97 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 204 len: 0 microversion: 2.26 time: 0.102876 Jun 04 21:08:08.773031 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1846/3568] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Jun 4 21:08:08 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:08.784044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019aac10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.812635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.813096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.813583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.819855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.820524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.821467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.822100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.856372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.857270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.873401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.874218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.907323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:08.923586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8002f4f2-88dd-43d1-8e8a-9f098376cef9 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-2113014508" status: 201 len: 0 microversion: 2.26 time: 0.144367 Jun 04 21:08:08.924252 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1723/3569] 10.222.0.18 () {62 vars in 1379 bytes} [Sat Jun 4 21:08:08 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-2113014508 => generated 0 bytes in 146 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 04 21:08:08.933776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d01a925e0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:08.943583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.944409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.945221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:08.953149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.953955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.955009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.955841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:08.993654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:08.994394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.017086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.017658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.052328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:09.069318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c50285c3-f827-463a-8201-5a5be7d4cce2 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1386083225" status: 201 len: 0 microversion: 2.26 time: 0.139621 Jun 04 21:08:09.071560 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1847/3570] 10.222.0.18 () {62 vars in 1379 bytes} [Sat Jun 4 21:08:08 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags/tempest-tag-1386083225 => generated 0 bytes in 141 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 04 21:08:09.080339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Action: 'update_all', calling method: .version_select at 0x7f2d0bf34670>, body: {"tags": ["tempest-tag-851431719", "tempest-tag-1626095806"]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:09.090451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.091139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.091836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.097851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.098769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.099799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.100459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.105300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.105947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.117266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.119372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.120760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.121222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.146311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.146715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.206356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:09.227177 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2bd6f6ac-9855-4cf9-a13f-dd53b4c412d7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 200 len: 61 microversion: 2.26 time: 0.151920 Jun 04 21:08:09.228361 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1724/3571] 10.222.0.18 () {62 vars in 1311 bytes} [Sat Jun 4 21:08:09 2022] PUT /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 61 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:09.239948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebd76b7d-5ca6-47ba-ad48-680d66fda8b7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d0be6a160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.253694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebd76b7d-5ca6-47ba-ad48-680d66fda8b7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.254179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebd76b7d-5ca6-47ba-ad48-680d66fda8b7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.260562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:09.267286 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebd76b7d-5ca6-47ba-ad48-680d66fda8b7 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 200 len: 61 microversion: 2.26 time: 0.031650 Jun 04 21:08:09.268460 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1725/3572] 10.222.0.18 () {60 vars in 1291 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 61 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:09.278394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:09.281087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:09.283611 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d9d8a96-10ed-49ae-b0d3-d0a0f2490791 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1409 microversion: 2.54 time: 0.185267 Jun 04 21:08:09.284857 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1848/3573] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:09.287097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '.version_select at 0x7f2d019f6430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.295963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.296655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.298347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.306506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1efed35-918a-4450-991f-ea54aed9b95c tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019621f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.324733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.328134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.333692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.334528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.365520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=5,nova_cell1:RELEASE=4,nova_cell1:DELETE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:09.371844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.372392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.381298 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1efed35-918a-4450-991f-ea54aed9b95c tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1432 microversion: 2.1 time: 0.078654 Jun 04 21:08:09.384467 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1849/3574] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1432 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:09.398648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lazy-loading 'flavor' on Instance uuid 9c5f5204-e1b7-4472-8683-75412bedc83f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:09.407612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd689779-5f3a-404d-bae3-8a4a3440ecc2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01ab4ca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.463768 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0f55b0e6-0d9d-48fc-8d79-c392dc6e528f tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags" status: 204 len: 0 microversion: 2.26 time: 0.182549 Jun 04 21:08:09.470577 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1726/3575] 10.222.0.18 () {60 vars in 1294 bytes} [Sat Jun 4 21:08:09 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f/tags => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:09.472747 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd689779-5f3a-404d-bae3-8a4a3440ecc2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 200 len: 1432 microversion: 2.1 time: 0.077299 Jun 04 21:08:09.473935 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1850/3576] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 1432 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:09.479454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.480355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.484806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.485663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.489174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.490332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.491819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.492730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.504430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.505033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.506325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.506940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.537110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:08:09.644167 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e45c34b-520e-4156-bc78-796764072577 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 204 len: 0 microversion: 2.26 time: 0.167568 Jun 04 21:08:09.651705 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1851/3577] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:08:09 2022] DELETE /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:09.667853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.669061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.683636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.684458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.685496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.686117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.769461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:09.797268 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85ff26a0-0e40-4640-aaeb-4a896896d333 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.328892 Jun 04 21:08:09.798185 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1727/3578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:09.816950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:09.820475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:09.830922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.832223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:09.833567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:09.836342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:10.044011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.054126 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cfb7aa65-bfd5-4470-b6ff-c25b0e9860c8 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1466 microversion: 2.1 time: 0.403639 Jun 04 21:08:10.057392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1852/3579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1466 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:10.072092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1d6fca4-444b-47b0-ae07-ebfa89677bee tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01929820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:10.124987 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1d6fca4-444b-47b0-ae07-ebfa89677bee tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/926a4015-c327-4be7-9086-5cce1a8e0ebf" status: 200 len: 784 microversion: 2.1 time: 0.057211 Jun 04 21:08:10.125614 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1853/3580] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:10 2022] GET /compute/v2.1/images/926a4015-c327-4be7-9086-5cce1a8e0ebf => generated 784 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:08:10.138552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5777b185-81dc-4d87-b694-ac72c3510f6e tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:10.150524 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5777b185-81dc-4d87-b694-ac72c3510f6e tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017124 Jun 04 21:08:10.151653 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1854/3581] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:08:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:10.161133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.170453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f1af049-e61a-42a5-95c4-c55eb8ec45bf tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0bdcfe50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:10.174066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.176766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.178489 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f35da52-d66e-46fe-91da-0cc54f77536d tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1550 microversion: 2.26 time: 0.366319 Jun 04 21:08:10.182949 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1728/3582] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:09 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1550 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:10.305308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:10.306080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:10.318490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:10.324326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:10.326679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:10.327120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:10.439161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.454286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.455982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:10.457177 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90262e79-bdac-4921-89a6-d7137f0547d5 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1415 microversion: 2.54 time: 0.158505 Jun 04 21:08:10.460681 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1729/3583] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:10 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1415 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:10.814365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:10.815098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:10.821719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:10.822468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:10.823535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:10.824166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:10.996065 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f1af049-e61a-42a5-95c4-c55eb8ec45bf tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "DELETE /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 204 len: 0 microversion: 2.1 time: 0.829706 Jun 04 21:08:10.997166 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1855/3584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:10 2022] DELETE /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:08:11.005715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62d66c67-49c8-4311-bbbd-78f7b9696564 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0be58dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:11.040829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:11.048860 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-62d66c67-49c8-4311-bbbd-78f7b9696564 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] HTTP exception thrown: Image not found. Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62d66c67-49c8-4311-bbbd-78f7b9696564 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Request method failure captured: Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 HTTP/1.1 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8mM_Ql7apyGajeAcX8XPjIkYep_edPu2kwmlrhynl6n_y-ttwXBGluj9upgHWYOVWc0htRuwgKpy6qqstYMC0_DLkPl3XHrwyHrz2vDgYmde8UGgqqqtR8gM1QMXZ6gPkhN7cuSbxHccN2__ZLFkOuvL7t57Kw31iZU-mbmPy4AkCw Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2de85e590d5e45c9bca587e74b6689d6 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2de85e590d5e45c9bca587e74b6689d6 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerTestJSON-1016629484-project Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 465cff93c4244a4794784ad2885c02e7 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerTestJSON-1016629484-project Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0cf81cea-b043-4576-b6c6-61d2a12df1a9'} Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0cf81cea-b043-4576-b6c6-61d2a12df1a9 Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:08:11.051350 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0cf81cea-b043-4576-b6c6-61d2a12df1a9 could not be found. Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:08:11.056291 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:11.062495 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-85d0f9d9-2ce8-4e18-ab7f-9672706b6feb tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.241261 Jun 04 21:08:11.062495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1730/3585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:10 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:11.065051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62d66c67-49c8-4311-bbbd-78f7b9696564 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:11.068440 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-62d66c67-49c8-4311-bbbd-78f7b9696564 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 404 len: 62 microversion: 2.1 time: 0.067184 Jun 04 21:08:11.071249 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1856/3586] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:11 2022] GET /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:08:11.080992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-40440119"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:11.082181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:11.094356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:11.094800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:11.100535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:11.101023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:11.203444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:11.204253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:11.226067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:11.226920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:11.227963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:11.233129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:11.560421 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72bec1e7-6604-43f5-89fc-46d41142ae73 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "POST /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556/action" status: 202 len: 0 microversion: 2.1 time: 0.483366 Jun 04 21:08:11.562960 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1731/3587] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:08:11 2022] POST /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:08:11.569357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:11.570662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:11.578147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:11.581534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:11.582573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:11.583902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:11.584798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:11.595189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:11.599339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:11.603749 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d2b9a02-1fc9-487c-9eb1-e769a5383594 tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1550 microversion: 2.26 time: 0.405656 Jun 04 21:08:11.606896 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1857/3588] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:11 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1550 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:11.617985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e5b5a37-2e99-4fa5-ba87-553c2a35ee75 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019bf9d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:11.692286 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e5b5a37-2e99-4fa5-ba87-553c2a35ee75 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.083603 Jun 04 21:08:11.694201 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1858/3589] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:11 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:12.074592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:12.076128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:12.092337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:12.093380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:12.094822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:12.095494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:12.345378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.360296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.362666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.368793 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db2f5954-f4bc-48ba-853d-9536d0be32bc tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1415 microversion: 2.54 time: 0.800474 Jun 04 21:08:12.370584 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1732/3590] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:11 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1415 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:12.531125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.543409 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-926adea6-0ab6-4152-b32e-7a3fc7178598 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.476751 Jun 04 21:08:12.545301 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1859/3591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:12 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:12.644480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:12.647307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:12.690959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:12.694736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:12.696988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:12.699970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:12.710637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ec6438d-dc78-4f20-9238-af63ee73695a tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a6b940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:12.797127 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ec6438d-dc78-4f20-9238-af63ee73695a tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.092940 Jun 04 21:08:12.797127 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1860/3592] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:12 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:12.842391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.858423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.861477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '797aa51baad940e08e46a861b76e4af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fae3157a11e4b7ab621512cec5442b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:12.864463 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-99e2ea75-ca7b-4b17-be7d-4a3292fd7c3c tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 200 len: 1508 microversion: 2.26 time: 0.235327 Jun 04 21:08:12.876937 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1733/3593] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:12 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:13.301778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a24de96a-d4f5-4357-b7c4-e1dde5ec724f req-399bd6c4-2e9f-4fcf-97fa-6b404f6a1a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5f5204-e1b7-4472-8683-75412bedc83f", "name": "network-vif-deleted", "tag": "d98325fa-3b20-4191-af5e-8aa1f761945f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:13.321950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a24de96a-d4f5-4357-b7c4-e1dde5ec724f req-399bd6c4-2e9f-4fcf-97fa-6b404f6a1a9d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.322623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a24de96a-d4f5-4357-b7c4-e1dde5ec724f req-399bd6c4-2e9f-4fcf-97fa-6b404f6a1a9d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.372171 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a24de96a-d4f5-4357-b7c4-e1dde5ec724f req-399bd6c4-2e9f-4fcf-97fa-6b404f6a1a9d service nova] Creating event network-vif-deleted:d98325fa-3b20-4191-af5e-8aa1f761945f for instance 9c5f5204-e1b7-4472-8683-75412bedc83f on nch1-master-1 Jun 04 21:08:13.387650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a24de96a-d4f5-4357-b7c4-e1dde5ec724f req-399bd6c4-2e9f-4fcf-97fa-6b404f6a1a9d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.454146 Jun 04 21:08:13.390835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:13.391419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:13.392123 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1861/3594] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:13.414305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.416145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.418660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.419426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.563187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:13.571613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:13.605037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.607274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.610324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.611843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.633718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:13.645059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:13.650314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:13.651557 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-627f1a92-0732-4452-a1f9-50b9662ace75 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1400 microversion: 2.54 time: 0.267127 Jun 04 21:08:13.661458 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1734/3595] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:13 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1400 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:13.677120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-788dc95c-8155-45f7-8d83-269b17e27e3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '.version_select at 0x7f2d0be6aa60>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:13.722255 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-788dc95c-8155-45f7-8d83-269b17e27e3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1850074620" status: 204 len: 0 microversion: 2.54 time: 0.051339 Jun 04 21:08:13.725232 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1735/3596] 10.222.0.18 () {60 vars in 1318 bytes} [Sat Jun 4 21:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1850074620 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 04 21:08:13.742552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:13.743445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:13.758234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.761140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.762621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:13.763467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:13.863039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:08:14.004224 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a3392fe-a4e0-46f7-856f-786b45620f3b tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 204 len: 0 microversion: 2.54 time: 0.265759 Jun 04 21:08:14.008211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1736/3597] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:08:13 2022] DELETE /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:08:14.019938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65299a18-ae20-4a75-a980-bb58a0f60920 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0be6aee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:14.129357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-65299a18-ae20-4a75-a980-bb58a0f60920 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.119551 Jun 04 21:08:14.134894 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1737/3598] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:14 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:14.142226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:14.142982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] [instance: 9c5f5204-e1b7-4472-8683-75412bedc83f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:14.160459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:14.160891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:14.161684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:14.162113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:14.191741 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] HTTP exception thrown: Instance 9c5f5204-e1b7-4472-8683-75412bedc83f could not be found. Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Request method failure captured: Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f HTTP/1.1 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mklBvMMqaz2-9dgRZSzFW75gt1tibMn--KStA7LJXUwhLzKeHJz642NOqNuMHM-OipY0q4pR323l-jT-YpD9oewvUGCWzF2KUdxRbH-Ul_mQyQNMk4NK-OoqIBN6o98_h8b5GapOQivCTFS2vGhtgA8rtxRkXx3MJblKnGfq1Ai5w Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.26 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 3fae3157a11e4b7ab621512cec5442b5 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerTagsTestJSON-36289587 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3fae3157a11e4b7ab621512cec5442b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3fae3157a11e4b7ab621512cec5442b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3fae3157a11e4b7ab621512cec5442b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3fae3157a11e4b7ab621512cec5442b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerTagsTestJSON-36289587 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 3fae3157a11e4b7ab621512cec5442b5 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerTagsTestJSON-36289587 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerTagsTestJSON-36289587-project Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 797aa51baad940e08e46a861b76e4af6 Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerTagsTestJSON-36289587-project Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 9c5f5204-e1b7-4472-8683-75412bedc83f could not be found. Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '9c5f5204-e1b7-4472-8683-75412bedc83f'} Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5f5204-e1b7-4472-8683-75412bedc83f could not be found. Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5f5204-e1b7-4472-8683-75412bedc83f could not be found. Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:14.193626 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5f5204-e1b7-4472-8683-75412bedc83f could not be found. Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] Returning 404 to user: Instance 9c5f5204-e1b7-4472-8683-75412bedc83f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:14.198954 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c130e557-28a5-45cb-be70-2a6bfa72486e tempest-ServerTagsTestJSON-36289587 tempest-ServerTagsTestJSON-36289587-project] 10.222.0.18 "GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f" status: 404 len: 111 microversion: 2.26 time: 0.064075 Jun 04 21:08:14.202022 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1738/3599] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:14 2022] GET /compute/v2.1/servers/9c5f5204-e1b7-4472-8683-75412bedc83f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:08:14.232339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:14.233977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:14.257147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:14.257611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:14.258424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:14.259642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:14.650853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:14.662203 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e31c9e29-7983-4de0-97eb-93bce2b308ba tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 1.104466 Jun 04 21:08:14.665484 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1862/3600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:13 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:14.690103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:14.716463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:14.722542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:14.724009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2afc01d7-4ac5-4661-a735-a34c34b036e9 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1406 microversion: 2.54 time: 0.514221 Jun 04 21:08:14.726859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1739/3601] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:14 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:15.015333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b7c9786e-6159-458b-9dea-1260cb40182f req-9459eefb-01e6-48f0-926e-33860af351a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "name": "network-vif-unplugged", "status": "completed", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:15.027227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b7c9786e-6159-458b-9dea-1260cb40182f req-9459eefb-01e6-48f0-926e-33860af351a6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:15.033909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b7c9786e-6159-458b-9dea-1260cb40182f req-9459eefb-01e6-48f0-926e-33860af351a6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:15.052458 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b7c9786e-6159-458b-9dea-1260cb40182f req-9459eefb-01e6-48f0-926e-33860af351a6 service nova] Creating event network-vif-unplugged:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:08:15.068104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b7c9786e-6159-458b-9dea-1260cb40182f req-9459eefb-01e6-48f0-926e-33860af351a6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.400901 Jun 04 21:08:15.071062 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1863/3602] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:15.143210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-31853b96-458b-4f8b-a379-a0af51be6460 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a27b80>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:15.240311 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-31853b96-458b-4f8b-a379-a0af51be6460 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.100463 Jun 04 21:08:15.241391 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1740/3603] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:15 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:15.689891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:15.690623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:15.720546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:15.721213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:15.722798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:15.725408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:15.746088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:15.749207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:15.773612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:15.774079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:15.774906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:15.775343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:15.990216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:16.015443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:16.018861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:16.021537 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d38f988-1745-469c-a819-485a20d05043 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1406 microversion: 2.54 time: 0.278780 Jun 04 21:08:16.023025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1741/3604] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:15 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:08:16.093501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:16.107593 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-492640ee-6138-4bc0-a230-1ef24a4d4282 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.428494 Jun 04 21:08:16.127716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1864/3605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:15 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:16.257960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22ef23c0-0b29-485a-82a1-5de337db0e03 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a279d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:16.316389 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22ef23c0-0b29-485a-82a1-5de337db0e03 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.063823 Jun 04 21:08:16.319659 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1742/3606] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:16 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:16.618828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1591079773", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:16.769094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:08:17.041759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:17.043178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:17.056585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.057317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.058277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.058887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.118594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.119049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.119643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lazy-loading 'fault' on Instance uuid a3905e1c-bc3e-4005-accb-c8eecb164d9e {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:17.122792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:17.285231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:17.297967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:17.304293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c06fd081dccd4e10bdbb3c7871be811f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a52f1d9032436f907a2d30636b5d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:17.306264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0a07526-4b17-4085-907b-a9fe244b67a3 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 200 len: 1411 microversion: 2.54 time: 0.268872 Jun 04 21:08:17.319322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1743/3607] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:17 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 1411 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:08:17.332238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:17.332899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:17.358133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.359819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.365032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.365821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.620307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:08:17.620753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:08:17.621874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:08:17.622428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:08:17.622834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:08:17.650196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.650901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.652829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:17.655820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:17.713633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Getting quotas for project 78708ead8abd482bab61be479bae7912. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:08:17.738573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Getting quotas for user 14f03605fadb4a819444a497e7a2805f and project 78708ead8abd482bab61be479bae7912. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:08:17.757168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:08:17.760402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:08:17.878703 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df8ce4b7-b294-4e12-a971-e08e2e8a0d5f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263793 Jun 04 21:08:17.888157 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1865/3608] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:08:17.896575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9fd33491-22a9-4872-adf4-d936e5434c18 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d02c36790>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:18.031339 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9fd33491-22a9-4872-adf4-d936e5434c18 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.141584 Jun 04 21:08:18.032385 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1866/3609] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:17 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:18.051208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ec6f2a8-1f37-44c6-9ec8-df3b46b968c1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:18.053715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ec6f2a8-1f37-44c6-9ec8-df3b46b968c1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:18.496155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ec6f2a8-1f37-44c6-9ec8-df3b46b968c1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:18.503589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ec6f2a8-1f37-44c6-9ec8-df3b46b968c1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1214 microversion: 2.1 time: 0.466735 Jun 04 21:08:18.524344 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1867/3610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:18 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1214 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:18.539421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:18.543860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] [instance: a3905e1c-bc3e-4005-accb-c8eecb164d9e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:18.560069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:18.567998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:18.568476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:18.569298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:18.571015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:18.579419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b14c0021-3651-4ac0-baec-67f2ac48ab2a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 1.257482 Jun 04 21:08:18.580472 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1744/3611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:17 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:18.633365 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] HTTP exception thrown: Instance a3905e1c-bc3e-4005-accb-c8eecb164d9e could not be found. Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Request method failure captured: Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e HTTP/1.1 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8mWJ2KigymOTsI_Fe5DEcyNwjLVe9hPa8HNCswY9H5UoVhZCHRsurcTtTSKXvc-kfU6It1aUPagtsYavActzUzTntnjH2nRZBcw9BQH4RzQpH_mxdU9Le1PgIOdczxjnLTuirYR4bwxx6QaH5OmpD--SixdapJRmJwigRKvRyaZR-U Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.54 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: f3a52f1d9032436f907a2d30636b5d3d Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerShowV254Test-1302908095 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f3a52f1d9032436f907a2d30636b5d3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3a52f1d9032436f907a2d30636b5d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f3a52f1d9032436f907a2d30636b5d3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f3a52f1d9032436f907a2d30636b5d3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerShowV254Test-1302908095 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: f3a52f1d9032436f907a2d30636b5d3d Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerShowV254Test-1302908095 Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerShowV254Test-1302908095-project Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c06fd081dccd4e10bdbb3c7871be811f Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerShowV254Test-1302908095-project Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a3905e1c-bc3e-4005-accb-c8eecb164d9e could not be found. Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a3905e1c-bc3e-4005-accb-c8eecb164d9e'} Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3905e1c-bc3e-4005-accb-c8eecb164d9e could not be found. Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3905e1c-bc3e-4005-accb-c8eecb164d9e could not be found. Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:18.638239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3905e1c-bc3e-4005-accb-c8eecb164d9e could not be found. Jun 04 21:08:18.643825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:18.647293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] Returning 404 to user: Instance a3905e1c-bc3e-4005-accb-c8eecb164d9e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:18.650421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0443afd9-bfa4-4ade-abf0-3fcd1178f747 tempest-ServerShowV254Test-1302908095 tempest-ServerShowV254Test-1302908095-project] 10.222.0.18 "GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e" status: 404 len: 111 microversion: 2.54 time: 0.123035 Jun 04 21:08:18.653030 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1868/3612] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:08:18 2022] GET /compute/v2.1/servers/a3905e1c-bc3e-4005-accb-c8eecb164d9e => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:08:18.795097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3157b042-1807-4996-b379-b3c92b129859 req-fd71675b-69d1-4bd1-a44a-d0c0df96fb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "name": "network-vif-plugged", "status": "completed", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:18.812464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3157b042-1807-4996-b379-b3c92b129859 req-fd71675b-69d1-4bd1-a44a-d0c0df96fb0f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:18.814367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3157b042-1807-4996-b379-b3c92b129859 req-fd71675b-69d1-4bd1-a44a-d0c0df96fb0f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:18.861370 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3157b042-1807-4996-b379-b3c92b129859 req-fd71675b-69d1-4bd1-a44a-d0c0df96fb0f service nova] Creating event network-vif-plugged:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:08:18.874456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3157b042-1807-4996-b379-b3c92b129859 req-fd71675b-69d1-4bd1-a44a-d0c0df96fb0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084938 Jun 04 21:08:18.884101 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1745/3613] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:19.045644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fcab070-3a4b-4e25-9696-f3827f5ea80e tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0bd2d040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:19.156107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2fcab070-3a4b-4e25-9696-f3827f5ea80e tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.114704 Jun 04 21:08:19.156706 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1869/3614] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:19 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:19.524545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:19.581349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:19.581349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:19.581349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:19.581349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:19.581349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:19.597718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:19.598663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:19.614048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:19.614506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:19.615292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:19.616421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:20.246762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:20.268920 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95bb4a0c-8e5f-4cd3-82ef-19c84a241fa4 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1266 microversion: 2.1 time: 0.749965 Jun 04 21:08:20.269534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1746/3615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:19 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1266 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:20.300870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4864e672-a060-4520-ac9c-cb1e480b7247 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a24430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:20.413628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4864e672-a060-4520-ac9c-cb1e480b7247 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.142946 Jun 04 21:08:20.414229 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1747/3616] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:20 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:20.763826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:20.805109 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cae28357-5b98-4e09-a467-731e29403c29 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 1.210964 Jun 04 21:08:20.807150 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1870/3617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:19 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:21.292718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:21.293545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:21.313649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:21.314121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:21.314930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:21.315376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:21.429571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51e68599-fa95-4a98-b5b9-466e63113ca7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01b4bca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:21.511793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:21.518623 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-51e68599-fa95-4a98-b5b9-466e63113ca7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.094508 Jun 04 21:08:21.521297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1871/3618] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:21 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:21.527734 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95e2d321-c26f-4c06-aab9-b281d46c21fa tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1272 microversion: 2.1 time: 0.240208 Jun 04 21:08:21.527734 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1748/3619] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:21 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:21.823741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:21.824887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:21.857189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:21.857567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:21.858371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:21.858812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:23.071029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Action: 'create', calling method: .version_select at 0x7f2d01ab43a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1575473819"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:23.438581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:23.464727 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-de7d408b-63aa-4376-8705-17b7d884723d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 1.644969 Jun 04 21:08:23.467076 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1749/3620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:21 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:23.483460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d16f1475-8746-4586-beaf-9657fe0179d7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a0e670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:23.566932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d16f1475-8746-4586-beaf-9657fe0179d7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.098328 Jun 04 21:08:23.568333 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1750/3621] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:23 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:23.582933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:23.585579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:23.595683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:23.599399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:23.600967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:23.601804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:23.790514 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad9eec2c-0b19-46bd-a3b9-1a225054b769 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 1.317743 Jun 04 21:08:23.791269 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1872/3622] 10.222.0.18 () {60 vars in 1154 bytes} [Sat Jun 4 21:08:22 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 1320 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 04 21:08:23.804763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-714ae04f-6c5d-4d5c-8690-d190bf883326 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d0be58dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:23.823291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:23.857090 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b3b088c9-f41a-488c-aaf8-e69f22ed5c55 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1272 microversion: 2.1 time: 0.287168 Jun 04 21:08:23.857779 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1751/3623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:23 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1272 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:23.936006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-714ae04f-6c5d-4d5c-8690-d190bf883326 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 200 len: 338 microversion: 2.1 time: 0.135967 Jun 04 21:08:23.937510 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1873/3624] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:08:23 2022] GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 338 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:24.482512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:24.484711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:24.497135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:24.498030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:24.499198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:24.500025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:24.585393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8221b59b-9b81-416a-ba7d-5785b3f6eeb6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01049940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:24.673079 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8221b59b-9b81-416a-ba7d-5785b3f6eeb6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.094815 Jun 04 21:08:24.674956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1874/3625] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:24 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:24.875064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:24.876207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:24.891446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:24.892268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:24.893350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:24.893999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:24.985455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:25.001188 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5d6345d-9787-4b9b-b15b-6a92655da56a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.523419 Jun 04 21:08:25.007441 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1752/3626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:24 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:25.016563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd27ae0b-9f79-427c-82b5-a63f564c3527 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d0bd83700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:25.121733 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd27ae0b-9f79-427c-82b5-a63f564c3527 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 200 len: 339 microversion: 2.1 time: 0.112633 Jun 04 21:08:25.122811 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1753/3627] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:08:25 2022] GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:25.134507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e60d795-2d62-4f17-8461-eaffeedf58be tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Action: 'create', calling method: .version_select at 0x7f2d0bd83670>, body: {"snapshot": {"volume_id": "194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1883459615"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:25.489077 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5e60d795-2d62-4f17-8461-eaffeedf58be tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.358578 Jun 04 21:08:25.490003 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1754/3628] 10.222.0.18 () {60 vars in 1161 bytes} [Sat Jun 4 21:08:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:25.501217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-629419a8-4a6e-43d8-ae05-d1eb03770b36 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d01a35550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:25.554040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:25.555652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-629419a8-4a6e-43d8-ae05-d1eb03770b36 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55" status: 200 len: 287 microversion: 2.1 time: 0.059482 Jun 04 21:08:25.556231 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1755/3629] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:08:25 2022] GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:08:25.569280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-118cd69e-91ea-4161-bc25-2d92fa3dd3af tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d0bf8c310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:25.593585 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-51caba1b-21f6-4aa6-9646-2c2e1bf263db tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 0.723037 Jun 04 21:08:25.594197 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1875/3630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:24 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:25.614058 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-118cd69e-91ea-4161-bc25-2d92fa3dd3af tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.051463 Jun 04 21:08:25.615288 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1756/3631] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Jun 4 21:08:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:08:25.628214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f93cb6f7-f8c6-4a26-85e8-c712b4091861 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d01b4b280>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:25.676842 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f93cb6f7-f8c6-4a26-85e8-c712b4091861 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55" status: 200 len: 287 microversion: 2.1 time: 0.055224 Jun 04 21:08:25.678122 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1876/3632] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:08:25 2022] GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:25.688532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9473b9ff-438a-43f6-aa8a-c91269de5d28 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0bd83280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:25.746251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9473b9ff-438a-43f6-aa8a-c91269de5d28 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.062210 Jun 04 21:08:25.755958 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1757/3633] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:25 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:26.020221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:26.021189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:26.034523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:26.036794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:26.037851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:26.040493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:26.613224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:26.614582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:26.634507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:26.641996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:26.643478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:26.646573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:26.960378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:26.962217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:26.981969 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba6a3294-91cb-470c-895e-a3ee2c863c72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.961874 Jun 04 21:08:26.987351 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1877/3634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:26 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:26.987976 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b7e62b39-9153-4522-b3fa-b6bfd9f812e1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 0.375716 Jun 04 21:08:26.995595 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1758/3635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:26 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:27.001227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb67c818-74ab-40e8-b4af-9b8d1694143b tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d0bdcfe50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:27.022257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e498f89-f554-45b2-a768-11df3fc8e9b2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a27700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:27.093522 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e498f89-f554-45b2-a768-11df3fc8e9b2 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.096181 Jun 04 21:08:27.112032 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb67c818-74ab-40e8-b4af-9b8d1694143b tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55" status: 200 len: 288 microversion: 2.1 time: 0.122819 Jun 04 21:08:27.113127 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1878/3636] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:08:26 2022] GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 => generated 288 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:27.116849 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1759/3637] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:26 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:27.125935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d019bff70>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:27.276275 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b9796b8b-19f8-4f96-be8f-950b0d1fe36b tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55" status: 202 len: 0 microversion: 2.1 time: 0.155682 Jun 04 21:08:27.278008 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1879/3638] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:08:27 2022] DELETE /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:08:27.287789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66f3a2e7-e40b-4201-90c4-091f46fddf68 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d01a241f0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:27.347489 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66f3a2e7-e40b-4201-90c4-091f46fddf68 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55" status: 200 len: 287 microversion: 2.1 time: 0.063908 Jun 04 21:08:27.352462 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1760/3639] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:08:27 2022] GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:28.004496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:28.005740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:28.007658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:28.008893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:28.024982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:28.028162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:28.028628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:28.030425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:28.033984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:28.034996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:28.035779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:28.036787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:28.038871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:28.054280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:28.502963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:28.694870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:28.705292 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1d8d100b-f3b0-4416-8bd3-8ef55f7c633a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.705822 Jun 04 21:08:28.712993 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1880/3640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:27 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:28.750002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0979cf65-ed0b-4fb6-9db8-de6cab57e4d6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01929820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:28.899099 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0979cf65-ed0b-4fb6-9db8-de6cab57e4d6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.184515 Jun 04 21:08:28.900827 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1881/3641] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:28 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:28.912564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97d28929-c01d-4e5b-9cc3-1f57708cb3a3 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d028d03a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:28.969575 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-97d28929-c01d-4e5b-9cc3-1f57708cb3a3 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] HTTP exception thrown: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97d28929-c01d-4e5b-9cc3-1f57708cb3a3 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Request method failure captured: Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 HTTP/1.1 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8nGuUfSezg6k8xhYNCObhJoyx22yg1-V4wPzzUzwzdbG9YdIHT_AwvpY6oIR7Cgdk9dDj4DwhF-GROrxW742E6pemdOd7MAvEgtMseAZyeslQVdVw355105ffEppL2NIPreuJtED9P4_i39ODXnDOUO5l9JG8fCT-jei2AyHn4ctgM Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 60df515b9c4c490994284bf20ccb0b31 Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: exception: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '841b81bc-280d-455e-9b47-871a86c8ae55'} Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. (HTTP 404) (Request-ID: req-40bfe829-01b9-4af2-b542-0f267a650ed5) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:08:28.976942 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97d28929-c01d-4e5b-9cc3-1f57708cb3a3 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Returning 404 to user: Snapshot 841b81bc-280d-455e-9b47-871a86c8ae55 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-97d28929-c01d-4e5b-9cc3-1f57708cb3a3 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55" status: 404 len: 111 microversion: 2.1 time: 0.076735 Jun 04 21:08:28.982046 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1882/3642] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:08:28 2022] GET /compute/v2.1/os-snapshots/841b81bc-280d-455e-9b47-871a86c8ae55 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:29.000439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e354efe-b41e-4b5f-a16f-e048a5809455 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d026981f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:29.200801 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e354efe-b41e-4b5f-a16f-e048a5809455 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 202 len: 0 microversion: 2.1 time: 0.209452 Jun 04 21:08:29.202959 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1883/3643] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:08:28 2022] DELETE /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:08:29.211257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cb3363c-098a-44f4-a4fe-82c217801362 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d0be49040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:29.399110 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8cb3363c-098a-44f4-a4fe-82c217801362 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 200 len: 338 microversion: 2.1 time: 0.192402 Jun 04 21:08:29.399872 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1884/3644] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:08:29 2022] GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:08:29.734777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:29.735811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:29.748738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:29.760402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ea9e91df-8a62-4c9c-85be-2b794a9fd0c7 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 1.757832 Jun 04 21:08:29.766972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:29.771791 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1761/3645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:28 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:29.773359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:29.776897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:29.789999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:30.312553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5eb90c50-739b-4f27-8a77-62b682f2a6c9 req-db68e1ee-7e2e-4232-b814-f8e2514a66ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30877e8d-36a0-405d-8df2-04785754249f", "tag": "e897aa0f-d284-4e0e-99ec-7aefe50c9eed"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:30.339769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5eb90c50-739b-4f27-8a77-62b682f2a6c9 req-db68e1ee-7e2e-4232-b814-f8e2514a66ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:30.344870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5eb90c50-739b-4f27-8a77-62b682f2a6c9 req-db68e1ee-7e2e-4232-b814-f8e2514a66ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:30.397381 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5eb90c50-739b-4f27-8a77-62b682f2a6c9 req-db68e1ee-7e2e-4232-b814-f8e2514a66ca service nova] Creating event network-changed:e897aa0f-d284-4e0e-99ec-7aefe50c9eed for instance 30877e8d-36a0-405d-8df2-04785754249f on nch2-master-1 Jun 04 21:08:30.414923 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5eb90c50-739b-4f27-8a77-62b682f2a6c9 req-db68e1ee-7e2e-4232-b814-f8e2514a66ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.561655 Jun 04 21:08:30.424425 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1762/3646] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:08:30.429819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-119cd0f7-77d3-4d5b-9fc0-e16bc19548b1 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01947700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:30.521110 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-119cd0f7-77d3-4d5b-9fc0-e16bc19548b1 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.095002 Jun 04 21:08:30.521710 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1763/3647] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:30 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:30.538659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-daaa6488-0eb4-49aa-b5e2-636e20372ae0 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d01a27430>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:30.589871 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-daaa6488-0eb4-49aa-b5e2-636e20372ae0 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] HTTP exception thrown: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-daaa6488-0eb4-49aa-b5e2-636e20372ae0 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Request method failure captured: Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 HTTP/1.1 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8nGuUfSezg6k8xhYNCObhJoyx22yg1-V4wPzzUzwzdbG9YdIHT_AwvpY6oIR7Cgdk9dDj4DwhF-GROrxW742E6pemdOd7MAvEgtMseAZyeslQVdVw355105ffEppL2NIPreuJtED9P4_i39ODXnDOUO5l9JG8fCT-jei2AyHn4ctgM Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 60df515b9c4c490994284bf20ccb0b31 Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: exception: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8'} Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. (HTTP 404) (Request-ID: req-bcd62821-2b3c-4a50-b8a1-bda6416c26ff) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:08:30.615923 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.622165 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.631645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-daaa6488-0eb4-49aa-b5e2-636e20372ae0 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Returning 404 to user: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:30.631645 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-daaa6488-0eb4-49aa-b5e2-636e20372ae0 tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 404 len: 109 microversion: 2.1 time: 0.103227 Jun 04 21:08:30.631645 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1764/3648] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:08:30 2022] GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:30.642378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fd6c5d2-4ff0-46c3-86e0-3857074368ee tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d019aac10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:30.642650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:30.655104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-52ec1cc6-3d86-4fe0-b4d2-8b950f46f55e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.928452 Jun 04 21:08:30.657215 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1885/3649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:29 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:30.693855 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0fd6c5d2-4ff0-46c3-86e0-3857074368ee tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] HTTP exception thrown: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fd6c5d2-4ff0-46c3-86e0-3857074368ee tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Request method failure captured: Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 HTTP/1.1 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8nGuUfSezg6k8xhYNCObhJoyx22yg1-V4wPzzUzwzdbG9YdIHT_AwvpY6oIR7Cgdk9dDj4DwhF-GROrxW742E6pemdOd7MAvEgtMseAZyeslQVdVw355105ffEppL2NIPreuJtED9P4_i39ODXnDOUO5l9JG8fCT-jei2AyHn4ctgM Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 60df515b9c4c490994284bf20ccb0b31 Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: exception: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8'} Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. (HTTP 404) (Request-ID: req-4de5e392-0ead-4765-ada8-3a71e7446e84) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:08:30.696193 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fd6c5d2-4ff0-46c3-86e0-3857074368ee tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Returning 404 to user: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fd6c5d2-4ff0-46c3-86e0-3857074368ee tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 404 len: 109 microversion: 2.1 time: 0.065552 Jun 04 21:08:30.706091 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1765/3650] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:08:30 2022] DELETE /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:30.710877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-117e3a17-66b8-4ebc-8e92-9a2d5abdc4ce tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Calling method '.version_select at 0x7f2d0be49430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:30.756521 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-117e3a17-66b8-4ebc-8e92-9a2d5abdc4ce tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] HTTP exception thrown: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-117e3a17-66b8-4ebc-8e92-9a2d5abdc4ce tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Request method failure captured: Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 HTTP/1.1 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8nGuUfSezg6k8xhYNCObhJoyx22yg1-V4wPzzUzwzdbG9YdIHT_AwvpY6oIR7Cgdk9dDj4DwhF-GROrxW742E6pemdOd7MAvEgtMseAZyeslQVdVw355105ffEppL2NIPreuJtED9P4_i39ODXnDOUO5l9JG8fCT-jei2AyHn4ctgM Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/b8abf73775cf4d25aec54d7e27a6cc52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: b8abf73775cf4d25aec54d7e27a6cc52 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-564982919 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 60df515b9c4c490994284bf20ccb0b31 Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesSnapshotsTestJSON-564982919-project Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: exception: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8'} Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. (HTTP 404) (Request-ID: req-cc9ead41-5a80-41bb-ad10-7f1b2bccc688) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:08:30.758718 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-117e3a17-66b8-4ebc-8e92-9a2d5abdc4ce tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] Returning 404 to user: Volume 194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-117e3a17-66b8-4ebc-8e92-9a2d5abdc4ce tempest-VolumesSnapshotsTestJSON-564982919 tempest-VolumesSnapshotsTestJSON-564982919-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8" status: 404 len: 109 microversion: 2.1 time: 0.056293 Jun 04 21:08:30.765844 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1886/3651] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:08:30 2022] GET /compute/v2.1/os-volumes/194bfef6-00cd-46d8-9a76-9a7cf3d0b4c8 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:30.789075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:30.789886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:30.804020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:30.805306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:30.823307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:30.823848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:30.833930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:30.834392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:30.854996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:30.855865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:30.863663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:30.864898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:31.115486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lazy-loading 'services' on Instance uuid 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:31.282481 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d1db252-9075-4963-8e8f-9eb0733eb9ef tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-volume_attachments/95700618-6da4-4410-8224-5fe706fb560d" status: 202 len: 0 microversion: 2.1 time: 0.470241 Jun 04 21:08:31.283082 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1887/3652] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:08:30 2022] DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-volume_attachments/95700618-6da4-4410-8224-5fe706fb560d => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:08:31.506636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:31.518568 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c7dc861-ae72-48f7-ab31-585247ee7674 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 0.733697 Jun 04 21:08:31.540865 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1766/3653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:30 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:31.541912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6ce4d8e-7413-44e6-bde3-f53b4fcd63b7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d00fed3a0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:31.674849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:31.675669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:31.683945 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6ce4d8e-7413-44e6-bde3-f53b4fcd63b7 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.144376 Jun 04 21:08:31.688085 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1888/3654] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:31 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:31.699107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:31.700134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:31.701636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:31.702345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:31.976211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:31.987102 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a2e6e41-2ccb-4fca-9b95-4372dc446561 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1514 microversion: 2.1 time: 0.317160 Jun 04 21:08:32.006729 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1767/3655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:31 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1514 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:32.558260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:32.560391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:32.598973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:32.601976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:32.602901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:32.603353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:32.701744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-41d93676-c609-4ce0-94a8-6ad3375eecfb tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0be355e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:32.800626 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-41d93676-c609-4ce0-94a8-6ad3375eecfb tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.103149 Jun 04 21:08:32.806982 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1768/3656] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:32 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:33.021886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:33.023316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:33.041720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:33.042462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:33.043951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:33.044577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:34.481492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:34.501273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a2e0ac7-fd19-47fd-ab44-9120f11237b3 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 1.959685 Jun 04 21:08:34.505038 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1889/3657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:32 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 1965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:34.522239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4c63845-c311-490d-afba-7511af9ab1dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01049ca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:34.653350 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d4c63845-c311-490d-afba-7511af9ab1dd tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.143236 Jun 04 21:08:34.658807 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1890/3658] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:34 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:34.834434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97763e15-df4c-44cb-8f80-bf6964e51333 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:34.872895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97763e15-df4c-44cb-8f80-bf6964e51333 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:34.873389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97763e15-df4c-44cb-8f80-bf6964e51333 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:34.913235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-97763e15-df4c-44cb-8f80-bf6964e51333 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:08:35.033461 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-97763e15-df4c-44cb-8f80-bf6964e51333 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.203416 Jun 04 21:08:35.035355 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1891/3659] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:08:34 2022] POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:08:35.062047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:35.062779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:35.136151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:35.136778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:35.142796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:35.146342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:36.126559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:36.140251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a5ce0db-e555-41f0-b23a-cb44848493a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 3.123225 Jun 04 21:08:36.140857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1769/3660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:33 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:36.171369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:36.175134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:36.195911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:36.213089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:36.223819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:36.224822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:36.225273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:37.286769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:37.298635 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d233841-1e91-46ea-923f-a61183441b17 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1675 microversion: 2.1 time: 2.250544 Jun 04 21:08:37.316661 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1892/3661] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:35 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1675 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:37.338184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad806f07-2b5d-498c-a3cb-f1e335609c67 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01971b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:37.462449 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad806f07-2b5d-498c-a3cb-f1e335609c67 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.142226 Jun 04 21:08:37.463318 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1893/3662] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:37 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:37.482837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:37.483473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:37.485712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:37.525514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:37.525982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:37.532844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:37.533499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:37.629900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:37.652943 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eab5152f-7a8d-44fe-a232-742388926886 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 1.498178 Jun 04 21:08:37.653578 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1770/3663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:36 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:38.127301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:38.139341 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53c7d781-9c7b-4664-b921-88b2a3b4711c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.671028 Jun 04 21:08:38.150647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1894/3664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:37 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:38.334053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:38.334662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:38.352113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:38.352547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:38.368694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:38.369348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:38.481484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e1739ff5-bef3-4a8d-894d-3798f648a9ea tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01a3b4c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:38.640582 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e1739ff5-bef3-4a8d-894d-3798f648a9ea tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.166884 Jun 04 21:08:38.641601 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1895/3665] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:38 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:38.703738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:38.704752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:38.742719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:38.747975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:38.761943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:38.766549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:39.872856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:39.905813 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-46b8325c-a416-447c-b999-ee2a1542ef79 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1675 microversion: 2.1 time: 1.575232 Jun 04 21:08:39.938794 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1771/3666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:38 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1675 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:39.971901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:39.977279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:40.006449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:40.009646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:40.012246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:40.014972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:40.266581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:40.276617 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ca7c65a-a6cd-4dce-a512-139c474a759f tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 1.603252 Jun 04 21:08:40.288338 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1896/3667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:38 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:40.294259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a609965-4fc3-4aca-8ca4-756058efed9c tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01971dc0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:40.405281 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a609965-4fc3-4aca-8ca4-756058efed9c tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.115220 Jun 04 21:08:40.406055 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1897/3668] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:40 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:40.683821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:40.694678 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db665cc5-a0ce-488a-a90b-12cbb3d68367 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.753968 Jun 04 21:08:40.697969 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1772/3669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:39 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:40.951287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:40.951977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:41.011079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:41.011605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:41.012409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:41.012839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:41.305952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:41.307911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:41.325910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:41.326455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:41.331550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:41.334985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:41.573655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:41.596428 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a657054b-7c9a-43ea-a358-ec6d08d81fb2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1675 microversion: 2.1 time: 0.655975 Jun 04 21:08:41.600846 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1898/3670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:40 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1675 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:41.652636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8d7b1ff1-cd1e-4a82-aca8-3a9cf630eec4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0be58040>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:41.788624 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8d7b1ff1-cd1e-4a82-aca8-3a9cf630eec4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.180465 Jun 04 21:08:41.797860 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1899/3671] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:41 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:41.806593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:41.808743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:41.827922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:41.829747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:41.832783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:41.833475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:41.938081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:41.954116 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d603493d-3499-4c29-8c8e-876d6bb7e1f1 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 0.652693 Jun 04 21:08:41.956162 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1773/3672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:41 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:42.290515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:42.311761 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c189d049-5334-463e-8d98-a0343fced6e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.511608 Jun 04 21:08:42.312576 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1900/3673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:41 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:42.619320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:42.620446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:42.647950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:42.648541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:42.657322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:42.659382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:42.714408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:42.815089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35aa9a04-d400-4d09-8852-f14c69e005f6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0bd8daf0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:42.938946 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35aa9a04-d400-4d09-8852-f14c69e005f6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.132452 Jun 04 21:08:42.939895 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1901/3674] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:42 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:42.972771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:42.977283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:43.000981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:43.001606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:43.002711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:43.003441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:43.716181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:43.727046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5f6f895-90ea-495a-a134-8bec0a13e26e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1675 microversion: 2.1 time: 1.113230 Jun 04 21:08:43.736215 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1774/3675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:42 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1675 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:43.759645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:43.760282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:43.807132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:43.810403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:43.814497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:43.815795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:44.034673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:44.067290 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e8c7dfac-9baf-4fae-9e9f-7ac2e36800ae tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 1.098981 Jun 04 21:08:44.068630 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1902/3676] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:42 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:44.074330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f1cc88a-6e65-4f63-bd9b-87ee3744f133 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0246eee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:44.149532 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f1cc88a-6e65-4f63-bd9b-87ee3744f133 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1427 microversion: 2.1 time: 0.079136 Jun 04 21:08:44.150864 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1903/3677] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:44 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:44.283973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:44.296315 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b3f25191-7173-4adc-8430-f4978910e01b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.558466 Jun 04 21:08:44.297842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1775/3678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:43 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:44.750636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:44.751172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:44.766775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:44.767237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:44.768062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:44.768501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:44.997183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2500878e-08e4-4d17-9032-7f3ea4e3a3bd req-064d618f-321f-4e30-a8d9-47ef6035ce51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30877e8d-36a0-405d-8df2-04785754249f", "name": "network-vif-plugged", "status": "completed", "tag": "e897aa0f-d284-4e0e-99ec-7aefe50c9eed"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:45.021944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2500878e-08e4-4d17-9032-7f3ea4e3a3bd req-064d618f-321f-4e30-a8d9-47ef6035ce51 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:45.024154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2500878e-08e4-4d17-9032-7f3ea4e3a3bd req-064d618f-321f-4e30-a8d9-47ef6035ce51 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:45.060906 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2500878e-08e4-4d17-9032-7f3ea4e3a3bd req-064d618f-321f-4e30-a8d9-47ef6035ce51 service nova] Creating event network-vif-plugged:e897aa0f-d284-4e0e-99ec-7aefe50c9eed for instance 30877e8d-36a0-405d-8df2-04785754249f on nch2-master-1 Jun 04 21:08:45.076055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2500878e-08e4-4d17-9032-7f3ea4e3a3bd req-064d618f-321f-4e30-a8d9-47ef6035ce51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081761 Jun 04 21:08:45.078857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1776/3679] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:45.095205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:45.097039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:45.141820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:45.142316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:45.146830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:45.149136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:45.514108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:45.524593 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0705257a-f285-4308-bffe-f73da21250cc tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1675 microversion: 2.1 time: 0.777486 Jun 04 21:08:45.532881 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1904/3680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:44 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1675 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:45.556750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e5d159f4-5f0f-405c-a9c0-1f69ad355914 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0272fd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:45.654717 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e5d159f4-5f0f-405c-a9c0-1f69ad355914 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1436 microversion: 2.1 time: 0.120219 Jun 04 21:08:45.655315 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1905/3681] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:45 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1436 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:45.665162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:45.666021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:45.681289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:45.681753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:45.682552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:45.686519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:45.879700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:45.891235 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-06a95184-5e56-497b-8758-c4db09c7599d tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 0.808345 Jun 04 21:08:45.891855 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1777/3682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:45 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:45.896741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09241662-153b-4038-85ac-4cfffeebd408 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d01947ee0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:46.002356 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09241662-153b-4038-85ac-4cfffeebd408 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 200 len: 1436 microversion: 2.1 time: 0.109382 Jun 04 21:08:46.002998 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1778/3683] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:08:45 2022] GET /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 1436 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:46.014604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:46.015225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:46.035811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:46.036776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:46.037811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:46.038416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:46.479488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:46.493434 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7944a962-a38c-4fb9-9a21-b007fb06b633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.836670 Jun 04 21:08:46.503559 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1906/3684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:45 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:46.561158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:46.561772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:46.579501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:46.580978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:46.581975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:46.584016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:46.612199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:46.621307 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d84704b-8b80-4670-b5c8-7f934daef319 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1466 microversion: 2.1 time: 0.610509 Jun 04 21:08:46.621985 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1779/3685] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:46 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1466 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:08:46.644805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4d53e91f-7e52-4995-9e4e-0d09aa52197f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d019479d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:46.981726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:46.995089 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-22d9bf4d-2011-47bc-96b8-e8244ea66553 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1652 microversion: 2.1 time: 0.443960 Jun 04 21:08:47.011198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1907/3686] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:46 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1652 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:47.032412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:47.033054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:47.057583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:47.058055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:47.067310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:47.070679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:47.471743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:47.486543 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef777cea-e443-44b3-847d-cf8b21b67985 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1314 microversion: 2.1 time: 0.472246 Jun 04 21:08:47.488329 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1908/3687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:47 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:47.494282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ca0c883-33ac-4d81-a486-efca9dda520d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:47.502513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ca0c883-33ac-4d81-a486-efca9dda520d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:47.503229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ca0c883-33ac-4d81-a486-efca9dda520d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:47.535059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:08:47.539627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ca0c883-33ac-4d81-a486-efca9dda520d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Going to try to start instance {{(pid=137228) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:08:47.622975 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ca0c883-33ac-4d81-a486-efca9dda520d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.129846 Jun 04 21:08:47.624462 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1909/3688] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:08:47 2022] POST /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:08:47.641487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e24f8dbe-e714-4357-af36-e3b3e0291d34 req-2c5cbfc2-189a-4a47-b4b4-d66d34d86ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ba73aa-fbc6-409e-927f-babb129b426f", "name": "network-vif-plugged", "status": "completed", "tag": "e80b5629-a1fb-4e80-9942-82c35b283706"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:47.668782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e24f8dbe-e714-4357-af36-e3b3e0291d34 req-2c5cbfc2-189a-4a47-b4b4-d66d34d86ca6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:47.672023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e24f8dbe-e714-4357-af36-e3b3e0291d34 req-2c5cbfc2-189a-4a47-b4b4-d66d34d86ca6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:47.733061 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e24f8dbe-e714-4357-af36-e3b3e0291d34 req-2c5cbfc2-189a-4a47-b4b4-d66d34d86ca6 service nova] Creating event network-vif-plugged:e80b5629-a1fb-4e80-9942-82c35b283706 for instance 06ba73aa-fbc6-409e-927f-babb129b426f on nch1-master-1 Jun 04 21:08:47.751597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e24f8dbe-e714-4357-af36-e3b3e0291d34 req-2c5cbfc2-189a-4a47-b4b4-d66d34d86ca6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119633 Jun 04 21:08:47.757185 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1910/3689] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:47.778715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:47.779451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:47.823995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:47.830939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:47.840408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:47.843496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.158216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:48.167983 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4d53e91f-7e52-4995-9e4e-0d09aa52197f tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "DELETE /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46" status: 204 len: 0 microversion: 2.1 time: 1.526860 Jun 04 21:08:48.169295 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1780/3690] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:46 2022] DELETE /compute/v2.1/images/573acf9b-bd3d-4a06-bb27-d992b508ca46 => generated 0 bytes in 1529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:08:48.178712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:48.179646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:48.186807 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8627e1a3-1e92-4aa8-a1cc-c8c203587a0a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.425359 Jun 04 21:08:48.190598 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1911/3691] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:47 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:48.203137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-63f160cb-1cbb-4c8e-b2b9-301bc03e00d4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '.version_select at 0x7f2d0266f0d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:48.210475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.213322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.216268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.216813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.256104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-63f160cb-1cbb-4c8e-b2b9-301bc03e00d4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] HTTP exception thrown: Image not found. Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-63f160cb-1cbb-4c8e-b2b9-301bc03e00d4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Request method failure captured: Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 HTTP/1.1 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8mM_Ql7apyGajeAcX8XPjIkYep_edPu2kwmlrhynl6n_y-ttwXBGluj9upgHWYOVWc0htRuwgKpy6qqstYMC0_DLkPl3XHrwyHrz2vDgYmde8UGgqqqtR8gM1QMXZ6gPkhN7cuSbxHccN2__ZLFkOuvL7t57Kw31iZU-mbmPy4AkCw Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2de85e590d5e45c9bca587e74b6689d6 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2de85e590d5e45c9bca587e74b6689d6 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerTestJSON-1016629484-project Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 465cff93c4244a4794784ad2885c02e7 Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerTestJSON-1016629484-project Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0cf81cea-b043-4576-b6c6-61d2a12df1a9'} Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0cf81cea-b043-4576-b6c6-61d2a12df1a9 to delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0cf81cea-b043-4576-b6c6-61d2a12df1a9 could not be found. Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.258580 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:08:48.265097 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:48.269766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-63f160cb-1cbb-4c8e-b2b9-301bc03e00d4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:48.269766 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-63f160cb-1cbb-4c8e-b2b9-301bc03e00d4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "DELETE /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9" status: 404 len: 62 microversion: 2.1 time: 0.076150 Jun 04 21:08:48.271759 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1912/3692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:48 2022] DELETE /compute/v2.1/images/0cf81cea-b043-4576-b6c6-61d2a12df1a9 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:08:48.286324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:48.287930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:48.311416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.317896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.320179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.321894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.404428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:08:48.555456 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b54fe6da-486d-4569-8f5d-b408b88514c4 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 204 len: 0 microversion: 2.1 time: 0.278160 Jun 04 21:08:48.556972 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1913/3693] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:08:48 2022] DELETE /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:08:48.568665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:48.569569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:48.599340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.600066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.601741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.602944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.769535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:48.783769 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-898edd11-7786-4ec0-8ef6-a1eeb93051df tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1661 microversion: 2.1 time: 0.609886 Jun 04 21:08:48.785146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1781/3694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:48 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1661 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:48.813484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:48.824076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:48.845276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.846444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:48.849627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:48.851413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:49.120424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:49.131621 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b3b5c9e0-6bcb-4196-85ab-ae432c3fe992 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1464 microversion: 2.1 time: 0.573115 Jun 04 21:08:49.133089 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1914/3695] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:48 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1464 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:49.151239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c836df33-8fb7-44c0-b929-30e858c8f700", "device": "/dev/sdb"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:49.153204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:49.160159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:49.160864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:49.161832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:49.162467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:49.181944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:49.195389 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d226e535-595a-470c-bf43-5a8eafaf539d tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1472 microversion: 2.1 time: 0.408873 Jun 04 21:08:49.198357 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1782/3696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:48 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1472 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:49.203790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:49.204723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:49.213600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:49.214615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:49.226088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:49.227805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:49.832163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:49.846763 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36e4b3f7-61dc-4cb6-8b08-ab9df35ea402 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1520 microversion: 2.1 time: 0.645432 Jun 04 21:08:49.849713 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1783/3697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:49 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1520 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:49.857179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-21b7d0ea-b4d2-42b2-8896-55e935663a18 req-8401c459-e470-4425-90d2-49268bfcce93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "name": "network-vif-unplugged", "status": "completed", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:49.885846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-21b7d0ea-b4d2-42b2-8896-55e935663a18 req-8401c459-e470-4425-90d2-49268bfcce93 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:49.888025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-21b7d0ea-b4d2-42b2-8896-55e935663a18 req-8401c459-e470-4425-90d2-49268bfcce93 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:49.927551 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-21b7d0ea-b4d2-42b2-8896-55e935663a18 req-8401c459-e470-4425-90d2-49268bfcce93 service nova] Creating event network-vif-unplugged:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:08:49.940196 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-21b7d0ea-b4d2-42b2-8896-55e935663a18 req-8401c459-e470-4425-90d2-49268bfcce93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088394 Jun 04 21:08:49.949613 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1784/3698] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:49.961198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:49.969950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:50.000212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:50.002075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:50.004137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:50.004753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:50.447720 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab50fdde-e2e5-4eda-a2c3-c2ae42a5a5c5 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "POST /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.293856 Jun 04 21:08:50.457942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1915/3699] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:08:49 2022] POST /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f/os-volume_attachments => generated 194 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:50.468367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:50.477361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:50.493627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:50.497292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:50.498391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:50.500039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:52.524740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:52.541863 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4bad6c10-cb23-4b74-bf79-c54530aaf4a6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1661 microversion: 2.1 time: 2.586594 Jun 04 21:08:52.543328 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1785/3700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:49 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1661 bytes in 2593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:52.557198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:52.560481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:52.582954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:52.585716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:52.586683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:52.586987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:52.827342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:52.835919 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7fdafd8c-c19b-4fb7-ba1f-4c5466fa45da tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1472 microversion: 2.1 time: 2.374820 Jun 04 21:08:52.847427 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1916/3701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:50 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1472 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:53.141488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:53.151498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b3f88635-9c39-466f-b013-af1ed3609cad tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1505 microversion: 2.1 time: 0.605180 Jun 04 21:08:53.153927 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1786/3702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:52 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:53.169596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:53.172112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:53.188837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.190367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.191658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.196650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.313948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-6bd08ffa-df90-4c11-9e6a-b006c270f34a req-0eee0e81-68d1-436d-9f4f-25f5701ece31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e4d7e-f3d3-4d80-a67d-b4dec2627556", "name": "network-vif-deleted", "tag": "279195a4-0eb0-42c9-be36-673f26f7a582"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:53.336443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6bd08ffa-df90-4c11-9e6a-b006c270f34a req-0eee0e81-68d1-436d-9f4f-25f5701ece31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.337590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6bd08ffa-df90-4c11-9e6a-b006c270f34a req-0eee0e81-68d1-436d-9f4f-25f5701ece31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.396192 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-6bd08ffa-df90-4c11-9e6a-b006c270f34a req-0eee0e81-68d1-436d-9f4f-25f5701ece31 service nova] Creating event network-vif-deleted:279195a4-0eb0-42c9-be36-673f26f7a582 for instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 on nch2-master-1 Jun 04 21:08:53.408322 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-6bd08ffa-df90-4c11-9e6a-b006c270f34a req-0eee0e81-68d1-436d-9f4f-25f5701ece31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099103 Jun 04 21:08:53.412358 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1787/3703] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:08:53.564571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:53.565660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:53.578495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.581683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.582870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.583610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.660936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:53.674819 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dfe4f106-3298-46c3-b210-9d92d212ca13 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 200 len: 1505 microversion: 2.1 time: 0.508273 Jun 04 21:08:53.678141 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1917/3704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:53 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:53.695246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:53.699161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:53.714792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.715981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.720065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:53.721883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:53.784899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:08:53.983850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b281dae7-5031-4291-a40c-62a49e217a41 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 204 len: 0 microversion: 2.1 time: 0.293202 Jun 04 21:08:53.985144 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1918/3705] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:08:53 2022] DELETE /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:08:53.992754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:53.995406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:54.007804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:54.008165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:54.033911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:54.040484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:54.169160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:54.172454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:54.173252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lazy-loading 'fault' on Instance uuid e63e4d7e-f3d3-4d80-a67d-b4dec2627556 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:08:54.326239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '465cff93c4244a4794784ad2885c02e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de85e590d5e45c9bca587e74b6689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:54.331127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:54.349553 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7f111625-6be2-47f2-ab51-807de08a8848 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1665 microversion: 2.1 time: 0.788942 Jun 04 21:08:54.352977 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1788/3706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:53 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1665 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:54.359811 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ea9b0024-43ba-485a-84ba-2b3075c9c516 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 200 len: 1307 microversion: 2.1 time: 0.369610 Jun 04 21:08:54.368174 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1919/3707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:53 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 1307 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:54.373621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-389893040", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "99e771a0-e10b-4b48-9a48-d9965a86dd4c"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:54.494004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] validate_networks() for [('99e771a0-e10b-4b48-9a48-d9965a86dd4c', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:08:55.392107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:55.392771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] [instance: e63e4d7e-f3d3-4d80-a67d-b4dec2627556] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:55.421502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:55.422792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:55.426772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:55.427563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:55.459830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] HTTP exception thrown: Instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 could not be found. Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Request method failure captured: Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 HTTP/1.1 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8mM_Ql7apyGajeAcX8XPjIkYep_edPu2kwmlrhynl6n_y-ttwXBGluj9upgHWYOVWc0htRuwgKpy6qqstYMC0_DLkPl3XHrwyHrz2vDgYmde8UGgqqqtR8gM1QMXZ6gPkhN7cuSbxHccN2__ZLFkOuvL7t57Kw31iZU-mbmPy4AkCw Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 2de85e590d5e45c9bca587e74b6689d6 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/2de85e590d5e45c9bca587e74b6689d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 2de85e590d5e45c9bca587e74b6689d6 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1016629484 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ImagesOneServerTestJSON-1016629484-project Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 465cff93c4244a4794784ad2885c02e7 Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ImagesOneServerTestJSON-1016629484-project Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 could not be found. Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e63e4d7e-f3d3-4d80-a67d-b4dec2627556'} Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 could not be found. Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 could not be found. Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:08:55.462961 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 could not be found. Jun 04 21:08:55.468834 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:08:55.472260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] Returning 404 to user: Instance e63e4d7e-f3d3-4d80-a67d-b4dec2627556 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:08:55.473455 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5463976e-563b-4a58-b51f-aea2e94e17e6 tempest-ImagesOneServerTestJSON-1016629484 tempest-ImagesOneServerTestJSON-1016629484-project] 10.222.0.18 "GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556" status: 404 len: 111 microversion: 2.1 time: 0.092047 Jun 04 21:08:55.478585 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1920/3708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:55 2022] GET /compute/v2.1/servers/e63e4d7e-f3d3-4d80-a67d-b4dec2627556 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:08:56.403276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:08:56.403822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:08:56.404227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:08:56.404641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:08:56.405064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:08:56.430083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:56.430525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:56.433463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:56.434619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:56.485812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Getting quotas for project 14f851d439ae4167af07518e3b1354ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:08:56.494518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Getting quotas for user ecdc2e5bf2e3492bb5320e054641ec3c and project 14f851d439ae4167af07518e3b1354ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:08:56.531215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:08:56.538894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:08:56.661383 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5d0a5e6-236c-4a78-9907-315080cc190b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.304451 Jun 04 21:08:56.663627 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1789/3709] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:08:56.674852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a743e9d-e3ab-429a-b04d-826125a78e39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:56.675486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a743e9d-e3ab-429a-b04d-826125a78e39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:57.082194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a743e9d-e3ab-429a-b04d-826125a78e39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:57.090316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a743e9d-e3ab-429a-b04d-826125a78e39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1217 microversion: 2.1 time: 0.421653 Jun 04 21:08:57.099948 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1921/3710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:56 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1217 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:57.578169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b5c02fdd-dd86-4502-baa5-b50af039361d req-7a20b152-e08e-4d06-8470-d94a51af130e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ba73aa-fbc6-409e-927f-babb129b426f", "name": "network-vif-deleted", "tag": "e80b5629-a1fb-4e80-9942-82c35b283706"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:08:57.622175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b5c02fdd-dd86-4502-baa5-b50af039361d req-7a20b152-e08e-4d06-8470-d94a51af130e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:57.623777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b5c02fdd-dd86-4502-baa5-b50af039361d req-7a20b152-e08e-4d06-8470-d94a51af130e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:57.682359 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b5c02fdd-dd86-4502-baa5-b50af039361d req-7a20b152-e08e-4d06-8470-d94a51af130e service nova] Creating event network-vif-deleted:e80b5629-a1fb-4e80-9942-82c35b283706 for instance 06ba73aa-fbc6-409e-927f-babb129b426f on nch1-master-1 Jun 04 21:08:57.700607 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b5c02fdd-dd86-4502-baa5-b50af039361d req-7a20b152-e08e-4d06-8470-d94a51af130e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129572 Jun 04 21:08:57.703375 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1790/3711] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:08:58.111456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:58.113450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:58.135100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:58.152475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:58.157948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:58.160257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:58.338979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:08:58.380890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0d7e6ffb-42de-41bf-8e6d-b3ce53b116ea tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1269 microversion: 2.1 time: 0.273374 Jun 04 21:08:58.381951 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1922/3712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:58 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1269 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:08:59.401399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:08:59.403024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:08:59.424634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:59.428527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:08:59.430665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:08:59.440648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:00.467814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:00.481868 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-61cee8f2-c340-4258-b57b-ab6fd8bbeead tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1317 microversion: 2.1 time: 1.083895 Jun 04 21:09:00.491403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1791/3713] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:08:59 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1317 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:00.700806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f2f0a36-af65-4454-856a-c40b60e380f8 tempest-ListImageFiltersNegativeTestJSON-568464604 tempest-ListImageFiltersNegativeTestJSON-568464604-project] Calling method '.version_select at 0x7f2d02611b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:00.735608 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8f2f0a36-af65-4454-856a-c40b60e380f8 tempest-ListImageFiltersNegativeTestJSON-568464604 tempest-ListImageFiltersNegativeTestJSON-568464604-project] HTTP exception thrown: Image not found. Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f2f0a36-af65-4454-856a-c40b60e380f8 tempest-ListImageFiltersNegativeTestJSON-568464604 tempest-ListImageFiltersNegativeTestJSON-568464604-project] Request method failure captured: Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/images/9cb742fd-ecc5-4205-94c9-e604ccc16ce3 HTTP/1.1 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8nsFHp8ID9M9a7Hv2Ohtz-cam9Jig0BVOJ2kcrME-7IMLnU70pag50tKjEHyixVBFJsouXKOxOHU2EiImTl8bVKh-aVeQnr-_dzjiKck87XDxeY_DXO0vCtzpM2hdAfy0pahtt79DUkY6Cq95H388DE1xZ3EeyAD24DcUCvxdy23h0 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4b3cf94cd6bb4d7c89a79a76127da15d Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-568464604 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4b3cf94cd6bb4d7c89a79a76127da15d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b3cf94cd6bb4d7c89a79a76127da15d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4b3cf94cd6bb4d7c89a79a76127da15d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4b3cf94cd6bb4d7c89a79a76127da15d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-568464604 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4b3cf94cd6bb4d7c89a79a76127da15d Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-568464604 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ListImageFiltersNegativeTestJSON-568464604-project Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 872847a42c134cdaaa854ec9dcd1fb2f Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-568464604-project Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: exception: Image not found. Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '9cb742fd-ecc5-4205-94c9-e604ccc16ce3'} Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9cb742fd-ecc5-4205-94c9-e604ccc16ce3 Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 04 21:09:00.738480 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9cb742fd-ecc5-4205-94c9-e604ccc16ce3 could not be found. Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f2f0a36-af65-4454-856a-c40b60e380f8 tempest-ListImageFiltersNegativeTestJSON-568464604 tempest-ListImageFiltersNegativeTestJSON-568464604-project] Returning 404 to user: Image not found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f2f0a36-af65-4454-856a-c40b60e380f8 tempest-ListImageFiltersNegativeTestJSON-568464604 tempest-ListImageFiltersNegativeTestJSON-568464604-project] 10.222.0.18 "GET /compute/v2.1/images/9cb742fd-ecc5-4205-94c9-e604ccc16ce3" status: 404 len: 62 microversion: 2.1 time: 0.391171 Jun 04 21:09:00.750164 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1923/3714] 10.222.0.18 () {58 vars in 1232 bytes} [Sat Jun 4 21:09:00 2022] GET /compute/v2.1/images/9cb742fd-ecc5-4205-94c9-e604ccc16ce3 => generated 62 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:09:01.501749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:01.502292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:01.520950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:01.521401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:01.522200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:01.522639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:01.605647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3096f533-f841-4e3e-83c6-f95bcca944be tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Action: 'create', calling method: .version_select at 0x7f2d0185f820>, body: {"keypair": {"name": "tempest-keypair-459859254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVcB2/tVZBRmdpJ4mF1HNPVXPtz1mqGj6Ctao58QA1tSioDiETwe8NT13o6a4dLPkjL51dQK2dy97WVhyWYyOAHZexA1itHUBmSv1NfkYT98Z3+UA+lhHSTJq9mncQ7xg=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:01.665925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-3096f533-f841-4e3e-83c6-f95bcca944be tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Getting quotas for project 3a41aa195bb047cfae9f16c5e29050cc. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:01.685791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-3096f533-f841-4e3e-83c6-f95bcca944be tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Getting quotas for user 33de20254305474aa55173591da1b6a6 and project 3a41aa195bb047cfae9f16c5e29050cc. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:01.777312 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3096f533-f841-4e3e-83c6-f95bcca944be tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.178800 Jun 04 21:09:01.778683 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1924/3715] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 21:09:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 04 21:09:01.783702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1b72e496-a16e-4faa-8511-05b06efccb78 req-5a757b87-266d-4c90-add1-bd685064fd47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9146e266-6fc5-4e35-b90c-c41b1e45d869", "tag": "126889b8-b81a-4945-9d18-feb97708cbfb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:01.816077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1b72e496-a16e-4faa-8511-05b06efccb78 req-5a757b87-266d-4c90-add1-bd685064fd47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:01.816532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1b72e496-a16e-4faa-8511-05b06efccb78 req-5a757b87-266d-4c90-add1-bd685064fd47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:01.819594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:01.841453 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1b72e496-a16e-4faa-8511-05b06efccb78 req-5a757b87-266d-4c90-add1-bd685064fd47 service nova] Creating event network-changed:126889b8-b81a-4945-9d18-feb97708cbfb for instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 on nch2-master-1 Jun 04 21:09:01.857989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1b72e496-a16e-4faa-8511-05b06efccb78 req-5a757b87-266d-4c90-add1-bd685064fd47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077774 Jun 04 21:09:01.866964 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1925/3716] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:02.249672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:02.268996 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4f234f9-7772-46d1-bc1e-d6f9a6bf8481 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1317 microversion: 2.1 time: 0.773571 Jun 04 21:09:02.275596 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1792/3717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:01 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:03.291384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:03.292129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:03.331797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:03.333313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:03.335207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:03.335914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:04.244575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:04.259934 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-25650cbb-0d83-4ea6-bebf-be06c95f4742 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1317 microversion: 2.1 time: 0.974381 Jun 04 21:09:04.261017 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1926/3718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:03 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1317 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:04.570807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-05a87711-53b3-4a49-88b9-16dadf92fdb4 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d00f02ca0>, body: {"keypair": {"name": "tempest-keypair-1538344035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZkg2G2YWu36OSj2doW4nBH/BiuIxyquOPjHDoVoN1dzZWBthowLNT12nQJcSM8Fu30UsiAxzBamWhevklQEAoTytm49m2hlJwANOzO4DGZNzDQJ7lVozdiP7QHaeZA7A=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:04.611758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-05a87711-53b3-4a49-88b9-16dadf92fdb4 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:04.651844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-05a87711-53b3-4a49-88b9-16dadf92fdb4 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:04.685242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-807292271", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "f4a0b90f-c1c2-4e50-bb51-ae131c03a5df"}, {"port": "c609dbe7-1ecc-4c38-8e4c-c41f8b766947", "tag": "port-1"}, {"port": "25e9d377-4b92-4a26-a908-1a149587b307", "tag": "port-2"}, {"uuid": "5f3bdc8f-104a-464b-b306-a02d09b2de36", "tag": "net-1"}, {"uuid": "5f3bdc8f-104a-464b-b306-a02d09b2de36"}, {"uuid": "c5d69f2e-7687-41d0-b10f-a8a7e4e63e8e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c5d69f2e-7687-41d0-b10f-a8a7e4e63e8e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0759769d-5fc7-469e-af57-4709d45e102f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "66176986-39c7-4e62-9130-71c9355b1a92", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d16e3dd4-cd03-43cd-b2b9-c804951744fa", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1431776633"}], "key_name": "tempest-keypair-459859254", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:04.725307 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-05a87711-53b3-4a49-88b9-16dadf92fdb4 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.381108 Jun 04 21:09:04.734871 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1793/3719] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:09:04.744918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44982153-3902-4faf-a87f-f293553a98ce tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d0be355e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:04.766597 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44982153-3902-4faf-a87f-f293553a98ce tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-1538344035" status: 200 len: 513 microversion: 2.2 time: 0.029819 Jun 04 21:09:04.768007 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1794/3720] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Jun 4 21:09:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1538344035 => generated 513 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:04.785307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aa284d5d-e7c6-4a03-ab91-2a18bf023c20 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d01874310>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:04.819925 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aa284d5d-e7c6-4a03-ab91-2a18bf023c20 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538344035" status: 204 len: 0 microversion: 2.2 time: 0.043045 Jun 04 21:09:04.829041 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1795/3721] 10.222.0.18 () {60 vars in 1260 bytes} [Sat Jun 4 21:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538344035 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:04.837584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24a3ea29-8b06-4706-b4c1-6ab58d184b08 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d019aad30>, body: {"keypair": {"name": "tempest-keypair-864434322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFaUjdqZHXHv+GiHMByTL+uO9qaHrSa//Ixsn0im4nNmFVk6duwM/3Dk4cqkHX8vgbuarJardhcB8BjuX/GC3F3pYKl68csaU3FFwKNMsmD0JupNYZyoh5BMLDouRdJXg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:04.855777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-24a3ea29-8b06-4706-b4c1-6ab58d184b08 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:04.862159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-24a3ea29-8b06-4706-b4c1-6ab58d184b08 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:04.893159 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-24a3ea29-8b06-4706-b4c1-6ab58d184b08 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.060925 Jun 04 21:09:04.900048 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1796/3722] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:09:04.907236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-495f5404-6121-45f9-8d3c-48b99f52b703 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d018a60d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:04.945374 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-495f5404-6121-45f9-8d3c-48b99f52b703 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864434322" status: 204 len: 0 microversion: 2.2 time: 0.042728 Jun 04 21:09:04.957812 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1797/3723] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Jun 4 21:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864434322 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:04.965457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14d8e9ae-9713-423c-a1f9-6a682e4bc21c tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d019fa4c0>, body: {"keypair": {"name": "tempest-keypair-1804751683", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:04.996875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] validate_networks() for [('f4a0b90f-c1c2-4e50-bb51-ae131c03a5df', None, None, None, None, None), (None, None, 'c609dbe7-1ecc-4c38-8e4c-c41f8b766947', None, None, None), (None, None, '25e9d377-4b92-4a26-a908-1a149587b307', None, None, None), ('5f3bdc8f-104a-464b-b306-a02d09b2de36', None, None, None, None, None), ('5f3bdc8f-104a-464b-b306-a02d09b2de36', None, None, None, None, None), ('c5d69f2e-7687-41d0-b10f-a8a7e4e63e8e', '10.2.2.100', None, None, None, None), ('c5d69f2e-7687-41d0-b10f-a8a7e4e63e8e', '10.2.2.200', None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:09:05.002135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-14d8e9ae-9713-423c-a1f9-6a682e4bc21c tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:05.010596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-14d8e9ae-9713-423c-a1f9-6a682e4bc21c tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:05.035224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:05.049087 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14d8e9ae-9713-423c-a1f9-6a682e4bc21c tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.089773 Jun 04 21:09:05.050476 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1798/3724] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:04 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:09:05.064412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9829b87e-55dc-4f3d-8d38-0fee1a3babfc tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d0277bb80>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:05.096192 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9829b87e-55dc-4f3d-8d38-0fee1a3babfc tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804751683" status: 204 len: 0 microversion: 2.2 time: 0.037509 Jun 04 21:09:05.097539 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1799/3725] 10.222.0.18 () {60 vars in 1260 bytes} [Sat Jun 4 21:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804751683 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:05.122466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d2711d6-585b-46b0-968b-ca592da0a935 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d019f6d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-133856144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW/6EkFK0UTI3hrkM3E1S57TVOcbrlYISnfnxwnrlHtFm0QmZ5Fws+zIFy/rB1u4a6mRbWERhJpSsfoV8zU6wybhIbx1ir7aX3lu9BsSFp2mRAqK6Yybo++1tfdCodUlQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:05.149405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9d2711d6-585b-46b0-968b-ca592da0a935 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:05.179884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9d2711d6-585b-46b0-968b-ca592da0a935 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:05.260347 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d2711d6-585b-46b0-968b-ca592da0a935 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.153756 Jun 04 21:09:05.261009 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1800/3726] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 04 21:09:05.283939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-39c72ae7-2a4c-45f8-95d4-8c525229fc8d tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d01a27d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1269921935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDw/eFyCI1H9Wtyw5QawYLwCYSv+Bp7U/DZpU9mgmDQYI9PzGip1Hd0f9cNiO9w/T/sTlUAf1i/UnUVvilHixgmRaF/qmw3ITQReGmf195+9zbZ3rr3OyGfSX4ZL2uxmsw=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:05.325576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-39c72ae7-2a4c-45f8-95d4-8c525229fc8d tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:05.338202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-39c72ae7-2a4c-45f8-95d4-8c525229fc8d tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:05.399603 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-39c72ae7-2a4c-45f8-95d4-8c525229fc8d tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.128703 Jun 04 21:09:05.400225 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1801/3727] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:09:05.410240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:05.410926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:05.425636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:05.426093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:05.426888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:05.427327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:05.934179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:05.947337 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-009e4058-5d6c-4d0e-ad91-c0c566965f71 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1317 microversion: 2.1 time: 0.544975 Jun 04 21:09:05.948346 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1802/3728] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:05 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1317 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:05.954544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e8e89f1-2a55-48fe-9681-837854e84178 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d02021ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-660682738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtVeqq4zd1OcR/fuk4/wLRhgpWW0lxIa0N2yPL3IJ6IqcoiwuADdEP6v6RdDofAkwO++qh13DRJBNZZWYkq3uXpVMDhYEv3wt+jxYwdp4xzvcPTLlugzSqc1KtA1iUrRA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:05.971182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7e8e89f1-2a55-48fe-9681-837854e84178 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:05.979759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7e8e89f1-2a55-48fe-9681-837854e84178 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:06.013481 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7e8e89f1-2a55-48fe-9681-837854e84178 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.063731 Jun 04 21:09:06.014467 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1803/3729] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:05 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:09:06.030545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb04d0c2-d745-49f8-90de-dee94b8bebd9 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d019f64c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.033555 ncdv-master-1 devstack@n-api.service[137229]: WARNING oslo_db.sqlalchemy.utils [None req-eb04d0c2-d745-49f8-90de-dee94b8bebd9 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 04 21:09:06.056881 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb04d0c2-d745-49f8-90de-dee94b8bebd9 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.033619 Jun 04 21:09:06.060862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1804/3730] 10.222.0.18 () {60 vars in 1176 bytes} [Sat Jun 4 21:09:06 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:06.071301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6e133b3-c366-4c40-8186-9ae1a99f2376 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d019e9940>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.103877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6e133b3-c366-4c40-8186-9ae1a99f2376 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-660682738" status: 204 len: 0 microversion: 2.2 time: 0.036866 Jun 04 21:09:06.105430 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1805/3731] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Jun 4 21:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-660682738 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:09:06.114701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad6e6975-51e1-4866-96e4-f63c80cc6ab1 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d01a23d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.165189 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ad6e6975-51e1-4866-96e4-f63c80cc6ab1 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1269921935" status: 204 len: 0 microversion: 2.2 time: 0.055146 Jun 04 21:09:06.169369 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1806/3732] 10.222.0.18 () {60 vars in 1320 bytes} [Sat Jun 4 21:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1269921935 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:06.175877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ec1a9af9-0982-4844-94df-f52e6e874ba6 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d019fa5e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.221037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ec1a9af9-0982-4844-94df-f52e6e874ba6 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-133856144" status: 204 len: 0 microversion: 2.2 time: 0.050130 Jun 04 21:09:06.228614 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1807/3733] 10.222.0.18 () {60 vars in 1317 bytes} [Sat Jun 4 21:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-133856144 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:06.235923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fcc7d274-d901-4fc7-bcba-1c42bf98b3df tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d00f02040>, body: {"keypair": {"name": "tempest-keypair-793555312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1uWOFbSb2MCbu3npuMeFj6pT+2S/LOT2C9Ytbjr5nj7bqNfmlJKHY9aGR9XnR7Vc/FZ9vhG4udsECYa0kDhLJVlXuGxhd8NpzlUA4UxV3E28NYX/JVYuKMIpwdEVfxTQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:06.303500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fcc7d274-d901-4fc7-bcba-1c42bf98b3df tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:06.309450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fcc7d274-d901-4fc7-bcba-1c42bf98b3df tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:06.344080 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fcc7d274-d901-4fc7-bcba-1c42bf98b3df tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.113176 Jun 04 21:09:06.345441 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1808/3734] 10.222.0.18 () {62 vars in 1198 bytes} [Sat Jun 4 21:09:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:09:06.363406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75cf1c29-a013-4d25-9213-e595e1d7db06 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d019f64c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.372993 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75cf1c29-a013-4d25-9213-e595e1d7db06 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-793555312" status: 200 len: 512 microversion: 2.2 time: 0.021650 Jun 04 21:09:06.374273 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1809/3735] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Jun 4 21:09:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-793555312 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:06.394131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9468da02-6558-4c88-bb47-eed262b74387 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d018064c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.402885 ncdv-master-1 devstack@n-api.service[137229]: WARNING oslo_db.sqlalchemy.utils [None req-9468da02-6558-4c88-bb47-eed262b74387 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 04 21:09:06.416713 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9468da02-6558-4c88-bb47-eed262b74387 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.031642 Jun 04 21:09:06.418224 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1810/3736] 10.222.0.18 () {60 vars in 1176 bytes} [Sat Jun 4 21:09:06 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:06.430724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c29e3d4b-2c33-46db-b85f-7086f5c234aa tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d01874550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:06.457597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:06.467772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c29e3d4b-2c33-46db-b85f-7086f5c234aa tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-793555312" status: 204 len: 0 microversion: 2.2 time: 0.042803 Jun 04 21:09:06.470209 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1811/3737] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Jun 4 21:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-793555312 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:06.482282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Action: 'create', calling method: .version_select at 0x7f2d0bd28550>, body: {"keypair": {"name": "tempest-keypair-136672554", "type": "x509"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:06.505145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:06.514246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:06.544932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.processutils [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmps_fwvits/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps_fwvits/temp.key -subj /CN=e1865685fa174c9a8a06af94099ca5d0 -extensions v3_req_client {{(pid=137229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:07.569172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.processutils [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmps_fwvits/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps_fwvits/temp.key -subj /CN=e1865685fa174c9a8a06af94099ca5d0 -extensions v3_req_client" returned: 0 in 1.025s {{(pid=137229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:07.572524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.processutils [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmps_fwvits/temp.key -password pass: {{(pid=137229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 04 21:09:07.628198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.processutils [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] CMD "openssl pkcs12 -export -inkey /tmp/tmps_fwvits/temp.key -password pass:" returned: 0 in 0.057s {{(pid=137229) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 04 21:09:07.735094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:07.758411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Getting quotas for user e1865685fa174c9a8a06af94099ca5d0 and project 727bfb4a2c5e449881b2e666725b41b1. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:07.806999 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0728cca8-036f-4ea4-8f5e-65045b9b36ff tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.329215 Jun 04 21:09:07.811128 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1812/3738] 10.222.0.18 () {62 vars in 1197 bytes} [Sat Jun 4 21:09:06 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1335 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:07.828051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:07.829603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:07.839171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:07.853671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:07.854443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:07.856595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:07.860474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:08.264343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:08.276508 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eca7812a-0619-4caa-9842-a2717bfbe56e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1317 microversion: 2.1 time: 0.463354 Jun 04 21:09:08.284862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1813/3739] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:07 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:08.295677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1bc36028-e0d4-4b14-879f-022d6264d876 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d019fa160>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:08.306580 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1bc36028-e0d4-4b14-879f-022d6264d876 tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs/tempest-keypair-136672554" status: 200 len: 1533 microversion: 2.2 time: 0.020336 Jun 04 21:09:08.307377 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1814/3740] 10.222.0.18 () {60 vars in 1254 bytes} [Sat Jun 4 21:09:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-136672554 => generated 1533 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:08.321302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b71b380-7c86-43cc-a5fa-7b54fcfea4ca tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d01a27c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:08.323728 ncdv-master-1 devstack@n-api.service[137229]: WARNING oslo_db.sqlalchemy.utils [None req-6b71b380-7c86-43cc-a5fa-7b54fcfea4ca tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 04 21:09:08.329937 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b71b380-7c86-43cc-a5fa-7b54fcfea4ca tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.012992 Jun 04 21:09:08.335631 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1815/3741] 10.222.0.18 () {60 vars in 1176 bytes} [Sat Jun 4 21:09:08 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:08.341263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6de9bd0b-aed8-42f0-86e6-816704c63a3f tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] Calling method '.version_select at 0x7f2d015c6c10>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:08.377577 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6de9bd0b-aed8-42f0-86e6-816704c63a3f tempest-KeyPairsV22TestJSON-1853251660 tempest-KeyPairsV22TestJSON-1853251660-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136672554" status: 204 len: 0 microversion: 2.2 time: 0.040587 Jun 04 21:09:08.379045 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1816/3742] 10.222.0.18 () {60 vars in 1257 bytes} [Sat Jun 4 21:09:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136672554 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:09.061371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-15dbac17-3e8e-4fbe-8d29-305c8d44f3ab req-7273e81a-cbc4-460c-8e63-a6d9539a286d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9146e266-6fc5-4e35-b90c-c41b1e45d869", "name": "network-vif-plugged", "status": "completed", "tag": "126889b8-b81a-4945-9d18-feb97708cbfb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:09.085816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-15dbac17-3e8e-4fbe-8d29-305c8d44f3ab req-7273e81a-cbc4-460c-8e63-a6d9539a286d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:09.086668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-15dbac17-3e8e-4fbe-8d29-305c8d44f3ab req-7273e81a-cbc4-460c-8e63-a6d9539a286d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:09.115152 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-15dbac17-3e8e-4fbe-8d29-305c8d44f3ab req-7273e81a-cbc4-460c-8e63-a6d9539a286d service nova] Creating event network-vif-plugged:126889b8-b81a-4945-9d18-feb97708cbfb for instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 on nch2-master-1 Jun 04 21:09:09.130834 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-15dbac17-3e8e-4fbe-8d29-305c8d44f3ab req-7273e81a-cbc4-460c-8e63-a6d9539a286d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074567 Jun 04 21:09:09.134720 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1817/3743] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:09:09.302541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:09.303709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:09.317589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:09.318236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:09.319601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:09.324628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:09.925667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:09.935913 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d5520b11-2720-4d87-beb7-27b1ee9c94e2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1317 microversion: 2.1 time: 0.638316 Jun 04 21:09:09.940225 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1818/3744] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:09 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:09.963095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:09:09.963576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:09:09.963999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:09:09.964416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:09:09.964829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:09:09.969457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:09.989287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:09.989747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:09.990646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:09.990976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:10.014482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Getting quotas for project 3a41aa195bb047cfae9f16c5e29050cc. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:10.024221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Getting quotas for user 33de20254305474aa55173591da1b6a6 and project 3a41aa195bb047cfae9f16c5e29050cc. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:10.263315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:09:10.266658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0759769d-5fc7-469e-af57-4709d45e102f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='66176986-39c7-4e62-9130-71c9355b1a92',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d16e3dd4-cd03-43cd-b2b9-c804951744fa',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:09:10.822033 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e608b05-b3d5-41f2-bdbf-ad7508a4e64a tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 6.144485 Jun 04 21:09:10.829376 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1927/3745] 10.222.0.18 () {62 vars in 1188 bytes} [Sat Jun 4 21:09:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 6153 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:09:10.834424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-70f5c254-6fba-4dd9-b4ed-5cbf0f951037 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:10.835754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-70f5c254-6fba-4dd9-b4ed-5cbf0f951037 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:10.924259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-70f5c254-6fba-4dd9-b4ed-5cbf0f951037 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:10.934890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-70f5c254-6fba-4dd9-b4ed-5cbf0f951037 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:10.937944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-70f5c254-6fba-4dd9-b4ed-5cbf0f951037 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:10.939620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-70f5c254-6fba-4dd9-b4ed-5cbf0f951037 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1284 microversion: 2.42 time: 0.109155 Jun 04 21:09:10.940475 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1819/3746] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:10 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:09:10.958239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:10.960094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:10.969204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:10.970323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:10.971441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:10.972908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:11.183230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:11.196800 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ba967ad-8706-413c-9373-de53efadd23c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1507 microversion: 2.1 time: 0.242470 Jun 04 21:09:11.197932 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1928/3747] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:10 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:11.213053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:11.213672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:11.229086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:11.230215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:11.231193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:11.231833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:11.239676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:11.694786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:11.713076 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e2a5fc5-634c-4f89-920b-5bdb6289fe95 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1507 microversion: 2.1 time: 0.502615 Jun 04 21:09:11.714469 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1820/3748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:11 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1507 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:11.744218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:11.745967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:11.760139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:11.764263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:11.769351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:11.770136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:11.924020 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-31807f77-0cb7-4111-b721-1e3cf785e5f6 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "PUT /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1079 microversion: 2.1 time: 0.184600 Jun 04 21:09:11.939071 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1929/3749] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:09:11 2022] PUT /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1079 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:11.947053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:11.949164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:11.961342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1035d974-027b-44bd-af14-26b4605c7d9c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:11.962415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1035d974-027b-44bd-af14-26b4605c7d9c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:11.973674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:11.974139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:11.974959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:11.979297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:12.165618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1035d974-027b-44bd-af14-26b4605c7d9c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:12.184750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1035d974-027b-44bd-af14-26b4605c7d9c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:12.197107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1035d974-027b-44bd-af14-26b4605c7d9c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:12.203799 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1035d974-027b-44bd-af14-26b4605c7d9c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1284 microversion: 2.42 time: 0.249286 Jun 04 21:09:12.207524 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1930/3750] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:11 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1284 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:12.829950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:12.830465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:12.857404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:12.857865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:12.858675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:12.859124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:13.006761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lazy-loading 'services' on Instance uuid 30877e8d-36a0-405d-8df2-04785754249f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:09:13.170039 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aba43da5-b381-4a8b-b02a-efd3ab790b76 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "DELETE /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f/os-volume_attachments/c836df33-8fb7-44c0-b929-30e858c8f700" status: 202 len: 0 microversion: 2.1 time: 0.343924 Jun 04 21:09:13.170796 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1931/3751] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:09:12 2022] DELETE /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f/os-volume_attachments/c836df33-8fb7-44c0-b929-30e858c8f700 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:09:13.224179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:13.227058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:13.227870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:13.236788 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b40d7cee-a35e-4785-a005-2c88a108751f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1505 microversion: 2.1 time: 1.299272 Jun 04 21:09:13.247397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:13.248207 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1821/3752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:11 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1505 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:13.248494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:13.250427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:13.251171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:13.259087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:13.259778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:13.276139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:13.278003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:13.283549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:13.284333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:13.482523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:13.497324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:13.499279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:13.500757 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be9c2049-42ad-42e5-96ac-ba81b581638e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1574 microversion: 2.42 time: 0.278355 Jun 04 21:09:13.504616 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1932/3753] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:13 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1574 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:09:13.852443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:13.875377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-417f949a-b766-4760-8105-e04351c6a499 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1505 microversion: 2.1 time: 0.625883 Jun 04 21:09:13.876249 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1822/3754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:13 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:13.894790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:13.897506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:13.922900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:13.923624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:13.938155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:13.938546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.099988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:09:14.100835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:09:14.101723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:09:14.102363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:09:14.102930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:09:14.226197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:14.237904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.239318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.240986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.241769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.285267 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae922a8f-57b2-4817-9cb0-5512df23fa19 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "POST /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869/action" status: 202 len: 1111 microversion: 2.1 time: 0.395610 Jun 04 21:09:14.287267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1933/3755] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:09:13 2022] POST /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869/action => generated 1111 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 04 21:09:14.303044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:14.312338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:14.325675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.326596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.327958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.328670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.423129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:14.423673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:14.437401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.437851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.438855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.439469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.498756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:09:14.716260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-767b71cb-2de9-4689-846e-afe58c529c99 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "DELETE /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 204 len: 0 microversion: 2.1 time: 0.296869 Jun 04 21:09:14.717195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1934/3756] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:09:14 2022] DELETE /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:09:14.730722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:14.731763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:14.740216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.740881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.741687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.742128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.895254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:14.909357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da70e7c9-3603-46e4-ab1d-00be7bbba512 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.610450 Jun 04 21:09:14.910393 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1823/3757] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:14 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:14.922048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:14.923338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:14.942520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.942920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:14.943987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:14.949107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:15.029603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:15.046970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:15.052553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:15.053958 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-346f9efe-f356-4293-9bab-1afed72e6507 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1592 microversion: 2.42 time: 0.335223 Jun 04 21:09:15.058556 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1935/3758] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:14 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1592 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:15.583332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:15.601252 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77adc5f9-0031-4543-8109-b93d76322c26 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1470 microversion: 2.1 time: 0.687351 Jun 04 21:09:15.602471 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1824/3759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:14 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1470 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:15.943309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:15.947456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:15.980387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:15.982221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:15.988840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:15.991992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:16.325991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a62f09f-896f-4a76-bc82-6c881b34f9e7 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d01874280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1800389236", "description": "tempest-description-1945339974"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:16.523129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:16.542260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5afa0308-847e-47e2-890a-5f7c5270bb72 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.617049 Jun 04 21:09:16.543161 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1936/3760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:15 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:16.549221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:16.550052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:16.577933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:16.578384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:16.579173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:16.582384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:16.776983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:16.784528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a62f09f-896f-4a76-bc82-6c881b34f9e7 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.733051 Jun 04 21:09:16.785253 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1825/3761] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:09:16 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:16.790894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:16.794039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:16.815545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:16.820017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:16.820574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:16.821443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:16.823313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:16.824446 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a2893f4b-f302-4228-aec9-206038a0c484 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1592 microversion: 2.42 time: 0.280212 Jun 04 21:09:16.826089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:16.829952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1937/3762] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:16 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1592 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:16.837379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5e73193-576b-4af3-8992-aafb5a6d1979 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d02451dc0>, body: {"security_group_rule": {"parent_group_id": "be94da4f-7f8b-4a09-afa3-ff2889fec1cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:17.232236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14f03605fadb4a819444a497e7a2805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78708ead8abd482bab61be479bae7912', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:17.243367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7bb076b-fba7-4728-bf0a-58d11fa29ac0 tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 200 len: 1470 microversion: 2.1 time: 0.456694 Jun 04 21:09:17.259940 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1826/3763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:16 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 1470 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:17.530025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-f32d337d-d777-493f-9bdc-65d5ff3fb132 req-0f5798ea-b483-41a7-ae88-64bb5489d9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30877e8d-36a0-405d-8df2-04785754249f", "name": "network-vif-deleted", "tag": "e897aa0f-d284-4e0e-99ec-7aefe50c9eed"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:17.552933 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5e73193-576b-4af3-8992-aafb5a6d1979 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.721486 Jun 04 21:09:17.554207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f32d337d-d777-493f-9bdc-65d5ff3fb132 req-0f5798ea-b483-41a7-ae88-64bb5489d9d0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:17.555184 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1938/3764] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:17.555884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f32d337d-d777-493f-9bdc-65d5ff3fb132 req-0f5798ea-b483-41a7-ae88-64bb5489d9d0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:17.561943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:17.563245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:17.573896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:17.574393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:17.575925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:17.576396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:17.576690 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-f32d337d-d777-493f-9bdc-65d5ff3fb132 req-0f5798ea-b483-41a7-ae88-64bb5489d9d0 service nova] Creating event network-vif-deleted:e897aa0f-d284-4e0e-99ec-7aefe50c9eed for instance 30877e8d-36a0-405d-8df2-04785754249f on nch2-master-1 Jun 04 21:09:17.584381 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-f32d337d-d777-493f-9bdc-65d5ff3fb132 req-0f5798ea-b483-41a7-ae88-64bb5489d9d0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058321 Jun 04 21:09:17.586636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1827/3765] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:17.594337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90431a05-daf5-4c9a-a4c4-c57206d3fef1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d01a23e50>, body: {"security_group_rule": {"parent_group_id": "be94da4f-7f8b-4a09-afa3-ff2889fec1cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:17.708434 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-90431a05-daf5-4c9a-a4c4-c57206d3fef1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: This rule already exists in group be94da4f-7f8b-4a09-afa3-ff2889fec1cd Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90431a05-daf5-4c9a-a4c4-c57206d3fef1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 138 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: {"security_group_rule": {"parent_group_id": "be94da4f-7f8b-4a09-afa3-ff2889fec1cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: exception: This rule already exists in group be94da4f-7f8b-4a09-afa3-ff2889fec1cd Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'be94da4f-7f8b-4a09-afa3-ff2889fec1cd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group be94da4f-7f8b-4a09-afa3-ff2889fec1cd Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group be94da4f-7f8b-4a09-afa3-ff2889fec1cd Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:17.710234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group be94da4f-7f8b-4a09-afa3-ff2889fec1cd Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90431a05-daf5-4c9a-a4c4-c57206d3fef1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 400 to user: This rule already exists in group be94da4f-7f8b-4a09-afa3-ff2889fec1cd {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90431a05-daf5-4c9a-a4c4-c57206d3fef1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.123774 Jun 04 21:09:17.717033 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1828/3766] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:17 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:09:17.720821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7139926-351e-4a23-8cee-9c4191709e73 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d01a35670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:17.870753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:17.879232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-015b0c30-40cb-4703-a0c7-e3da82d270c1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.322857 Jun 04 21:09:17.884470 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1939/3767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:17 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:17.890416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:17.891572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:17.904928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:17.913421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:17.914815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:17.915527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:17.998116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:18.147406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7139926-351e-4a23-8cee-9c4191709e73 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/c8cef72d-6385-4fad-810b-67e99f29da25" status: 202 len: 0 microversion: 2.1 time: 0.430193 Jun 04 21:09:18.148571 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1829/3768] 10.222.0.18 () {58 vars in 1286 bytes} [Sat Jun 4 21:09:17 2022] DELETE /compute/v2.1/os-security-group-rules/c8cef72d-6385-4fad-810b-67e99f29da25 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:09:18.161441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19c46b1a-afef-4b66-ba95-dc4f6f2ab7e1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d01a35ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-110889160", "description": "tempest-description-1308078737"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:18.408008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:18.417421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:18.418923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:18.420116 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5909b25e-d0f2-4c06-abb0-f1ceadaa7a1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1660 microversion: 2.42 time: 0.534450 Jun 04 21:09:18.420700 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1940/3769] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:17 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1660 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:18.450945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:18.465909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] [instance: 30877e8d-36a0-405d-8df2-04785754249f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:18.482970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:18.483425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:18.484248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:18.484693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:18.521137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] HTTP exception thrown: Instance 30877e8d-36a0-405d-8df2-04785754249f could not be found. Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Request method failure captured: Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f HTTP/1.1 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8m-z1GxZHTAu84uJfSSMO-CQFgbiX_kPhFyrCrOmTf3qTjK1-qEPehQzDpyVsM81gGNEPt0G1FkGkV3bmbUPwUZBfxNuMsILhgbXj3Q4Fe8gWvb597KL_uhqDWBTS6PF6cnSj6FjjCKbeM1fcbOMAXlorfUnIkiAih4Brb01XG6jDo Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 78708ead8abd482bab61be479bae7912 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesBackupsTest-1343716541 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_78708ead8abd482bab61be479bae7912"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78708ead8abd482bab61be479bae7912"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/78708ead8abd482bab61be479bae7912"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/78708ead8abd482bab61be479bae7912"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesBackupsTest-1343716541 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 78708ead8abd482bab61be479bae7912 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesBackupsTest-1343716541 Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesBackupsTest-1343716541-project Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 14f03605fadb4a819444a497e7a2805f Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesBackupsTest-1343716541-project Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 30877e8d-36a0-405d-8df2-04785754249f could not be found. Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '30877e8d-36a0-405d-8df2-04785754249f'} Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30877e8d-36a0-405d-8df2-04785754249f could not be found. Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30877e8d-36a0-405d-8df2-04785754249f could not be found. Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:18.524274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30877e8d-36a0-405d-8df2-04785754249f could not be found. Jun 04 21:09:18.533972 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.540313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] Returning 404 to user: Instance 30877e8d-36a0-405d-8df2-04785754249f could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:18.541788 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-57d86f04-ed3f-490f-93d7-31244a1957ea tempest-VolumesBackupsTest-1343716541 tempest-VolumesBackupsTest-1343716541-project] 10.222.0.18 "GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f" status: 404 len: 111 microversion: 2.1 time: 0.095051 Jun 04 21:09:18.543614 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1941/3770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:18 2022] GET /compute/v2.1/servers/30877e8d-36a0-405d-8df2-04785754249f => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:18.693706 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19c46b1a-afef-4b66-ba95-dc4f6f2ab7e1 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.536832 Jun 04 21:09:18.694403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1830/3771] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:09:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:18.707965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a2433ef-0080-4f30-943d-1c8369603263 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d019bfdc0>, body: {"security_group_rule": {"parent_group_id": "71c5d5a1-dd26-48a2-b3e1-0523e6388c3d", "ip_protocol": "tcp", "from_port": 143307906, "to_port": 22}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:18.875833 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8a2433ef-0080-4f30-943d-1c8369603263 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Invalid port range 143307906:22. Former value cannot be greater than the later Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a2433ef-0080-4f30-943d-1c8369603263 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 145 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: {"security_group_rule": {"parent_group_id": "71c5d5a1-dd26-48a2-b3e1-0523e6388c3d", "ip_protocol": "tcp", "from_port": 143307906, "to_port": 22}} Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid port range 143307906:22. Former value cannot be greater than the later Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'security_group_rule': {'parent_group_id': '71c5d5a1-dd26-48a2-b3e1-0523e6388c3d', 'ip_protocol': 'tcp', 'from_port': 143307906, 'to_port': 22}}} Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 143307906:22. Former value cannot be greater than the later Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 143307906:22. Former value cannot be greater than the later Jun 04 21:09:18.881319 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 143307906:22. Former value cannot be greater than the later Jun 04 21:09:18.887641 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.889189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a2433ef-0080-4f30-943d-1c8369603263 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 400 to user: Invalid port range 143307906:22. Former value cannot be greater than the later {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:18.893375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a2433ef-0080-4f30-943d-1c8369603263 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.190498 Jun 04 21:09:18.901761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:18.903043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:18.907543 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1942/3772] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:18 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 04 21:09:18.915135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e811ed8-0c39-4fcf-8cc7-066d43d22de9 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d024519d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1232000481", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:18.925497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:18.926652 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4e811ed8-0c39-4fcf-8cc7-066d43d22de9 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Security group id should be uuid Jun 04 21:09:18.927350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:18.930225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e811ed8-0c39-4fcf-8cc7-066d43d22de9 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 131 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1232000481", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group id should be uuid Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1232000481', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:18.949033 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:18.954234 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 04 21:09:18.954234 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:18.954422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:18.954561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e811ed8-0c39-4fcf-8cc7-066d43d22de9 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 400 to user: Security group id should be uuid {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:18.955879 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e811ed8-0c39-4fcf-8cc7-066d43d22de9 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.044995 Jun 04 21:09:18.965397 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1943/3773] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:18 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:18.991341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bbf1f60-fc9d-4b75-95b0-1d3d979ead27 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d018698b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-790392067", "description": "tempest-description-1260482507"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:19.734049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:19.750585 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-27f88011-1048-40d8-b801-6e7f83346d4f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.853708 Jun 04 21:09:19.751979 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1831/3774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:18 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:19.762453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:19.764805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:19.776825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:19.777758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:19.779009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:19.779943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:20.006204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:20.195590 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bbf1f60-fc9d-4b75-95b0-1d3d979ead27 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.227891 Jun 04 21:09:20.199291 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1944/3775] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:09:18 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:20.207918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f21520c4-6497-4666-bdb7-2bf8320482ab tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d020fef70>, body: {"security_group_rule": {"parent_group_id": "1acde4dd-5766-43c2-8595-e997f3694b68", "ip_protocol": "tempest-999-56031502", "from_port": 22, "to_port": 22}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:20.288759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:20.308178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f21520c4-6497-4666-bdb7-2bf8320482ab tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Invalid IP protocol tempest-999-56031502. Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f21520c4-6497-4666-bdb7-2bf8320482ab tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 155 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: {"security_group_rule": {"parent_group_id": "1acde4dd-5766-43c2-8595-e997f3694b68", "ip_protocol": "tempest-999-56031502", "from_port": 22, "to_port": 22}} Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid IP protocol tempest-999-56031502. Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1acde4dd-5766-43c2-8595-e997f3694b68', 'ip_protocol': 'tempest-999-56031502', 'from_port': 22, 'to_port': 22}}} Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-56031502. Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-56031502. Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.314239 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-56031502. Jun 04 21:09:20.321119 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.322051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:20.322262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f21520c4-6497-4666-bdb7-2bf8320482ab tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 400 to user: Invalid IP protocol tempest-999-56031502. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:20.324285 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f21520c4-6497-4666-bdb7-2bf8320482ab tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.119789 Jun 04 21:09:20.324546 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1945/3776] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:20 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 04 21:09:20.329156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:20.329156 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d680c7bb-7502-4ede-9f49-94a88276e2ed tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1707 microversion: 2.42 time: 0.575520 Jun 04 21:09:20.344354 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1832/3777] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:19 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1707 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:20.346500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-80d3284d-5ca7-4f73-abff-56f1b817a5b4 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d023255e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-902709211", "description": "tempest-description-1244298536"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:20.555628 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-80d3284d-5ca7-4f73-abff-56f1b817a5b4 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.225234 Jun 04 21:09:20.571224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f97f985-e084-49b2-9916-6ed0416516a8 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d01a351f0>, body: {"security_group_rule": {"parent_group_id": "9c22c091-c6b7-4c86-9bf0-9cefa5ebfd4e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:20.571875 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1946/3778] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:09:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:20.639607 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-6f97f985-e084-49b2-9916-6ed0416516a8 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f97f985-e084-49b2-9916-6ed0416516a8 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 138 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: {"security_group_rule": {"parent_group_id": "9c22c091-c6b7-4c86-9bf0-9cefa5ebfd4e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9c22c091-c6b7-4c86-9bf0-9cefa5ebfd4e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 04 21:09:20.642522 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6f97f985-e084-49b2-9916-6ed0416516a8 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:20.648685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6f97f985-e084-49b2-9916-6ed0416516a8 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.078406 Jun 04 21:09:20.649639 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1833/3779] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:20 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 83 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:09:20.657069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-575d3af4-76f3-4d15-a6d6-b082ae2578f6 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d02325280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-222555513", "description": "tempest-description-295692388"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:20.771258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:20.772004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:20.782916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:20.783837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:20.784830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:20.785270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:20.932852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=44 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:20.982366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-575d3af4-76f3-4d15-a6d6-b082ae2578f6 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.328182 Jun 04 21:09:20.983470 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1947/3780] 10.222.0.18 () {60 vars in 1179 bytes} [Sat Jun 4 21:09:20 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:21.003217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-284f7dc8-44dd-497f-a550-fda5e3bb91ec tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d020fe820>, body: {"security_group_rule": {"parent_group_id": "70a801e2-75f7-4fec-85b8-cf7c903be1ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 1793869813}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:21.116864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:21.125339 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c0719e24-92b8-4d76-aa4c-b21f0afbbb3b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.360599 Jun 04 21:09:21.135687 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1834/3781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:20 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:21.159764 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-284f7dc8-44dd-497f-a550-fda5e3bb91ec tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Invalid port range 22:1793869813. Valid TCP ports should be between 1-65535 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-284f7dc8-44dd-497f-a550-fda5e3bb91ec tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 146 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: {"security_group_rule": {"parent_group_id": "70a801e2-75f7-4fec-85b8-cf7c903be1ee", "ip_protocol": "tcp", "from_port": 22, "to_port": 1793869813}} Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid port range 22:1793869813. Valid TCP ports should be between 1-65535 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'security_group_rule': {'parent_group_id': '70a801e2-75f7-4fec-85b8-cf7c903be1ee', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1793869813}}} Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1793869813. Valid TCP ports should be between 1-65535 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1793869813. Valid TCP ports should be between 1-65535 Jun 04 21:09:21.161372 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1793869813. Valid TCP ports should be between 1-65535 Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-284f7dc8-44dd-497f-a550-fda5e3bb91ec tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 400 to user: Invalid port range 22:1793869813. Valid TCP ports should be between 1-65535 {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-284f7dc8-44dd-497f-a550-fda5e3bb91ec tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.170331 Jun 04 21:09:21.167318 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1948/3782] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:20 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:09:21.196075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Action: 'create', calling method: .version_select at 0x7f2d0bd28820>, body: {"security_group_rule": {"parent_group_id": "4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:21.255602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG neutronclient.v2_0.client [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist", "detail": ""}} {{(pid=137229) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:09:21.256921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.security_group_api [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Neutron security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 not found {{(pid=137229) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 04 21:09:21.258283 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.258283 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 138 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: {"security_group_rule": {"parent_group_id": "4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: exception: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:09:21.262351 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 404 to user: Security group 4fd73fa0-eb7d-4f5e-9e99-c4bc1d26b199 does not exist Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: Neutron server returns request_ids: ['req-d8ea309d-43d6-4732-9c27-17d419b4c245'] {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:21.268981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0300c771-781f-483c-874f-5ca7297b9c48 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.081151 Jun 04 21:09:21.279753 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1835/3783] 10.222.0.18 () {60 vars in 1194 bytes} [Sat Jun 4 21:09:21 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:21.279913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d01a6b9d0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:21.322668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG neutronclient.v2_0.client [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist", "detail": ""}} {{(pid=137228) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 04 21:09:21.324430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.security_group_api [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Neutron security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 not found {{(pid=137228) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 04 21:09:21.325750 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] HTTP exception thrown: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.325750 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Request method failure captured: Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-security-group-rules/834cb05c-c795-496f-a017-0ba0e8c42cd0 HTTP/1.1 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8n7IrU4AS2Ei517mwsNY455SHHyqRB1jASV_OnCKU_LNlqqbWFOxl-pkpjBhSwv0T9MNSLvpA-voSz6ZBnCcS8N2smctpXXtAIdwpWNAlPtQ3AvGdfhpqdA1plYZ3d96UExMVmcd2guW2eqveEMqEdBGYrOjgYer2I753iK5lURM2o Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1f5a1973383d43b78538311cfb1df87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1f5a1973383d43b78538311cfb1df87c Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7fbde1fc523414d9bbe535db7f70095 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: exception: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '834cb05c-c795-496f-a017-0ba0e8c42cd0'} Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 04 21:09:21.330583 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] Jun 04 21:09:21.337931 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:09:21.344996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Returning 404 to user: Security group rule 834cb05c-c795-496f-a017-0ba0e8c42cd0 does not exist Jun 04 21:09:21.344996 ncdv-master-1 devstack@n-api.service[137228]: Neutron server returns request_ids: ['req-6548c874-21d2-4811-860d-1cf909cacbe7'] {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:21.345619 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71ce30b5-4f95-465d-8661-9edb0c725bee tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-group-rules/834cb05c-c795-496f-a017-0ba0e8c42cd0" status: 404 len: 199 microversion: 2.1 time: 0.072547 Jun 04 21:09:21.351021 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1949/3784] 10.222.0.18 () {58 vars in 1286 bytes} [Sat Jun 4 21:09:21 2022] DELETE /compute/v2.1/os-security-group-rules/834cb05c-c795-496f-a017-0ba0e8c42cd0 => generated 199 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:21.354645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:21.355263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:21.367334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9736926c-3081-4a5e-a0d7-40f7d8a427ad tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d020fe430>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:21.374849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:21.375638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:21.376217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:21.376654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:21.709449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:21.733169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:21.736581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:21.740277 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-45c3ef4d-04b2-44e9-b02d-c81fe331dda9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1742 microversion: 2.42 time: 0.392596 Jun 04 21:09:21.741672 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1836/3785] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:21 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1742 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:22.022069 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9736926c-3081-4a5e-a0d7-40f7d8a427ad tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/70a801e2-75f7-4fec-85b8-cf7c903be1ee" status: 202 len: 0 microversion: 2.1 time: 0.662059 Jun 04 21:09:22.023028 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1950/3786] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:09:21 2022] DELETE /compute/v2.1/os-security-groups/70a801e2-75f7-4fec-85b8-cf7c903be1ee => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:09:22.035043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1ef7de1-8397-44a4-8c79-229cca279935 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d015c6940>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:22.144188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:22.144834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:22.175140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:22.180996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:22.181520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:22.182644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:22.183267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:22.606674 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1ef7de1-8397-44a4-8c79-229cca279935 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/9c22c091-c6b7-4c86-9bf0-9cefa5ebfd4e" status: 202 len: 0 microversion: 2.1 time: 0.577764 Jun 04 21:09:22.607245 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1837/3787] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:09:22 2022] DELETE /compute/v2.1/os-security-groups/9c22c091-c6b7-4c86-9bf0-9cefa5ebfd4e => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:09:22.616309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-17654b21-fd1e-4bf8-b092-98da783a88da tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d015c6670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:22.630244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:22.650125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9d1aacb4-2185-4f1d-8cf5-776657b0ca4c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.508455 Jun 04 21:09:22.652846 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1951/3788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:22 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:22.761155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:22.761785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:22.786798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:22.787332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:22.788219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:22.788665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:23.271955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:23.290806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:23.293461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:23.296980 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d3ef977c-c751-4cd7-873f-69b9e7354009 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1742 microversion: 2.42 time: 0.540547 Jun 04 21:09:23.305970 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1952/3789] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:22 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1742 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:23.402487 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-17654b21-fd1e-4bf8-b092-98da783a88da tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/1acde4dd-5766-43c2-8595-e997f3694b68" status: 202 len: 0 microversion: 2.1 time: 0.788717 Jun 04 21:09:23.403652 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1838/3790] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:09:22 2022] DELETE /compute/v2.1/os-security-groups/1acde4dd-5766-43c2-8595-e997f3694b68 => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:09:23.413917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d807f5b3-0895-4048-8242-a4f487542600 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d02c36310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:23.669637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:23.670632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:23.689063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:23.690516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:23.691584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:23.691792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:23.890015 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d807f5b3-0895-4048-8242-a4f487542600 tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/71c5d5a1-dd26-48a2-b3e1-0523e6388c3d" status: 202 len: 0 microversion: 2.1 time: 0.482081 Jun 04 21:09:23.890966 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1953/3791] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:09:23 2022] DELETE /compute/v2.1/os-security-groups/71c5d5a1-dd26-48a2-b3e1-0523e6388c3d => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:09:23.900176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e9b86150-2458-4c30-a406-3b4dc7eb9caf tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] Calling method '.version_select at 0x7f2d020fe1f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:24.137859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:24.147400 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23df023a-47b7-4e2b-9ea2-eb46523e96d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.483079 Jun 04 21:09:24.152738 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1839/3792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:23 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:24.317773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:24.322889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:24.334299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:24.334757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:24.335773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:24.336217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:24.554175 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e9b86150-2458-4c30-a406-3b4dc7eb9caf tempest-SecurityGroupRulesNegativeTestJSON-1717527647 tempest-SecurityGroupRulesNegativeTestJSON-1717527647-project] 10.222.0.18 "DELETE /compute/v2.1/os-security-groups/be94da4f-7f8b-4a09-afa3-ff2889fec1cd" status: 202 len: 0 microversion: 2.1 time: 0.659417 Jun 04 21:09:24.555833 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1954/3793] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:09:23 2022] DELETE /compute/v2.1/os-security-groups/be94da4f-7f8b-4a09-afa3-ff2889fec1cd => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:09:24.707769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:24.723771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:24.728344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:24.730569 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e6de0bc9-f3db-488b-a3a6-78173f1f6430 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1789 microversion: 2.42 time: 0.417005 Jun 04 21:09:24.731186 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1840/3794] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:24 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1789 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:09:25.177379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:25.178064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:25.188435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:25.189758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:25.190912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:25.191846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:25.393113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:25.409941 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de30c0c0-8ce9-4346-94ed-e143fe96f167 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.237246 Jun 04 21:09:25.412660 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1955/3795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:25 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:25.750004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:25.751121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:25.779212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:25.780001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:25.782513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:25.788252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.384891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:26.387291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:26.388461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:26.396320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.396767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.397877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.398416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.403559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:26.405885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:26.407208 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4af7447f-94c4-4e53-a727-ab5b2e482d65 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1789 microversion: 2.42 time: 0.661626 Jun 04 21:09:26.426904 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1841/3796] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:25 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1789 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:26.433199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:26.434114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:26.440776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.441536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.442530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.442660 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5dde2296-b571-4a43-ae51-0089639e4f1f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062692 Jun 04 21:09:26.443280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.450442 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1956/3797] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:09:26 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:09:26.510857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:26.511381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:26.518845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.519301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.524416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.525197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.589931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:09:26.729610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-40f1ec2e-7059-4cb0-bd2e-8aa3b59ad83a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 204 len: 0 microversion: 2.1 time: 0.223076 Jun 04 21:09:26.735297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1957/3798] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:09:26 2022] DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:26.743935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:26.745273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:26.754589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.755293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.756192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:26.757462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:26.766637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:26.785046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d2c0a647-8c00-4730-837e-4a8e8ba8110a tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.350729 Jun 04 21:09:26.786122 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1842/3799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:26 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:27.020947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:27.039539 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c114cfc-3f64-4243-b3b5-3237c5ae40e0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1671 microversion: 2.1 time: 0.298227 Jun 04 21:09:27.040285 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1958/3800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:26 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1671 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:27.441093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:27.441735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:27.452297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:27.452759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:27.453560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:27.454026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:27.806250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:27.807090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:27.834140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:27.834627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:27.837134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:27.837584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:27.971057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:28.001219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:28.005787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:28.011296 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9cd934a-3d17-4e14-aca9-d5a3fcf40df1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1836 microversion: 2.42 time: 0.573125 Jun 04 21:09:28.013710 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1843/3801] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:27 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1836 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:28.060578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:28.062232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:28.083065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:28.084740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:28.103050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:28.110873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:28.463831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:28.478072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a059c169-dfa1-4e30-950d-9a58d5ad9bf4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.673022 Jun 04 21:09:28.490244 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1959/3802] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:27 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:28.505519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:28.519108 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-053053d2-99ca-4bdd-9dd7-0f202ef855d7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1671 microversion: 2.1 time: 0.463765 Jun 04 21:09:28.523700 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1844/3803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:28 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1671 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:29.036979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:29.038421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:29.052371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:29.064006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:29.065436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:29.066041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:29.499435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:29.501425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:29.520837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:29.521635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:29.522692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:29.523375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:29.555487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:29.571964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:29.574091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:29.577876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:29.590468 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fadfc080-0cb1-49d1-87d9-3eb6ff8e83d1 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1836 microversion: 2.42 time: 0.559836 Jun 04 21:09:29.593652 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1960/3804] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:29 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1836 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:29.603265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:29.609776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:29.625823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:29.640928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:29.640928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:29.640928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:30.361269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:30.378749 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cbfd2f77-1aa8-4ad2-b56e-422c7bc4308d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1671 microversion: 2.1 time: 0.783674 Jun 04 21:09:30.379777 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1961/3805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:29 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1671 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:30.413056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:30.439350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed9e843f-5717-4bbd-a427-1bb66064cff2 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.944772 Jun 04 21:09:30.446956 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1845/3806] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:29 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:30.622935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:30.623766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:30.655116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:30.658382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:30.675203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:30.677993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:31.398826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:31.402401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:31.426223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:31.427157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:31.428905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:31.430538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:31.848437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:31.878231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:31.880404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:31.881362 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-819115fb-0ab8-4f81-a9ee-86b1d8f132ea tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1836 microversion: 2.42 time: 1.270784 Jun 04 21:09:31.881938 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1962/3807] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:30 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1836 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:31.909048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:31.910819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:31.923917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:31.927895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:31.936408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:31.936868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:32.581545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:32.592334 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1fbfab85-2b6f-407d-a2d6-af317fb7a5e6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1671 microversion: 2.1 time: 1.198735 Jun 04 21:09:32.592653 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1846/3808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:31 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1671 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:32.910331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:32.918039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:32.927668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:32.927897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:32.928586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:32.928996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:33.478450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:33.503703 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7dbf8b9d-c113-408f-b0db-bfb4e40f60c7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 1.610651 Jun 04 21:09:33.505223 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1963/3809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:31 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:33.522875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3dbd5bff-53f3-49fd-a40b-5071f0521709 req-c9c202f7-9616-4cc1-92b8-b1ba8db1b7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "f88009bf-efdf-45e9-a270-b9a8b276b69f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:33.566143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3dbd5bff-53f3-49fd-a40b-5071f0521709 req-c9c202f7-9616-4cc1-92b8-b1ba8db1b7b0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:33.566606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3dbd5bff-53f3-49fd-a40b-5071f0521709 req-c9c202f7-9616-4cc1-92b8-b1ba8db1b7b0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:33.623652 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3dbd5bff-53f3-49fd-a40b-5071f0521709 req-c9c202f7-9616-4cc1-92b8-b1ba8db1b7b0 service nova] Creating event network-changed:f88009bf-efdf-45e9-a270-b9a8b276b69f for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:33.645947 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3dbd5bff-53f3-49fd-a40b-5071f0521709 req-c9c202f7-9616-4cc1-92b8-b1ba8db1b7b0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137569 Jun 04 21:09:33.657773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1964/3810] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:33.666574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:33.667745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:33.683925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:33.690226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:33.690226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:33.690226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:33.985597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:33.997810 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e2ef2a5-03cf-4b18-a06c-97aca3ba3675 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1604 microversion: 2.1 time: 0.338353 Jun 04 21:09:34.011615 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1965/3811] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:33 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:34.026773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:34.036655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:34.038180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:34.039395 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5f059dc9-0616-4877-ab93-64b4b4c190c0 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1836 microversion: 2.42 time: 1.140131 Jun 04 21:09:34.039991 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1847/3812] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:32 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1836 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:34.522795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:34.524304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:34.547498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:34.555910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:34.557875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:34.558598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.023502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:35.024921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:35.034346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:35.039210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.040860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:35.041628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.149186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:35.154848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.155933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lazy-loading 'fault' on Instance uuid 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:09:35.670349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:35.711839 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8be99d23-73f6-42c8-83c7-7cd1f64245b2 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 200 len: 1326 microversion: 2.1 time: 0.698700 Jun 04 21:09:35.715775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1848/3813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:35 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 1326 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:35.755130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:35.755130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:35.782049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:35.782565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:35.787368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.787368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:35.787368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.801021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4c6f3e9-e9a8-4e10-ba5c-be3abe07b1d5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 1.279536 Jun 04 21:09:35.807051 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1966/3814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:34 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:35.817717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0d98cad9-c071-437b-826c-1bf60d68fb74 req-4e0a55a8-930a-4ce9-9b66-145879ba6fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e", "name": "network-vif-deleted", "tag": "5b26a2ed-455a-43c0-a30d-6c49466dbc5b"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:35.852015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0d98cad9-c071-437b-826c-1bf60d68fb74 req-4e0a55a8-930a-4ce9-9b66-145879ba6fa0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:35.856086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0d98cad9-c071-437b-826c-1bf60d68fb74 req-4e0a55a8-930a-4ce9-9b66-145879ba6fa0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:35.908815 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0d98cad9-c071-437b-826c-1bf60d68fb74 req-4e0a55a8-930a-4ce9-9b66-145879ba6fa0 service nova] Creating event network-vif-deleted:5b26a2ed-455a-43c0-a30d-6c49466dbc5b for instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e on nch1-master-1 Jun 04 21:09:35.930796 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0d98cad9-c071-437b-826c-1bf60d68fb74 req-4e0a55a8-930a-4ce9-9b66-145879ba6fa0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118632 Jun 04 21:09:35.931594 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1967/3815] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:36.380778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-801188154", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "13995e9b-bb5b-4fd9-852a-d1c92a200f78"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:36.517548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] validate_networks() for [('13995e9b-bb5b-4fd9-852a-d1c92a200f78', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:09:37.960314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:37.995292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:37.996810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:38.005898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c0e0b11b-ae34-4927-9a21-bf45a0180084 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1857 microversion: 2.42 time: 2.262258 Jun 04 21:09:38.006869 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1849/3816] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:35 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1857 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:38.011871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:38.012487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:38.038062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:38.060835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.061608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.062577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.063184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.102082 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] HTTP exception thrown: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Request method failure captured: Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e HTTP/1.1 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8lQ-8eryORwl7MxHXjqtSRZVq1GDZnj0L8RyLZ-H8bTGz6YWNwo44yURLvf_tmd1lsG27gESupuPfBRaC8wD4UZIRD2RilIGNnWCmUFLoU97miginej-2xX_ZxKaJ5odcPV41LZ4mFHsI6aMzGxpCuQJowUK-KHqvxHWnhQEJBV3zs Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfea83c42bb443459619d4d679aa1769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: f290b5d01a074e2c9859488bd4ff1162 Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e'} Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:09:38.110424 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Returning 404 to user: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32dce689-a11d-49c5-9f14-9edb2514ee3d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 404 len: 111 microversion: 2.1 time: 0.104591 Jun 04 21:09:38.117427 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1850/3817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:38 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:09:38.122917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:38.123565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:38.150328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.150328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.150328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.150328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.561919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:09:38.562492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:09:38.562873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:09:38.563332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:09:38.563783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:09:38.581598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.584243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.587413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.588955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.622086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:38.661962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Getting quotas for project 0f2b7449c8de4c6eba0e9b7c174856e1. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:38.675854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Getting quotas for user 3467d447a572424f9c6cd56c5fa7e0c4 and project 0f2b7449c8de4c6eba0e9b7c174856e1. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:38.700814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Going to run 2 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:09:38.705984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: cfc75637-dfeb-420f-bc6e-380409b5e0f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:09:38.722443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:38.764706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:38.783377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-799e0439-34ad-4616-84bd-1ce072cd0dc1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.669086 Jun 04 21:09:38.784398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=cfc75637-dfeb-420f-bc6e-380409b5e0f1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:09:38.785207 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1851/3818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:38 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:38.811083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4d9e0625-dd5c-40ab-9fe5-42fad5c10abb req-3fbeae1b-718a-4efc-bd0b-8bb49821aa43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "c609dbe7-1ecc-4c38-8e4c-c41f8b766947"}, {"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "25e9d377-4b92-4a26-a908-1a149587b307"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:38.834236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d9e0625-dd5c-40ab-9fe5-42fad5c10abb req-3fbeae1b-718a-4efc-bd0b-8bb49821aa43 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:38.835873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d9e0625-dd5c-40ab-9fe5-42fad5c10abb req-3fbeae1b-718a-4efc-bd0b-8bb49821aa43 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:38.869622 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4d9e0625-dd5c-40ab-9fe5-42fad5c10abb req-3fbeae1b-718a-4efc-bd0b-8bb49821aa43 service nova] Creating event network-changed:c609dbe7-1ecc-4c38-8e4c-c41f8b766947 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:38.870417 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4d9e0625-dd5c-40ab-9fe5-42fad5c10abb req-3fbeae1b-718a-4efc-bd0b-8bb49821aa43 service nova] Creating event network-changed:25e9d377-4b92-4a26-a908-1a149587b307 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:38.882176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4d9e0625-dd5c-40ab-9fe5-42fad5c10abb req-3fbeae1b-718a-4efc-bd0b-8bb49821aa43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091978 Jun 04 21:09:38.884255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1852/3819] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:38.894040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25412272-1527-4f56-a5ff-c9f1fe407801 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '.version_select at 0x7f2d015c6280>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:38.930123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae89e7f1-cccb-454f-9990-c59170b777be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.985883 Jun 04 21:09:38.931054 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1968/3820] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:09:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:09:38.942551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:38.956333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:38.957538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Searching by: {'deleted': False, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1'} {{(pid=137228) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:09:38.989738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25412272-1527-4f56-a5ff-c9f1fe407801 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-765814108" status: 202 len: 0 microversion: 2.1 time: 0.104038 Jun 04 21:09:38.992537 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1853/3821] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-765814108 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:09:38.999524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:39.000571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:39.003961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:39.004930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:39.029965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:39.031129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:39.045643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:39.048328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:39.049394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:39.052036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:39.053147 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4bfc43a-ee11-4f33-b029-d8f49ac1daba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.114449 Jun 04 21:09:39.054254 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1969/3822] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:09:38 2022] GET /compute/v2.1/servers => generated 675 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:39.065594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a847eac-d6d7-4a4d-b81a-dcca5a0e1c66 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:39.066600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a847eac-d6d7-4a4d-b81a-dcca5a0e1c66 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:39.360771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a847eac-d6d7-4a4d-b81a-dcca5a0e1c66 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:39.371387 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a847eac-d6d7-4a4d-b81a-dcca5a0e1c66 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1219 microversion: 2.1 time: 0.310303 Jun 04 21:09:39.387776 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1970/3823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:39 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1219 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:39.801920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:39.802543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:39.810665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:39.811111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:39.812133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:39.812999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:40.034668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:40.049877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:40.051428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:40.057474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a02eab3-1297-46cc-9956-f47a7e7bedeb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.036194 Jun 04 21:09:40.058278 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1854/3824] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:39 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:09:40.396532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:40.397276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:40.410976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:40.412361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:40.415405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:40.416660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:41.027234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:41.039668 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23796df5-3e05-42e3-a90d-a0f72de7bdba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1223 microversion: 2.1 time: 0.649830 Jun 04 21:09:41.042245 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1855/3825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:40 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1223 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:41.087755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:41.089530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:41.118309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:41.120698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:41.133348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:41.141383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:41.264522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:41.287421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a268fa47-710c-4925-b707-4df3a0ef0208 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 1.487547 Jun 04 21:09:41.302137 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1971/3826] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:39 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:41.316066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b612ccca-cad0-4363-86f7-cce49dfe7df3 req-42831e3a-2e45-4924-a5ce-9982d9ae0a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "2be49f23-9dc7-4218-8ae0-35037e1424eb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:41.339499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b612ccca-cad0-4363-86f7-cce49dfe7df3 req-42831e3a-2e45-4924-a5ce-9982d9ae0a60 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:41.339997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b612ccca-cad0-4363-86f7-cce49dfe7df3 req-42831e3a-2e45-4924-a5ce-9982d9ae0a60 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:41.391963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b612ccca-cad0-4363-86f7-cce49dfe7df3 req-42831e3a-2e45-4924-a5ce-9982d9ae0a60 service nova] Creating event network-changed:2be49f23-9dc7-4218-8ae0-35037e1424eb for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:41.405144 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b612ccca-cad0-4363-86f7-cce49dfe7df3 req-42831e3a-2e45-4924-a5ce-9982d9ae0a60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099183 Jun 04 21:09:41.405985 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1972/3827] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:42.068571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:42.075990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:42.117583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:42.120604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:42.124503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:42.125466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:42.288987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:42.304854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:42.311922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:42.319688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:42.321918 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a666a2f1-6d14-41a2-aa61-d4007b82abb3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.244661 Jun 04 21:09:42.327158 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1856/3828] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:41 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:42.328661 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c39cacd1-eedf-4754-a7d6-b6b5a4936acd tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1289 microversion: 2.1 time: 0.272868 Jun 04 21:09:42.329759 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1973/3829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:42 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1289 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:42.342363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ad24fd6-4f32-40a1-a063-f5a104177f7c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: .version_select at 0x7f2d0bd28280>, body: {"keypair": {"name": "tempest-keypair-1723967188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDANt/G12/g7PsB8QuRco2wyjhiiLIa6K/P05g3ZRFr8RhKp7yEEa2/t3WjyakeaKwHaAl886vHyYBwlLZmibAGWio63rrIDp/xwhbkqnbt27rSyuJC+V3FYuSQJqleaqg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:42.343621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:42.344889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:42.373495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:42.374452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:42.375593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:42.376280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:42.397054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-4ad24fd6-4f32-40a1-a063-f5a104177f7c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for project cfea83c42bb443459619d4d679aa1769. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:42.406311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-4ad24fd6-4f32-40a1-a063-f5a104177f7c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for user f290b5d01a074e2c9859488bd4ff1162 and project cfea83c42bb443459619d4d679aa1769. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:42.474939 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ad24fd6-4f32-40a1-a063-f5a104177f7c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146591 Jun 04 21:09:42.486400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1857/3830] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:09:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:43.024846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:43.035849 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f8985f75-6445-47f0-8f14-b2ac7dd10c01 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1516 microversion: 2.1 time: 0.704567 Jun 04 21:09:43.036746 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1974/3831] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:42 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1516 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:43.347718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:43.349270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:43.363007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:43.365128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:43.366451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:43.368025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:43.387359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:43.395965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:43.421825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:43.422694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:43.423705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:43.424493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:43.649950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:43.678563 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73b77bc2-20c8-453a-9483-569dbf2668a3 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1277 microversion: 2.1 time: 0.335578 Jun 04 21:09:43.686754 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1975/3832] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:43 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1277 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:44.059555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:44.060443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:44.068734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:44.069441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:44.070441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:44.071341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:44.736745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:44.780722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:44.787990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:44.793248 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9146874a-bdb0-4f97-bd68-384aff0a03e8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.449556 Jun 04 21:09:44.793971 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1858/3833] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:43 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:44.805006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:44.808310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:44.829813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:44.831001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:44.832301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:44.833001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:44.931085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:44.944792 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed371c85-635f-4e58-bfe6-8cb840691633 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1522 microversion: 2.1 time: 0.890434 Jun 04 21:09:44.945682 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1976/3834] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:44 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1522 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:44.951186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-8ed4eb5d-588f-4420-a2a0-f31191a8c94e req-94d676bd-3cea-4603-b3c8-9b0747d8fff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "611f4ee0-557c-4fa9-a580-d389ba7a7980"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:44.985700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8ed4eb5d-588f-4420-a2a0-f31191a8c94e req-94d676bd-3cea-4603-b3c8-9b0747d8fff4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:44.988379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8ed4eb5d-588f-4420-a2a0-f31191a8c94e req-94d676bd-3cea-4603-b3c8-9b0747d8fff4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:45.034314 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-8ed4eb5d-588f-4420-a2a0-f31191a8c94e req-94d676bd-3cea-4603-b3c8-9b0747d8fff4 service nova] Creating event network-changed:611f4ee0-557c-4fa9-a580-d389ba7a7980 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:45.052457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-8ed4eb5d-588f-4420-a2a0-f31191a8c94e req-94d676bd-3cea-4603-b3c8-9b0747d8fff4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105279 Jun 04 21:09:45.053699 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1977/3835] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:45.159620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:45.173379 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d05524a-fd10-42a5-a0ce-443d8d986dba tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1277 microversion: 2.1 time: 0.376471 Jun 04 21:09:45.187885 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1859/3836] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:44 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1277 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:45.815685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:45.818717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:45.849436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:45.860418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:45.867121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:45.868484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:45.965816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:45.966551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:45.983755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:45.984548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:45.985542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:45.986153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:46.984304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:47.013218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:47.018729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:47.025957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-56dfec5c-64c4-49fd-b79a-936eae663e0d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.214478 Jun 04 21:09:47.032135 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1978/3837] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:45 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:47.056649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:47.059132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:47.059776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:47.086217 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c0007845-06e5-4d8b-ad0c-7ebef318d804 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1522 microversion: 2.1 time: 1.125489 Jun 04 21:09:47.096508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:47.100805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:47.103205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:47.103434 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1860/3838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:45 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1522 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:09:47.112990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:47.309258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:47.322777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7db063e-cfb0-48ec-9dd4-6ce9c069acf9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1277 microversion: 2.1 time: 0.283695 Jun 04 21:09:47.323562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1979/3839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:47 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:47.581109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-09ff03b8-c791-47e0-a75c-02bbfed39158 req-44f6a023-697a-4916-b522-c4d8b70f169e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9146e266-6fc5-4e35-b90c-c41b1e45d869", "name": "network-vif-unplugged", "status": "completed", "tag": "126889b8-b81a-4945-9d18-feb97708cbfb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:47.614078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-09ff03b8-c791-47e0-a75c-02bbfed39158 req-44f6a023-697a-4916-b522-c4d8b70f169e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:47.615370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-09ff03b8-c791-47e0-a75c-02bbfed39158 req-44f6a023-697a-4916-b522-c4d8b70f169e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:47.675905 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-09ff03b8-c791-47e0-a75c-02bbfed39158 req-44f6a023-697a-4916-b522-c4d8b70f169e service nova] Creating event network-vif-unplugged:126889b8-b81a-4945-9d18-feb97708cbfb for instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 on nch2-master-1 Jun 04 21:09:47.684360 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-09ff03b8-c791-47e0-a75c-02bbfed39158 req-44f6a023-697a-4916-b522-c4d8b70f169e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115364 Jun 04 21:09:47.685079 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1861/3840] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:09:48.052381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:48.052963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:48.066851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:48.067314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:48.075224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:48.075744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:48.106612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:48.107397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:48.122479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:48.122940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:48.127902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:48.128443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:49.016593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:49.367648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:49.453340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f01e2808-0145-47bb-bcad-42a9d8bbb693 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1522 microversion: 2.1 time: 1.375803 Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1862/3841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:48 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1522 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:49.552562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:49.686914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:49.705499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:49.708852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:49.714421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-afa4a0d5-e6b7-4027-b955-a1b87299135b tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.665749 Jun 04 21:09:49.717246 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1980/3842] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:48 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:49.730174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d242876a-f119-4e17-b63c-f7850fb34b6d req-434a9781-0dc8-4922-896f-7046e2004e0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "51933103-024f-40de-a3da-309ec20b0d07"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:49.745186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d242876a-f119-4e17-b63c-f7850fb34b6d req-434a9781-0dc8-4922-896f-7046e2004e0c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:49.746108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d242876a-f119-4e17-b63c-f7850fb34b6d req-434a9781-0dc8-4922-896f-7046e2004e0c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:49.762448 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d242876a-f119-4e17-b63c-f7850fb34b6d req-434a9781-0dc8-4922-896f-7046e2004e0c service nova] Creating event network-changed:51933103-024f-40de-a3da-309ec20b0d07 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:49.771883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d242876a-f119-4e17-b63c-f7850fb34b6d req-434a9781-0dc8-4922-896f-7046e2004e0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052797 Jun 04 21:09:49.772529 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1981/3843] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:49.787169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-9067db3c-6378-4ffa-ab66-d557d1d1f724 req-bd53168d-d1ea-418b-bb02-02a1a1945111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9146e266-6fc5-4e35-b90c-c41b1e45d869", "name": "network-vif-plugged", "status": "completed", "tag": "126889b8-b81a-4945-9d18-feb97708cbfb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:49.801344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9067db3c-6378-4ffa-ab66-d557d1d1f724 req-bd53168d-d1ea-418b-bb02-02a1a1945111 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:49.801991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9067db3c-6378-4ffa-ab66-d557d1d1f724 req-bd53168d-d1ea-418b-bb02-02a1a1945111 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:49.832171 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-9067db3c-6378-4ffa-ab66-d557d1d1f724 req-bd53168d-d1ea-418b-bb02-02a1a1945111 service nova] Creating event network-vif-plugged:126889b8-b81a-4945-9d18-feb97708cbfb for instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 on nch2-master-1 Jun 04 21:09:49.841006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-9067db3c-6378-4ffa-ab66-d557d1d1f724 req-bd53168d-d1ea-418b-bb02-02a1a1945111 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063292 Jun 04 21:09:49.842257 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1982/3844] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:49.952998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:49.996358 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac2cfd5a-0e68-45b9-8ce1-3a7af8bcec5f tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 0.513840 Jun 04 21:09:49.997346 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1863/3845] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:49 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:50.495475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:50.496960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:50.521645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:50.522354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:50.523196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:50.539032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:50.734836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:50.735419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:50.750323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:50.751091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:50.752899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:50.754366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:51.192865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:51.202238 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3786200-8ed4-48f8-8105-39b05a2d038e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1522 microversion: 2.1 time: 0.711515 Jun 04 21:09:51.202833 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1983/3846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:50 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:51.214269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:51.220118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:51.233654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:51.234113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:51.235289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:51.235775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:51.498219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:51.517759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:51.521181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:51.525319 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-84384f73-d483-4fd4-b7d9-0b11fb7bb2f6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.792043 Jun 04 21:09:51.540356 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1864/3847] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:50 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:09:52.220061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:52.221571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:52.230488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:52.235593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:52.236669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:52.242169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:52.418518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:52.645536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:52.669981 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c0508454-e3ff-4db3-a50c-42a5332d92b5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 1.461335 Jun 04 21:09:52.670711 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1984/3848] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:51 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:52.680853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:52.681621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:52.702477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:52.703376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:52.704618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:52.706405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:52.924923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:52.930994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:52.938066 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0aebf94-dea4-4031-a2e2-e847995a3224 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1507 microversion: 2.1 time: 0.722204 Jun 04 21:09:52.938685 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1865/3849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:52 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1507 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:52.961286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-99d765bf-cfd4-4ea2-b191-88d55ee3faf4 req-e32c19c2-31ce-4393-858d-7934fbd1d025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc75637-dfeb-420f-bc6e-380409b5e0f1", "tag": "b9e52fab-feb3-427d-a942-ba4127a5a6f4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:52.984172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-99d765bf-cfd4-4ea2-b191-88d55ee3faf4 req-e32c19c2-31ce-4393-858d-7934fbd1d025 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:52.984626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-99d765bf-cfd4-4ea2-b191-88d55ee3faf4 req-e32c19c2-31ce-4393-858d-7934fbd1d025 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:53.008339 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-99d765bf-cfd4-4ea2-b191-88d55ee3faf4 req-e32c19c2-31ce-4393-858d-7934fbd1d025 service nova] Creating event network-changed:b9e52fab-feb3-427d-a942-ba4127a5a6f4 for instance cfc75637-dfeb-420f-bc6e-380409b5e0f1 on nch1-master-1 Jun 04 21:09:53.015826 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-99d765bf-cfd4-4ea2-b191-88d55ee3faf4 req-e32c19c2-31ce-4393-858d-7934fbd1d025 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057675 Jun 04 21:09:53.016813 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1866/3850] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:53.026531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-760100629", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c946d160-9d42-4fd6-818b-110d6e0b1e76"}], "security_groups": [{"name": "tempest-securitygroup--1094609252"}], "key_name": "tempest-keypair-1723967188", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:53.740772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:53.755985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] validate_networks() for [('c946d160-9d42-4fd6-818b-110d6e0b1e76', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:09:53.783874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:53.786190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:53.789277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-30debe5c-7350-4c02-9283-acfcaf0663f8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.117229 Jun 04 21:09:53.803454 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1985/3851] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:52 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:53.811905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:53.818462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:53.831110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:53.832082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:53.834876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:53.835460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:54.435143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:54.447680 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-75567349-36f1-4e44-b50f-f069c9bed715 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 200 len: 1507 microversion: 2.1 time: 0.642130 Jun 04 21:09:54.448553 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1986/3852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:53 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 1507 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:54.454101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6fef025e-27e2-4a64-8b54-26e930363cdb req-40d15ca0-ff93-4ace-a1f6-c9a4de0216be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:54.483367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6fef025e-27e2-4a64-8b54-26e930363cdb req-40d15ca0-ff93-4ace-a1f6-c9a4de0216be service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:54.484054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6fef025e-27e2-4a64-8b54-26e930363cdb req-40d15ca0-ff93-4ace-a1f6-c9a4de0216be service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:54.516651 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6fef025e-27e2-4a64-8b54-26e930363cdb req-40d15ca0-ff93-4ace-a1f6-c9a4de0216be service nova] Creating event network-changed:f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:09:54.536411 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6fef025e-27e2-4a64-8b54-26e930363cdb req-40d15ca0-ff93-4ace-a1f6-c9a4de0216be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086139 Jun 04 21:09:54.537538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1987/3853] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:54.545794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:54.546866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:54.554363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:54.555047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:54.556024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:54.556545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:55.421857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:55.432650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b279585c-3b35-4ffe-87e4-5400bda1882e tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 0.893578 Jun 04 21:09:55.434020 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1988/3854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:54 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:55.440295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:55.440886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:55.448791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:55.449314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:55.450287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:55.451579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:55.482240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:09:55.512595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:09:55.609489 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99ac51d4-7e75-4a17-b3ce-27d18967b6a1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 204 len: 0 microversion: 2.1 time: 0.173417 Jun 04 21:09:55.610514 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1989/3855] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:09:55 2022] DELETE /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:09:55.616770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:55.618661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:55.626841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:55.627675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:55.629240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:55.629899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:56.075225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:09:56.076413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:09:56.077100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:09:56.077743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:09:56.078241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:09:56.089569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:56.090139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:56.091048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:56.091934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:56.115807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for project cfea83c42bb443459619d4d679aa1769. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:56.123735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Getting quotas for user f290b5d01a074e2c9859488bd4ff1162 and project cfea83c42bb443459619d4d679aa1769. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:56.143049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:09:56.145982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:09:56.222998 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b7090815-998b-43d1-8449-0170904138c7 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.203577 Jun 04 21:09:56.234772 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1867/3856] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:09:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:09:56.246939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-21bc841d-72b1-43f1-a2bb-23667d335a85 req-e20164e3-ddb8-46c0-a14c-081d921c1848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0e24c1-222e-43e9-8cab-ede5fc3fc238", "tag": "50162a6b-2a03-454d-8f73-827201f7801c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:56.285870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-21bc841d-72b1-43f1-a2bb-23667d335a85 req-e20164e3-ddb8-46c0-a14c-081d921c1848 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:56.291823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-21bc841d-72b1-43f1-a2bb-23667d335a85 req-e20164e3-ddb8-46c0-a14c-081d921c1848 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:56.323718 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-21bc841d-72b1-43f1-a2bb-23667d335a85 req-e20164e3-ddb8-46c0-a14c-081d921c1848 service nova] Creating event network-changed:50162a6b-2a03-454d-8f73-827201f7801c for instance ec0e24c1-222e-43e9-8cab-ede5fc3fc238 on nch2-master-1 Jun 04 21:09:56.338650 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-21bc841d-72b1-43f1-a2bb-23667d335a85 req-e20164e3-ddb8-46c0-a14c-081d921c1848 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100655 Jun 04 21:09:56.341044 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1868/3857] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:09:56.350183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-785061410", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "99e771a0-e10b-4b48-9a48-d9965a86dd4c"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:56.430759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] validate_networks() for [('99e771a0-e10b-4b48-9a48-d9965a86dd4c', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:09:56.440898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:56.455287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:56.457594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:56.458938 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7f81b2e6-5dfc-4f41-818f-1415a0876ed8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.846582 Jun 04 21:09:56.459890 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1990/3858] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:55 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:56.468163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e286ff95-8ce2-4dce-879a-f65fde2878f0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:56.468797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e286ff95-8ce2-4dce-879a-f65fde2878f0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:56.678612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e286ff95-8ce2-4dce-879a-f65fde2878f0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:56.687468 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e286ff95-8ce2-4dce-879a-f65fde2878f0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1237 microversion: 2.1 time: 0.226331 Jun 04 21:09:56.688336 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1991/3859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:56 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1237 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:56.693731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:56.694826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:56.703834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:56.704579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:56.705599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:56.706178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:57.467846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:57.501610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-51ed941b-ed11-41d4-8e5b-47f8dbcc4f35 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 0.811663 Jun 04 21:09:57.502329 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1992/3860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:56 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:57.508233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:57.508864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:57.518252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:57.519017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:57.520468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:57.520932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.440817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:58.463156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:58.467757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:58.470935 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d69134b-e980-40d9-ae26-71d00e8c380f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.967426 Jun 04 21:09:58.472683 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1993/3861] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:57 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:09:58.483681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:58.485347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:58.493509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:58.494426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.496367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:58.497047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.797800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:58.806650 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4187d41-20a3-415e-a5e7-876d8d778937 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1295 microversion: 2.1 time: 0.332543 Jun 04 21:09:58.817602 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1994/3862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:58 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1295 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:58.823274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:58.824215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:58.831712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:58.832557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.834148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:58.834813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.860618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:09:58.861644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:09:58.862985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:09:58.863621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:09:58.864229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:09:58.883914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:58.884954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.886429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:58.888409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:58.919199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Getting quotas for project 14f851d439ae4167af07518e3b1354ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:09:58.925314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Getting quotas for user ecdc2e5bf2e3492bb5320e054641ec3c and project 14f851d439ae4167af07518e3b1354ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:09:58.939633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:09:58.954227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:09:59.024360 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fbf04c09-40e5-42da-85a7-bc8a8941e689 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.680279 Jun 04 21:09:59.026962 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1869/3863] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:09:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:09:59.045705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36fc4fbd-73c3-42fc-b7c6-dc057ae1ed0c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:59.046798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-36fc4fbd-73c3-42fc-b7c6-dc057ae1ed0c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:59.239078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-36fc4fbd-73c3-42fc-b7c6-dc057ae1ed0c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:59.252377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36fc4fbd-73c3-42fc-b7c6-dc057ae1ed0c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1217 microversion: 2.1 time: 0.218002 Jun 04 21:09:59.252984 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1870/3864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:59 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:59.304325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1cb606b5-2f68-4cf2-8418-9b1f7bb362d2 req-9caff366-92c4-43e0-85da-2136121a7f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9146e266-6fc5-4e35-b90c-c41b1e45d869", "name": "network-vif-unplugged", "status": "completed", "tag": "126889b8-b81a-4945-9d18-feb97708cbfb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:09:59.327140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1cb606b5-2f68-4cf2-8418-9b1f7bb362d2 req-9caff366-92c4-43e0-85da-2136121a7f94 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:59.329893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1cb606b5-2f68-4cf2-8418-9b1f7bb362d2 req-9caff366-92c4-43e0-85da-2136121a7f94 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:59.354786 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1cb606b5-2f68-4cf2-8418-9b1f7bb362d2 req-9caff366-92c4-43e0-85da-2136121a7f94 service nova] Creating event network-vif-unplugged:126889b8-b81a-4945-9d18-feb97708cbfb for instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 on nch2-master-1 Jun 04 21:09:59.371611 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1cb606b5-2f68-4cf2-8418-9b1f7bb362d2 req-9caff366-92c4-43e0-85da-2136121a7f94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070796 Jun 04 21:09:59.373795 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1871/3865] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:09:59.503802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:59.504498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:59.535920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:59.536225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:59.537181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:59.537774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:59.566622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:09:59.603905 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5fd7d5cd-6009-4403-9013-f14376c35b91 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 0.781939 Jun 04 21:09:59.617296 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1995/3866] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:58 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:09:59.826098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:09:59.827404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:09:59.855891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:59.858745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:09:59.859827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:09:59.862569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:00.211482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:00.220498 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14c6dc9d-d6de-4509-8b00-0c3759d79fed tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1295 microversion: 2.1 time: 0.400187 Jun 04 21:10:00.233634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1996/3867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:09:59 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1295 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:00.274802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:00.275982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:00.297705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:00.305577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:00.308786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:00.309649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:00.312234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:00.318326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:00.328978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:00.338336 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fbf938df-3917-449b-a483-167aab89ce96 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.851273 Jun 04 21:10:00.354467 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1872/3868] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:09:59 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:00.442390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:00.462481 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd1eb588-049b-43be-85ec-b75130c64ef5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1269 microversion: 2.1 time: 0.192138 Jun 04 21:10:00.463193 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1997/3869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:00 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:00.614603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5aef98de-93c2-449d-8eb7-d4d6a8d47d98 req-10bb2c48-6f9a-4290-a766-104cbf0a2dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9146e266-6fc5-4e35-b90c-c41b1e45d869", "name": "network-vif-deleted", "tag": "126889b8-b81a-4945-9d18-feb97708cbfb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:00.622712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:00.624099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:00.637864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5aef98de-93c2-449d-8eb7-d4d6a8d47d98 req-10bb2c48-6f9a-4290-a766-104cbf0a2dda service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:00.641123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:00.643362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:00.644512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:00.645704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5aef98de-93c2-449d-8eb7-d4d6a8d47d98 req-10bb2c48-6f9a-4290-a766-104cbf0a2dda service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:00.651693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:00.670787 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5aef98de-93c2-449d-8eb7-d4d6a8d47d98 req-10bb2c48-6f9a-4290-a766-104cbf0a2dda service nova] Creating event network-vif-deleted:126889b8-b81a-4945-9d18-feb97708cbfb for instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 on nch2-master-1 Jun 04 21:10:00.684939 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5aef98de-93c2-449d-8eb7-d4d6a8d47d98 req-10bb2c48-6f9a-4290-a766-104cbf0a2dda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078015 Jun 04 21:10:00.691244 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1873/3870] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:01.242379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:01.244210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:01.272716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:01.275499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:01.284876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:01.286099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:01.613529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:01.622317 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3dcadf87-d755-4326-a297-28423bf517d8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 1.003770 Jun 04 21:10:01.622935 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1998/3871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:00 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:01.637864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:01.638749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:01.653213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:01.664482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:01.665703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:01.666305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:01.783216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:01.801308 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f1c25fc3-cf30-4eb9-ad0f-3aff30be957d tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.563718 Jun 04 21:10:01.802130 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1874/3872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:01 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:01.811401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:01.820510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:01.836793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:01.856464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:01.857678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:01.858313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:02.147158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:02.162948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0aa81c55-b5c7-40e3-88eb-5752cb1835b4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1275 microversion: 2.1 time: 0.359393 Jun 04 21:10:02.172541 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1875/3873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:01 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1275 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:02.173108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7c5430b1-11a3-4667-8a81-65310212adb8 req-5c853781-da8a-460d-b3ca-363fcf7bb149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc75637-dfeb-420f-bc6e-380409b5e0f1", "name": "network-vif-plugged", "status": "completed", "tag": "b9e52fab-feb3-427d-a942-ba4127a5a6f4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:02.209185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7c5430b1-11a3-4667-8a81-65310212adb8 req-5c853781-da8a-460d-b3ca-363fcf7bb149 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:02.209706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7c5430b1-11a3-4667-8a81-65310212adb8 req-5c853781-da8a-460d-b3ca-363fcf7bb149 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:02.236642 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7c5430b1-11a3-4667-8a81-65310212adb8 req-5c853781-da8a-460d-b3ca-363fcf7bb149 service nova] Creating event network-vif-plugged:b9e52fab-feb3-427d-a942-ba4127a5a6f4 for instance cfc75637-dfeb-420f-bc6e-380409b5e0f1 on nch1-master-1 Jun 04 21:10:02.243072 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7c5430b1-11a3-4667-8a81-65310212adb8 req-5c853781-da8a-460d-b3ca-363fcf7bb149 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077199 Jun 04 21:10:02.244505 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1876/3874] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:02.644309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:02.645798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:02.667487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:02.667987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:02.671260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:02.673136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:03.422715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:03.441773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:03.443277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:03.444500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b1e73e4e-60f3-4878-ae5b-98435be9db87 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.810854 Jun 04 21:10:03.445108 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 1999/3875] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:01 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:03.476460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:03.477099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:03.490925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:03.491999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:03.493782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:03.494951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:03.956818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:03.968180 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f86a9831-e6a4-4c38-8011-5f7b50e0de9b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 1.330049 Jun 04 21:10:03.979778 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1877/3876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:02 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:03.991233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:03.994528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:04.003542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:04.005872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:04.006638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:04.008445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:04.009258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:04.210244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:04.224892 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e21a8863-bdfd-404c-acf4-5a9bb711b234 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.767704 Jun 04 21:10:04.225977 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2000/3877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:03 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:04.291165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d5d03f5a-cf34-40a1-a4a9-1e0ffe7a692d req-16b8b488-ddd0-4ddc-8513-8d4dd44a903b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0e24c1-222e-43e9-8cab-ede5fc3fc238", "name": "network-vif-plugged", "status": "completed", "tag": "50162a6b-2a03-454d-8f73-827201f7801c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:04.307648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d5d03f5a-cf34-40a1-a4a9-1e0ffe7a692d req-16b8b488-ddd0-4ddc-8513-8d4dd44a903b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:04.308646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d5d03f5a-cf34-40a1-a4a9-1e0ffe7a692d req-16b8b488-ddd0-4ddc-8513-8d4dd44a903b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:04.325889 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d5d03f5a-cf34-40a1-a4a9-1e0ffe7a692d req-16b8b488-ddd0-4ddc-8513-8d4dd44a903b service nova] Creating event network-vif-plugged:50162a6b-2a03-454d-8f73-827201f7801c for instance ec0e24c1-222e-43e9-8cab-ede5fc3fc238 on nch2-master-1 Jun 04 21:10:04.328206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:04.333368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d5d03f5a-cf34-40a1-a4a9-1e0ffe7a692d req-16b8b488-ddd0-4ddc-8513-8d4dd44a903b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047479 Jun 04 21:10:04.337178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ce54938-5358-4751-87cc-48c1c975678e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1275 microversion: 2.1 time: 0.356061 Jun 04 21:10:04.339046 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2001/3878] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:04.341925 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1878/3879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:03 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1275 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:04.466627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:04.467457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:04.480238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:04.481462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:04.482410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:04.483494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:04.605525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-feb7fb3d-4679-4413-914c-08fb90e70ea0 req-c9d49c20-4f5c-447a-b70f-2bc9876f6494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b5db72-5ec2-495f-86bf-99c94ec6c3af", "tag": "9a71ae16-64f4-408b-96ba-75aa9a0fada9"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:04.623544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-feb7fb3d-4679-4413-914c-08fb90e70ea0 req-c9d49c20-4f5c-447a-b70f-2bc9876f6494 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:04.625871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-feb7fb3d-4679-4413-914c-08fb90e70ea0 req-c9d49c20-4f5c-447a-b70f-2bc9876f6494 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:04.654265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-feb7fb3d-4679-4413-914c-08fb90e70ea0 req-c9d49c20-4f5c-447a-b70f-2bc9876f6494 service nova] Creating event network-changed:9a71ae16-64f4-408b-96ba-75aa9a0fada9 for instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af on nch1-master-1 Jun 04 21:10:04.660524 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-feb7fb3d-4679-4413-914c-08fb90e70ea0 req-c9d49c20-4f5c-447a-b70f-2bc9876f6494 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059611 Jun 04 21:10:04.661472 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1879/3880] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:10:04.991786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:04.994999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:05.011625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:05.012414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:05.014446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:05.015662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:05.463795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:05.495170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:05.507078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:05.530122 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d271a559-a60d-4904-9401-9032f9781994 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.051870 Jun 04 21:10:05.531100 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2002/3881] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:04 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:05.561100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:05.573761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:05.586023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:05.586650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:05.588051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:05.588660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:05.683703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:05.698987 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01fa663b-059c-43ce-b7a0-cef9eb1f3a94 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1319 microversion: 2.1 time: 0.711040 Jun 04 21:10:05.699747 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1880/3882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:04 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:05.712781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:05.713915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:05.724971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:05.727493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:05.729493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:05.729959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:05.915946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:05.925689 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7af2d8d2-508a-40df-a079-4d4a46a8b8bf tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1275 microversion: 2.1 time: 0.224223 Jun 04 21:10:05.940220 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1881/3883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:05 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1275 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:06.174026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:06.183111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f69436d7-f9aa-4c81-82cb-ebc020c5c6ce tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.637994 Jun 04 21:10:06.189245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2003/3884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:05 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:06.549944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:06.551352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:06.560285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:06.561935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:06.563070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:06.564025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:06.719126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:06.720839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:06.723560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:06.729869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:06.730431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:06.731311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:06.732561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:07.797036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:07.807080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:07.808635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:07.817211 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-419ae295-abab-4e7e-8606-5c08c3503af3 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.271262 Jun 04 21:10:07.820659 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1882/3885] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:06 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:07.831064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:07.832252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:07.846768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:07.847486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:07.848660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:07.850547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:07.999205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:08.019125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85d2b485-430c-4e7b-b629-3aa0f3594197 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 200 len: 1507 microversion: 2.1 time: 1.303795 Jun 04 21:10:08.022911 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2004/3886] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:06 2022] GET /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 1507 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:08.040353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:08.041200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:08.082740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:08.084417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:08.085807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:08.086570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:08.546117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:08.559447 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1367bf82-7207-4855-a334-a26315942aee tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 0.737004 Jun 04 21:10:08.561041 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1883/3887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:07 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:08.569258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:08.571010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: cfc75637-dfeb-420f-bc6e-380409b5e0f1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:08.584850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:08.585475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:08.586853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:08.587479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:08.862508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:08.876940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6ae78eb-d39f-42b0-a056-3604b0bfdf19 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.852992 Jun 04 21:10:08.877587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2005/3888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:08 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:08.889813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:08.890443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:08.892454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:08.907273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:08.910847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:08.911235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:08.912074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:08.912515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:09.244968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:09.430832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:09.454067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:09.456252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:09.458675 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f17d6617-8726-492f-9d84-7ae136312c20 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.578747 Jun 04 21:10:09.461579 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2006/3889] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:08 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:09.558997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:09.573561 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a9b76da5-865a-45db-813f-e3a31f838cc9 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/cfc75637-dfeb-420f-bc6e-380409b5e0f1" status: 200 len: 1508 microversion: 2.1 time: 1.011080 Jun 04 21:10:09.575670 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1884/3890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:08 2022] GET /compute/v2.1/servers/cfc75637-dfeb-420f-bc6e-380409b5e0f1 => generated 1508 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:09.594952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:09.595537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: cfc75637-dfeb-420f-bc6e-380409b5e0f1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:09.596931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:09.598445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:09.610628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:09.615623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:09.623323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:09.623840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:09.641148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:09.642333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:09.644254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:09.645750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:09.663779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:09.703292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: cfc75637-dfeb-420f-bc6e-380409b5e0f1] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:09.925422 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebc8a0b0-e667-41d5-8a45-21c0a78fc179 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cfc75637-dfeb-420f-bc6e-380409b5e0f1" status: 204 len: 0 microversion: 2.1 time: 0.334781 Jun 04 21:10:09.926341 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1885/3891] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:09 2022] DELETE /compute/v2.1/servers/cfc75637-dfeb-420f-bc6e-380409b5e0f1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:10:09.932983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:09.946318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:09.952958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:09.956011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:09.956996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:09.957574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:10.297286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:10.305296 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5aea867e-a820-4e4c-8710-0ff0e6f0816c tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.377716 Jun 04 21:10:10.319533 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1886/3892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:09 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:10.325485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:10.326293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:10.332784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:10.333365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:10.334349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:10.335049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:10.375607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:10.385177 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82213392-c2c7-4648-9682-86c20ce62f06 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 0.809481 Jun 04 21:10:10.386363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:10.397334 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2007/3893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:09 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:10.403465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1966460904", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:10.408728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: ec0e24c1-222e-43e9-8cab-ede5fc3fc238] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:10.495827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:10:10.618452 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e10f2bb-fc8c-44d9-bb5f-8170d1410ff8 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238" status: 204 len: 0 microversion: 2.1 time: 0.296632 Jun 04 21:10:10.619023 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1887/3894] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:10 2022] DELETE /compute/v2.1/servers/ec0e24c1-222e-43e9-8cab-ede5fc3fc238 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:10:10.630022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:10.633151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:10.647879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:10.649578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:10.650672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:10.652420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:11.222358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:11.232450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:11.233976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:11.247352 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fb6ce9dd-2923-43e7-979d-a7f537c02ec5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.626480 Jun 04 21:10:11.248593 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1888/3895] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:10 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:11.254137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2066328935", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "13995e9b-bb5b-4fd9-852a-d1c92a200f78"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:11.366526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] validate_networks() for [('13995e9b-bb5b-4fd9-852a-d1c92a200f78', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:10:11.600420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:10:11.600944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:10:11.601698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:10:11.602401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:10:11.603595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:10:11.638190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:11.639625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:11.642828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:11.643986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:11.695860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Getting quotas for project 241876e358514965aadcc36146a30265. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:10:11.704121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Getting quotas for user 0678a3e330f449d8acf9c01cda1808be and project 241876e358514965aadcc36146a30265. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:10:11.753879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:10:11.757300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:10:11.835755 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a0849af-49de-4fce-af55-a973e38f65f2 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444351 Jun 04 21:10:11.842219 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2008/3896] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:10:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:10:11.854662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:11.856452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:11.866031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:11.866853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:11.868086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:11.881504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:13.066584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:13.083981 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2ad88b6-104b-41cb-8639-cf39a192b2ee tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 1.234922 Jun 04 21:10:13.093619 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2009/3897] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:11 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:13.098624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:13.099251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:13.115167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:13.115670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:13.116468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:13.116917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.419097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:14.442569 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05b8e8a5-d394-4815-93c1-1a50c6e3297b tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 1.343958 Jun 04 21:10:14.451754 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2010/3898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:13 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:14.453353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6015f4c0-9f24-4fbb-89c0-97b257a21a15 req-b1a65f42-9adb-4ddd-bf52-2f72deb3c618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03913b6b-c6bb-4b05-818e-697cbfb57428", "tag": "69428c06-6441-4bd8-a759-490658345854"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:14.468723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6015f4c0-9f24-4fbb-89c0-97b257a21a15 req-b1a65f42-9adb-4ddd-bf52-2f72deb3c618 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.469252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6015f4c0-9f24-4fbb-89c0-97b257a21a15 req-b1a65f42-9adb-4ddd-bf52-2f72deb3c618 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.492635 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6015f4c0-9f24-4fbb-89c0-97b257a21a15 req-b1a65f42-9adb-4ddd-bf52-2f72deb3c618 service nova] Creating event network-changed:69428c06-6441-4bd8-a759-490658345854 for instance 03913b6b-c6bb-4b05-818e-697cbfb57428 on nch2-master-1 Jun 04 21:10:14.533307 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6015f4c0-9f24-4fbb-89c0-97b257a21a15 req-b1a65f42-9adb-4ddd-bf52-2f72deb3c618 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083113 Jun 04 21:10:14.535684 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2011/3899] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:14.558040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:14.558839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:14.574163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.574811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.575889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.576336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.657838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:10:14.658871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:10:14.659592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:10:14.660164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:10:14.660747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:10:14.674653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.675104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.682509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.683082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.692366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:14.711131 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b1fc602f-08c5-4ab8-a5d6-7bdc9e0d4ad9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1273 microversion: 2.1 time: 0.172283 Jun 04 21:10:14.712138 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2012/3900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:14 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:14.725151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:14.728123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:14.743018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.749093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.749804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Getting quotas for project 0f2b7449c8de4c6eba0e9b7c174856e1. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:10:14.750254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.750715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:14.758520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Getting quotas for user 3467d447a572424f9c6cd56c5fa7e0c4 and project 0f2b7449c8de4c6eba0e9b7c174856e1. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:10:14.778237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Going to run 2 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:10:14.784213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:10:14.846140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=e42add09-dd41-4620-882d-f0c426b2576c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:10:14.961108 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a37d0a7-e702-4054-986b-658cbfd2c32d tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.710273 Jun 04 21:10:14.962073 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1889/3901] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:10:11 2022] POST /compute/v2.1/servers => generated 32 bytes in 3713 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 04 21:10:14.970274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0d8e343c-91ae-4ede-a5f9-dcf3890c4563 req-dcbe14d8-5645-4db3-800f-1be00dbe9eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc75637-dfeb-420f-bc6e-380409b5e0f1", "name": "network-vif-deleted", "tag": "b9e52fab-feb3-427d-a942-ba4127a5a6f4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:14.984658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0d8e343c-91ae-4ede-a5f9-dcf3890c4563 req-dcbe14d8-5645-4db3-800f-1be00dbe9eac service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:14.985325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0d8e343c-91ae-4ede-a5f9-dcf3890c4563 req-dcbe14d8-5645-4db3-800f-1be00dbe9eac service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.004247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0d8e343c-91ae-4ede-a5f9-dcf3890c4563 req-dcbe14d8-5645-4db3-800f-1be00dbe9eac service nova] Creating event network-vif-deleted:b9e52fab-feb3-427d-a942-ba4127a5a6f4 for instance cfc75637-dfeb-420f-bc6e-380409b5e0f1 on nch1-master-1 Jun 04 21:10:15.016048 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0d8e343c-91ae-4ede-a5f9-dcf3890c4563 req-dcbe14d8-5645-4db3-800f-1be00dbe9eac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051460 Jun 04 21:10:15.019889 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1890/3902] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:15.030294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-86f18a8a-38d7-4f67-9257-da7c638e70e3 req-160b8a82-ba81-421b-b378-091dd8747aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "f88009bf-efdf-45e9-a270-b9a8b276b69f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:15.085174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-86f18a8a-38d7-4f67-9257-da7c638e70e3 req-160b8a82-ba81-421b-b378-091dd8747aa6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.086443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-86f18a8a-38d7-4f67-9257-da7c638e70e3 req-160b8a82-ba81-421b-b378-091dd8747aa6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.118250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:15.136708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:15.142054 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-86f18a8a-38d7-4f67-9257-da7c638e70e3 req-160b8a82-ba81-421b-b378-091dd8747aa6 service nova] Creating event network-vif-plugged:f88009bf-efdf-45e9-a270-b9a8b276b69f for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:15.143062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:15.144390 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c8e384bb-fa44-4f89-be71-c05e4afbe1c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.429900 Jun 04 21:10:15.147443 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2013/3903] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:14 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:15.155671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:15.156542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:15.175998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.178094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.179121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.182617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.193908 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-86f18a8a-38d7-4f67-9257-da7c638e70e3 req-160b8a82-ba81-421b-b378-091dd8747aa6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170368 Jun 04 21:10:15.195023 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1891/3904] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:15.216122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:15.227625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:15.228791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Searching by: {'deleted': False, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:10:15.278010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.278534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.282645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.282645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.311444 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9203da47-346c-4045-834b-7726dd5bb2be tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.107013 Jun 04 21:10:15.312087 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1892/3905] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:10:15 2022] GET /compute/v2.1/servers => generated 673 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:15.325817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36041540-59af-4323-a559-62ba540d9036 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:15.326895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-36041540-59af-4323-a559-62ba540d9036 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:15.624771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-36041540-59af-4323-a559-62ba540d9036 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:15.632561 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36041540-59af-4323-a559-62ba540d9036 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1218 microversion: 2.1 time: 0.312588 Jun 04 21:10:15.637064 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1893/3906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:15 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1218 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:15.642194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:15.653318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:15.663171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.663812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.666977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.668704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.776181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:15.794366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6bb3442e-895d-4111-864e-6098f90f5c56 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.644599 Jun 04 21:10:15.796953 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2014/3907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:15 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:15.825020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:15.826418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:15.845990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.846889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:15.848160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:15.848754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:16.787014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:16.801333 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84e38ef4-d7cb-46e5-9d82-c2429f355c71 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1273 microversion: 2.1 time: 1.001910 Jun 04 21:10:16.802481 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2015/3908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:15 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1273 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:16.820120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:16.821024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:16.840627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:16.841353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:16.842973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:16.846524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.307109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:17.333946 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-53333718-8e74-4789-b813-c8a2c55043dd tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 1.686582 Jun 04 21:10:17.343644 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1894/3909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:15 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:17.355814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:17.356825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:17.382250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.382592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.391659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.392335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.646025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:17.663416 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bcfcb842-b110-4689-a57a-8d6703d35645 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1288 microversion: 2.1 time: 0.318230 Jun 04 21:10:17.664822 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1895/3910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:17 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1288 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:17.678818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1641462c-ade0-4363-a9c9-70c0ee3ffd8c req-937876cb-85c2-47a3-af4b-3b0e146cc2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0e24c1-222e-43e9-8cab-ede5fc3fc238", "name": "network-vif-deleted", "tag": "50162a6b-2a03-454d-8f73-827201f7801c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:17.690730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1641462c-ade0-4363-a9c9-70c0ee3ffd8c req-937876cb-85c2-47a3-af4b-3b0e146cc2c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.691602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1641462c-ade0-4363-a9c9-70c0ee3ffd8c req-937876cb-85c2-47a3-af4b-3b0e146cc2c4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.710384 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1641462c-ade0-4363-a9c9-70c0ee3ffd8c req-937876cb-85c2-47a3-af4b-3b0e146cc2c4 service nova] Creating event network-vif-deleted:50162a6b-2a03-454d-8f73-827201f7801c for instance ec0e24c1-222e-43e9-8cab-ede5fc3fc238 on nch2-master-1 Jun 04 21:10:17.717462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:17.719677 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1641462c-ade0-4363-a9c9-70c0ee3ffd8c req-937876cb-85c2-47a3-af4b-3b0e146cc2c4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053246 Jun 04 21:10:17.720503 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1896/3911] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:17.732842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:17.733818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:17.734118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:17.735664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:17.736883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6fd6d5fc-881c-4acd-9e44-7a8e2ed0321f tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.931914 Jun 04 21:10:17.737462 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2016/3912] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:16 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:17.754096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.754940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.755992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.756602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.818362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:17.819868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:17.829251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.829909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.832409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:17.833189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:17.958872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:17.971061 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fb629698-3c32-47c4-9e3c-c994825f030b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1273 microversion: 2.1 time: 0.155979 Jun 04 21:10:17.974811 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2017/3913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:17 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:18.281659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:18.299643 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2539efcd-afbe-4a33-b2e8-268ebda82578 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.574703 Jun 04 21:10:18.300519 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1897/3914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:17 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:18.357067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:18.358011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:18.371101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.371907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:18.372953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.373842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:18.684822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:18.687908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:18.716554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.717729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:18.721833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.722895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:18.732713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:18.749964 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-56f4b876-256f-4541-86d5-bb564f60d6f0 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 0.399161 Jun 04 21:10:18.754158 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2018/3915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:18 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:18.774967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:18.778944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:18.795728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.797480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:18.800417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.802566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:18.857609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:18.867699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a46fe447-5fe2-410e-92a0-c1a02bc80f33 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1276 microversion: 2.1 time: 0.189965 Jun 04 21:10:18.871792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1898/3916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:18 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:18.989127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:18.989765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:18.999321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:18.999816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:19.001040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:19.001040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:19.516763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:19.534903 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c9d99c7-7a86-4920-8717-b3904949133c tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 0.550239 Jun 04 21:10:19.536129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:19.539100 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1899/3917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:18 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:19.548565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:19.551057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:19.560925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:19.567173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:19.571518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:19.572267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:19.573310 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad1c181a-ee1f-4b2e-b059-dbca8bc343a8 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.803436 Jun 04 21:10:19.573853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:19.574443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:19.577155 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2019/3918] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:18 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:19.774192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:19.774892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:19.782533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:19.783310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:19.784319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:19.784956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:20.079958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:20.089132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fec0a7cd-0634-41d9-8848-0dc020a50f63 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.548357 Jun 04 21:10:20.099123 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1900/3919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:19 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:20.105106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:20.106021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:20.113247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:20.113972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:20.115184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:20.115873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:20.327066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:20.342668 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-40f1a15a-76d2-4e20-a695-ed2d7e417b46 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 0.575022 Jun 04 21:10:20.343725 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2020/3920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:19 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:20.559765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:20.560409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:20.571044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:20.571999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:20.573514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:20.574192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:21.224610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:21.262842 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e048a157-c88d-40fe-953c-60ff6d179ca2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 1.162221 Jun 04 21:10:21.263701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1901/3921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:20 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:21.286000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:21.287062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:21.300534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:21.301852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:21.302827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:21.303413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:21.526303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:21.549588 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b49a97f1-34f6-484b-b635-b547d68f09c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 0.999423 Jun 04 21:10:21.557790 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2021/3922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:20 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:21.580379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:21.587018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:21.614063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:21.614541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:21.616197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:21.619368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:21.681855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:21.742758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:21.975858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:21.989095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:21.990659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:21.992106 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e7722575-c135-4b1c-9e18-30faa9d03961 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.716467 Jun 04 21:10:21.992871 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1902/3923] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:21 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:21.998626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c44406e9-da52-4a52-add6-5fe0d3b57ef5 req-6e3af1e9-413f-48ea-b0df-7cadb267cf82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec16dea-e559-4dc0-b789-afe3e88c34cc", "tag": "83ce9e21-d62c-4d95-9b66-3b8b0d42902f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:22.018197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c44406e9-da52-4a52-add6-5fe0d3b57ef5 req-6e3af1e9-413f-48ea-b0df-7cadb267cf82 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.018723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c44406e9-da52-4a52-add6-5fe0d3b57ef5 req-6e3af1e9-413f-48ea-b0df-7cadb267cf82 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.034427 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c44406e9-da52-4a52-add6-5fe0d3b57ef5 req-6e3af1e9-413f-48ea-b0df-7cadb267cf82 service nova] Creating event network-changed:83ce9e21-d62c-4d95-9b66-3b8b0d42902f for instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc on nch2-master-1 Jun 04 21:10:22.040897 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c44406e9-da52-4a52-add6-5fe0d3b57ef5 req-6e3af1e9-413f-48ea-b0df-7cadb267cf82 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046583 Jun 04 21:10:22.043010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1903/3924] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:22.051419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:22.053030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:22.065378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.066162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.067224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.068121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.134704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:22.144127 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d12ff22-4681-4bf5-9026-ce64ca7e642e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.584379 Jun 04 21:10:22.144725 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2022/3925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:21 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:22.150511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c2c1be79-4155-4e79-8e71-59f3347579a4 req-b617425f-3348-42bd-a776-d52be13b6438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03913b6b-c6bb-4b05-818e-697cbfb57428", "name": "network-vif-plugged", "status": "completed", "tag": "69428c06-6441-4bd8-a759-490658345854"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:22.165300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c2c1be79-4155-4e79-8e71-59f3347579a4 req-b617425f-3348-42bd-a776-d52be13b6438 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.165885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c2c1be79-4155-4e79-8e71-59f3347579a4 req-b617425f-3348-42bd-a776-d52be13b6438 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.178756 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c2c1be79-4155-4e79-8e71-59f3347579a4 req-b617425f-3348-42bd-a776-d52be13b6438 service nova] Creating event network-vif-plugged:69428c06-6441-4bd8-a759-490658345854 for instance 03913b6b-c6bb-4b05-818e-697cbfb57428 on nch2-master-1 Jun 04 21:10:22.184944 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c2c1be79-4155-4e79-8e71-59f3347579a4 req-b617425f-3348-42bd-a776-d52be13b6438 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Jun 04 21:10:22.185778 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2023/3926] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:22.280512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:22.281731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:22.291034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.291979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.293448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.294215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.565373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:22.576660 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-35c7d257-2877-463f-9967-a755f2f2ef43 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 0.532058 Jun 04 21:10:22.586550 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1904/3927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:22 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:22.593255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:22.594192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:22.601817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.602911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:22.604102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:22.604793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.029319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:23.054184 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d2ec531-a036-42d5-804f-8064856c8c43 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.777426 Jun 04 21:10:23.056782 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2024/3928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:22 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:23.071532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-11fcdc31-5c6b-4573-83dd-efaf88be5ec7 req-6b258561-1838-4931-bdc8-73c29cd8cc6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52b2553-b6f7-4b38-8e22-885c864c8c6a", "tag": "91e1dacd-6b9e-4e3d-b066-f95a3472854c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:23.090603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-11fcdc31-5c6b-4573-83dd-efaf88be5ec7 req-6b258561-1838-4931-bdc8-73c29cd8cc6b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.091553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-11fcdc31-5c6b-4573-83dd-efaf88be5ec7 req-6b258561-1838-4931-bdc8-73c29cd8cc6b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.107361 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-11fcdc31-5c6b-4573-83dd-efaf88be5ec7 req-6b258561-1838-4931-bdc8-73c29cd8cc6b service nova] Creating event network-changed:91e1dacd-6b9e-4e3d-b066-f95a3472854c for instance a52b2553-b6f7-4b38-8e22-885c864c8c6a on nch2-master-1 Jun 04 21:10:23.114793 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-11fcdc31-5c6b-4573-83dd-efaf88be5ec7 req-6b258561-1838-4931-bdc8-73c29cd8cc6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054982 Jun 04 21:10:23.120470 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2025/3929] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:23.129264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:23.130505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:23.139259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.140311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.141350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.142033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.165302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:23.220967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:23.236437 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a53b4c51-de6e-40c4-b565-e7ec2828d471 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 0.647834 Jun 04 21:10:23.248968 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1905/3930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:22 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:23.262183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:23.266640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:23.284421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.285254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.286518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.287127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.635090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:23.653210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:23.667376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:23.669303 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ad0173a-8a6f-4a59-9138-8d4eefb13db5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.546295 Jun 04 21:10:23.670143 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2026/3931] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:23 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:23.691987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:23.692659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:23.700183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.705769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.706682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:23.707143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:23.972876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:23.987144 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d9c45d5d-fb50-4d8e-892f-32ea3f00ddf1 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.736664 Jun 04 21:10:23.987954 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1906/3932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:23 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:24.073722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:24.074715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:24.093840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.094303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:24.095093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.096596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:24.119361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:24.510843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:24.522317 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c683e428-8134-4ffa-9a53-c1cbfccb1478 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1317 microversion: 2.1 time: 0.850591 Jun 04 21:10:24.523442 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2027/3933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:23 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1317 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:24.529558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e949cd7a-7dd8-4654-85bd-07952234e619 req-f5edace7-e717-4b57-8704-386d12aa5386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42add09-dd41-4620-882d-f0c426b2576c", "tag": "e2302ef7-5403-4fc0-a84a-7450ccebe926"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:24.541908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e949cd7a-7dd8-4654-85bd-07952234e619 req-f5edace7-e717-4b57-8704-386d12aa5386 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.542583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e949cd7a-7dd8-4654-85bd-07952234e619 req-f5edace7-e717-4b57-8704-386d12aa5386 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:24.574983 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e949cd7a-7dd8-4654-85bd-07952234e619 req-f5edace7-e717-4b57-8704-386d12aa5386 service nova] Creating event network-changed:e2302ef7-5403-4fc0-a84a-7450ccebe926 for instance e42add09-dd41-4620-882d-f0c426b2576c on nch1-master-1 Jun 04 21:10:24.580340 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e949cd7a-7dd8-4654-85bd-07952234e619 req-f5edace7-e717-4b57-8704-386d12aa5386 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055376 Jun 04 21:10:24.581596 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2028/3934] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:24.587654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:24.588794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:24.616873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:24.640739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f04f22b-5d88-4b96-9531-72f00f782335 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.568352 Jun 04 21:10:24.641680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.642243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:24.644541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.645514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:24.654474 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1907/3935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:24 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:24.689408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:24.690031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:24.700936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.701377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:24.705733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:24.706773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:25.288560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:25.632082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:25.761396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:25.774914 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b00aa8c-b580-48de-b2ea-67d6222ad340 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 1.191597 Jun 04 21:10:25.776180 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2029/3936] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:24 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:25.793479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:25.794115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:25.811022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:25.811763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:25.812748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:25.813340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:25.849406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:25.865555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:25.868260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:25.873043 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b2cdea16-1073-47cf-a9de-b9e7efcb74ce tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.186856 Jun 04 21:10:25.889373 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1908/3937] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:24 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:25.902680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:25.907791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:25.917070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:25.917780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:25.918910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:25.920841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.642665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:26.653460 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a7082097-8c4d-450d-9bcf-1fa3ad777e69 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.864173 Jun 04 21:10:26.664449 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2030/3938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:25 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:26.671861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:26.672871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:26.680856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.681712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.682756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.683866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.777824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:26.807002 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf269b48-c809-4b2a-9bf8-1ed39c16a13e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1507 microversion: 2.1 time: 0.912835 Jun 04 21:10:26.809060 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1909/3939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:25 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1507 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:26.816139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-002c09b5-ac06-4e04-b4bf-166c7034a38a req-f1e66e7c-9643-47d8-9389-e1e8b0c1eab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "51933103-024f-40de-a3da-309ec20b0d07"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:26.834948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-002c09b5-ac06-4e04-b4bf-166c7034a38a req-f1e66e7c-9643-47d8-9389-e1e8b0c1eab9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.837071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-002c09b5-ac06-4e04-b4bf-166c7034a38a req-f1e66e7c-9643-47d8-9389-e1e8b0c1eab9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.862255 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-002c09b5-ac06-4e04-b4bf-166c7034a38a req-f1e66e7c-9643-47d8-9389-e1e8b0c1eab9 service nova] Creating event network-vif-plugged:51933103-024f-40de-a3da-309ec20b0d07 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:26.870638 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-002c09b5-ac06-4e04-b4bf-166c7034a38a req-f1e66e7c-9643-47d8-9389-e1e8b0c1eab9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059961 Jun 04 21:10:26.871842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1910/3940] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:26.878548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:26.879812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:26.889529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.890478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.891650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.892323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.944073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:26.959217 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-edd31d73-9bf1-4c0b-952a-c76781ef7c80 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.292235 Jun 04 21:10:26.960079 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2031/3941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:26 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:26.967203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:26.979892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:26.987412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.988103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:26.992644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:26.993997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:27.743746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:27.755902 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fcfaa9aa-b151-4d93-b825-f163dfde09e4 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 0.882316 Jun 04 21:10:27.757831 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1911/3942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:26 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:27.763385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:27.770434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:27.775136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:27.782230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:27.793468 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e1264d3c-8582-4dd9-a66b-59a7d0a62d3c tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1507 microversion: 2.1 time: 0.826981 Jun 04 21:10:27.807977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:27.810131 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2032/3943] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:26 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1507 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:27.812903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:27.814156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:27.814723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:27.818632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:27.819444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:27.829973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:27.830728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:27.831825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:27.832454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:29.485332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:29.508296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:29.518003 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8fdee863-6bea-46fd-af48-5d3efa1211d6 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 1.704884 Jun 04 21:10:29.519001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:29.521391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:29.522217 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2033/3944] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:27 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:29.526344 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20479166-237a-4504-a3c0-c134bfcd1656 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.766257 Jun 04 21:10:29.526920 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1912/3945] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:27 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:29.539379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:29.551691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:29.553213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:29.558100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:29.566757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:29.567215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:29.568034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:29.568475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:29.573978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:29.574528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:29.575264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:29.575737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:29.764984 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4fbc24d1-8150-4e2c-9336-b3913b92a4a4 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "PUT /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1079 microversion: 2.1 time: 0.241239 Jun 04 21:10:29.777209 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2034/3946] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:10:29 2022] PUT /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1079 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:29.782530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:29.783155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:29.792138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:29.792598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:29.793395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:29.793839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:30.303155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:30.324772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e0bcae4-995f-41b9-b21c-a93e53b9e1a4 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.790907 Jun 04 21:10:30.339023 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1913/3947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:29 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:30.353142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "2be49f23-9dc7-4218-8ae0-35037e1424eb"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e"}, {"server_uuid": "e9b5db72-5ec2-495f-86bf-99c94ec6c3af", "name": "network-vif-plugged", "status": "completed", "tag": "9a71ae16-64f4-408b-96ba-75aa9a0fada9"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:30.388147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:30.388900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:30.412538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] Creating event network-vif-plugged:2be49f23-9dc7-4218-8ae0-35037e1424eb for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:30.413591 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] Creating event network-vif-plugged:f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:30.415222 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] Creating event network-vif-plugged:9a71ae16-64f4-408b-96ba-75aa9a0fada9 for instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af on nch1-master-1 Jun 04 21:10:30.430326 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-22396575-b703-4411-9104-7c3b05259592 req-7809245d-fd5b-4bc7-b8a5-cab1115b7dd0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.089383 Jun 04 21:10:30.431936 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1914/3948] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:30.439051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:30.440608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:30.467541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:30.468237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:30.469539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:30.470156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:30.488438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:30.501317 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d4b0c86-256d-48ed-a078-620619ec73c6 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 0.722254 Jun 04 21:10:30.501934 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2035/3949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:29 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:30.538906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:30.540532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:30.550911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:30.552195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:30.553676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:30.555389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:31.058410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:31.080316 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-976703f6-c548-4843-a10d-e8cd156bf5b5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1505 microversion: 2.1 time: 0.644012 Jun 04 21:10:31.081850 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1915/3950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:30 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1505 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:31.090488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:31.104152 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a62d007e-3b4c-4964-88fb-17183c6d247f tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1363 microversion: 2.1 time: 0.569552 Jun 04 21:10:31.105389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2036/3951] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:30 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1363 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:31.118409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:31.119379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:31.120257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:31.121670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:31.133777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:31.134558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:31.135461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:31.136584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:31.153848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:31.160083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:31.161034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:31.161499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:31.555835 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:31.569894 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-56c34020-0b70-47a2-83fa-e7da96cda336 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1505 microversion: 2.1 time: 0.462825 Jun 04 21:10:31.570845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2037/3952] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:31 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:31.586362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:31.587258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:31.598151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:31.598613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:31.605221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:31.605691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.436765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:32.469336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:32.476164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:32.482988 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-57eb94c6-dce6-43f9-b770-9e7950252218 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 1.397299 Jun 04 21:10:32.483466 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1916/3953] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:31 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:32.502141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:32.510629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:32.521277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:32.521727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.522517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:32.522953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.687810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:32.699947 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e0d5f3d-152b-4a0e-aa81-2c660f51d480 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 1.127972 Jun 04 21:10:32.700573 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2038/3954] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:31 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:32.714257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:32.721200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:32.733876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:32.739947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.741173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:32.741765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.855565 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-58f962bd-f2ae-4a87-9c7d-96b84ed8a892 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "PUT /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1081 microversion: 2.1 time: 0.144881 Jun 04 21:10:32.856391 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2039/3955] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:10:32 2022] PUT /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1081 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:32.861965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:32.862590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:32.872674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:32.873135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.874146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:32.874949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:32.955070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:32.977455 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73f11cb6-9ce2-4895-a13c-e9bd606fae08 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1315 microversion: 2.1 time: 0.480437 Jun 04 21:10:32.978171 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1917/3956] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:32 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:32.990984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "611f4ee0-557c-4fa9-a580-d389ba7a7980"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "25e9d377-4b92-4a26-a908-1a149587b307"}, {"server_uuid": "8ec16dea-e559-4dc0-b789-afe3e88c34cc", "name": "network-vif-plugged", "status": "completed", "tag": "83ce9e21-d62c-4d95-9b66-3b8b0d42902f"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-plugged", "status": "completed", "tag": "c609dbe7-1ecc-4c38-8e4c-c41f8b766947"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:33.006042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.016364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.043299 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Creating event network-vif-plugged:611f4ee0-557c-4fa9-a580-d389ba7a7980 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:33.044102 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Creating event network-vif-plugged:25e9d377-4b92-4a26-a908-1a149587b307 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:33.044783 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Creating event network-vif-plugged:83ce9e21-d62c-4d95-9b66-3b8b0d42902f for instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc on nch2-master-1 Jun 04 21:10:33.045447 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] Creating event network-vif-plugged:c609dbe7-1ecc-4c38-8e4c-c41f8b766947 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:33.065533 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9a20be04-2224-4213-85b1-95ab42c77c87 req-db2f5576-590b-4abf-9d65-653c10d09fec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.085785 Jun 04 21:10:33.066557 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1918/3957] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:33.072037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:33.072791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:33.091672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.092769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.096214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.096847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.428725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:33.441766 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6803a77f-6138-4479-80ae-d4315c4fe42e tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1549 microversion: 2.1 time: 0.583777 Jun 04 21:10:33.443029 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2040/3958] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:32 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1549 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:33.456116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:33.458899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:33.461015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:33.467624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.468318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.469438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.470029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.475442 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e1ede603-6d6e-45a2-b5f2-6f33ef26509e tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1507 microversion: 2.1 time: 0.407580 Jun 04 21:10:33.489890 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1919/3959] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:33 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:33.495550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:33.496385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:33.505135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.505931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.506931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.508218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.711049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46ac44a8-5896-4764-9cdd-7f3a02084280 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.254927 Jun 04 21:10:33.714871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2041/3960] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:10:33 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:33.720924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:33.721811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:33.734926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.735855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:33.737962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:33.739402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.020387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:34.045731 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-580d7893-d558-47e8-a4e5-ac5ee25a9a39 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1507 microversion: 2.1 time: 0.554583 Jun 04 21:10:34.046994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1920/3961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:33 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:34.053269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:34.054091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:34.061000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.061762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.062610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.063114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.417448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:34.421099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:34.450953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:34.454616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:34.458818 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-07a6901d-aee3-4f16-b43e-cfea0b983883 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1878 microversion: 2.42 time: 0.742552 Jun 04 21:10:34.460022 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2042/3962] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:33 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1878 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:34.466493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:34.467398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:34.476556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.477125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.478153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.478671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.540309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:34.551989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f96191fb-035a-44f5-8206-971e3d486da5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.503645 Jun 04 21:10:34.552894 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1921/3963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:34 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:34.557955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:34.558535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:34.566064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.566750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.567555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.567986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.597070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:34.720511 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e733f84e-9fc5-422a-b8ec-8ee874798f9f tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 204 len: 0 microversion: 2.1 time: 0.165996 Jun 04 21:10:34.723602 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1922/3964] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:34 2022] DELETE /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:10:34.741783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:34.742706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:34.751422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.752489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.753298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.753902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.793919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:34.809176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:34.858536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Instance is already in deleting state, ignoring this request Jun 04 21:10:34.860312 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d592965-f757-4d80-bb67-d8772e05df38 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 204 len: 0 microversion: 2.1 time: 0.122824 Jun 04 21:10:34.861136 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1923/3965] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:34 2022] DELETE /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:10:34.871899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:34.872861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:34.883635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.884079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:34.885220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:34.885652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.446741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:35.456468 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7758c26-4d16-4d93-be88-284fb97c8e06 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1465 microversion: 2.1 time: 0.994857 Jun 04 21:10:35.457245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2043/3966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:34 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1465 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:35.466522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-64eef839-c445-4164-ab61-4e533b9dd77b req-868efa27-eb9e-45db-b8ee-a967df0d878f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42add09-dd41-4620-882d-f0c426b2576c", "name": "network-vif-plugged", "status": "completed", "tag": "e2302ef7-5403-4fc0-a84a-7450ccebe926"}, {"server_uuid": "a52b2553-b6f7-4b38-8e22-885c864c8c6a", "name": "network-vif-plugged", "status": "completed", "tag": "91e1dacd-6b9e-4e3d-b066-f95a3472854c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:35.495579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-64eef839-c445-4164-ab61-4e533b9dd77b req-868efa27-eb9e-45db-b8ee-a967df0d878f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.498395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-64eef839-c445-4164-ab61-4e533b9dd77b req-868efa27-eb9e-45db-b8ee-a967df0d878f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.515422 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-64eef839-c445-4164-ab61-4e533b9dd77b req-868efa27-eb9e-45db-b8ee-a967df0d878f service nova] Creating event network-vif-plugged:e2302ef7-5403-4fc0-a84a-7450ccebe926 for instance e42add09-dd41-4620-882d-f0c426b2576c on nch1-master-1 Jun 04 21:10:35.516211 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-64eef839-c445-4164-ab61-4e533b9dd77b req-868efa27-eb9e-45db-b8ee-a967df0d878f service nova] Creating event network-vif-plugged:91e1dacd-6b9e-4e3d-b066-f95a3472854c for instance a52b2553-b6f7-4b38-8e22-885c864c8c6a on nch2-master-1 Jun 04 21:10:35.526337 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-64eef839-c445-4164-ab61-4e533b9dd77b req-868efa27-eb9e-45db-b8ee-a967df0d878f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066778 Jun 04 21:10:35.527147 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2044/3967] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:35.535282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:35.536363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:35.544887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.545444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.546310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.547484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.636980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:35.644841 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e76dc5d-98e0-48d1-ab37-00b03160adf1 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1513 microversion: 2.1 time: 0.779365 Jun 04 21:10:35.646093 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1924/3968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:34 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1513 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:35.656260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:35.657142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:35.664783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.665417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.666492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.667040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.697567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:35.883350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b62d4913-dbb7-434c-9070-efd8398ee09f tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 204 len: 0 microversion: 2.1 time: 0.235066 Jun 04 21:10:35.887947 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1925/3969] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:35 2022] DELETE /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:10:35.898255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:35.899802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:35.909838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.910572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.912255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:35.912870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:35.952011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:35.970559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:35.973025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:35.974551 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f6decb8-7854-4a4b-a6ff-98e9d2d270bb tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2835 microversion: 2.42 time: 0.445859 Jun 04 21:10:35.990797 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2045/3970] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:10:35 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2835 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:35.997129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:35.998037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:36.005691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:36.006357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:36.007315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:36.007969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:36.414373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:36.427974 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e19e613d-48eb-434a-aed3-54d1928605db tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.537123 Jun 04 21:10:36.429028 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1926/3971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:35 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:36.436327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:36.439311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:36.451814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:36.454311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:36.467716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:36.472186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:36.630547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:36.648555 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-680d85de-692a-40f2-b10d-79439d886cd9 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1471 microversion: 2.1 time: 0.656210 Jun 04 21:10:36.653350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2046/3972] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:35 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1471 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:36.667439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:36.668425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:36.677776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:36.678286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:36.678993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:36.679427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:36.867161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecbec4e5-ce12-4427-a2bb-5533931b09c5 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.435530 Jun 04 21:10:36.869147 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1927/3973] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Jun 4 21:10:36 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c/os-interface => generated 1830 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:10:37.380032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:37.403736 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd1794bc-d137-4da2-8b76-41cb657af2d7 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1513 microversion: 2.1 time: 0.741166 Jun 04 21:10:37.404569 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2047/3974] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:36 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1513 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:37.445699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:37.446474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:37.460715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:37.461173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:37.462118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:37.462557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:37.470331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d01c76b3-c605-448f-9002-0be69e68939a req-d010e1d5-169f-473a-b46e-c2b0637b8f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9b5db72-5ec2-495f-86bf-99c94ec6c3af", "tag": "9a71ae16-64f4-408b-96ba-75aa9a0fada9"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:37.490011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d01c76b3-c605-448f-9002-0be69e68939a req-d010e1d5-169f-473a-b46e-c2b0637b8f4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:37.490730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d01c76b3-c605-448f-9002-0be69e68939a req-d010e1d5-169f-473a-b46e-c2b0637b8f4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:37.522598 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d01c76b3-c605-448f-9002-0be69e68939a req-d010e1d5-169f-473a-b46e-c2b0637b8f4e service nova] Creating event network-changed:9a71ae16-64f4-408b-96ba-75aa9a0fada9 for instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af on nch1-master-1 Jun 04 21:10:37.531122 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d01c76b3-c605-448f-9002-0be69e68939a req-d010e1d5-169f-473a-b46e-c2b0637b8f4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063912 Jun 04 21:10:37.532519 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2048/3975] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:37.677734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:37.681426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:37.698593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:37.701573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:37.702543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:37.703753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:37.706235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:37.938638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:37.952035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ed4359ca-dac3-4966-8a4c-86e0ce4a94ab tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1318 microversion: 2.1 time: 0.510754 Jun 04 21:10:37.955925 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1928/3976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:37 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:38.350358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:38.368190 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73aaaeed-9370-401c-84ff-265af71d181b tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1471 microversion: 2.1 time: 0.698020 Jun 04 21:10:38.373588 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2049/3977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:37 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1471 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:38.424179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:38.425025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:38.436062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:38.437542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:38.444337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:38.445020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:38.971136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:38.971808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:38.995573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:38.996309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:38.997257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:38.997829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:39.039026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecdc2e5bf2e3492bb5320e054641ec3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f851d439ae4167af07518e3b1354ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:39.050750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e009ea1-a4e4-4e96-a3f4-1d3b3ad1b1df tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 200 len: 1471 microversion: 2.1 time: 0.631591 Jun 04 21:10:39.051735 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1929/3978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:38 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:39.404339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:39.406803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:39.419929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:39.420573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:39.421376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:39.421816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:39.422347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:39.432023 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a644d1bd-7148-46a2-8b93-d5ac9e62ba03 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 200 len: 1506 microversion: 2.1 time: 0.466517 Jun 04 21:10:39.447899 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2050/3979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:38 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:39.463483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:39.464143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:39.477713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:39.478412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:39.480557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:39.481151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.104691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:40.117226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:40.131559 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87188028-33e1-49c2-884f-29d4be0ad2bf tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1471 microversion: 2.1 time: 0.743582 Jun 04 21:10:40.131841 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b2e0cf52-0751-4b8b-9cab-130243998730 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c" status: 200 len: 1507 microversion: 2.1 time: 0.678458 Jun 04 21:10:40.133077 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2051/3980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:39 2022] GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c => generated 1507 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:40.138416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-56071aba-b9b5-41a1-864e-d1821f8d5f40 req-3d344e1f-04c8-4665-80e8-eaee19e57335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03913b6b-c6bb-4b05-818e-697cbfb57428", "name": "network-vif-deleted", "tag": "69428c06-6441-4bd8-a759-490658345854"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:40.139481 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1930/3981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:39 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1471 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:40.147163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.149596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 03913b6b-c6bb-4b05-818e-697cbfb57428] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.163230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-56071aba-b9b5-41a1-864e-d1821f8d5f40 req-3d344e1f-04c8-4665-80e8-eaee19e57335 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.164062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-56071aba-b9b5-41a1-864e-d1821f8d5f40 req-3d344e1f-04c8-4665-80e8-eaee19e57335 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.166010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.169954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.171828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.172589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.206716 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-56071aba-b9b5-41a1-864e-d1821f8d5f40 req-3d344e1f-04c8-4665-80e8-eaee19e57335 service nova] Creating event network-vif-deleted:69428c06-6441-4bd8-a759-490658345854 for instance 03913b6b-c6bb-4b05-818e-697cbfb57428 on nch2-master-1 Jun 04 21:10:40.212287 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-56071aba-b9b5-41a1-864e-d1821f8d5f40 req-3d344e1f-04c8-4665-80e8-eaee19e57335 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077423 Jun 04 21:10:40.214057 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] HTTP exception thrown: Instance 03913b6b-c6bb-4b05-818e-697cbfb57428 could not be found. Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Request method failure captured: Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 HTTP/1.1 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mcAQpTYPxplHQE6gUtd_y3sfguCWlRaoHXjeiw4ssNsJ1avShU_E2NhT-qgGFmhnC2E08Y5cr5wuXPCqoHWTfSQZ10Q5U3zTOXYNr7oS7JLxHNGom5MrtHWbPXLdjOG0oFmI0_DatjMHUhZlf_SEfzkeP2c-jnPsTCyzVYQfjLaDM Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14f851d439ae4167af07518e3b1354ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ecdc2e5bf2e3492bb5320e054641ec3c Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 03913b6b-c6bb-4b05-818e-697cbfb57428 could not be found. Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '03913b6b-c6bb-4b05-818e-697cbfb57428'} Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03913b6b-c6bb-4b05-818e-697cbfb57428 could not be found. Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03913b6b-c6bb-4b05-818e-697cbfb57428 could not be found. Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.216008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03913b6b-c6bb-4b05-818e-697cbfb57428 could not be found. Jun 04 21:10:40.221638 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.222510 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2052/3982] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:40.240213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Returning 404 to user: Instance 03913b6b-c6bb-4b05-818e-697cbfb57428 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:40.242477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b72c5a0b-a334-4a1b-aab0-07de24c47409 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428" status: 404 len: 111 microversion: 2.1 time: 0.100843 Jun 04 21:10:40.250746 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1931/3983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:40 2022] GET /compute/v2.1/servers/03913b6b-c6bb-4b05-818e-697cbfb57428 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:40.280999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.283141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.285866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.286390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.297574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.301995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.304419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.304884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.305600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.306691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.310902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.311355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.338354 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] HTTP exception thrown: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Request method failure captured: Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 HTTP/1.1 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mcAQpTYPxplHQE6gUtd_y3sfguCWlRaoHXjeiw4ssNsJ1avShU_E2NhT-qgGFmhnC2E08Y5cr5wuXPCqoHWTfSQZ10Q5U3zTOXYNr7oS7JLxHNGom5MrtHWbPXLdjOG0oFmI0_DatjMHUhZlf_SEfzkeP2c-jnPsTCyzVYQfjLaDM Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14f851d439ae4167af07518e3b1354ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ecdc2e5bf2e3492bb5320e054641ec3c Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '9146e266-6fc5-4e35-b90c-c41b1e45d869'} Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:40.340290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.343447 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.346004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Returning 404 to user: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:40.347112 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5e33d963-a2fa-41ee-9de8-f16f0dd22312 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 404 len: 111 microversion: 2.1 time: 0.094977 Jun 04 21:10:40.353151 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1932/3984] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:40 2022] DELETE /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:40.366620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.377195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:40.380448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 9146e266-6fc5-4e35-b90c-c41b1e45d869] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.390631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.391440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.392541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.393234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.422590 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] HTTP exception thrown: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Request method failure captured: Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 HTTP/1.1 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mcAQpTYPxplHQE6gUtd_y3sfguCWlRaoHXjeiw4ssNsJ1avShU_E2NhT-qgGFmhnC2E08Y5cr5wuXPCqoHWTfSQZ10Q5U3zTOXYNr7oS7JLxHNGom5MrtHWbPXLdjOG0oFmI0_DatjMHUhZlf_SEfzkeP2c-jnPsTCyzVYQfjLaDM Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14f851d439ae4167af07518e3b1354ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ecdc2e5bf2e3492bb5320e054641ec3c Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '9146e266-6fc5-4e35-b90c-c41b1e45d869'} Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.425140 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. Jun 04 21:10:40.428511 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.431304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Returning 404 to user: Instance 9146e266-6fc5-4e35-b90c-c41b1e45d869 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:40.434010 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76ba884e-7c65-46cd-a527-d3fce4308d9d tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869" status: 404 len: 111 microversion: 2.1 time: 0.078040 Jun 04 21:10:40.438809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1933/3985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:40 2022] GET /compute/v2.1/servers/9146e266-6fc5-4e35-b90c-c41b1e45d869 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:40.444425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.445250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.452736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.453520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.454528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.455177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.484607 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] HTTP exception thrown: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Request method failure captured: Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f HTTP/1.1 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mcAQpTYPxplHQE6gUtd_y3sfguCWlRaoHXjeiw4ssNsJ1avShU_E2NhT-qgGFmhnC2E08Y5cr5wuXPCqoHWTfSQZ10Q5U3zTOXYNr7oS7JLxHNGom5MrtHWbPXLdjOG0oFmI0_DatjMHUhZlf_SEfzkeP2c-jnPsTCyzVYQfjLaDM Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14f851d439ae4167af07518e3b1354ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ecdc2e5bf2e3492bb5320e054641ec3c Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '06ba73aa-fbc6-409e-927f-babb129b426f'} Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:40.489367 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.498535 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.501420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Returning 404 to user: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:40.502571 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78c06c7b-4f1b-4fad-9e4b-78b62d8788e5 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "DELETE /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 404 len: 111 microversion: 2.1 time: 0.062348 Jun 04 21:10:40.507229 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1934/3986] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:40 2022] DELETE /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:40.516035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.516955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] [instance: 06ba73aa-fbc6-409e-927f-babb129b426f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.525539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.526291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.527302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.527994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.550487 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] HTTP exception thrown: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Request method failure captured: Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f HTTP/1.1 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8mcAQpTYPxplHQE6gUtd_y3sfguCWlRaoHXjeiw4ssNsJ1avShU_E2NhT-qgGFmhnC2E08Y5cr5wuXPCqoHWTfSQZ10Q5U3zTOXYNr7oS7JLxHNGom5MrtHWbPXLdjOG0oFmI0_DatjMHUhZlf_SEfzkeP2c-jnPsTCyzVYQfjLaDM Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_14f851d439ae4167af07518e3b1354ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/14f851d439ae4167af07518e3b1354ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 14f851d439ae4167af07518e3b1354ac Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1452137065 Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ecdc2e5bf2e3492bb5320e054641ec3c Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-1452137065-project Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '06ba73aa-fbc6-409e-927f-babb129b426f'} Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:40.552936 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. Jun 04 21:10:40.556561 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:40.559748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] Returning 404 to user: Instance 06ba73aa-fbc6-409e-927f-babb129b426f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:40.564565 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5fb49d33-06dd-4a49-b3e8-9f8a4343db65 tempest-ServerDiskConfigTestJSON-1452137065 tempest-ServerDiskConfigTestJSON-1452137065-project] 10.222.0.18 "GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f" status: 404 len: 111 microversion: 2.1 time: 0.052184 Jun 04 21:10:40.570179 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1935/3987] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:40 2022] GET /compute/v2.1/servers/06ba73aa-fbc6-409e-927f-babb129b426f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:40.580480 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5ca63576-8f06-45d4-9fa7-536ae910d664 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c" status: 204 len: 0 microversion: 2.1 time: 0.356219 Jun 04 21:10:40.581080 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2053/3988] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:40 2022] DELETE /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:10:40.589583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.590095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.607587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.608070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.608873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.609498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.650240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:10:40.791749 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-654b3429-adb6-47fc-b703-c1c4b9dbf259 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 204 len: 0 microversion: 2.1 time: 0.204732 Jun 04 21:10:40.793029 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1936/3989] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:10:40 2022] DELETE /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:10:40.801931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:40.802893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:40.810685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.811376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.812359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.812944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:40.965929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-96e34eca-3278-4393-982e-f7233b2431cd req-cf49fe7c-c4a1-404c-98b7-646e2b093837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec16dea-e559-4dc0-b789-afe3e88c34cc", "name": "network-vif-deleted", "tag": "83ce9e21-d62c-4d95-9b66-3b8b0d42902f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:40.982183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-96e34eca-3278-4393-982e-f7233b2431cd req-cf49fe7c-c4a1-404c-98b7-646e2b093837 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:40.982636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-96e34eca-3278-4393-982e-f7233b2431cd req-cf49fe7c-c4a1-404c-98b7-646e2b093837 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:41.012036 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-96e34eca-3278-4393-982e-f7233b2431cd req-cf49fe7c-c4a1-404c-98b7-646e2b093837 service nova] Creating event network-vif-deleted:83ce9e21-d62c-4d95-9b66-3b8b0d42902f for instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc on nch2-master-1 Jun 04 21:10:41.031956 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-96e34eca-3278-4393-982e-f7233b2431cd req-cf49fe7c-c4a1-404c-98b7-646e2b093837 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070159 Jun 04 21:10:41.033229 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1937/3990] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:41.161039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:41.162424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:41.171227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:41.171720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:41.172522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:41.172975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:41.337463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0678a3e330f449d8acf9c01cda1808be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241876e358514965aadcc36146a30265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:41.346706 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ab3fe9b7-dfdf-4440-8c1a-b721e75bd109 tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 200 len: 1429 microversion: 2.1 time: 0.192571 Jun 04 21:10:41.348156 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1938/3991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:41 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 1429 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:41.388773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:41.397700 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45d267d7-4df2-4d74-8f56-e1b4bcde2b0b tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c" status: 200 len: 1513 microversion: 2.1 time: 0.600419 Jun 04 21:10:41.408243 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2054/3992] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:40 2022] GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c => generated 1513 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:42.379558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:42.382349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] [instance: 8ec16dea-e559-4dc0-b789-afe3e88c34cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:42.408318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:42.409188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:42.413363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:42.414567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:42.415385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:42.416554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:42.432652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:42.435424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:42.436274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:42.438410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:42.463474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] HTTP exception thrown: Instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc could not be found. Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Request method failure captured: Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc HTTP/1.1 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8owL8D6hpO0khpiMmICQj8K3xtNO2JQX3WKwpHsAPmsZXmc9S_bLjJeffSSEpoxjEsaZY80K3yU8sTnF75zLOTiaIhcKgXeXYhI8UIBPHeslZvBrzlIt5VjsOOg9HdeR4WzBW_HaIJ0pC56WFsvTXIjlJOSF2WpHG9wpprurCp-W4k Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 241876e358514965aadcc36146a30265 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesNegativeTest-2071514133 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_241876e358514965aadcc36146a30265"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/241876e358514965aadcc36146a30265"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/241876e358514965aadcc36146a30265"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/241876e358514965aadcc36146a30265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesNegativeTest-2071514133 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 241876e358514965aadcc36146a30265 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesNegativeTest-2071514133 Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesNegativeTest-2071514133-project Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 0678a3e330f449d8acf9c01cda1808be Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesNegativeTest-2071514133-project Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc could not be found. Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '8ec16dea-e559-4dc0-b789-afe3e88c34cc'} Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc could not be found. Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc could not be found. Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:42.469641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc could not be found. Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] Returning 404 to user: Instance 8ec16dea-e559-4dc0-b789-afe3e88c34cc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:42.473115 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-21f3eca1-5cc1-4bc7-b94d-854368d52cab tempest-VolumesNegativeTest-2071514133 tempest-VolumesNegativeTest-2071514133-project] 10.222.0.18 "GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc" status: 404 len: 111 microversion: 2.1 time: 0.104346 Jun 04 21:10:42.479080 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1939/3993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:42 2022] GET /compute/v2.1/servers/8ec16dea-e559-4dc0-b789-afe3e88c34cc => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:43.128772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e6ebcb65-6330-4f96-8840-677fd42f0d47 req-1e780ff7-1c5a-4392-9f2f-763e9675cc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "tag": "f88009bf-efdf-45e9-a270-b9a8b276b69f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:43.174344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e6ebcb65-6330-4f96-8840-677fd42f0d47 req-1e780ff7-1c5a-4392-9f2f-763e9675cc51 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:43.174797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e6ebcb65-6330-4f96-8840-677fd42f0d47 req-1e780ff7-1c5a-4392-9f2f-763e9675cc51 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:43.217158 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e6ebcb65-6330-4f96-8840-677fd42f0d47 req-1e780ff7-1c5a-4392-9f2f-763e9675cc51 service nova] Creating event network-changed:f88009bf-efdf-45e9-a270-b9a8b276b69f for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:10:43.225376 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e6ebcb65-6330-4f96-8840-677fd42f0d47 req-1e780ff7-1c5a-4392-9f2f-763e9675cc51 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108177 Jun 04 21:10:43.226828 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1940/3994] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:43.385352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:43.400587 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dbe1ce91-b461-4548-acad-90147374d7c2 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c" status: 200 len: 1513 microversion: 2.1 time: 0.990118 Jun 04 21:10:43.406098 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2055/3995] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:42 2022] GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c => generated 1513 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:44.421485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:44.424540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:44.441333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:44.444339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:44.446011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:44.448988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:44.737357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3467d447a572424f9c6cd56c5fa7e0c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2b7449c8de4c6eba0e9b7c174856e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:44.742043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:44.755330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76362223-f4c2-43bd-aa82-d045321d31a1 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c" status: 200 len: 1471 microversion: 2.1 time: 0.338866 Jun 04 21:10:44.771831 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1941/3996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:44 2022] GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c => generated 1471 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:10:45.300730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0c88b80b-f743-44ec-93cd-ae76857b187c req-bf711f48-1e02-41ec-b5c6-907644f70c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42add09-dd41-4620-882d-f0c426b2576c", "name": "network-vif-deleted", "tag": "e2302ef7-5403-4fc0-a84a-7450ccebe926"}, {"server_uuid": "a52b2553-b6f7-4b38-8e22-885c864c8c6a", "name": "network-vif-deleted", "tag": "91e1dacd-6b9e-4e3d-b066-f95a3472854c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:45.316071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c88b80b-f743-44ec-93cd-ae76857b187c req-bf711f48-1e02-41ec-b5c6-907644f70c37 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:45.316527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c88b80b-f743-44ec-93cd-ae76857b187c req-bf711f48-1e02-41ec-b5c6-907644f70c37 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:45.353047 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0c88b80b-f743-44ec-93cd-ae76857b187c req-bf711f48-1e02-41ec-b5c6-907644f70c37 service nova] Creating event network-vif-deleted:e2302ef7-5403-4fc0-a84a-7450ccebe926 for instance e42add09-dd41-4620-882d-f0c426b2576c on nch1-master-1 Jun 04 21:10:45.353894 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0c88b80b-f743-44ec-93cd-ae76857b187c req-bf711f48-1e02-41ec-b5c6-907644f70c37 service nova] Creating event network-vif-deleted:91e1dacd-6b9e-4e3d-b066-f95a3472854c for instance a52b2553-b6f7-4b38-8e22-885c864c8c6a on nch2-master-1 Jun 04 21:10:45.376613 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0c88b80b-f743-44ec-93cd-ae76857b187c req-bf711f48-1e02-41ec-b5c6-907644f70c37 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.080539 Jun 04 21:10:45.380588 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2056/3997] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:45.785532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:45.788795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: e42add09-dd41-4620-882d-f0c426b2576c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:45.810015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:45.817527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:45.819552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:45.820140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:45.854349 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] HTTP exception thrown: Instance e42add09-dd41-4620-882d-f0c426b2576c could not be found. Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Request method failure captured: Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c HTTP/1.1 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8oPZnR1wDBrOh0leVXvnvXKr5lSntqe2wXoe0mL5C9DAU6BAbTqlZRf8Xjmw_6XmNWNYFjlQ_Gaxj1oMNwwY6Bl73ZZsGQK3tPYJyFHU5k6jy63xlNfMp35VTqbTcY4gmREgfNV_UYSRGHb3tExZRfzSlf3kFYo_Q3Hxwq6simtmUo Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0f2b7449c8de4c6eba0e9b7c174856e1 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-MultipleCreateTestJSON-134057962 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-MultipleCreateTestJSON-134057962 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0f2b7449c8de4c6eba0e9b7c174856e1 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-MultipleCreateTestJSON-134057962 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-MultipleCreateTestJSON-134057962-project Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3467d447a572424f9c6cd56c5fa7e0c4 Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-MultipleCreateTestJSON-134057962-project Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e42add09-dd41-4620-882d-f0c426b2576c could not be found. Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e42add09-dd41-4620-882d-f0c426b2576c'} Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42add09-dd41-4620-882d-f0c426b2576c could not be found. Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42add09-dd41-4620-882d-f0c426b2576c could not be found. Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:45.858006 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42add09-dd41-4620-882d-f0c426b2576c could not be found. Jun 04 21:10:45.861623 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.864588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Returning 404 to user: Instance e42add09-dd41-4620-882d-f0c426b2576c could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:45.865855 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0400f618-45e3-4cb9-8a0b-77ca80512263 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c" status: 404 len: 111 microversion: 2.1 time: 0.090368 Jun 04 21:10:45.870534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1942/3998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:45 2022] GET /compute/v2.1/servers/e42add09-dd41-4620-882d-f0c426b2576c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:10:45.875578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:45.876709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] [instance: a52b2553-b6f7-4b38-8e22-885c864c8c6a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:45.890415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:45.891041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:45.892021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:45.899772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:45.930444 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] HTTP exception thrown: Instance a52b2553-b6f7-4b38-8e22-885c864c8c6a could not be found. Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Request method failure captured: Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a HTTP/1.1 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8oPZnR1wDBrOh0leVXvnvXKr5lSntqe2wXoe0mL5C9DAU6BAbTqlZRf8Xjmw_6XmNWNYFjlQ_Gaxj1oMNwwY6Bl73ZZsGQK3tPYJyFHU5k6jy63xlNfMp35VTqbTcY4gmREgfNV_UYSRGHb3tExZRfzSlf3kFYo_Q3Hxwq6simtmUo Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0f2b7449c8de4c6eba0e9b7c174856e1 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-MultipleCreateTestJSON-134057962 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0f2b7449c8de4c6eba0e9b7c174856e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-MultipleCreateTestJSON-134057962 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0f2b7449c8de4c6eba0e9b7c174856e1 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-MultipleCreateTestJSON-134057962 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-MultipleCreateTestJSON-134057962-project Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 3467d447a572424f9c6cd56c5fa7e0c4 Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-MultipleCreateTestJSON-134057962-project Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a52b2553-b6f7-4b38-8e22-885c864c8c6a could not be found. Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a52b2553-b6f7-4b38-8e22-885c864c8c6a'} Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52b2553-b6f7-4b38-8e22-885c864c8c6a could not be found. Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52b2553-b6f7-4b38-8e22-885c864c8c6a could not be found. Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:10:45.932606 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52b2553-b6f7-4b38-8e22-885c864c8c6a could not be found. Jun 04 21:10:45.936294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:10:45.940638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] Returning 404 to user: Instance a52b2553-b6f7-4b38-8e22-885c864c8c6a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:10:45.942897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ea65ad3-6dd8-4d83-b00f-06f83ebf86c5 tempest-MultipleCreateTestJSON-134057962 tempest-MultipleCreateTestJSON-134057962-project] 10.222.0.18 "GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a" status: 404 len: 111 microversion: 2.1 time: 0.071700 Jun 04 21:10:45.945846 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2057/3999] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:45 2022] GET /compute/v2.1/servers/a52b2553-b6f7-4b38-8e22-885c864c8c6a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:10:54.618918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-785898769", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:54.719257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:10:55.832326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:57.251930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:10:57.252510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:10:57.252891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:10:57.253518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:10:57.254122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:10:57.272959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:57.277426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:57.282229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:57.283085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:57.321780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:10:57.330464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:10:57.373121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:10:57.388261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:10:57.485858 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-105f0fbf-63a7-4027-bc39-daae98f68283 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.435730 Jun 04 21:10:57.492816 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1943/4000] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:10:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:10:57.504000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4abdf70e-2297-439b-bdf6-a166d9c92ed9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:57.505245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4abdf70e-2297-439b-bdf6-a166d9c92ed9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:57.512430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:57.513341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:57.763262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4abdf70e-2297-439b-bdf6-a166d9c92ed9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:57.778233 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4abdf70e-2297-439b-bdf6-a166d9c92ed9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1192 microversion: 2.1 time: 0.279327 Jun 04 21:10:57.778919 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2058/4001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:57 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1192 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:10:58.385224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f592c1d4-da7b-406d-a176-d9f858147163 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'create', calling method: .version_select at 0x7f2d01874a60>, body: {"keypair": {"name": "tempest-keypair-1964913124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK42gVjPymTZelUaQVxdE8pFIEKy9xk3ZmEzKLBRKCD5DuUMpff8ooko0ohDuQU78+QgVL89RnQ4iJ72Niy1f7JV4/MMFeb4TtFwienohb5+ZR0IBGEmsaKLi+fKV8TdLQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:10:58.391839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:10:58.452326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f592c1d4-da7b-406d-a176-d9f858147163 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:10:58.472814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f592c1d4-da7b-406d-a176-d9f858147163 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for user 09431bbdbc394df8b368770d3e24a306 and project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:10:58.551207 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f592c1d4-da7b-406d-a176-d9f858147163 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.329759 Jun 04 21:10:58.551914 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1944/4002] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:10:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:10:58.801890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:10:58.801890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:10:58.837497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:58.840347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:58.841425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:10:58.843819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:10:59.036180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:10:59.053866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-67b02a66-41e1-4dc2-a035-7d10ef4cdf5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1188 microversion: 2.1 time: 0.253681 Jun 04 21:10:59.072906 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2059/4003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:10:58 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1188 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:00.090912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:00.091570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:00.112064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:00.112862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:00.114192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:00.118008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:00.412688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:00.427785 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe53c094-ec26-427b-9e30-0f283f575f87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1250 microversion: 2.1 time: 0.341807 Jun 04 21:11:00.431554 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1945/4004] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:00 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1250 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:01.451097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:01.451824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:01.464346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:01.468959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:01.474673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:01.475727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:02.143891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:02.180808 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6cb56833-8354-4416-b728-1089d7d53c7a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1250 microversion: 2.1 time: 0.733852 Jun 04 21:11:02.181436 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2060/4005] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:01 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1250 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:03.204571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:03.205612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:03.226749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:03.227429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:03.255878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:03.256652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:04.195287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:04.214679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4790027b-b2a6-4037-a6ce-88e40df6ae43 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 1.019635 Jun 04 21:11:04.218089 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1946/4006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:03 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:04.675014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-752563362", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "022d1b94-119f-49b9-8193-cbad0fb4c7b0"}], "security_groups": [{"name": "tempest-securitygroup--1075491825"}], "key_name": "tempest-keypair-1964913124", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:05.037090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] validate_networks() for [('022d1b94-119f-49b9-8193-cbad0fb4c7b0', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:11:05.239035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:05.240320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:05.251634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:05.262202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:05.263530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:05.264227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:05.724970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:05.741836 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-07980c63-0552-44c6-9cbe-c3bae102eb0d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 0.508043 Jun 04 21:11:05.744360 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1947/4007] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:05 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:05.750669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8ca6ad42-045c-45e8-a217-e9b63fb817fd req-e6f0ea88-bce9-49e1-9252-91015d90c376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e71dd12-8076-4390-a7f1-2c13462a8d7a", "tag": "629bffce-5ebc-4480-b299-58359eaaea52"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:05.763813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8ca6ad42-045c-45e8-a217-e9b63fb817fd req-e6f0ea88-bce9-49e1-9252-91015d90c376 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:05.764968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8ca6ad42-045c-45e8-a217-e9b63fb817fd req-e6f0ea88-bce9-49e1-9252-91015d90c376 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:05.786145 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8ca6ad42-045c-45e8-a217-e9b63fb817fd req-e6f0ea88-bce9-49e1-9252-91015d90c376 service nova] Creating event network-changed:629bffce-5ebc-4480-b299-58359eaaea52 for instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a on nch2-master-1 Jun 04 21:11:05.797771 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8ca6ad42-045c-45e8-a217-e9b63fb817fd req-e6f0ea88-bce9-49e1-9252-91015d90c376 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051795 Jun 04 21:11:05.826907 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1948/4008] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:06.190850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:11:06.191972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:11:06.192537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:11:06.193182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:11:06.193909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:11:06.218388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:06.218868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:06.220913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:06.221366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:06.271985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:11:06.289820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for user 09431bbdbc394df8b368770d3e24a306 and project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:11:06.307193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:11:06.309623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:11:06.381744 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd20d67c-88fe-4c54-ac11-b378b9b1c2a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.728517 Jun 04 21:11:06.392623 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2061/4009] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:11:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:11:06.399626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fedf95d5-5b3e-499e-87b2-465f86a39cd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:06.403094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fedf95d5-5b3e-499e-87b2-465f86a39cd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:06.649592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fedf95d5-5b3e-499e-87b2-465f86a39cd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:06.658504 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fedf95d5-5b3e-499e-87b2-465f86a39cd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1238 microversion: 2.1 time: 0.264418 Jun 04 21:11:06.662725 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1949/4010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:06 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1238 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:06.761255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:06.762913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:06.785736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:06.786280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:06.787334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:06.787820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:07.178326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:07.195933 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-baa3f3ba-ec53-478c-a0f6-4c7b730f0531 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 0.439430 Jun 04 21:11:07.203289 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2062/4011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:06 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:07.681975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:07.683474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:07.694193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:07.703214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:07.704043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:07.704923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:07.705382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:07.902949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:07.912454 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ab3a0c42-666b-4ba2-ad1e-e599bc727e5a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1298 microversion: 2.1 time: 0.235201 Jun 04 21:11:07.913207 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1950/4012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:07 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1298 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:08.218466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:08.219882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:08.240195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:08.240602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:08.241406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:08.242069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:08.932504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:08.933315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:08.944109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:08.944109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:08.945788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:08.946643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:09.109037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:09.125807 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5fb7f6fe-acb0-4d1f-9236-9f044dc7d7c5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 0.911826 Jun 04 21:11:09.138607 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2063/4013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:08 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:09.221880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:09.235239 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a43b26f8-1841-4945-9637-e519911ee8d1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1296 microversion: 2.1 time: 0.309258 Jun 04 21:11:09.236394 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1951/4014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:08 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1296 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:10.154567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:10.156219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:10.169738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:10.170942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:10.172620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:10.173107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:10.255346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:10.258222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:10.273516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:10.274226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:10.275146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:10.275734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:10.722973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:10.747350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-96614ffb-22fa-4b62-bab3-a9373c461be7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.496300 Jun 04 21:11:10.749265 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1952/4015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:10 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:10.772575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:10.785454 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82bce663-0292-4fd9-a98e-060b0e312ac8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 0.642542 Jun 04 21:11:10.791815 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2064/4016] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:10 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:11.767500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:11.768426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:11.787806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:11.788192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:11.789369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:11.789816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:11.805804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:11.808184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:11.824799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:11.825498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:11.826581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:11.827218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:12.418953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:12.427435 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b5f1baa-9775-44cf-8772-7cf3085c93ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.664124 Jun 04 21:11:12.428311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1953/4017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:11 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:12.459784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:12.461132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:12.473999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:12.474485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:12.475335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:12.476974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:12.513610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38126b47-43ea-4f2b-9786-3f516cf3b52a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/ips" status: 200 len: 146 microversion: 2.1 time: 0.072607 Jun 04 21:11:12.514242 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1954/4018] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:11:12 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/ips => generated 146 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:12.520661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4ea275d3-782f-4355-bf13-ffefbc6932b6 req-0bff2f71-6626-4249-ac50-e3e43f024271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e71dd12-8076-4390-a7f1-2c13462a8d7a", "name": "network-vif-plugged", "status": "completed", "tag": "629bffce-5ebc-4480-b299-58359eaaea52"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:12.537969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4ea275d3-782f-4355-bf13-ffefbc6932b6 req-0bff2f71-6626-4249-ac50-e3e43f024271 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:12.539007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4ea275d3-782f-4355-bf13-ffefbc6932b6 req-0bff2f71-6626-4249-ac50-e3e43f024271 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:12.554199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:12.567193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a358ecbd-c796-410f-938c-38cac609593c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 0.766539 Jun 04 21:11:12.569406 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2065/4019] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:11 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:12.577771 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4ea275d3-782f-4355-bf13-ffefbc6932b6 req-0bff2f71-6626-4249-ac50-e3e43f024271 service nova] Creating event network-vif-plugged:629bffce-5ebc-4480-b299-58359eaaea52 for instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a on nch2-master-1 Jun 04 21:11:12.585234 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4ea275d3-782f-4355-bf13-ffefbc6932b6 req-0bff2f71-6626-4249-ac50-e3e43f024271 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069349 Jun 04 21:11:12.586803 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1955/4020] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:13.445203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:13.446532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:13.469715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:13.470375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:13.472462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:13.474062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:13.587971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:13.588939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:13.596466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:13.596979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:13.597970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:13.598707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:14.038584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:14.049402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:14.063117 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b749da81-9ed2-4f19-bfa3-101ca130d921 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1292 microversion: 2.1 time: 0.481255 Jun 04 21:11:14.078955 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-38f83332-f075-4290-a34d-e0ec877298d4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.625311 Jun 04 21:11:14.078955 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2066/4021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:13 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:14.079406 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1956/4022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:13 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1292 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:14.086234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d4625cb8-0643-4a8c-9c3b-d2944d1e2978 req-0d3cfc3c-c4d3-45c1-acf6-b548aa6ff305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:14.114035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d4625cb8-0643-4a8c-9c3b-d2944d1e2978 req-0d3cfc3c-c4d3-45c1-acf6-b548aa6ff305 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:14.114794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d4625cb8-0643-4a8c-9c3b-d2944d1e2978 req-0d3cfc3c-c4d3-45c1-acf6-b548aa6ff305 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:14.132983 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d4625cb8-0643-4a8c-9c3b-d2944d1e2978 req-0d3cfc3c-c4d3-45c1-acf6-b548aa6ff305 service nova] Creating event network-changed:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:11:14.146631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d9f5fb-fdb4-420b-a47f-80c005582589"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:14.148660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:14.154046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d4625cb8-0643-4a8c-9c3b-d2944d1e2978 req-0d3cfc3c-c4d3-45c1-acf6-b548aa6ff305 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080963 Jun 04 21:11:14.155351 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2067/4023] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:14.160128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:14.161145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:14.162587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:14.163430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:14.763697 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af2d7aa5-1d5f-419a-8374-5a7963ea80ad tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622164 Jun 04 21:11:14.766185 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1957/4024] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:11:14 2022] POST /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:15.091893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:15.092623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:15.099410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:15.100176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:15.118327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:15.118797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:15.119633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:15.120085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:15.125033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:15.125506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:15.126381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:15.126818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:15.484489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:15.494149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:15.497236 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-190e946a-34e4-422d-b34f-13fbd9057b7e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.414562 Jun 04 21:11:15.497915 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2068/4025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:15 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:15.514902 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-29387501-8f7e-4a91-ac90-cecedc58e94f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1473 microversion: 2.1 time: 0.427143 Jun 04 21:11:15.517025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1958/4026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:15 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1473 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:15.721119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-117190980", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:15.816121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:11:16.246251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:16.301682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:16.516298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:16.518310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:16.539656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:16.540928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:16.546498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:16.549506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:16.657989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:16.953623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:16.965781 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1aaac4f6-6a19-43c1-a6d7-f629403f22ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.454369 Jun 04 21:11:16.966570 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1959/4027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:16 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:17.117850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:11:17.118221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:11:17.118804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:11:17.119582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:11:17.120210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:11:17.134618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:17.135393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:17.137157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:17.138119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:17.166996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:11:17.176201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:11:17.193554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:11:17.197528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 03097097-e8ad-4ef1-89bc-053132330a24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:11:17.262293 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-504cd52a-d83c-476e-8f27-b2af5a87ff94 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545323 Jun 04 21:11:17.264693 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2069/4028] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:11:17.277929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8d834dd-4cbf-4faa-9107-8edcc1d372b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:17.278559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8d834dd-4cbf-4faa-9107-8edcc1d372b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 03097097-e8ad-4ef1-89bc-053132330a24] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:17.309820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8d834dd-4cbf-4faa-9107-8edcc1d372b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 03097097-e8ad-4ef1-89bc-053132330a24] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:11:17.654089 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c8d834dd-4cbf-4faa-9107-8edcc1d372b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24" status: 204 len: 0 microversion: 2.1 time: 0.382374 Jun 04 21:11:17.656229 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1960/4029] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:11:17 2022] DELETE /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:11:17.668014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d441b7d-4ec0-4967-8b90-a5e8f89066af tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:17.668760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d441b7d-4ec0-4967-8b90-a5e8f89066af tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 03097097-e8ad-4ef1-89bc-053132330a24] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:17.706691 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-2d441b7d-4ec0-4967-8b90-a5e8f89066af tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d441b7d-4ec0-4967-8b90-a5e8f89066af tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 HTTP/1.1 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '03097097-e8ad-4ef1-89bc-053132330a24'} Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 03097097-e8ad-4ef1-89bc-053132330a24 Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:17.731388 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d441b7d-4ec0-4967-8b90-a5e8f89066af tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d441b7d-4ec0-4967-8b90-a5e8f89066af tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24" status: 404 len: 111 microversion: 2.1 time: 0.071456 Jun 04 21:11:17.735111 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2070/4030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:17 2022] GET /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:11:17.930016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-935472624", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:17.985489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:17.986221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:18.002454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:18.004071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:18.007065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:18.010017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:18.082638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:11:18.534867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:18.555971 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5afb12ff-ccab-41a0-974d-7ef90ebbe144 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.575760 Jun 04 21:11:18.557453 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2071/4031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:17 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:18.569760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:18.571828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:18.581645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:18.582543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:18.586643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:18.587117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:18.636085 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-00f0eaf9-f6c6-4b3a-ba6d-c31340407b07 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076412 Jun 04 21:11:18.636945 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2072/4032] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:11:18 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:18.651371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:18.652236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:18.661783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:18.662595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:18.663687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:18.664427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:18.737282 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4b5b5b51-f8f1-4909-8558-0550fcc99b7a tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/26d9f5fb-fdb4-420b-a47f-80c005582589" status: 200 len: 194 microversion: 2.1 time: 0.093963 Jun 04 21:11:18.738004 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2073/4033] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Jun 4 21:11:18 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/26d9f5fb-fdb4-420b-a47f-80c005582589 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:19.573894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:19.574729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:19.588544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:19.593646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:19.593646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:19.593646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:19.688134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:11:19.688716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:11:19.689396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:11:19.689990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:11:19.690572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:11:19.718864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:19.719417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:19.720940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:19.723249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:19.775950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:11:19.785421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:11:19.803766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:11:19.807995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:11:19.903847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:19.911242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c37dbbd-6b4e-46a5-bbea-ed6e5e04c5a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.988215 Jun 04 21:11:19.912859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1961/4034] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:11:19.920827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9efc3d27-5ccc-4431-aa46-20f8de7822f6 req-29bcb316-eafa-4ed8-9c47-e2d3db7af74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-plugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:19.933275 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71cf1bdd-c76b-42a1-ae00-7560e69217d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.364129 Jun 04 21:11:19.938173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9efc3d27-5ccc-4431-aa46-20f8de7822f6 req-29bcb316-eafa-4ed8-9c47-e2d3db7af74b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:19.939229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9efc3d27-5ccc-4431-aa46-20f8de7822f6 req-29bcb316-eafa-4ed8-9c47-e2d3db7af74b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:19.946954 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2074/4035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:19 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:19.960442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-feaaf324-d3cb-4d67-80e3-bae732418419 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:19.961009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9efc3d27-5ccc-4431-aa46-20f8de7822f6 req-29bcb316-eafa-4ed8-9c47-e2d3db7af74b service nova] Creating event network-vif-plugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:11:19.970539 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9efc3d27-5ccc-4431-aa46-20f8de7822f6 req-29bcb316-eafa-4ed8-9c47-e2d3db7af74b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055111 Jun 04 21:11:19.974708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-feaaf324-d3cb-4d67-80e3-bae732418419 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:19.978415 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1962/4036] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:20.147006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-feaaf324-d3cb-4d67-80e3-bae732418419 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:20.213100 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-feaaf324-d3cb-4d67-80e3-bae732418419 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1220 microversion: 2.1 time: 0.262855 Jun 04 21:11:20.213725 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2075/4037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:19 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1220 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:20.400009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14d67208-c233-4663-b9a2-c40b86117130"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:20.401536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:20.411190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:20.412097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:20.418325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:20.420189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:20.914534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:20.959150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:20.959786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:20.971756 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23a45334-ee21-483f-bcb8-531f7f8e47c4 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "POST /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577441 Jun 04 21:11:20.976152 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1963/4038] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:11:20 2022] POST /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:20.989256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:20.990262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:20.992696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:20.993387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:21.251960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:21.253406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:21.281738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:21.282228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:21.284214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:21.286655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:21.587357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:21.601861 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-120c4d90-cef2-4063-b9ba-2321130beb1d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1216 microversion: 2.1 time: 0.368989 Jun 04 21:11:21.604308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1964/4039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:21 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1216 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:21.723253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:21.732041 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a76bfd45-8ebf-4ceb-b494-14485f65c596 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1364 microversion: 2.1 time: 0.778956 Jun 04 21:11:21.732665 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2076/4040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:20 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1364 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:22.623109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:22.623918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:22.630938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:22.631676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:22.632825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:22.633491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:22.755501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:22.759164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:22.763635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:22.777799 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d886dc05-fe5d-4b11-9468-08c42e8d5a4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1278 microversion: 2.1 time: 0.161165 Jun 04 21:11:22.790321 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1965/4041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:22 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:22.799591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:22.800360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:22.803880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:22.806046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:23.426860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:23.442490 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-26a6cafd-8639-41fe-ba46-743c8a08e42b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1552 microversion: 2.1 time: 0.695445 Jun 04 21:11:23.448278 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2077/4042] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:22 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1552 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:23.466110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:23.466722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:23.481859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:23.482319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:23.485143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:23.485748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:23.673423 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5840e15f-11a0-4a54-89a8-8086f891c59d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212271 Jun 04 21:11:23.674084 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1966/4043] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:11:23 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:23.803618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:23.804491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:23.818991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:23.821434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:23.822800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:23.823560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:24.466914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:24.500719 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae4ef4bc-bd04-4703-aa8e-0b59805b8ac6 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.707008 Jun 04 21:11:24.504433 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2078/4044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:23 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:25.523457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:25.525547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:25.532908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:25.533684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:25.534885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:25.535599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:25.839921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-76e98e24-fea1-4055-8ab9-a55de4b163cd req-4e6ca311-a161-4aca-bafe-c54279510efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ab285f-4deb-4bf0-8d88-36599a0d805b", "tag": "838b2999-6de2-4671-ba5e-ae9355c880dc"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:25.884362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-76e98e24-fea1-4055-8ab9-a55de4b163cd req-4e6ca311-a161-4aca-bafe-c54279510efc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:25.888701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-76e98e24-fea1-4055-8ab9-a55de4b163cd req-4e6ca311-a161-4aca-bafe-c54279510efc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:25.925292 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-76e98e24-fea1-4055-8ab9-a55de4b163cd req-4e6ca311-a161-4aca-bafe-c54279510efc service nova] Creating event network-changed:838b2999-6de2-4671-ba5e-ae9355c880dc for instance 02ab285f-4deb-4bf0-8d88-36599a0d805b on nch2-master-1 Jun 04 21:11:25.942417 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-76e98e24-fea1-4055-8ab9-a55de4b163cd req-4e6ca311-a161-4aca-bafe-c54279510efc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119996 Jun 04 21:11:25.944077 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2079/4045] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:11:25.980460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:25.981987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:25.990356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:25.991961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:25.993131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:25.994217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.002913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:26.036151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb0400fa-317d-425a-b0e7-3bbec17f546b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061379 Jun 04 21:11:26.042649 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2080/4046] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:11:25 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:26.116291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:26.134613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d9f6418e-2390-4a76-aa58-c460b2f8e15a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.613720 Jun 04 21:11:26.135760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1967/4047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:25 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:26.196194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:26.196643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:26.206550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.207015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.207852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.208298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.246472 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5c1cea2c-15a5-492b-8e5e-6b983cfb4d65 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/26d9f5fb-fdb4-420b-a47f-80c005582589" status: 200 len: 194 microversion: 2.1 time: 0.054397 Jun 04 21:11:26.247731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2081/4048] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Jun 4 21:11:26 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/26d9f5fb-fdb4-420b-a47f-80c005582589 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:26.264382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:26.265168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:26.293740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.297584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.300488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.304492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.366640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:26.367451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:26.375114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.375960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.380215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.380947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.446285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lazy-loading 'services' on Instance uuid e9b5db72-5ec2-495f-86bf-99c94ec6c3af {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:11:26.598952 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6e2d53db-2e01-49df-b5d8-4990e0b299c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/26d9f5fb-fdb4-420b-a47f-80c005582589" status: 202 len: 0 microversion: 2.1 time: 0.343920 Jun 04 21:11:26.599651 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1968/4049] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:11:26 2022] DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/26d9f5fb-fdb4-420b-a47f-80c005582589 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:11:26.935308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:26.950659 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c69aaa01-de10-4a8a-b80c-dd436913ed75 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1552 microversion: 2.1 time: 0.585515 Jun 04 21:11:26.952584 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2082/4050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:26 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1552 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:26.971550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:26.972681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:26.986749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.989149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:26.991444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:26.992915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:27.154485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:27.155230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:27.164593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:27.173594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:27.173972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:27.174806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:27.178782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:27.209450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:27.221317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c6407f0-a8b2-41b9-ab4a-ec1a6f8781b3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1552 microversion: 2.1 time: 0.253443 Jun 04 21:11:27.223326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1969/4051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:26 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1552 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:27.538127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:27.547400 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78eff58c-3b6f-4505-b4bf-11aa294b168e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.398277 Jun 04 21:11:27.551710 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2083/4052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:27 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:27.884913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:27.885441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:27.905960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:27.906623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:27.907627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:27.910750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:27.961058 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef617cca-95c8-4faa-b12c-9d9685812eab tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/14d67208-c233-4663-b9a2-c40b86117130" status: 200 len: 194 microversion: 2.1 time: 0.080616 Jun 04 21:11:27.963138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c41b7396-5fd1-45a2-a90b-924ec481ab9a req-7870d828-9292-4a98-8e77-011ec38fc2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:27.963971 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1970/4053] 10.222.0.18 () {58 vars in 1412 bytes} [Sat Jun 4 21:11:27 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/14d67208-c233-4663-b9a2-c40b86117130 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:27.973038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:27.995967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:27.996778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:28.011732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c41b7396-5fd1-45a2-a90b-924ec481ab9a req-7870d828-9292-4a98-8e77-011ec38fc2d3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.012425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c41b7396-5fd1-45a2-a90b-924ec481ab9a req-7870d828-9292-4a98-8e77-011ec38fc2d3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.029748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.030449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.031836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.032623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.051146 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c41b7396-5fd1-45a2-a90b-924ec481ab9a req-7870d828-9292-4a98-8e77-011ec38fc2d3 service nova] Creating event network-changed:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:11:28.058334 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c41b7396-5fd1-45a2-a90b-924ec481ab9a req-7870d828-9292-4a98-8e77-011ec38fc2d3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099455 Jun 04 21:11:28.059227 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2084/4054] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:11:28.240920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:28.242476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:28.254169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lazy-loading 'services' on Instance uuid e9b5db72-5ec2-495f-86bf-99c94ec6c3af {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:11:28.262284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.263110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.264180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.264790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.433272 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-80df823f-11d7-483c-89cc-641bcdde08e3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/14d67208-c233-4663-b9a2-c40b86117130" status: 202 len: 0 microversion: 2.1 time: 0.461641 Jun 04 21:11:28.433974 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1971/4055] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:11:27 2022] DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments/14d67208-c233-4663-b9a2-c40b86117130 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:11:28.568570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:28.569858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:28.572314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:28.611750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.620983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.624849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:28.627474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:28.880593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:28.892426 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1af3e5df-08d7-477b-b25f-f0a49b153825 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1552 microversion: 2.1 time: 0.656355 Jun 04 21:11:28.893059 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2085/4056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:28 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1552 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:29.057801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:29.066230 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b4b8b321-e9ab-4c59-bb4b-bb98331bf968 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.502209 Jun 04 21:11:29.073061 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1972/4057] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:28 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:29.717660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:29.718639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:29.733148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:29.733613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:29.734421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:29.734861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:29.786253 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1050bd0b-b09f-4423-84ef-9e569a3cc357 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072480 Jun 04 21:11:29.787406 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2086/4058] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:11:29 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:11:29.909418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:29.910040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:29.913934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:29.915062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:29.922091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:29.923383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:29.924367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:29.924989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:29.960789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:29.961753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:29.973846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:29.974331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:29.975241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:29.975963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.016206 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7696e577-4488-4917-903f-6b8e9d735995 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059171 Jun 04 21:11:30.016781 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2087/4059] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:11:29 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 21:11:30.094167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:30.094884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:30.102289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.102846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.103915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.104686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.198066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:30.316293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:30.325084 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-acd850d9-f908-4dca-b3ae-b5394ebd8725 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.419493 Jun 04 21:11:30.336642 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1973/4060] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:29 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:30.342452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:30.343261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:30.350365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.351362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.352634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.353293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.401604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:11:30.521753 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cdd730f5-3cc9-4c92-9b42-a04dc81edad5 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 204 len: 0 microversion: 2.1 time: 0.181860 Jun 04 21:11:30.523012 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1974/4061] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:11:30 2022] DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:11:30.531682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:30.533318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:30.540320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.541061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.542156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.542692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.542919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:30.559992 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef954fb2-2fe7-4a70-a967-0cc39974fc42 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.478941 Jun 04 21:11:30.561265 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2088/4062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:30 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:30.566544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:30.568019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:30.574762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.575557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.576526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:30.577151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:30.925544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:30.933904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:30.952921 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81f0b35f-a7e2-4733-bf35-5fa72c07c8b0 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1674 microversion: 2.1 time: 0.390281 Jun 04 21:11:30.957485 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2089/4063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:30 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1674 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:30.958245 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cceeb576-81e2-4fcd-98ab-78a887896296 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.432679 Jun 04 21:11:30.959501 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1975/4064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:30 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:30.984325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-320441201"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:30.987774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:31.009522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:31.011212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:31.013414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:31.016164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:31.438637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bfefbd1-b3ab-43de-885c-64187ef31abf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.465351 Jun 04 21:11:31.439443 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2090/4065] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:11:30 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 04 21:11:31.581186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:31.582628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:31.593110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:31.594148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:31.596177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:31.599045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:31.990403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:31.999828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:32.003542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:32.024389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:32.025724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:32.028506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3a78e4b7-aabc-4ecf-ae32-cc1092ed3a75 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.451439 Jun 04 21:11:32.029338 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1976/4066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:31 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:32.038997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:32.039497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:32.097189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bc893767-79fb-4e07-8d6a-39087f0a5c76 req-3b0ebaf9-125e-4873-ae3c-0e0ae505550c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ab285f-4deb-4bf0-8d88-36599a0d805b", "name": "network-vif-plugged", "status": "completed", "tag": "838b2999-6de2-4671-ba5e-ae9355c880dc"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:32.125401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bc893767-79fb-4e07-8d6a-39087f0a5c76 req-3b0ebaf9-125e-4873-ae3c-0e0ae505550c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:32.126126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bc893767-79fb-4e07-8d6a-39087f0a5c76 req-3b0ebaf9-125e-4873-ae3c-0e0ae505550c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:32.151773 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bc893767-79fb-4e07-8d6a-39087f0a5c76 req-3b0ebaf9-125e-4873-ae3c-0e0ae505550c service nova] Creating event network-vif-plugged:838b2999-6de2-4671-ba5e-ae9355c880dc for instance 02ab285f-4deb-4bf0-8d88-36599a0d805b on nch2-master-1 Jun 04 21:11:32.161061 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bc893767-79fb-4e07-8d6a-39087f0a5c76 req-3b0ebaf9-125e-4873-ae3c-0e0ae505550c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074949 Jun 04 21:11:32.161924 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1977/4067] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:32.316862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:32.324686 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78eb3cc3-3152-45e1-9cfa-bba1b411898b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1674 microversion: 2.1 time: 0.353402 Jun 04 21:11:32.334623 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2091/4068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:31 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1674 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:33.054990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:33.057234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:33.068984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:33.070324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:33.071749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:33.072376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:33.094584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:33.347853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:33.349206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:33.385924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:33.388841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:33.395190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:33.401171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:33.644294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:33.664307 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1eb5974-6f9a-46fb-b51b-391f03fedbef tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1320 microversion: 2.1 time: 0.621280 Jun 04 21:11:33.665756 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1978/4069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:33 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:33.856084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:33.867784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b20a70f8-afd7-45df-b569-90a7a1ba56c8 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1674 microversion: 2.1 time: 0.528174 Jun 04 21:11:33.869835 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2092/4070] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:33 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1674 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:34.681358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:34.682046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:34.725626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:34.726098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:34.726991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:34.727351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:34.896272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:34.897643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:34.914617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:34.924656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:34.933730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:34.935035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:35.071366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:35.089936 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c25edce-5660-43ef-a167-221cfe7225ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1502 microversion: 2.1 time: 0.411667 Jun 04 21:11:35.090913 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1979/4071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:34 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1502 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:35.106883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:35.107934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:35.149881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:35.150354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:35.151145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:35.156219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:35.314363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:35.324470 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e73b1281-b92f-4555-896c-e53f22938e58 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1606 microversion: 2.1 time: 0.440681 Jun 04 21:11:35.339550 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2093/4072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:34 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1606 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:35.602884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2f0bc7c8-5172-4676-9a6d-d3d94063c797 req-7b1d2785-4b63-4c2c-9020-4d564609190a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9b5db72-5ec2-495f-86bf-99c94ec6c3af", "name": "network-vif-deleted", "tag": "9a71ae16-64f4-408b-96ba-75aa9a0fada9"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:35.627246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2f0bc7c8-5172-4676-9a6d-d3d94063c797 req-7b1d2785-4b63-4c2c-9020-4d564609190a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:35.627934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2f0bc7c8-5172-4676-9a6d-d3d94063c797 req-7b1d2785-4b63-4c2c-9020-4d564609190a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:35.660017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2f0bc7c8-5172-4676-9a6d-d3d94063c797 req-7b1d2785-4b63-4c2c-9020-4d564609190a service nova] Creating event network-vif-deleted:9a71ae16-64f4-408b-96ba-75aa9a0fada9 for instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af on nch1-master-1 Jun 04 21:11:35.685610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2f0bc7c8-5172-4676-9a6d-d3d94063c797 req-7b1d2785-4b63-4c2c-9020-4d564609190a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086880 Jun 04 21:11:35.687824 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2094/4073] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:11:35.711852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:35.733745 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75bcecb4-54ec-48d2-bb86-0d36f81a1d54 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1502 microversion: 2.1 time: 0.626595 Jun 04 21:11:35.748311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1980/4074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:35 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1502 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:35.753841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:35.754457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:35.767142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:35.767809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:35.775004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:35.775715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:35.832854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:11:35.907097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:36.034844 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01e16505-d37c-4930-b949-27cb1914ddea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 204 len: 0 microversion: 2.1 time: 0.281493 Jun 04 21:11:36.038966 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2095/4075] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:11:35 2022] DELETE /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:11:36.050022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:36.050693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:36.062651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:36.063108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:36.068739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:36.070339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:36.344005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:36.344999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:36.387657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:36.391092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:36.403434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:36.410045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:36.463302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:36.478092 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b681df52-5074-4892-bb8f-3869449c79f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1508 microversion: 2.1 time: 0.431314 Jun 04 21:11:36.492124 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1981/4076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:36 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1508 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:36.558722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:36.559332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:36.559671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lazy-loading 'fault' on Instance uuid e9b5db72-5ec2-495f-86bf-99c94ec6c3af {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:11:36.658817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f290b5d01a074e2c9859488bd4ff1162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfea83c42bb443459619d4d679aa1769', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:36.670089 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff9daab3-e0fe-4e7a-8394-a56d63fb67ac tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 200 len: 1327 microversion: 2.1 time: 0.330404 Jun 04 21:11:36.679650 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2096/4077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:36 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 1327 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:37.499256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:37.500195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:37.519202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:37.520281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:37.520819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:37.521269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:37.689355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:37.690556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:37.706927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:37.714443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:37.715833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:37.716431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:37.738905 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] HTTP exception thrown: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Request method failure captured: Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af HTTP/1.1 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8lQ-8eryORwl7MxHXjqtSRZVq1GDZnj0L8RyLZ-H8bTGz6YWNwo44yURLvf_tmd1lsG27gESupuPfBRaC8wD4UZIRD2RilIGNnWCmUFLoU97miginej-2xX_ZxKaJ5odcPV41LZ4mFHsI6aMzGxpCuQJowUK-KHqvxHWnhQEJBV3zs Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfea83c42bb443459619d4d679aa1769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: f290b5d01a074e2c9859488bd4ff1162 Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e9b5db72-5ec2-495f-86bf-99c94ec6c3af'} Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:37.742464 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Returning 404 to user: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:37.748593 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7cf9a769-687e-4c9a-8e5b-49951f9c4541 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 404 len: 111 microversion: 2.1 time: 0.062042 Jun 04 21:11:37.749398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2097/4078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:37 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:11:37.761783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-accc3c99-6ac4-4b47-bfb5-1fe3651f5724 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '.version_select at 0x7f2d0237a940>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:37.812440 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-accc3c99-6ac4-4b47-bfb5-1fe3651f5724 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723967188" status: 202 len: 0 microversion: 2.1 time: 0.058355 Jun 04 21:11:37.813486 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2098/4079] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723967188 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:11:38.197088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:38.231547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7ece1f09-aa11-4a2b-9769-124ad705e5e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1508 microversion: 2.1 time: 0.736723 Jun 04 21:11:38.240494 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1982/4080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:37 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1508 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:39.259691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:39.260919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:39.297829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:39.298836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:39.301140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:39.304431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:39.888436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:39.897378 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ac43d30e-c88f-4833-8020-886b573db114 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 200 len: 1508 microversion: 2.1 time: 0.642960 Jun 04 21:11:39.908393 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2099/4081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:39 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:39.986511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fcf77249-8b75-4578-83c5-043e459a06b9 req-6e5198b4-9248-48db-9dc8-9b0d1219afb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ab285f-4deb-4bf0-8d88-36599a0d805b", "name": "network-vif-deleted", "tag": "838b2999-6de2-4671-ba5e-ae9355c880dc"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:40.021316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fcf77249-8b75-4578-83c5-043e459a06b9 req-6e5198b4-9248-48db-9dc8-9b0d1219afb5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:40.026785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fcf77249-8b75-4578-83c5-043e459a06b9 req-6e5198b4-9248-48db-9dc8-9b0d1219afb5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:40.063473 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fcf77249-8b75-4578-83c5-043e459a06b9 req-6e5198b4-9248-48db-9dc8-9b0d1219afb5 service nova] Creating event network-vif-deleted:838b2999-6de2-4671-ba5e-ae9355c880dc for instance 02ab285f-4deb-4bf0-8d88-36599a0d805b on nch2-master-1 Jun 04 21:11:40.093336 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fcf77249-8b75-4578-83c5-043e459a06b9 req-6e5198b4-9248-48db-9dc8-9b0d1219afb5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109986 Jun 04 21:11:40.094395 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1983/4082] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:40.927830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:40.928502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:40.950136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:40.955554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:40.958968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:40.962000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:41.087552 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b HTTP/1.1 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '02ab285f-4deb-4bf0-8d88-36599a0d805b'} Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:41.098384 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:41.108200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:41.108200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:41.108200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:41.108200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:41.108200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:11:41.108200 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:41.116838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:41.118140 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d70468b-2f79-49d6-beb2-fdb215859106 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 404 len: 111 microversion: 2.1 time: 0.194380 Jun 04 21:11:41.119652 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2100/4083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:40 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:11:41.140777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a604e6a-3b0d-4cbb-b9e0-ffcd5bc611f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: .version_select at 0x7f2d0be6fdc0>, body: {"keypair": {"name": "tempest-key-232818135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/GD8/PapjiK8sX0nu8ZQokPu9b3MVEXknHOP0BTSWglcfSFEahTEDumz3AyDpj+jaZ0GhUMkG9mvA4sl/60POYtq7666cjX/3VVcg5q+162ZeQht7O7L4wNRv424JM4Q=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:41.167685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-1a604e6a-3b0d-4cbb-b9e0-ffcd5bc611f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:11:41.176877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-1a604e6a-3b0d-4cbb-b9e0-ffcd5bc611f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:11:41.219305 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a604e6a-3b0d-4cbb-b9e0-ffcd5bc611f7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.090315 Jun 04 21:11:41.221039 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1984/4084] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:11:41 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:41.230571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-18bb03b5-0e13-487f-98cf-1df3b0f634fb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '.version_select at 0x7f2d00e91b80>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:41.233761 ncdv-master-1 devstack@n-api.service[137228]: WARNING oslo_db.sqlalchemy.utils [None req-18bb03b5-0e13-487f-98cf-1df3b0f634fb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 04 21:11:41.244043 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-18bb03b5-0e13-487f-98cf-1df3b0f634fb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.016908 Jun 04 21:11:41.245330 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2101/4085] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:11:41 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:41.416501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1937214404", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "key_name": "tempest-key-232818135", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:41.516074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:11:42.136881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e054d1fe-fd2c-42f6-a0f4-1a37cc584259 req-3bb353a3-b087-4d9d-b8ac-64ddda420fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-plugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:42.150621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e054d1fe-fd2c-42f6-a0f4-1a37cc584259 req-3bb353a3-b087-4d9d-b8ac-64ddda420fd8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:42.151480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e054d1fe-fd2c-42f6-a0f4-1a37cc584259 req-3bb353a3-b087-4d9d-b8ac-64ddda420fd8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:42.163964 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e054d1fe-fd2c-42f6-a0f4-1a37cc584259 req-3bb353a3-b087-4d9d-b8ac-64ddda420fd8 service nova] Creating event network-vif-plugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:11:42.171193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e054d1fe-fd2c-42f6-a0f4-1a37cc584259 req-3bb353a3-b087-4d9d-b8ac-64ddda420fd8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038096 Jun 04 21:11:42.172507 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2102/4086] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:42.951871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:11:42.959950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:11:42.963949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:11:42.964733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:11:42.965339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:11:42.991265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:42.996009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:42.997186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:42.997715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:43.058237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:11:43.065178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:11:43.097201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:11:43.110213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:11:43.318060 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdbdf27e-223c-4b90-b987-539f770b531a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913907 Jun 04 21:11:43.320135 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1985/4087] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:11:43.332529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-866a5ab4-a2bf-4172-9ebb-b9ec323c498f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:43.333757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-866a5ab4-a2bf-4172-9ebb-b9ec323c498f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:44.430969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-866a5ab4-a2bf-4172-9ebb-b9ec323c498f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:44.446838 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-866a5ab4-a2bf-4172-9ebb-b9ec323c498f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1228 microversion: 2.1 time: 1.120036 Jun 04 21:11:44.451144 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2103/4088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:43 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1228 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:45.472552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:45.473983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:45.504768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:45.505534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:45.506614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:45.509308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:45.859419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:45.888817 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae8707ee-ad25-47a2-ba01-32ab370640da tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1288 microversion: 2.1 time: 0.425398 Jun 04 21:11:45.906480 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1986/4089] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:45 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1288 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:46.908874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:46.909557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:46.917338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:46.917827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:46.918583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:46.919061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:47.114982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:47.124436 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-953beac9-2889-4072-a639-589e439617ba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1286 microversion: 2.1 time: 0.218741 Jun 04 21:11:47.125297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2104/4090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:46 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1286 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:47.505873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:47.506896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:47.527820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:47.528727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:47.532363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:47.536104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:47.601724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] HTTP exception thrown: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Request method failure captured: Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af HTTP/1.1 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8lQ-8eryORwl7MxHXjqtSRZVq1GDZnj0L8RyLZ-H8bTGz6YWNwo44yURLvf_tmd1lsG27gESupuPfBRaC8wD4UZIRD2RilIGNnWCmUFLoU97miginej-2xX_ZxKaJ5odcPV41LZ4mFHsI6aMzGxpCuQJowUK-KHqvxHWnhQEJBV3zs Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfea83c42bb443459619d4d679aa1769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: f290b5d01a074e2c9859488bd4ff1162 Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e9b5db72-5ec2-495f-86bf-99c94ec6c3af'} Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:47.603361 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.607036 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.616455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Returning 404 to user: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:47.623367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-795fcc72-aefa-47f4-9521-4363f6c7c2d3 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 404 len: 111 microversion: 2.1 time: 0.119240 Jun 04 21:11:47.638815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:47.639770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: e9b5db72-5ec2-495f-86bf-99c94ec6c3af] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:47.645237 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1987/4091] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:11:47 2022] DELETE /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:11:47.647131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:47.647663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:47.665871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:47.666672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:47.712906 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] HTTP exception thrown: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Request method failure captured: Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af HTTP/1.1 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8lQ-8eryORwl7MxHXjqtSRZVq1GDZnj0L8RyLZ-H8bTGz6YWNwo44yURLvf_tmd1lsG27gESupuPfBRaC8wD4UZIRD2RilIGNnWCmUFLoU97miginej-2xX_ZxKaJ5odcPV41LZ4mFHsI6aMzGxpCuQJowUK-KHqvxHWnhQEJBV3zs Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfea83c42bb443459619d4d679aa1769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: f290b5d01a074e2c9859488bd4ff1162 Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e9b5db72-5ec2-495f-86bf-99c94ec6c3af'} Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:47.715147 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Returning 404 to user: Instance e9b5db72-5ec2-495f-86bf-99c94ec6c3af could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:47.721740 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b1f9277b-331d-4384-b3c5-dbfb9389b581 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af" status: 404 len: 111 microversion: 2.1 time: 0.086392 Jun 04 21:11:47.723874 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2105/4092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:47 2022] GET /compute/v2.1/servers/e9b5db72-5ec2-495f-86bf-99c94ec6c3af => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:11:48.148811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:48.149864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:48.179922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:48.181586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:48.183179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:48.186545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:48.927477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:48.939816 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a615d6a0-ccd5-42d5-88dd-e6d52ef4f9fc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.799666 Jun 04 21:11:48.941546 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1988/4093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:48 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:49.960129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:49.963233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:49.984952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:49.988714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:49.989988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:49.991641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:50.238722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:50.240260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:50.262744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:50.263288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:50.264020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:50.264459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:50.317084 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] HTTP exception thrown: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Request method failure captured: Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e HTTP/1.1 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8lQ-8eryORwl7MxHXjqtSRZVq1GDZnj0L8RyLZ-H8bTGz6YWNwo44yURLvf_tmd1lsG27gESupuPfBRaC8wD4UZIRD2RilIGNnWCmUFLoU97miginej-2xX_ZxKaJ5odcPV41LZ4mFHsI6aMzGxpCuQJowUK-KHqvxHWnhQEJBV3zs Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfea83c42bb443459619d4d679aa1769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: f290b5d01a074e2c9859488bd4ff1162 Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e'} Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:50.319147 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Returning 404 to user: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:50.323015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-202c9493-ddc4-48a5-8c3d-065b58afc53b tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 404 len: 111 microversion: 2.1 time: 0.086171 Jun 04 21:11:50.331730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1989/4094] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:11:50 2022] DELETE /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:11:50.344759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:50.345377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] [instance: 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:50.372909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:50.373364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:50.374343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:50.374789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:50.417862 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] HTTP exception thrown: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Request method failure captured: Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e HTTP/1.1 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8lQ-8eryORwl7MxHXjqtSRZVq1GDZnj0L8RyLZ-H8bTGz6YWNwo44yURLvf_tmd1lsG27gESupuPfBRaC8wD4UZIRD2RilIGNnWCmUFLoU97miginej-2xX_ZxKaJ5odcPV41LZ4mFHsI6aMzGxpCuQJowUK-KHqvxHWnhQEJBV3zs Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cfea83c42bb443459619d4d679aa1769"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cfea83c42bb443459619d4d679aa1769"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: cfea83c42bb443459619d4d679aa1769 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1210396921 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: f290b5d01a074e2c9859488bd4ff1162 Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeTestJSON-1210396921-project Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e'} Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:11:50.419478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] Returning 404 to user: Instance 164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ac4abe1-bdf4-4c35-aa4b-5c486bdaee35 tempest-AttachVolumeTestJSON-1210396921 tempest-AttachVolumeTestJSON-1210396921-project] 10.222.0.18 "GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e" status: 404 len: 111 microversion: 2.1 time: 0.080286 Jun 04 21:11:50.423111 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1990/4095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:50 2022] GET /compute/v2.1/servers/164f04cd-b9f4-47a6-9d20-fa35bfc4bc0e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:11:50.929536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:50.937561 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-914664c0-bb9b-4ace-a2c2-2c53eca87ebb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.982958 Jun 04 21:11:50.951940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2106/4096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:49 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:51.955910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:51.956549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:51.972694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:51.973107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:51.977992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:51.980739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:52.748228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1d6129a1-2a9b-4b13-9337-c15b5e39c7f9 req-336e0ed9-a103-4013-a7be-e0ba15e31349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2865f1fb-ef6f-4e9c-883d-3ef6517118f4", "tag": "c523fb7c-7d81-429b-8bab-64758b5462e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:11:52.771476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1d6129a1-2a9b-4b13-9337-c15b5e39c7f9 req-336e0ed9-a103-4013-a7be-e0ba15e31349 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:52.772282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1d6129a1-2a9b-4b13-9337-c15b5e39c7f9 req-336e0ed9-a103-4013-a7be-e0ba15e31349 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:52.814239 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1d6129a1-2a9b-4b13-9337-c15b5e39c7f9 req-336e0ed9-a103-4013-a7be-e0ba15e31349 service nova] Creating event network-changed:c523fb7c-7d81-429b-8bab-64758b5462e1 for instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 on nch1-master-1 Jun 04 21:11:52.922358 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1d6129a1-2a9b-4b13-9337-c15b5e39c7f9 req-336e0ed9-a103-4013-a7be-e0ba15e31349 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177947 Jun 04 21:11:52.923624 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2107/4097] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:11:52.937751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:52.950522 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62e62e75-9639-4ee1-90ed-9719b336605f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.998509 Jun 04 21:11:52.963872 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1991/4098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:51 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:53.974124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:53.975628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:53.992464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:53.992967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:53.993864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:53.994319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:54.426555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:54.443544 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9ed008e2-a78e-4418-b245-6359dfffd97d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.468477 Jun 04 21:11:54.446217 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2108/4099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:53 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:55.468751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:55.469830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:55.480078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:55.484311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:55.486513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:55.488301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:55.490715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:55.494020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:56.313649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:56.334454 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75ee629c-a06f-4a36-b121-855b5669f864 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.868761 Jun 04 21:11:56.338432 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1992/4100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:55 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:11:57.355356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:57.356072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:57.368411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:57.388706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:57.389670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:57.390587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:57.390701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:57.838016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:57.854397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-52f8b508-6c84-4f0b-8f76-bfb6c731287c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.502834 Jun 04 21:11:57.856557 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2109/4101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:57 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:11:58.872623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:11:58.873248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:11:58.876092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:11:58.885634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:58.886089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:58.892626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:11:58.893323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:11:59.312386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:11:59.330165 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a8408e08-10c6-49d3-a02c-ec67f6808949 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.461294 Jun 04 21:11:59.330790 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1993/4102] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:11:58 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:00.039766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-69d0c14b-7ea4-467d-9425-aaa0dba7ae69 req-6bccd75c-f63f-4e05-a91d-7b4ba746a6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2865f1fb-ef6f-4e9c-883d-3ef6517118f4", "name": "network-vif-plugged", "status": "completed", "tag": "c523fb7c-7d81-429b-8bab-64758b5462e1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:00.058295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:00.060808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-69d0c14b-7ea4-467d-9425-aaa0dba7ae69 req-6bccd75c-f63f-4e05-a91d-7b4ba746a6f1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:00.061498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-69d0c14b-7ea4-467d-9425-aaa0dba7ae69 req-6bccd75c-f63f-4e05-a91d-7b4ba746a6f1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:00.082196 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-69d0c14b-7ea4-467d-9425-aaa0dba7ae69 req-6bccd75c-f63f-4e05-a91d-7b4ba746a6f1 service nova] Creating event network-vif-plugged:c523fb7c-7d81-429b-8bab-64758b5462e1 for instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 on nch1-master-1 Jun 04 21:12:00.090414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-69d0c14b-7ea4-467d-9425-aaa0dba7ae69 req-6bccd75c-f63f-4e05-a91d-7b4ba746a6f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054557 Jun 04 21:12:00.091608 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2110/4103] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:00.356297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:00.356982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:00.384216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:00.387129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:00.389754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:00.390649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:00.948922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:00.981543 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04746658-5632-43d0-ae08-1d9c6b632c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1328 microversion: 2.1 time: 0.630435 Jun 04 21:12:00.986961 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1994/4104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:00 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1328 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:02.009913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:02.011405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:02.035263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.035869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.042194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.049895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.082946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:02.084475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:02.099105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.102032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.103071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.105433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.594852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:02.599200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:02.608737 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce43f844-c1f4-4010-a768-0e111f44b746 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1510 microversion: 2.1 time: 0.602607 Jun 04 21:12:02.610247 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2111/4105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:02 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1510 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:02.610365 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-716b9f5d-41f4-42da-8de3-1c846f8fb8ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.531785 Jun 04 21:12:02.610945 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1995/4106] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:02 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:02.641286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:02.641286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:02.652670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.654935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.656229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.657295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.875611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02fc7cfe-cfc9-4395-8594-97e8ba840b0b tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Action: 'create', calling method: .version_select at 0x7f2d0bf864c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-48036421", "metadata": {"Type": "work"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02fc7cfe-cfc9-4395-8594-97e8ba840b0b tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Request method failure captured: Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 120 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8qhygPUlq3oFw0mcpdAGT2fMcRjao6Pi_E4PLp-JQySwQiyW1Qwu12d8BuXzoypxUXgCR6IruONbR5WKvHfEQP4AgwVhxuOExr-qZNqGCn9JhT0WX95XzCIkYjfcuCyhIGvrKws9adcMnO2MqjbvbmBaR8Gz31dGnvRfP4BG4i6F5M Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d069147cbf9649279f79f6c0aac711ef Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-48036421", "metadata": {"Type": "work"}}} Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-48036421', 'metadata': {'Type': 'work'}}}} Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '#$%' Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:12:02.878695 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02fc7cfe-cfc9-4395-8594-97e8ba840b0b tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02fc7cfe-cfc9-4395-8594-97e8ba840b0b tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.268221 Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1996/4107] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:12:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 270 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-860724342"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:02.889991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:02.895861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.896316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:02.897230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:02.898160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:03.144902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:03.158864 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f6c97a8-8f32-415f-882a-19d1f951d5e1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1510 microversion: 2.1 time: 0.525522 Jun 04 21:12:03.159468 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2112/4108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:02 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:03.166220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e132cec6-a4af-42a3-9d61-8a8d5854df5e tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Action: 'create', calling method: .version_select at 0x7f2d00fed9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1494032675", "metadata": {"Type": "work"}}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e132cec6-a4af-42a3-9d61-8a8d5854df5e tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Request method failure captured: Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 120 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8qhygPUlq3oFw0mcpdAGT2fMcRjao6Pi_E4PLp-JQySwQiyW1Qwu12d8BuXzoypxUXgCR6IruONbR5WKvHfEQP4AgwVhxuOExr-qZNqGCn9JhT0WX95XzCIkYjfcuCyhIGvrKws9adcMnO2MqjbvbmBaR8Gz31dGnvRfP4BG4i6F5M Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: d069147cbf9649279f79f6c0aac711ef Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1494032675", "metadata": {"Type": "work"}}} Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: method: Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1494032675', 'metadata': {'Type': 'work'}}}} Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi '0' Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:12:03.173130 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 04 21:12:03.177024 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.183441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e132cec6-a4af-42a3-9d61-8a8d5854df5e tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:03.184543 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e132cec6-a4af-42a3-9d61-8a8d5854df5e tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024106 Jun 04 21:12:03.187207 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2113/4109] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:12:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:12:03.197271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:03.198119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:03.227563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:03.227958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:03.232144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:03.232665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:03.298235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:12:03.315119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=87 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:03.435875 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fff1feed-8978-4e20-b292-60e5dada7f1c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.523966 Jun 04 21:12:03.436686 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1997/4110] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:12:02 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 04 21:12:03.470763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-683f844c-d93a-4048-a557-3e18d25fafbc tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Action: 'create', calling method: .version_select at 0x7f2d0bf36430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1898073802", "metadata": {"Type": "work"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-683f844c-d93a-4048-a557-3e18d25fafbc tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Request method failure captured: Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 119 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8qhygPUlq3oFw0mcpdAGT2fMcRjao6Pi_E4PLp-JQySwQiyW1Qwu12d8BuXzoypxUXgCR6IruONbR5WKvHfEQP4AgwVhxuOExr-qZNqGCn9JhT0WX95XzCIkYjfcuCyhIGvrKws9adcMnO2MqjbvbmBaR8Gz31dGnvRfP4BG4i6F5M Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d069147cbf9649279f79f6c0aac711ef Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1898073802", "metadata": {"Type": "work"}}} Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1898073802', 'metadata': {'Type': 'work'}}}} Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '' Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:12:03.483792 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-683f844c-d93a-4048-a557-3e18d25fafbc tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-683f844c-d93a-4048-a557-3e18d25fafbc tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036921 Jun 04 21:12:03.492340 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1998/4111] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:12:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:12:03.516050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e068845-8ce9-49cb-958d-7730cd62f841 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Calling method '.version_select at 0x7f2d017e64c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:03.581553 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b437f690-3ca6-40ef-8078-d9b0f1d2d22c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 204 len: 0 microversion: 2.1 time: 0.392108 Jun 04 21:12:03.582721 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2114/4112] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:12:03 2022] DELETE /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:12:03.596575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:03.597639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:03.606787 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8e068845-8ce9-49cb-958d-7730cd62f841 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] HTTP exception thrown: Volume tempest-invalid-1485446508 could not be found. Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e068845-8ce9-49cb-958d-7730cd62f841 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Request method failure captured: Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1485446508 HTTP/1.1 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8qhygPUlq3oFw0mcpdAGT2fMcRjao6Pi_E4PLp-JQySwQiyW1Qwu12d8BuXzoypxUXgCR6IruONbR5WKvHfEQP4AgwVhxuOExr-qZNqGCn9JhT0WX95XzCIkYjfcuCyhIGvrKws9adcMnO2MqjbvbmBaR8Gz31dGnvRfP4BG4i6F5M Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d069147cbf9649279f79f6c0aac711ef Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: exception: Volume tempest-invalid-1485446508 could not be found. Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'tempest-invalid-1485446508'} Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1485446508 could not be found. (HTTP 404) (Request-ID: req-c8df0f4e-b400-4178-be56-1cb369f1dbfe) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:12:03.610594 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1485446508 could not be found. Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1485446508 could not be found. Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1485446508 could not be found. Jun 04 21:12:03.615715 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.619484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e068845-8ce9-49cb-958d-7730cd62f841 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Returning 404 to user: Volume tempest-invalid-1485446508 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:03.620856 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e068845-8ce9-49cb-958d-7730cd62f841 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1485446508" status: 404 len: 99 microversion: 2.1 time: 0.122113 Jun 04 21:12:03.623500 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 1999/4113] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:12:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1485446508 => generated 99 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 04 21:12:03.635250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:03.635920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:03.636945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:03.637553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:03.637714 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-67d85387-eb35-49dd-a34e-995507da7962 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007820 Jun 04 21:12:03.646900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2000/4114] 10.222.0.18 () {58 vars in 1139 bytes} [Sat Jun 4 21:12:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 21:12:03.656522 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-06ece0eb-090d-4f06-bcdb-3447fba106c9 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006957 Jun 04 21:12:03.660685 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2001/4115] 10.222.0.18 () {58 vars in 1136 bytes} [Sat Jun 4 21:12:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 04 21:12:03.681595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a438b194-8386-43c2-b8a3-bc37e2e86457 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Calling method '.version_select at 0x7f2d0be6a8b0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:03.727948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-a438b194-8386-43c2-b8a3-bc37e2e86457 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] HTTP exception thrown: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a438b194-8386-43c2-b8a3-bc37e2e86457 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Request method failure captured: Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/os-volumes/f66ca35e-d6b5-47f9-b965-6ac930cfa684 HTTP/1.1 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8qhygPUlq3oFw0mcpdAGT2fMcRjao6Pi_E4PLp-JQySwQiyW1Qwu12d8BuXzoypxUXgCR6IruONbR5WKvHfEQP4AgwVhxuOExr-qZNqGCn9JhT0WX95XzCIkYjfcuCyhIGvrKws9adcMnO2MqjbvbmBaR8Gz31dGnvRfP4BG4i6F5M Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d069147cbf9649279f79f6c0aac711ef Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: exception: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f66ca35e-d6b5-47f9-b965-6ac930cfa684'} Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. (HTTP 404) (Request-ID: req-4473fc80-86c7-4cf4-b42d-c1afe7c6c6c0) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:12:03.739194 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. Jun 04 21:12:03.743402 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.753215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a438b194-8386-43c2-b8a3-bc37e2e86457 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Returning 404 to user: Volume f66ca35e-d6b5-47f9-b965-6ac930cfa684 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:03.754581 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a438b194-8386-43c2-b8a3-bc37e2e86457 tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f66ca35e-d6b5-47f9-b965-6ac930cfa684" status: 404 len: 109 microversion: 2.1 time: 0.087175 Jun 04 21:12:03.758578 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2002/4116] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:12:03 2022] DELETE /compute/v2.1/os-volumes/f66ca35e-d6b5-47f9-b965-6ac930cfa684 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:12:03.779084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2936870d-f9c3-41a4-812e-3c741ae46a0c tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Calling method '.version_select at 0x7f2d017e6af0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:03.842628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2936870d-f9c3-41a4-812e-3c741ae46a0c tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] HTTP exception thrown: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2936870d-f9c3-41a4-812e-3c741ae46a0c tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Request method failure captured: Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-volumes/9dc7fe4a-c234-4844-8c3d-053260d2a376 HTTP/1.1 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8qhygPUlq3oFw0mcpdAGT2fMcRjao6Pi_E4PLp-JQySwQiyW1Qwu12d8BuXzoypxUXgCR6IruONbR5WKvHfEQP4AgwVhxuOExr-qZNqGCn9JhT0WX95XzCIkYjfcuCyhIGvrKws9adcMnO2MqjbvbmBaR8Gz31dGnvRfP4BG4i6F5M Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6f00fdd041ad47e69525f3e939dfa38e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6f00fdd041ad47e69525f3e939dfa38e Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesNegativeTest-411437875 Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d069147cbf9649279f79f6c0aac711ef Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesNegativeTest-411437875-project Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: exception: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '9dc7fe4a-c234-4844-8c3d-053260d2a376'} Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. (HTTP 404) (Request-ID: req-c933296e-1c68-4bb4-ba30-0f6a447e39a7) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:12:03.846160 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2936870d-f9c3-41a4-812e-3c741ae46a0c tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] Returning 404 to user: Volume 9dc7fe4a-c234-4844-8c3d-053260d2a376 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2936870d-f9c3-41a4-812e-3c741ae46a0c tempest-VolumesNegativeTest-411437875 tempest-VolumesNegativeTest-411437875-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/9dc7fe4a-c234-4844-8c3d-053260d2a376" status: 404 len: 109 microversion: 2.1 time: 0.077872 Jun 04 21:12:03.856421 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2003/4117] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:12:03 2022] GET /compute/v2.1/os-volumes/9dc7fe4a-c234-4844-8c3d-053260d2a376 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:12:04.006440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e571e1b1-6f40-4cc1-a558-e3070c2447a5 req-ebe58a74-eb21-4eab-9aea-9068d07db16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:04.043856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e571e1b1-6f40-4cc1-a558-e3070c2447a5 req-ebe58a74-eb21-4eab-9aea-9068d07db16c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:04.044420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e571e1b1-6f40-4cc1-a558-e3070c2447a5 req-ebe58a74-eb21-4eab-9aea-9068d07db16c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:04.095442 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e571e1b1-6f40-4cc1-a558-e3070c2447a5 req-ebe58a74-eb21-4eab-9aea-9068d07db16c service nova] Creating event network-vif-unplugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:12:04.109588 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e571e1b1-6f40-4cc1-a558-e3070c2447a5 req-ebe58a74-eb21-4eab-9aea-9068d07db16c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138501 Jun 04 21:12:04.113845 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2004/4118] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:04.295067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:04.307195 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-18f91c0f-9cac-451b-9ec7-95ecf1f8616b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1516 microversion: 2.1 time: 0.715941 Jun 04 21:12:04.310702 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2115/4119] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:03 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1516 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:05.329995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:05.330702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:05.351156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:05.351870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:05.357368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:05.358193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:05.960163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:05.991876 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aa7efa49-6d83-4efd-a586-61dc5095113e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1516 microversion: 2.1 time: 0.662237 Jun 04 21:12:05.995000 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2005/4120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:05 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1516 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:07.020519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:07.021428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:07.035811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:07.036510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:07.039797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:07.040896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:07.054802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:07.440038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:07.453733 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-22181e86-c6a7-463a-b667-0d3d23644c57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 200 len: 1516 microversion: 2.1 time: 0.444291 Jun 04 21:12:07.468752 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2116/4121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:07 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 1516 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:07.512837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4be2546c-cc0b-4779-9dc9-34319b33855b req-3a1596b6-f9ab-4402-be86-d3681df3a1be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2865f1fb-ef6f-4e9c-883d-3ef6517118f4", "name": "network-vif-deleted", "tag": "c523fb7c-7d81-429b-8bab-64758b5462e1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:07.533027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4be2546c-cc0b-4779-9dc9-34319b33855b req-3a1596b6-f9ab-4402-be86-d3681df3a1be service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:07.533826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4be2546c-cc0b-4779-9dc9-34319b33855b req-3a1596b6-f9ab-4402-be86-d3681df3a1be service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:07.553628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4be2546c-cc0b-4779-9dc9-34319b33855b req-3a1596b6-f9ab-4402-be86-d3681df3a1be service nova] Creating event network-vif-deleted:c523fb7c-7d81-429b-8bab-64758b5462e1 for instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 on nch1-master-1 Jun 04 21:12:07.560976 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4be2546c-cc0b-4779-9dc9-34319b33855b req-3a1596b6-f9ab-4402-be86-d3681df3a1be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052290 Jun 04 21:12:07.562326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2006/4122] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:08.474501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:08.475154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:08.497134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:08.500126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:08.508314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:08.511131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:08.557949 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 HTTP/1.1 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '2865f1fb-ef6f-4e9c-883d-3ef6517118f4'} Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:08.567696 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:12:08.572717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:12:08.572717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:12:08.572717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:12:08.572717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:12:08.572717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:12:08.572717 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:12:08.576622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:12:08.578276 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8bddc832-0ef5-4ee9-b8f0-004a9d1a22ad tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 404 len: 111 microversion: 2.1 time: 0.109385 Jun 04 21:12:08.583414 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2117/4123] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:08 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:12:08.598468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-efe5f824-f1c6-4eda-9ad3-2b0f261ad28e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '.version_select at 0x7f2d036fc4c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:08.653525 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-efe5f824-f1c6-4eda-9ad3-2b0f261ad28e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-key-232818135" status: 202 len: 0 microversion: 2.1 time: 0.065567 Jun 04 21:12:08.654538 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2007/4124] 10.222.0.18 () {58 vars in 1205 bytes} [Sat Jun 4 21:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-232818135 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:12:09.101574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1833529372", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:09.232692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:12:10.377566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2a48d930-e239-4368-a48a-53364684cac6 req-3aa241fb-c1b5-4197-b074-2f2c5aa3711c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-plugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:10.408690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2a48d930-e239-4368-a48a-53364684cac6 req-3aa241fb-c1b5-4197-b074-2f2c5aa3711c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:10.411194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2a48d930-e239-4368-a48a-53364684cac6 req-3aa241fb-c1b5-4197-b074-2f2c5aa3711c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:10.450389 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2a48d930-e239-4368-a48a-53364684cac6 req-3aa241fb-c1b5-4197-b074-2f2c5aa3711c service nova] Creating event network-vif-plugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:12:10.471107 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2a48d930-e239-4368-a48a-53364684cac6 req-3aa241fb-c1b5-4197-b074-2f2c5aa3711c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112723 Jun 04 21:12:10.472220 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2008/4125] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:12:10.625467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:12:10.626027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:12:10.626365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:12:10.626943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:12:10.627559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:12:10.656098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:10.659191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:10.662201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:10.665174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:10.759766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:12:10.767286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:12:10.790374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:12:10.799488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:12:10.896914 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-190ef901-dd5f-4eed-8232-2addca56c962 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801033 Jun 04 21:12:10.902373 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2118/4126] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:12:10.916768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afe76588-a6a6-45fb-87a1-c9d2dd37aa8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:10.917811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-afe76588-a6a6-45fb-87a1-c9d2dd37aa8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:11.369582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-afe76588-a6a6-45fb-87a1-c9d2dd37aa8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:11.402813 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-afe76588-a6a6-45fb-87a1-c9d2dd37aa8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1209 microversion: 2.1 time: 0.493539 Jun 04 21:12:11.406496 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2009/4127] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:10 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1209 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:12.425219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:12.426538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:12.461779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:12.462380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:12.463155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:12.463645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:12.852619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:12.868939 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39d03e0e-db40-428d-b011-47663a7d1ccd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1213 microversion: 2.1 time: 0.448377 Jun 04 21:12:12.883184 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2119/4128] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:12 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1213 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:13.886725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:13.887384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:13.904645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:13.906303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:13.908684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:13.909777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:14.192265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:14.244432 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe82b784-ecce-42b8-a6ad-20cc577500ee tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1279 microversion: 2.1 time: 0.360610 Jun 04 21:12:14.245837 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2010/4129] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:13 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1279 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:15.265007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:15.265629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:15.307051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:15.308415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:15.312845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:15.316788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:15.550924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:15.560197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-034860c6-c3fd-4c8d-b057-10981f223c99 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1267 microversion: 2.1 time: 0.300306 Jun 04 21:12:15.576306 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2120/4130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:15 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:16.595851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:16.596488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:16.612386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:16.613383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:16.614346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:16.614960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:17.583012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:17.605833 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bc20d8ca-fbd4-4638-9251-49abee7cf388 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 1.015136 Jun 04 21:12:17.608138 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2011/4131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:16 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:18.624564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:18.625333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:18.637972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:18.654948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:18.660687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:18.661169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:19.122536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:19.135988 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-49cc9c96-701c-40a3-a0ae-c11f0bdacd35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.511412 Jun 04 21:12:19.136664 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2121/4132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:18 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:19.907325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-821a67ae-9688-4f74-8913-155df2698c8e req-3d58ff15-13f9-46ff-8559-4e93bae87ddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d96768-43c1-4c0b-b27c-8bfe28b393a5", "tag": "2947f597-5de2-4407-a491-c67f7b4407a5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:19.959602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-821a67ae-9688-4f74-8913-155df2698c8e req-3d58ff15-13f9-46ff-8559-4e93bae87ddf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:19.960620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-821a67ae-9688-4f74-8913-155df2698c8e req-3d58ff15-13f9-46ff-8559-4e93bae87ddf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:20.110110 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-821a67ae-9688-4f74-8913-155df2698c8e req-3d58ff15-13f9-46ff-8559-4e93bae87ddf service nova] Creating event network-changed:2947f597-5de2-4407-a491-c67f7b4407a5 for instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 on nch1-master-1 Jun 04 21:12:20.144653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-821a67ae-9688-4f74-8913-155df2698c8e req-3d58ff15-13f9-46ff-8559-4e93bae87ddf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241487 Jun 04 21:12:20.156994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2012/4133] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:20.163015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:20.163863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:20.201951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:20.202484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:20.203319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:20.212422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:20.704102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:20.780451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:20.863138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:20.873398 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4394b0ea-9dda-45aa-a861-cdd483dadbcc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.723052 Jun 04 21:12:20.896265 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2122/4134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:20 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:21.896132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:21.897063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:21.915246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:21.925092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:21.928892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:21.932957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:21.936283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:22.464964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:22.477152 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a6790540-74f3-45ba-ab23-04ac4587aa0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.585843 Jun 04 21:12:22.477752 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2013/4135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:21 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:23.505827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:23.510167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:23.548304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:23.548805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:23.566280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:23.570882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:23.997792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:24.036294 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17160581-3807-49e4-b64e-18c481056baa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.542686 Jun 04 21:12:24.040347 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2123/4136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:23 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:24.603589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:24.604436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:24.622545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:24.623197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:24.625960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:24.627927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:25.060585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:25.061986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:25.087537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:25.101429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:25.102582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:25.106595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:25.636371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:25.647580 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-41830329-868f-406a-9bae-225e07d9a0f0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.594253 Jun 04 21:12:25.650039 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2124/4137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:25 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:25.664930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:25.677988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:25.680647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:25.682176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4f5a161-8206-4d72-86dd-f3f86facb82d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2954 microversion: 2.42 time: 1.085970 Jun 04 21:12:25.697912 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2014/4138] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:12:24 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2954 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:12:25.707905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:25.708813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:25.717411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:25.718777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:25.720190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:25.720816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:26.081731 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-370a20b0-0a78-4e42-a0cc-9a260953edd9 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.379777 Jun 04 21:12:26.084949 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2125/4139] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Jun 4 21:12:25 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c/os-interface => generated 1830 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:12:26.670043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:26.673134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:26.696885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:26.703618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:26.707280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:26.713414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:27.051257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:27.061590 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-491025ca-e00c-4ac3-bedc-5f16ce90d2c8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.397868 Jun 04 21:12:27.071347 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2015/4140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:26 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:28.099246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:28.106002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:28.140235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:28.142858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:28.152880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:28.156393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:29.310948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:29.335721 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1756f2ee-2b7a-498c-b6d1-da3cae75eaf3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 1.249085 Jun 04 21:12:29.342295 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2126/4141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:28 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:30.359636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:30.361013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:30.378229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:30.384783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:30.388738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:30.390465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:30.392099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:30.554678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-bc70fe49-155c-42c4-a3c7-8404d6a55c14 req-f41d0571-6e8a-4261-8fef-56bb078d535c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d96768-43c1-4c0b-b27c-8bfe28b393a5", "name": "network-vif-plugged", "status": "completed", "tag": "2947f597-5de2-4407-a491-c67f7b4407a5"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:30.568957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bc70fe49-155c-42c4-a3c7-8404d6a55c14 req-f41d0571-6e8a-4261-8fef-56bb078d535c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:30.571101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bc70fe49-155c-42c4-a3c7-8404d6a55c14 req-f41d0571-6e8a-4261-8fef-56bb078d535c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:30.618421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-bc70fe49-155c-42c4-a3c7-8404d6a55c14 req-f41d0571-6e8a-4261-8fef-56bb078d535c service nova] Creating event network-vif-plugged:2947f597-5de2-4407-a491-c67f7b4407a5 for instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 on nch1-master-1 Jun 04 21:12:30.626169 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-bc70fe49-155c-42c4-a3c7-8404d6a55c14 req-f41d0571-6e8a-4261-8fef-56bb078d535c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075707 Jun 04 21:12:30.628564 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2127/4142] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:31.131796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:31.159698 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7b7eb07-3610-4c73-a41e-7ca9272bcafe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 0.799551 Jun 04 21:12:31.164178 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2016/4143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:30 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:32.157512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-340143811", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "597e3b81-54a2-40c2-b0af-8c8229f008d5"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:32.178276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:32.178857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:32.210388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:32.210859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:32.211713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:32.212152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:32.213263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:32.839445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] validate_networks() for [('597e3b81-54a2-40c2-b0af-8c8229f008d5', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:12:33.476628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:33.482247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:33.497282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44bdc838-9636-4dfb-9933-7279f74f2b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1309 microversion: 2.1 time: 1.324548 Jun 04 21:12:33.498840 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2017/4144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:32 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1309 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:34.464873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:12:34.466129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:12:34.468533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:12:34.469083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:12:34.469684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:12:34.499437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:34.501749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:34.503856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:34.517228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:34.518939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:34.520189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:34.533701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:34.534171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:34.535080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:34.535698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:34.582485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Getting quotas for project 4fd1ca1698d14742981eb94fc11d64d8. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:12:34.604406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Getting quotas for user b7385bf9cbff4b30b6f75566ee78d92a and project 4fd1ca1698d14742981eb94fc11d64d8. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:12:34.641875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:12:34.654130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:12:34.800896 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c84c8673-2c09-4492-8b20-cde0716367f1 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.270263 Jun 04 21:12:34.802655 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2128/4145] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:12:34.821519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7360b83-1765-45d2-b6d0-cd42600fc06e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:34.827862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e7360b83-1765-45d2-b6d0-cd42600fc06e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:35.074220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e7360b83-1765-45d2-b6d0-cd42600fc06e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:35.089707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e7360b83-1765-45d2-b6d0-cd42600fc06e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1214 microversion: 2.1 time: 0.274172 Jun 04 21:12:35.102133 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2129/4146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:34 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1214 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:35.388460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:35.403946 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dc32b5ce-13a4-4dd9-8c0b-3498be93662d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1491 microversion: 2.1 time: 0.889441 Jun 04 21:12:35.407035 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2018/4147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:34 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1491 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:35.768893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1833529372", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:35.915719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:12:36.118989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:36.122144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:36.160153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:36.160636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:36.163813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:36.164498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:36.480803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:36.496089 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-648c899d-5958-458f-a8e2-e8cd8bae114f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1218 microversion: 2.1 time: 0.381532 Jun 04 21:12:36.523055 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2019/4148] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:36 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1218 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:37.528364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:37.528987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:37.562997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:37.565631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:37.567027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:37.567816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:37.781060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:37.803970 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b16f7fc1-13e6-4842-8f29-66be426e88fd tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1272 microversion: 2.1 time: 0.278910 Jun 04 21:12:37.804959 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2020/4149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:37 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:37.894846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:12:37.895445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:12:37.895832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:12:37.896786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:12:37.897456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:12:37.920473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:37.921433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:37.925426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:37.926761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:37.940848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=60 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:37.960375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:12:37.970106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:12:37.990945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:12:37.994021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:12:38.067957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bcf5d67-e661-4aa9-a2c7-85a196f58089 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.304202 Jun 04 21:12:38.069498 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2130/4150] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:12:38.079947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd4c0354-9ab8-4743-900e-76c238fe515f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:38.080848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bd4c0354-9ab8-4743-900e-76c238fe515f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:38.216633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bd4c0354-9ab8-4743-900e-76c238fe515f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:38.234780 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd4c0354-9ab8-4743-900e-76c238fe515f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1209 microversion: 2.1 time: 0.156257 Jun 04 21:12:38.248621 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2021/4151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:38 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1209 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:38.697431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:38.698229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:38.712121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:38.714667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:38.715854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:38.717587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:38.825367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:38.826043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:38.853064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:38.853527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:38.854320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:38.855840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:38.992295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:38.997339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:39.006522 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fba662a1-a23e-4492-8a15-7d7cd6aecdec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1272 microversion: 2.1 time: 0.188391 Jun 04 21:12:39.009831 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0686dbb4-cf4e-4e15-8abf-8741b9db151a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.317263 Jun 04 21:12:39.014152 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2022/4152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:38 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:39.021721 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2131/4153] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:38 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:39.042266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1158959626"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:39.043945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:39.064645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:39.065435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:39.067981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:39.072189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:39.254911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:39.255560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:39.273013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:39.273469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:39.280549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:39.281015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:39.654627 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7e80cb7-360b-4de6-8095-df9819b4fc01 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.627860 Jun 04 21:12:39.659123 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2023/4154] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:12:39 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 04 21:12:39.678030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:39.683175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:39.689084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:39.691740 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-383d1851-e0a1-4eda-ad8e-80790adbc86c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1261 microversion: 2.1 time: 0.437892 Jun 04 21:12:39.706009 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2132/4155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:39 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1261 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:39.715784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:39.717508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:39.724471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:39.725104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:40.027335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:40.028401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:40.045179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:40.045637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:40.046476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:40.046857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:40.071858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:40.081961 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8120e5e-f115-402a-b831-26fd9ce0aed3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.420988 Jun 04 21:12:40.084671 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2024/4156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:39 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:40.712351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:40.713211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:40.726047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:40.727570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:40.729542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:40.730658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:40.941456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:40.954244 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36ee1ed7-57c8-45ee-ade5-e0664e14830c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1267 microversion: 2.1 time: 0.248043 Jun 04 21:12:40.957087 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2025/4157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:40 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:41.024296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:41.034830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f757a31d-aa01-4821-b968-0c10a3efbc06 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 1.013039 Jun 04 21:12:41.044162 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2133/4158] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:40 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:41.102323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:41.103073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:41.109756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:41.110213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:41.119001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:41.119675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:41.475498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:41.484790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a67e7c07-5a0b-4c9f-88b1-4448441a4e0d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1689 microversion: 2.1 time: 0.386838 Jun 04 21:12:41.495628 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2026/4159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:41 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1689 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:41.975609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:41.976242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:41.992441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:41.992897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:42.015883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:42.016459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:42.055346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:42.060324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:42.092798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:42.093268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:42.094081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:42.094527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:42.607984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:42.627215 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b9fc09a-9bb9-4c2e-994f-713af73d7c71 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.646092 Jun 04 21:12:42.627940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2134/4160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:41 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:42.647419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:42.649511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:42.674541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:42.675109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:42.678598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:42.680605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:42.681189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:42.692268 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-46484acb-ae93-45ca-b3d1-e48c7ee878a0 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.641754 Jun 04 21:12:42.696186 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2027/4161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:42 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:43.241163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:43.261505 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-578353a8-8977-4548-b903-3db5b424ba4d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1689 microversion: 2.1 time: 0.632389 Jun 04 21:12:43.271392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2135/4162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:42 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1689 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:43.392034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-08fcf1ce-7375-451d-afd1-7d77e073160d req-944150ba-7b43-4b2a-9e68-3bf9043a73f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9575ac6-1822-4e7f-9f19-34f7c77e6023", "tag": "82a3e3fa-8824-4554-923a-924b58203734"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:43.412495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-08fcf1ce-7375-451d-afd1-7d77e073160d req-944150ba-7b43-4b2a-9e68-3bf9043a73f2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:43.412978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-08fcf1ce-7375-451d-afd1-7d77e073160d req-944150ba-7b43-4b2a-9e68-3bf9043a73f2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:43.452803 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-08fcf1ce-7375-451d-afd1-7d77e073160d req-944150ba-7b43-4b2a-9e68-3bf9043a73f2 service nova] Creating event network-changed:82a3e3fa-8824-4554-923a-924b58203734 for instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 on nch2-master-1 Jun 04 21:12:43.466845 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-08fcf1ce-7375-451d-afd1-7d77e073160d req-944150ba-7b43-4b2a-9e68-3bf9043a73f2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079123 Jun 04 21:12:43.467486 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2028/4163] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:43.644092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:43.645002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:43.661530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:43.661998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:43.682424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:43.683171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:43.713295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:43.714683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:43.730983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:43.731920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:43.735631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:43.736783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:44.201980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:44.213898 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99305aff-509f-4651-9d21-30e38924c6cb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.571504 Jun 04 21:12:44.215962 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2136/4164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:43 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:44.279439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:44.279439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:44.291172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:44.291563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:44.293870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:44.297982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:44.403275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:44.438569 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fdbcd669-6b42-414c-82b2-384e7cd0f824 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.730888 Jun 04 21:12:44.441542 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2029/4165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:43 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:44.448238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-26233a96-125c-4f14-9fc5-cd800131f641 req-c216a7b6-b0fb-4df7-8bec-aceeff45b642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca7fd07-04ec-4514-8c50-277456484f5a", "tag": "2a9a656c-1d89-4b16-a891-49c53a0e04f6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:44.474908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-26233a96-125c-4f14-9fc5-cd800131f641 req-c216a7b6-b0fb-4df7-8bec-aceeff45b642 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:44.476991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-26233a96-125c-4f14-9fc5-cd800131f641 req-c216a7b6-b0fb-4df7-8bec-aceeff45b642 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:44.505956 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-26233a96-125c-4f14-9fc5-cd800131f641 req-c216a7b6-b0fb-4df7-8bec-aceeff45b642 service nova] Creating event network-changed:2a9a656c-1d89-4b16-a891-49c53a0e04f6 for instance eca7fd07-04ec-4514-8c50-277456484f5a on nch1-master-1 Jun 04 21:12:44.525450 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-26233a96-125c-4f14-9fc5-cd800131f641 req-c216a7b6-b0fb-4df7-8bec-aceeff45b642 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076666 Jun 04 21:12:44.526325 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2030/4166] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:44.710709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8914fa13-2047-4569-b3d6-ce34f0a50a3a req-4c7163a7-9c24-4c24-848c-2cc0026b0af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:44.762057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8914fa13-2047-4569-b3d6-ce34f0a50a3a req-4c7163a7-9c24-4c24-848c-2cc0026b0af4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:44.763206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8914fa13-2047-4569-b3d6-ce34f0a50a3a req-4c7163a7-9c24-4c24-848c-2cc0026b0af4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:44.778598 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8914fa13-2047-4569-b3d6-ce34f0a50a3a req-4c7163a7-9c24-4c24-848c-2cc0026b0af4 service nova] Creating event network-vif-unplugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:12:44.784647 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8914fa13-2047-4569-b3d6-ce34f0a50a3a req-4c7163a7-9c24-4c24-848c-2cc0026b0af4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084475 Jun 04 21:12:44.786828 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2031/4167] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:44.905471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:44.923287 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bf75d05e-5334-4ef9-a38c-050d46ce769c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.648758 Jun 04 21:12:44.926698 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2137/4168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:44 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:45.234509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:45.235708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:45.252604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:45.253991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:45.255641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:45.256354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:45.462960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:45.464132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:45.476871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:45.480888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:45.487578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:45.490635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:45.911138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:45.948743 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-45d70d1d-c892-47df-8177-5688e5493c95 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.719966 Jun 04 21:12:45.974686 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2032/4169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:45 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:45.989874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:45.990558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:46.013374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:46.013826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:46.014614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:46.015049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:46.461841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:46.485305 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6b008243-b425-4860-9135-d2c042525964 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 1.031454 Jun 04 21:12:46.486844 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2138/4170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:45 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:46.749633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:46.766605 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0bafe567-2105-4e3f-9611-367609a2b05b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.789206 Jun 04 21:12:46.786272 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2033/4171] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:45 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:46.969396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:46.973784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:46.993572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:46.995718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:46.997235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:46.998903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:47.305149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:47.314414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2948baf-ebea-4fe0-bdb9-a8d36e0f7a8c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.351716 Jun 04 21:12:47.318435 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2139/4172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:46 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:47.505512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:47.507802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:47.516772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:47.517286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:47.518108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:47.518544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:47.788548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:47.789286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:47.803111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:47.803726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:47.804810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:47.805064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:47.805484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:47.826086 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e87a0b2-f489-48f5-b203-9b8a6fcc34b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.325579 Jun 04 21:12:47.831243 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2034/4173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:47 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:47.941814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:47.980805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:47.989596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:47.998089 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a03b5484-c2c7-4c75-802c-66465f709bc6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.214079 Jun 04 21:12:48.003172 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2140/4174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:47 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:48.245695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-af2d01c7-103a-4559-809a-bf19a96c88a4 req-902cead5-26e5-4855-99ac-219a1c970dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-plugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:48.272301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:48.278294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-af2d01c7-103a-4559-809a-bf19a96c88a4 req-902cead5-26e5-4855-99ac-219a1c970dd0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:48.278929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-af2d01c7-103a-4559-809a-bf19a96c88a4 req-902cead5-26e5-4855-99ac-219a1c970dd0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:48.320613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-af2d01c7-103a-4559-809a-bf19a96c88a4 req-902cead5-26e5-4855-99ac-219a1c970dd0 service nova] Creating event network-vif-plugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:12:48.329567 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-af2d01c7-103a-4559-809a-bf19a96c88a4 req-902cead5-26e5-4855-99ac-219a1c970dd0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094674 Jun 04 21:12:48.336600 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2035/4175] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:48.363544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:48.363544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:48.415277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:48.416097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:48.424468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:48.425228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:48.811059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:48.827754 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fb549f7c-f6f0-4dd3-be2b-7b73a933ff2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.490334 Jun 04 21:12:48.831828 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2141/4176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:48 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:48.847236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:48.848590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:48.862394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:48.864095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:48.866760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:48.867458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:49.024353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:49.026593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:49.048045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:49.049371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:49.054742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:49.057170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:49.687391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:49.689822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:49.699684 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-51a516de-400b-45e5-a16c-89ba4816a88c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.857763 Jun 04 21:12:49.700381 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2036/4177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:48 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:49.849334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:49.850784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:49.866982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:49.877247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:49.881664 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-58fb2878-f6f1-4dc9-8ef7-55e79607c0ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.864643 Jun 04 21:12:49.884041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:49.887547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:49.889450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:49.889907 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2142/4178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:49 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:50.276376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:50.292727 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe98364d-3df2-441e-b6f0-05ff26c7fcc4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.451340 Jun 04 21:12:50.293339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2037/4179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:49 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:50.717313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:50.718253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:50.735269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:50.736040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:50.737002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:50.737589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:50.912185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:50.914134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:50.932675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:50.936269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:50.940135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:50.941861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:51.362040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:51.374267 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d200833-1d4e-419f-98f6-9c94e7e78a81 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.470540 Jun 04 21:12:51.375451 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2038/4180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:50 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:51.388923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:51.390253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:51.405243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:51.408058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:51.409146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:51.409798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:51.518929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:51.563072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb1e3816-acd7-461e-a683-c708a4ca5e95 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.848869 Jun 04 21:12:51.569255 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2143/4181] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:50 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:51.977617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:51.997314 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-700488d6-d5e9-465f-9934-13c3ca2dc658 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.618937 Jun 04 21:12:51.998578 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2039/4182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:51 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:52.392735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:52.393677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:52.413602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:52.414296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:52.415918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:52.417993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:52.589075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:52.594026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:52.621070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:52.624333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:52.627547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:52.629583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:53.513314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:53.530998 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c33b8c23-b233-4d86-9e8c-1699ab24e7e5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.948604 Jun 04 21:12:53.532095 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2040/4183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:52 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:53.539804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:53.540962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:53.549154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:53.549923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:53.550411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:53.551346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:53.551932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:53.559529 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21bae248-20bd-4d53-9856-51c3772ea636 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 1.171801 Jun 04 21:12:53.564640 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2144/4184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:52 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:53.931826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:53.956877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-29ec514d-3f79-4d9e-bf47-d251e8f890dc tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.421160 Jun 04 21:12:53.960863 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2041/4185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:53 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:54.309681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d3d48022-325e-4eb8-aaad-ea84a2782625 req-64314057-6229-4e0a-aeea-7421dd56d77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca7fd07-04ec-4514-8c50-277456484f5a", "name": "network-vif-plugged", "status": "completed", "tag": "2a9a656c-1d89-4b16-a891-49c53a0e04f6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:54.333980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d3d48022-325e-4eb8-aaad-ea84a2782625 req-64314057-6229-4e0a-aeea-7421dd56d77a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:54.334457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d3d48022-325e-4eb8-aaad-ea84a2782625 req-64314057-6229-4e0a-aeea-7421dd56d77a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:54.378516 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d3d48022-325e-4eb8-aaad-ea84a2782625 req-64314057-6229-4e0a-aeea-7421dd56d77a service nova] Creating event network-vif-plugged:2a9a656c-1d89-4b16-a891-49c53a0e04f6 for instance eca7fd07-04ec-4514-8c50-277456484f5a on nch1-master-1 Jun 04 21:12:54.385700 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d3d48022-325e-4eb8-aaad-ea84a2782625 req-64314057-6229-4e0a-aeea-7421dd56d77a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080756 Jun 04 21:12:54.387253 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2145/4186] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:54.550992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:54.551819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:54.566046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:54.566656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:54.569958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:54.570626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:54.590538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:54.592240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:54.617715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:54.620292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:54.623633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:54.624949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:55.024099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:55.033616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e90e6d9-faf8-4b31-8881-1b7275ed6789 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.448709 Jun 04 21:12:55.038942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:55.048634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2146/4187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:54 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:55.054032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:55.054657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:55.060092 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-546ef1b4-14d6-49dd-a7ef-eaa1c35fb900 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.512770 Jun 04 21:12:55.060888 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2042/4188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:54 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:55.078504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:55.079191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:55.080409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:55.081691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:55.376192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:55.388950 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8934059a-083c-44d9-9bcf-b5d352d0e63a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1309 microversion: 2.1 time: 0.338725 Jun 04 21:12:55.390204 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2147/4189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:55 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:56.066110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:56.066788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:56.076843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:56.077461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:56.088664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:56.090084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:56.091483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:56.092068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:56.093238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:56.093935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:56.096324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:56.098244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:56.102252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:12:56.844464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:56.862458 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a21a26b-251c-4968-9010-f534c4f544bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.800058 Jun 04 21:12:56.865024 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2043/4190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:56 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:56.878283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:56.880214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:56.897273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:56.899147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:56.902892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:56.903352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.000498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:57.017774 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e9536136-3eda-4103-9f9c-364897d321c5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.944853 Jun 04 21:12:57.024808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2148/4191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:56 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:57.038956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2642f285-f891-4632-a746-f693462655ad req-985d3b35-599e-4b40-b25b-389d09db9597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9575ac6-1822-4e7f-9f19-34f7c77e6023", "name": "network-vif-plugged", "status": "completed", "tag": "82a3e3fa-8824-4554-923a-924b58203734"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:12:57.079390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2642f285-f891-4632-a746-f693462655ad req-985d3b35-599e-4b40-b25b-389d09db9597 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.081370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2642f285-f891-4632-a746-f693462655ad req-985d3b35-599e-4b40-b25b-389d09db9597 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.125808 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2642f285-f891-4632-a746-f693462655ad req-985d3b35-599e-4b40-b25b-389d09db9597 service nova] Creating event network-vif-plugged:82a3e3fa-8824-4554-923a-924b58203734 for instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 on nch2-master-1 Jun 04 21:12:57.146250 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2642f285-f891-4632-a746-f693462655ad req-985d3b35-599e-4b40-b25b-389d09db9597 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119605 Jun 04 21:12:57.156356 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2149/4192] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:12:57.322508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:57.332480 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1ee3624c-ab12-493d-9e7e-d3770e8464e5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1490 microversion: 2.1 time: 0.466001 Jun 04 21:12:57.348633 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2044/4193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:56 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1490 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:57.358653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:57.359371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:57.387160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.387679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.396991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.397474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.671963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:57.680006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a09cf158-5cc4-4730-8fb2-a483d8ba8ab1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1491 microversion: 2.1 time: 0.326246 Jun 04 21:12:57.684850 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2150/4194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:57 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1491 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:57.700312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:57.701039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:57.714707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.717462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.718520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.721171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.882409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:57.883300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:57.902776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.903248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:57.908226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:57.919462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:58.032495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:58.058632 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5e734db-1244-4550-97cd-38fb1f559511 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1490 microversion: 2.1 time: 0.364208 Jun 04 21:12:58.061418 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2045/4195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:57 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1490 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:58.077712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:58.079899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:58.096355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:58.098657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:58.100944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:58.103729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:58.422412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:58.437719 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3b90b9e3-cedc-446e-b4ad-c90039668530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.560357 Jun 04 21:12:58.443918 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2151/4196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:57 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:58.464461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:58.465888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:58.475918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:58.482360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:58.482840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:58.484286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:58.485294 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a7110e8-6f5a-42c2-aa10-4856bcdbc0b6 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1314 microversion: 2.1 time: 0.422027 Jun 04 21:12:58.486020 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2046/4197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:58 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:12:58.486525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:58.530251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:12:58.782079 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-12767b73-ed9c-459b-91c7-e3c0e07a745f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 204 len: 0 microversion: 2.1 time: 0.333333 Jun 04 21:12:58.788216 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2152/4198] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:12:58 2022] DELETE /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:12:58.792542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:58.793176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:58.831871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:58.832394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:58.833496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:58.833946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.348570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:59.357186 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-33bdb6ed-c2cc-4abd-99f9-0924955d33ce tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1496 microversion: 2.1 time: 0.569360 Jun 04 21:12:59.378198 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2047/4199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:58 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1496 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:59.461471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:59.464102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:59.478028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:59.485528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.499758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:59.500565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.503494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:59.504330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:59.514283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:59.516640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.517627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:59.534565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.879018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:59.887818 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-11404327-8f03-4e56-ba7f-3ba9875ec7df tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1501 microversion: 2.1 time: 0.389031 Jun 04 21:12:59.900147 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2048/4200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:59 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1501 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:12:59.908450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:12:59.909391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:12:59.917892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:59.918536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.919719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:12:59.920441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:12:59.969051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:12:59.977920 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be8baa37-895a-47cc-9131-d26629f2c33a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.521032 Jun 04 21:12:59.985790 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2153/4201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:59 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:00.301788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:00.316275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d2e6c248-a81a-4d59-a5f3-0673b82ffb69 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1501 microversion: 2.1 time: 0.412616 Jun 04 21:13:00.339283 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2049/4202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:12:59 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1501 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:00.360320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:00.360881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:00.371339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:00.374609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:00.376401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:00.377677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:00.388955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:00.389754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:00.400416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:00.400875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:00.402303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:00.402898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:00.450673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lazy-loading 'flavor' on Instance uuid d9575ac6-1822-4e7f-9f19-34f7c77e6023 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:13:00.622989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4aae1602-ae7c-4be5-9fa4-96596aaf0d68 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action" status: 202 len: 0 microversion: 2.1 time: 0.270095 Jun 04 21:13:00.626063 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2154/4203] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:00 2022] POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:00.643671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:00.648625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:00.678986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:00.680942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:00.687975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:00.688875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:00.928408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:00.937475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f21ccb8f-796b-4448-b8c8-aa948a613b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1496 microversion: 2.1 time: 0.554397 Jun 04 21:13:00.940000 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2050/4204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:00 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1496 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:01.002189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:01.003412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:01.007850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=76 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:01.016205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:01.018560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:01.020517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:01.021988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:01.601949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:01.613484 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4a8a6bd1-d18f-4f7d-bfb6-0e142f099613 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1509 microversion: 2.1 time: 0.974299 Jun 04 21:13:01.627420 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2155/4205] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:00 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1509 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:01.653737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:01.667982 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3b098e3-1066-47b3-a8ec-c4906ea09113 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.669528 Jun 04 21:13:01.668583 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2051/4206] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:00 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:01.957884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:01.959876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:01.975760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:01.977000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:01.979692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:01.983605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:02.207284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:02.222559 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-74f74efd-df3f-4d7c-a09d-c43f794995ed tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 200 len: 1454 microversion: 2.1 time: 0.269232 Jun 04 21:13:02.223988 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2156/4207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:01 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 1454 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:02.273198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4e55b3e7-250e-41ba-983a-fa3fc5721e2a req-ffae4333-deac-4da8-901a-d119380ec6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca7fd07-04ec-4514-8c50-277456484f5a", "name": "network-vif-deleted", "tag": "2a9a656c-1d89-4b16-a891-49c53a0e04f6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:02.301972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e55b3e7-250e-41ba-983a-fa3fc5721e2a req-ffae4333-deac-4da8-901a-d119380ec6a7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:02.302709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e55b3e7-250e-41ba-983a-fa3fc5721e2a req-ffae4333-deac-4da8-901a-d119380ec6a7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:02.337350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4e55b3e7-250e-41ba-983a-fa3fc5721e2a req-ffae4333-deac-4da8-901a-d119380ec6a7 service nova] Creating event network-vif-deleted:2a9a656c-1d89-4b16-a891-49c53a0e04f6 for instance eca7fd07-04ec-4514-8c50-277456484f5a on nch1-master-1 Jun 04 21:13:02.344692 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4e55b3e7-250e-41ba-983a-fa3fc5721e2a req-ffae4333-deac-4da8-901a-d119380ec6a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076960 Jun 04 21:13:02.346912 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2052/4208] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:02.635194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:02.636946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:02.642250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:02.661844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:02.662613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:02.666799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:02.668445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:02.687345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:02.688181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:02.708023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:02.708535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:02.717329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:02.721183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.284765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:03.301475 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ecc45166-0c26-4520-b233-906f2acce2e2 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1492 microversion: 2.1 time: 0.664776 Jun 04 21:13:03.302744 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2157/4209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:02 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1492 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:03.324876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:03.329249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:03.357155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.366124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.369110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.382636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.383856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:03.398540 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ea877e4-c17a-4881-957d-37cf61afa6b9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.716882 Jun 04 21:13:03.412767 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2053/4210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:02 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:03.423139 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:13:03.427087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:03.431037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a HTTP/1.1 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'eca7fd07-04ec-4514-8c50-277456484f5a'} Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:13:03.435865 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:13:03.440162 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-768ea426-9ffc-4435-8da4-c5d92abfbc80 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 404 len: 111 microversion: 2.1 time: 0.133073 Jun 04 21:13:03.449801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.450533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.450726 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2158/4211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:03 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:13:03.452700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.455544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.464170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:03.464379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:03.466857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:03.489049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.498117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.499175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.499843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.580728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:13:03.622263 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f79874cc-7d4f-4643-bdb9-c2df1b5b3b49 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action" status: 202 len: 0 microversion: 2.1 time: 0.206355 Jun 04 21:13:03.623844 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2054/4212] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:03 2022] POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:03.646659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:03.651902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:03.678872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.679441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.685181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.688471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.930031 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88370a0a-bc99-4161-973b-2693a7da244f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 204 len: 0 microversion: 2.1 time: 0.475022 Jun 04 21:13:03.935545 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2159/4213] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:13:03 2022] DELETE /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:13:03.943471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:03.944565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:03.956125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.956960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:03.958807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:03.959641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:04.078084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:04.094424 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-102dd971-cb86-4891-87a4-91f1a53d831a tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1498 microversion: 2.1 time: 0.460762 Jun 04 21:13:04.095030 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2055/4214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:03 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:04.417668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:04.419173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:04.435784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:04.441200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:04.443255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:04.445058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:04.461945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:04.473870 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04ed6dc8-43c2-49aa-b8a0-5feec662f36b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1497 microversion: 2.1 time: 0.535453 Jun 04 21:13:04.478231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2160/4215] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:03 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1497 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:04.794936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:04.809809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cea09773-0827-4499-aebb-5ced1f55070d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.395281 Jun 04 21:13:04.810435 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2056/4216] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:04 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:05.111972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:05.112667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:05.132556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:05.133487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:05.134538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:05.135160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:05.138639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:05.504850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:05.505359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:05.520869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:05.521464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:05.522368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:05.524367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:05.652463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:05.665423 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-771b4e54-d4d2-443e-b53e-0e94b37f8554 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1498 microversion: 2.1 time: 0.557131 Jun 04 21:13:05.665870 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2161/4217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:05 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1498 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:05.828999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:05.830220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:05.839678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:05.840434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:05.841404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:05.842054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:06.450334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:06.457715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:06.466480 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85ced5dc-fd51-4e38-a584-9efc0a7fa209 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.642779 Jun 04 21:13:06.469654 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7786100-2f21-46cc-b94d-56b3516b1616 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1497 microversion: 2.1 time: 0.969660 Jun 04 21:13:06.471560 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2162/4218] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:05 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:06.471707 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2057/4219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:05 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1497 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:06.687116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:06.687976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:06.695908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:06.697436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:06.698415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:06.698948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.258019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:07.278595 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fec695b3-bb4e-483a-ba32-302a4fd170de tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1498 microversion: 2.1 time: 0.599905 Jun 04 21:13:07.288935 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2163/4220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:06 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1498 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:07.330569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-6be5230f-1afe-4fdc-9a70-7099432055e7 req-57adccfb-c303-4bb7-8dc8-1b99d3dfa84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d96768-43c1-4c0b-b27c-8bfe28b393a5", "name": "network-vif-deleted", "tag": "2947f597-5de2-4407-a491-c67f7b4407a5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:07.348516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6be5230f-1afe-4fdc-9a70-7099432055e7 req-57adccfb-c303-4bb7-8dc8-1b99d3dfa84e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:07.349333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6be5230f-1afe-4fdc-9a70-7099432055e7 req-57adccfb-c303-4bb7-8dc8-1b99d3dfa84e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.388731 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-6be5230f-1afe-4fdc-9a70-7099432055e7 req-57adccfb-c303-4bb7-8dc8-1b99d3dfa84e service nova] Creating event network-vif-deleted:2947f597-5de2-4407-a491-c67f7b4407a5 for instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 on nch1-master-1 Jun 04 21:13:07.395948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-6be5230f-1afe-4fdc-9a70-7099432055e7 req-57adccfb-c303-4bb7-8dc8-1b99d3dfa84e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071219 Jun 04 21:13:07.397212 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2058/4221] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:13:07.489681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:07.490307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:07.493270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:07.495579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:07.516555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:07.517410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:07.517592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.518559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:07.520630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.531844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.534929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:07.538561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.652298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:07.653133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:07.653852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lazy-loading 'fault' on Instance uuid 18d96768-43c1-4c0b-b27c-8bfe28b393a5 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:13:07.738662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:07.762438 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2b63525a-c36d-429b-81fb-ab177984237e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 200 len: 1299 microversion: 2.1 time: 0.275533 Jun 04 21:13:07.763885 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2059/4222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:07 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:07.805781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:07.813451 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a1fa87bd-c706-494f-bfa9-fc1470f2f2d3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1684 microversion: 2.1 time: 0.331135 Jun 04 21:13:07.814517 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2164/4223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:07 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1684 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:08.299158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:08.299277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:08.332429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.333790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.335321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.336239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.610028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:08.619474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-acbdd53f-dfbb-4e5b-9dc3-6b5e79a144da tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1501 microversion: 2.1 time: 0.326963 Jun 04 21:13:08.623578 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2060/4224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:08 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:08.638652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:08.639920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:08.648623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.649427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.650378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.651054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.683571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lazy-loading 'flavor' on Instance uuid d9575ac6-1822-4e7f-9f19-34f7c77e6023 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:13:08.781500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:08.782657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:08.795705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.796511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.797542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.797986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.822999 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d3b0e67b-4752-4203-9b2c-b00aab881ce5 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action" status: 202 len: 0 microversion: 2.1 time: 0.184523 Jun 04 21:13:08.827007 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2165/4225] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:08 2022] POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:08.847205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:08.852528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:08.853156 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 HTTP/1.1 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '18d96768-43c1-4c0b-b27c-8bfe28b393a5'} Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:08.854886 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:08.859588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:13:08.864586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98806151-0430-4a52-a7d3-750ff32c4cbe tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 404 len: 111 microversion: 2.1 time: 0.087343 Jun 04 21:13:08.868249 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2061/4226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:08 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:13:08.869445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.870108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.872081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.873149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.886421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:08.887310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:08.899770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.902060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:08.909670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:08.911062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:09.263588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:09.300016 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-06a35c0d-7c23-4838-b9e8-9522c4312b73 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.468600 Jun 04 21:13:09.301630 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2166/4227] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:08 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:09.309478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-413873983", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:09.444007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:09.470032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:13:09.473541 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ccb16a0-fd3a-4d66-a45e-cde91fa69caf tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1509 microversion: 2.1 time: 0.606129 Jun 04 21:13:09.474741 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2062/4228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:08 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:10.239529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:13:10.241182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:13:10.241840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:13:10.242626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:13:10.243606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:13:10.260392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:10.260843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:10.261633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:10.262080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:10.286718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:13:10.292444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:13:10.306926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:13:10.309558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:13:10.405298 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13af0f17-1691-4478-ac07-d109efe8fb78 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.100125 Jun 04 21:13:10.408576 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2167/4229] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:13:10.416888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3dad6a90-33c3-4002-8152-8e957eb45653 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:10.417212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3dad6a90-33c3-4002-8152-8e957eb45653 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:10.496101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:10.496759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:10.517879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:10.520184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:10.521275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:10.523222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:10.685083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3dad6a90-33c3-4002-8152-8e957eb45653 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:10.692964 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3dad6a90-33c3-4002-8152-8e957eb45653 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1208 microversion: 2.1 time: 0.280619 Jun 04 21:13:10.695921 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2063/4230] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:10 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1208 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:10.711112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:10.711819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:10.720427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:10.720885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:10.722213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:10.723394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:10.985628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:11.004358 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6256fbf-a484-4510-80be-7a7d2f8b7e8e tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1492 microversion: 2.1 time: 0.512822 Jun 04 21:13:11.015892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2168/4231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:10 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1492 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:11.022872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:11.023239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:11.042042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:11.047014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:11.048675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:11.051134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:11.054812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:11.073616 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-768fc1c0-e964-4eb1-9b00-2af8963849a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.374676 Jun 04 21:13:11.076159 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2064/4232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:10 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:11.245809 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-909f7e21-4ab4-4355-b5cb-621c308c222c tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action" status: 202 len: 0 microversion: 2.1 time: 0.195897 Jun 04 21:13:11.246538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2169/4233] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:11 2022] POST /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:11.256388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:11.257686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:11.272811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:11.273888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:11.276372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:11.277047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:11.499632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:11.512396 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26139982-a72c-4e9d-ab2d-d8879d2c42ec tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1498 microversion: 2.1 time: 0.261272 Jun 04 21:13:11.524201 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2065/4234] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:11 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1498 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:11.717889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:11.724927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:11.742756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:11.743750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:11.744780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:11.745419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:11.916162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:11.926781 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b976686-297e-4633-9c09-b5476641acfa tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1260 microversion: 2.1 time: 0.218563 Jun 04 21:13:11.938257 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2170/4235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:11 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:12.366079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-faa7eced-7373-435a-bc8a-9d27f6c71b70 req-a69c6652-11e8-40e1-b4bb-a7c5487f0432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-unplugged", "status": "completed", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:12.388197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-faa7eced-7373-435a-bc8a-9d27f6c71b70 req-a69c6652-11e8-40e1-b4bb-a7c5487f0432 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:12.389060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-faa7eced-7373-435a-bc8a-9d27f6c71b70 req-a69c6652-11e8-40e1-b4bb-a7c5487f0432 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:12.424796 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-faa7eced-7373-435a-bc8a-9d27f6c71b70 req-a69c6652-11e8-40e1-b4bb-a7c5487f0432 service nova] Creating event network-vif-unplugged:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:13:12.440693 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-faa7eced-7373-435a-bc8a-9d27f6c71b70 req-a69c6652-11e8-40e1-b4bb-a7c5487f0432 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077865 Jun 04 21:13:12.443824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2066/4236] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:12.539083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:12.540541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:12.549012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:12.549627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:12.550546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:12.551394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:12.946830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:12.947568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:12.955772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:12.956220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:12.957305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:12.957748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:13.008751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:13.021376 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-52ff8900-5062-4ae9-aae9-2c66b84b3b63 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1498 microversion: 2.1 time: 0.494712 Jun 04 21:13:13.022138 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2171/4237] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:12 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1498 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:13.099376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:13.118312 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6c7eb586-21ca-46e9-b6d6-b596c2c0177b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1266 microversion: 2.1 time: 0.173874 Jun 04 21:13:13.119806 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2067/4238] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:12 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:13.254506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:13.255404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:13.262635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:13.263813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:13.264741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:13.265321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.027823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:14.043171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:14.044544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:14.064930 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a33370a-93a2-4cbd-9e2f-5c6246b7f546 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.816158 Jun 04 21:13:14.066698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.068052 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2172/4239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:13 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:14.069084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.070070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.070513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.085273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:14.085897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:14.097800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.098245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.099036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.099471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.467109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:14.478435 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cea9a54d-9337-4cb6-8277-63fb0e4bfa0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.398772 Jun 04 21:13:14.492130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2173/4240] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:14 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:14.502841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:14.508929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:14.516859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.517845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.519963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.521475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.670589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:14.683730 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8692f577-b6e2-4332-9fd8-e516ad1600b8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1501 microversion: 2.1 time: 0.646153 Jun 04 21:13:14.697380 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2068/4241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:14 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1501 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:14.708514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:14.709141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:14.736120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.736120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.744567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.745034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.821288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:14.844170 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87754d48-239b-4349-b888-c417cd1b1f0c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.350503 Jun 04 21:13:14.851623 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2174/4242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:14 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:14.867028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:14.872516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:14.880613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.881685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.882722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:14.883468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:14.935401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:13:14.953254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:15.119581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:15.142230 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f997bc04-d1b2-4668-95a5-a5c8643b328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.443576 Jun 04 21:13:15.142986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2069/4243] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:14 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:15.171819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:15.173561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:15.181645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.182433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.183544 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0fac984c-c8ef-421c-83ad-5d8091195943 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 204 len: 0 microversion: 2.1 time: 0.330013 Jun 04 21:13:15.184212 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2175/4244] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:13:14 2022] DELETE /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:13:15.191648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.192573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.194786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:15.199337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:15.217184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.217812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.219015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.219568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.359004 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecc390b0-1c66-4683-82ce-f1eae360b7f1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.198641 Jun 04 21:13:15.363688 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2070/4245] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:15 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:15.380526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:15.382068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:15.389866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.397644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.399809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.400448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.423332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:15.686184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:15.695837 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-36d3c1b9-965c-42b1-8c03-18d4df46c0a8 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1507 microversion: 2.1 time: 0.506520 Jun 04 21:13:15.698693 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2176/4246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:15 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:15.776134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:15.799459 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db545c61-1d94-475b-91f0-69bd563c0c7b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1673 microversion: 2.1 time: 0.420559 Jun 04 21:13:15.802295 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2071/4247] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:15 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1673 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:15.865400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:15.866476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:15.884692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.887885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:15.889099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:15.889556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:16.224045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:16.234020 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-602bf76b-efb3-459d-87ba-c34f2269a910 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.373803 Jun 04 21:13:16.243272 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2177/4248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:15 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:16.449120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4552ecd9-d2b2-4fcc-9864-aed181d1032a req-33854918-8c17-4635-8d23-f37ff70e9409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9ce254-01db-43b3-8a06-48c93fb4d947", "tag": "bc273f68-8a94-42d7-b8f0-0aebf80e6964"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:16.466454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4552ecd9-d2b2-4fcc-9864-aed181d1032a req-33854918-8c17-4635-8d23-f37ff70e9409 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:16.466914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4552ecd9-d2b2-4fcc-9864-aed181d1032a req-33854918-8c17-4635-8d23-f37ff70e9409 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:16.490310 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4552ecd9-d2b2-4fcc-9864-aed181d1032a req-33854918-8c17-4635-8d23-f37ff70e9409 service nova] Creating event network-changed:bc273f68-8a94-42d7-b8f0-0aebf80e6964 for instance de9ce254-01db-43b3-8a06-48c93fb4d947 on nch1-master-1 Jun 04 21:13:16.496931 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4552ecd9-d2b2-4fcc-9864-aed181d1032a req-33854918-8c17-4635-8d23-f37ff70e9409 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052791 Jun 04 21:13:16.497561 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2072/4249] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:16.720395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:16.720395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:16.725951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:16.726446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:16.727466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:16.728210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:16.819868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:16.820621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:16.833204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:16.835383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:16.840657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:16.841215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:17.165839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:17.179197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-03ee6160-daad-4a8d-98c7-ac17656c2117 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1507 microversion: 2.1 time: 0.465989 Jun 04 21:13:17.179921 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2178/4250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:16 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1507 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:17.251134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:17.253897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:17.272053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:17.273659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:17.275522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:17.276269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:17.346731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:17.358157 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd2b367f-d63d-48b3-8950-ba322b3fbace tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1673 microversion: 2.1 time: 0.544204 Jun 04 21:13:17.369999 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2073/4251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:16 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1673 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:17.640917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:17.652973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fb04b907-4037-40cc-a180-de691f64700f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.405660 Jun 04 21:13:17.654135 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2179/4252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:17 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:18.196204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:18.197035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:18.203980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.204438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.205222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.205671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.276405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7385bf9cbff4b30b6f75566ee78d92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fd1ca1698d14742981eb94fc11d64d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:18.287134 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-71448723-a58a-4070-8f92-2ad3148bf4e3 tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 200 len: 1299 microversion: 2.1 time: 0.094614 Jun 04 21:13:18.288435 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2074/4253] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:18 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:18.383465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:18.384128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:18.393846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.394689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.395473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.395959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.524937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bad8aa9f-7326-4063-84d9-d9bc6633cc41 req-36a6efa4-66ed-4f65-814e-d9aff465f7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9575ac6-1822-4e7f-9f19-34f7c77e6023", "name": "network-vif-deleted", "tag": "82a3e3fa-8824-4554-923a-924b58203734"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:18.539896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bad8aa9f-7326-4063-84d9-d9bc6633cc41 req-36a6efa4-66ed-4f65-814e-d9aff465f7b2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.540718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bad8aa9f-7326-4063-84d9-d9bc6633cc41 req-36a6efa4-66ed-4f65-814e-d9aff465f7b2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.552770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:18.570690 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a88bdba-aa4a-4ba5-9639-dfcb5a149fd1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.190026 Jun 04 21:13:18.583716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2180/4254] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:18 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:18.588093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bad8aa9f-7326-4063-84d9-d9bc6633cc41 req-36a6efa4-66ed-4f65-814e-d9aff465f7b2 service nova] Creating event network-vif-deleted:82a3e3fa-8824-4554-923a-924b58203734 for instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 on nch2-master-1 Jun 04 21:13:18.594145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:18.598062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:18.603287 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bad8aa9f-7326-4063-84d9-d9bc6633cc41 req-36a6efa4-66ed-4f65-814e-d9aff465f7b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085563 Jun 04 21:13:18.604760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2075/4255] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:18.615016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.615630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.616332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.616772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.672216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:18.673231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:18.681406 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e557bacf-c67e-4638-a67a-997b0cb9669b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 200 len: 322 microversion: 2.1 time: 0.095716 Jun 04 21:13:18.682297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2181/4256] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:18 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:18.695006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:18.695980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:18.701169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.704154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.705026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.705473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.708081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.708551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:18.709345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:18.710003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.035073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:19.045350 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5a1be76d-34c9-43e9-b1a1-01d35b1d7b37 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.356807 Jun 04 21:13:19.050049 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2182/4257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:18 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:19.068362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:19.069097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:19.076092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.076556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.077340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.080221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.143383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:19.162710 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-39106d53-abaf-4dd4-8f05-9edf42782f26 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.496090 Jun 04 21:13:19.163311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2076/4258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:18 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:19.307835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:19.309645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] [instance: d9575ac6-1822-4e7f-9f19-34f7c77e6023] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:19.322482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.323304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.324996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.325776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.325890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:19.337905 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ba07ba4-d2ae-46e5-a8fb-6a57dbf779e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.273965 Jun 04 21:13:19.342518 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2183/4259] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:19 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:19.353412 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] HTTP exception thrown: Instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 could not be found. Jun 04 21:13:19.354390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:19.355004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Request method failure captured: Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 HTTP/1.1 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8q6Gb75NqkMAeZnVo-uovCheYRsmE8cfSeAgkiTgPr4pUjCOacJoKTn1Oj1hW9O08XorHlRxl0122UJ7m-soyxOw2_POfewxkyOE0mdDjSlPJTgie2Vzy-jaMpDpXod5CWz81w3hkVj2va-i58602iF1HHMiJQPAyxR1JHY6JFwP5o Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4fd1ca1698d14742981eb94fc11d64d8 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestServerAdvancedOps-360047803 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4fd1ca1698d14742981eb94fc11d64d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4fd1ca1698d14742981eb94fc11d64d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4fd1ca1698d14742981eb94fc11d64d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4fd1ca1698d14742981eb94fc11d64d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestServerAdvancedOps-360047803 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4fd1ca1698d14742981eb94fc11d64d8 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestServerAdvancedOps-360047803 Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestServerAdvancedOps-360047803-project Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: b7385bf9cbff4b30b6f75566ee78d92a Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestServerAdvancedOps-360047803-project Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 could not be found. Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'd9575ac6-1822-4e7f-9f19-34f7c77e6023'} Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 could not be found. Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 could not be found. Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:19.355655 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 could not be found. Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] Returning 404 to user: Instance d9575ac6-1822-4e7f-9f19-34f7c77e6023 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:13:19.359478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb7b63b7-9e86-46b1-ab54-3ee5c43f5d9f tempest-TestServerAdvancedOps-360047803 tempest-TestServerAdvancedOps-360047803-project] 10.222.0.18 "GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023" status: 404 len: 111 microversion: 2.1 time: 0.055609 Jun 04 21:13:19.369067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.369449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.370410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.371066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.372744 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2077/4260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:19 2022] GET /compute/v2.1/servers/d9575ac6-1822-4e7f-9f19-34f7c77e6023 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:13:19.633972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:19.642860 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-520e674a-7c72-469c-984c-e4514ae5328d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.292263 Jun 04 21:13:19.644638 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2184/4261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:19 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:19.662139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:19.662768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:19.675442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.675894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.676765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:19.677443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:19.944080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:19.953914 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95e9537a-41f6-4103-86e7-044effa9ee2a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.296773 Jun 04 21:13:19.967710 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2078/4262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:19 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:20.078865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2024740923", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "022d1b94-119f-49b9-8193-cbad0fb4c7b0"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:20.171198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] validate_networks() for [('022d1b94-119f-49b9-8193-cbad0fb4c7b0', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:13:20.180707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:20.181483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:20.193147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:20.193609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:20.195746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:20.196433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:20.277659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:20.300099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:20.554444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:20.567154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c24cb38-6902-4c97-92b5-47f5a85a29b3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.391779 Jun 04 21:13:20.570311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2079/4263] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:20 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:20.889613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:13:20.890215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:13:20.890506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:13:20.890908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:13:20.891317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:13:20.903969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:20.905585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:20.906351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:20.907688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:20.983107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:13:20.997770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for user 09431bbdbc394df8b368770d3e24a306 and project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:13:21.021294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:13:21.024844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:13:21.131194 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05ba914f-b6e3-40ef-bb30-5d964d75527c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060343 Jun 04 21:13:21.137073 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2185/4264] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:13:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:13:21.143149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a8cba9ec-b1cb-4546-ad13-081fcacc071b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:21.143807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a8cba9ec-b1cb-4546-ad13-081fcacc071b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:21.150291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:21.252305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a8cba9ec-b1cb-4546-ad13-081fcacc071b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:21.265182 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a8cba9ec-b1cb-4546-ad13-081fcacc071b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1215 microversion: 2.1 time: 0.126149 Jun 04 21:13:21.266605 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2080/4265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:21 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:21.591890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:21.592801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:21.609771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:21.610467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:21.611465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:21.613308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:21.839205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:21.859613 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a74d8b9-713c-4650-859f-19c9e42c1928 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.271764 Jun 04 21:13:21.871798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2186/4266] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:21 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:22.283639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:22.284432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:22.302343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:22.302902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:22.303912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:22.306241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:22.470261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:22.480588 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d825dea-2d3b-4cc3-9a4e-12e8a2a89341 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1267 microversion: 2.1 time: 0.201174 Jun 04 21:13:22.487737 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2081/4267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:22 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:22.879274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:22.881083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:22.886143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:22.903256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:22.903840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:22.907381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:22.907932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:23.415255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:23.439174 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-daf2d754-3430-4681-979b-9518c5be12f5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.565587 Jun 04 21:13:23.445888 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2187/4268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:22 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:23.500180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:23.500970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:23.510000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:23.511328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:23.512494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:23.513377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:23.631897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:23.646815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e4334c85-5e8f-44f4-95fd-ec1be99cad42 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1273 microversion: 2.1 time: 0.150751 Jun 04 21:13:23.659113 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2082/4269] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:23 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:24.470788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:24.474972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:24.485855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:24.487311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:24.489946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:24.490396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:24.613438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-bcc8c11d-a14d-41f8-9d84-fd02dbe05261 req-351ebc4f-2e56-419c-b419-36126427c311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9ce254-01db-43b3-8a06-48c93fb4d947", "name": "network-vif-plugged", "status": "completed", "tag": "bc273f68-8a94-42d7-b8f0-0aebf80e6964"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:24.622864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bcc8c11d-a14d-41f8-9d84-fd02dbe05261 req-351ebc4f-2e56-419c-b419-36126427c311 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:24.623424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-bcc8c11d-a14d-41f8-9d84-fd02dbe05261 req-351ebc4f-2e56-419c-b419-36126427c311 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:24.646962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-bcc8c11d-a14d-41f8-9d84-fd02dbe05261 req-351ebc4f-2e56-419c-b419-36126427c311 service nova] Creating event network-vif-plugged:bc273f68-8a94-42d7-b8f0-0aebf80e6964 for instance de9ce254-01db-43b3-8a06-48c93fb4d947 on nch1-master-1 Jun 04 21:13:24.653691 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-bcc8c11d-a14d-41f8-9d84-fd02dbe05261 req-351ebc4f-2e56-419c-b419-36126427c311 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297761 Jun 04 21:13:24.654621 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2188/4270] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:24.668392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:24.668814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:24.684660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:24.686714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:24.688341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:24.688795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:25.072195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:25.088135 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-009fe8e9-77c5-49af-a8fd-263c9b1b64d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.627778 Jun 04 21:13:25.089596 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2083/4271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:24 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:25.278854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:25.314871 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e52805a-0983-4b0c-aebb-4be686b591d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1315 microversion: 2.1 time: 0.652019 Jun 04 21:13:25.333367 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2189/4272] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:24 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:26.105875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:26.107464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:26.118753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:26.119932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:26.120941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:26.121725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:26.339470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:26.340200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:26.367458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:26.367968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:26.368800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:26.369238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:26.898641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:26.917132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac9a3c86-6c34-4a8d-b490-71a681b1cbf2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1308 microversion: 2.1 time: 0.814182 Jun 04 21:13:26.930005 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2084/4273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:26 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1308 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:26.942862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-10c0b8f2-8df7-40f4-a622-ae2fda52ae75 req-3af49dd5-01cf-43e4-a587-8ccc69214e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb609fdf-9184-45fb-a65e-d1c466a13b40", "tag": "8a058226-3db6-4aae-b937-e66a694a910d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:26.965985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-10c0b8f2-8df7-40f4-a622-ae2fda52ae75 req-3af49dd5-01cf-43e4-a587-8ccc69214e47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:26.966444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-10c0b8f2-8df7-40f4-a622-ae2fda52ae75 req-3af49dd5-01cf-43e4-a587-8ccc69214e47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:26.993292 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-10c0b8f2-8df7-40f4-a622-ae2fda52ae75 req-3af49dd5-01cf-43e4-a587-8ccc69214e47 service nova] Creating event network-changed:8a058226-3db6-4aae-b937-e66a694a910d for instance bb609fdf-9184-45fb-a65e-d1c466a13b40 on nch2-master-1 Jun 04 21:13:27.003689 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-10c0b8f2-8df7-40f4-a622-ae2fda52ae75 req-3af49dd5-01cf-43e4-a587-8ccc69214e47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070346 Jun 04 21:13:27.006993 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2085/4274] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:27.146819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:27.167261 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c66a031c-6cdb-4123-a786-0e4ee3e9a203 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1315 microversion: 2.1 time: 0.832911 Jun 04 21:13:27.180032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2190/4275] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:26 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:27.939225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:27.940092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:27.951408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:27.951929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:27.952724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:27.953169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:28.187321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:28.188032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:28.198814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:28.199416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:28.200297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:28.201000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:28.372308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:28.382981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a548295-c8d1-4184-9ce7-5cd05486307e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1490 microversion: 2.1 time: 0.450613 Jun 04 21:13:28.383787 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2086/4276] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:27 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1490 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:28.400621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:28.401923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:28.408787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:28.409314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:28.411039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:28.411487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:28.595016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:28.610662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-493df638-43cb-481f-aa1c-02a9187deef2 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "PUT /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1085 microversion: 2.1 time: 0.213777 Jun 04 21:13:28.612388 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2087/4277] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:13:28 2022] PUT /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1085 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:28.625729 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9d6dda22-af4c-44b4-b672-d3a509ed8bea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1315 microversion: 2.1 time: 0.442381 Jun 04 21:13:28.633376 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2191/4278] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:28 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:28.648702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:28.649855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:28.671754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:28.673574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:28.674951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:28.676698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:29.130935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:29.154336 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8d36973-d260-4d84-ace5-e6fc21706d35 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1511 microversion: 2.1 time: 0.521243 Jun 04 21:13:29.155500 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2088/4279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:28 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:29.174588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:29.175309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:29.183372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:29.183942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:29.184742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:29.185188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:29.217090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:29.655903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:29.656595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:29.675826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:29.676286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:29.677107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:29.677551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:29.958459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:29.970525 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e08ea78-8524-4997-9a5b-c7b58e0f08d4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1511 microversion: 2.1 time: 0.801194 Jun 04 21:13:29.984099 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2192/4280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:29 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1511 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:29.991965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:29.992895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:29.999657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:30.000427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:30.001386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:30.001976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:30.031830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:13:30.100302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:30.114814 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-612b4dfc-111e-4eab-a2af-c1345426e642 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1315 microversion: 2.1 time: 0.468663 Jun 04 21:13:30.117971 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2089/4281] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:29 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:30.168669 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b518fcdb-120e-4a9f-a185-bdbf1e5c6975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 204 len: 0 microversion: 2.1 time: 0.182544 Jun 04 21:13:30.170696 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2193/4282] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:13:29 2022] DELETE /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:13:30.181599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:30.183242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:30.192309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:30.194102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:30.195449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:30.196564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:31.131841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:31.131841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:31.136428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:31.137463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:31.165413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:31.166268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:31.167631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:31.168233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:31.259777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:31.376725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:31.412295 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a2d28aea-3a8b-4095-9b92-4abc2d890ab8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1517 microversion: 2.1 time: 1.232831 Jun 04 21:13:31.415374 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2090/4283] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:30 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1517 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:31.766284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:31.778830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e5e09ea7-98c4-459e-9fba-94257d662670 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1315 microversion: 2.1 time: 0.648925 Jun 04 21:13:31.792122 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2194/4284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:31 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:32.281929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7ff61d56-1d14-4cfa-804f-6d17c8ea8e36 req-1978c824-cfdd-4f48-bff5-fbfa2827d015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb609fdf-9184-45fb-a65e-d1c466a13b40", "name": "network-vif-plugged", "status": "completed", "tag": "8a058226-3db6-4aae-b937-e66a694a910d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:32.296626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=86 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:32.303748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7ff61d56-1d14-4cfa-804f-6d17c8ea8e36 req-1978c824-cfdd-4f48-bff5-fbfa2827d015 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:32.304257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7ff61d56-1d14-4cfa-804f-6d17c8ea8e36 req-1978c824-cfdd-4f48-bff5-fbfa2827d015 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:32.310397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:32.329329 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7ff61d56-1d14-4cfa-804f-6d17c8ea8e36 req-1978c824-cfdd-4f48-bff5-fbfa2827d015 service nova] Creating event network-vif-plugged:8a058226-3db6-4aae-b937-e66a694a910d for instance bb609fdf-9184-45fb-a65e-d1c466a13b40 on nch2-master-1 Jun 04 21:13:32.338974 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7ff61d56-1d14-4cfa-804f-6d17c8ea8e36 req-1978c824-cfdd-4f48-bff5-fbfa2827d015 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061106 Jun 04 21:13:32.369751 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2091/4285] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:32.436100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:32.442259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:32.454290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:32.455480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:32.459575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:32.460275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:32.805249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:32.806835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:32.823408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:32.825443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:32.826554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:32.827189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:33.144735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:33.159029 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b9e3dae4-42ac-47d8-88ce-44b469a29e9e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1517 microversion: 2.1 time: 0.730169 Jun 04 21:13:33.160278 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2195/4286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:32 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1517 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:33.630172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:33.650333 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a6382fec-c873-4e21-a42f-7da52f4bc1a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1315 microversion: 2.1 time: 0.857362 Jun 04 21:13:33.653229 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2092/4287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:32 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:33.937606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0fe6ad4f-bb03-453c-b289-e590509dd563 req-0804a8f5-4952-4b06-bd4c-2455303afae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9ce254-01db-43b3-8a06-48c93fb4d947", "name": "network-vif-deleted", "tag": "bc273f68-8a94-42d7-b8f0-0aebf80e6964"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:33.962994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0fe6ad4f-bb03-453c-b289-e590509dd563 req-0804a8f5-4952-4b06-bd4c-2455303afae9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:33.964554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0fe6ad4f-bb03-453c-b289-e590509dd563 req-0804a8f5-4952-4b06-bd4c-2455303afae9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:34.001088 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0fe6ad4f-bb03-453c-b289-e590509dd563 req-0804a8f5-4952-4b06-bd4c-2455303afae9 service nova] Creating event network-vif-deleted:bc273f68-8a94-42d7-b8f0-0aebf80e6964 for instance de9ce254-01db-43b3-8a06-48c93fb4d947 on nch1-master-1 Jun 04 21:13:34.007954 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0fe6ad4f-bb03-453c-b289-e590509dd563 req-0804a8f5-4952-4b06-bd4c-2455303afae9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468041 Jun 04 21:13:34.009610 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2196/4288] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:34.182025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:34.183410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:34.196606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:34.198412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:34.200450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:34.201711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:34.281971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:34.282593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:34.283075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lazy-loading 'fault' on Instance uuid de9ce254-01db-43b3-8a06-48c93fb4d947 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:13:34.361726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:34.380936 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ce00784-9e3d-4bdb-9730-fd017161afac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 200 len: 1319 microversion: 2.1 time: 0.199260 Jun 04 21:13:34.388501 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2093/4289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:34 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:34.671938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:34.672924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:34.684878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:34.689379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:34.690239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:34.690782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:35.001128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:35.011779 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f790f1c3-e5a6-49ee-8112-5abc6a782fe8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1503 microversion: 2.1 time: 0.345440 Jun 04 21:13:35.015974 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2197/4290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:34 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:35.037803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-54bf4d5a-46f4-46a7-bba6-a46cec806b34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:35.045889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54bf4d5a-46f4-46a7-bba6-a46cec806b34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:35.046550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54bf4d5a-46f4-46a7-bba6-a46cec806b34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:35.072083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-54bf4d5a-46f4-46a7-bba6-a46cec806b34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Going to try to stop instance {{(pid=137229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:13:35.136816 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-54bf4d5a-46f4-46a7-bba6-a46cec806b34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40/action" status: 202 len: 0 microversion: 2.1 time: 0.102893 Jun 04 21:13:35.141642 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2094/4291] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:35 2022] POST /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:35.152449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:35.153346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:35.166621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:35.168386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:35.170099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:35.172856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:35.401713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:35.402719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:35.410005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:35.410762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:35.411749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:35.412337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:35.428463 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 HTTP/1.1 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'de9ce254-01db-43b3-8a06-48c93fb4d947'} Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:35.430430 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:13:35.435720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:13:35.435720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:13:35.435720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:13:35.435720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:13:35.435720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:13:35.435720 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:13:35.437358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:13:35.438423 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3fdf8920-a69b-4efd-bb8c-56f2bebb6cbd tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 404 len: 111 microversion: 2.1 time: 0.042018 Jun 04 21:13:35.443620 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2095/4292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:35 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:13:35.553480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-275250745", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "e2e6ffe6-1017-422f-8011-eb2f514a17a8"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:35.577813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:35.593522 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78470197-3e6e-4559-903a-320f02f35c1a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.444792 Jun 04 21:13:35.603991 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2198/4293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:35 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:35.627621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] validate_networks() for [('e2e6ffe6-1017-422f-8011-eb2f514a17a8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:13:36.289852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-860203357", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "b586c282-5bd6-41b0-abfb-43a702795e5a"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:36.400553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] validate_networks() for [('b586c282-5bd6-41b0-abfb-43a702795e5a', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:13:36.706256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:13:36.706773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:13:36.707157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:13:36.707594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:13:36.708004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:13:36.721283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:36.725719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:36.726762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:36.727374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:36.800565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:13:36.812357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Getting quotas for user c3a7b7c72a80455381b2b9b4ee14eed3 and project e173e952f35b465898956477d2facf0e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:13:36.845188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:13:36.852460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:13:36.928011 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-efb7b78c-ee36-42b9-8c37-d8f379276e00 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378551 Jun 04 21:13:36.929553 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2096/4294] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:13:36.935495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:36.936919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:36.946127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:36.947014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:36.948092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:36.948890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:37.349150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:13:37.349771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:13:37.350036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:13:37.350670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:13:37.351087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:13:37.365917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:37.372570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:37.375531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:37.379257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:37.379441 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81bb55d2-d030-441c-a601-6243923a7194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.448212 Jun 04 21:13:37.380323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:37.381046 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2097/4295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:36 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:37.395125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92395422-dc9e-4d1f-b042-b143b473c92d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:37.395882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92395422-dc9e-4d1f-b042-b143b473c92d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:37.436973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Getting quotas for project 4f970c3882e940f98bab811c9fdd078a. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:13:37.450233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Getting quotas for user 4eccde33e4f44565b9e7ed25ba378948 and project 4f970c3882e940f98bab811c9fdd078a. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:13:37.476239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:13:37.478822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:13:37.501332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-92395422-dc9e-4d1f-b042-b143b473c92d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:37.515640 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92395422-dc9e-4d1f-b042-b143b473c92d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1208 microversion: 2.1 time: 0.128957 Jun 04 21:13:37.516895 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2098/4296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:37 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1208 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:37.536675 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ab367f79-634c-4828-a46d-c4f53efbf9c4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507072 Jun 04 21:13:37.537981 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2199/4297] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:13:37.548031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d5dbed8e-43b5-4833-a808-fda98fc76253 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:37.548893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d5dbed8e-43b5-4833-a808-fda98fc76253 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:37.634494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d5dbed8e-43b5-4833-a808-fda98fc76253 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:37.649331 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d5dbed8e-43b5-4833-a808-fda98fc76253 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1213 microversion: 2.1 time: 0.104210 Jun 04 21:13:37.653659 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2099/4298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:37 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:38.400115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:38.402533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:38.423472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:38.424136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:38.425673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:38.426265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:38.540589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:38.541656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:38.559151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:38.559645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:38.560449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:38.560979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:38.750835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:38.765730 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ee87bee0-ff4b-45cf-bf7c-ad14d41d448c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1260 microversion: 2.1 time: 0.229187 Jun 04 21:13:38.766971 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2100/4299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:38 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:38.772434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:38.784987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:38.804616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:38.805085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:38.805886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:38.806406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:38.901283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:38.910041 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-361f3474-9e2d-4658-bee9-e9794a9ec7f8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.515909 Jun 04 21:13:38.915764 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2200/4300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:38 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:39.161504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:39.183116 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1a000b5d-4300-4bb5-bf95-9bcc0ca0ce3b tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1209 microversion: 2.1 time: 0.414708 Jun 04 21:13:39.183615 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2101/4301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:38 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1209 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:39.784782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:39.786368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:39.799455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:39.802701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:39.805610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:39.809605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:39.926688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:39.927315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:39.945687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:39.946190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:39.946996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:39.963275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:40.074102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:40.087469 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d2422d8-cdbd-437f-abf4-6ccca8689b5e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1266 microversion: 2.1 time: 0.307391 Jun 04 21:13:40.097254 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2201/4302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:39 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:40.201169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:40.201733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:40.218218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:40.220844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:40.222205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:40.226018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:40.437186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:40.451024 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a5d47ec-1c95-4e11-8e9d-7ee52fa8fee0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1271 microversion: 2.1 time: 0.252978 Jun 04 21:13:40.452506 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2202/4303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:40 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:40.496127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:40.535981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5015b596-b49f-4ac0-9a42-dfc8f0cb49fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.613258 Jun 04 21:13:40.556786 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2102/4304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:39 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:41.108352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:41.108889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:41.124420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:41.125185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:41.125962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:41.126425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:41.468561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:41.469350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:41.472131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:41.481550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:41.482804 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d307aa7b-7b6c-4357-9131-f0f91ab266eb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.377904 Jun 04 21:13:41.483431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2203/4305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:41 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:41.495965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:41.496825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:41.497311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:41.559350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:41.560443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:41.571356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:41.573794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:41.576302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:41.578806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:41.697414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:41.710613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78e03e6b-956f-4927-9279-1018ae4e5a67 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1271 microversion: 2.1 time: 0.244634 Jun 04 21:13:41.711333 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2103/4306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:41 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:42.460436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:42.471021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99c24d1f-cd0a-4fe5-828f-f326d0297391 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.915755 Jun 04 21:13:42.487899 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2204/4307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:41 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:42.522848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:42.540805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:42.559587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.560332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:42.561326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.561944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:42.800133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Calling method '.version_select at 0x7f2d01874d30>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:42.801767 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:13:42.801767 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:13:42.803366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.803850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:42.839069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.839583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:42.886838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.887296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:42.901572 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e17c664-b569-44c9-8ff8-1290ac6f1005 tempest-PortsAdminExtendedAttrsTestJSON-629695533 tempest-PortsAdminExtendedAttrsTestJSON-629695533-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.590211 Jun 04 21:13:42.907279 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2104/4308] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:13:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:42.916535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:42.917426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:42.931207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.931981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:42.932922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:42.933571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:43.054720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:43.073973 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-430b9e69-f6cf-4208-824e-7394d09591f0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1271 microversion: 2.1 time: 0.161494 Jun 04 21:13:43.074581 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2105/4309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:42 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:43.116140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:43.129328 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae41b00c-d6b6-41fa-9c1e-4324907a5e4b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.632293 Jun 04 21:13:43.139811 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2205/4310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:42 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:43.495404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:43.496556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:43.511785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:43.516226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:43.519376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:43.523237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:43.683375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cc9e7fd5-530f-4fb5-b9a8-c62abcd749fb req-46a02cf8-5c27-457f-ad5c-4122fe82b994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef265e34-1e93-4dc9-913b-54f4ad3a160b", "tag": "1082c414-6ccf-43a6-85b2-7162c86c1f50"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:43.714957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cc9e7fd5-530f-4fb5-b9a8-c62abcd749fb req-46a02cf8-5c27-457f-ad5c-4122fe82b994 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:43.715826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cc9e7fd5-530f-4fb5-b9a8-c62abcd749fb req-46a02cf8-5c27-457f-ad5c-4122fe82b994 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:43.731974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cc9e7fd5-530f-4fb5-b9a8-c62abcd749fb req-46a02cf8-5c27-457f-ad5c-4122fe82b994 service nova] Creating event network-changed:1082c414-6ccf-43a6-85b2-7162c86c1f50 for instance ef265e34-1e93-4dc9-913b-54f4ad3a160b on nch1-master-1 Jun 04 21:13:43.737836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cc9e7fd5-530f-4fb5-b9a8-c62abcd749fb req-46a02cf8-5c27-457f-ad5c-4122fe82b994 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067213 Jun 04 21:13:43.739832 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2206/4311] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:43.879046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:43.896892 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b6b5e34a-98f3-4e08-8e9c-f4adeed75919 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.404802 Jun 04 21:13:43.907648 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2106/4312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:43 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:44.092867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:44.093603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:44.101066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:44.101529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:44.102507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:44.102954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:44.146909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:44.147854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:44.154747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:44.155577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:44.156673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:44.157331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:44.345316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:44.354702 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ea92826-07b2-471a-afdf-3e3fcf302eec tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.266847 Jun 04 21:13:44.369320 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2207/4313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:44 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:44.392709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:44.410989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2275e27e-ebb4-4fcd-9d9e-72dd0b3d06ea tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.268387 Jun 04 21:13:44.413355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2107/4314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:44 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:44.916127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:44.917403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:44.925153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:44.926082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:44.927083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:44.928079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:45.200522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:45.211789 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-92e79a87-f5e4-4002-8ba2-34bd343e0f0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.299773 Jun 04 21:13:45.213010 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2208/4315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:44 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:45.376968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:45.377621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:45.392165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:45.392616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:45.393521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:45.394311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:45.429060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:45.429696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:45.466842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:45.468913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:45.473104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:45.474963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:45.508405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:46.028165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:46.039244 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1cfc5e8a-99ce-4662-842c-1c1be7b0f076 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.670556 Jun 04 21:13:46.044126 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2108/4316] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:45 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:46.072394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:46.088200 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6734c03a-ca3c-4928-82ff-4f2b46013893 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.663405 Jun 04 21:13:46.088801 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2209/4317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:45 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:46.230966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:46.231668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:46.247027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:46.247413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:46.255363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:46.255859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:46.752244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:46.756940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:46.786111 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c0a4e5e-8faf-4759-90d0-ec73b5c19621 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.557835 Jun 04 21:13:46.788905 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2109/4318] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:46 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:47.061282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:47.061924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:47.074268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.076050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:47.077053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.084494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:47.138939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:47.158460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e8dceb6e-d173-447a-8953-2149d5742cab req-5cfe36b4-4b64-4c77-8f3b-12f33690e86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d8902f-000b-4a45-9cca-5b4a4a0535ca", "tag": "a44f9e09-03ee-487d-bb66-08eb0d73e5f9"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:47.183055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e8dceb6e-d173-447a-8953-2149d5742cab req-5cfe36b4-4b64-4c77-8f3b-12f33690e86b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.183562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e8dceb6e-d173-447a-8953-2149d5742cab req-5cfe36b4-4b64-4c77-8f3b-12f33690e86b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:47.205275 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e8dceb6e-d173-447a-8953-2149d5742cab req-5cfe36b4-4b64-4c77-8f3b-12f33690e86b service nova] Creating event network-changed:a44f9e09-03ee-487d-bb66-08eb0d73e5f9 for instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca on nch1-master-1 Jun 04 21:13:47.213982 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e8dceb6e-d173-447a-8953-2149d5742cab req-5cfe36b4-4b64-4c77-8f3b-12f33690e86b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.470369 Jun 04 21:13:47.215350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2210/4319] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:13:47.223306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:47.224361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:47.242329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.242789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:47.244354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.245377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:47.418432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:47.469712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:47.633468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:47.642466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8315ba2c-06bb-4e6e-ac76-1eb40aae4433 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.425379 Jun 04 21:13:47.644712 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2211/4320] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:47 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:47.645021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:47.663982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:47.682044 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-002c7def-619b-41c9-8040-25d57f86c4a0 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.624725 Jun 04 21:13:47.683347 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2110/4321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:47 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:47.804711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:47.805334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:47.812917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.813387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:47.814364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:47.814954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:48.126489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:48.162667 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6aacfbc3-217a-46f5-b4f5-fc09fbe1e748 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.361744 Jun 04 21:13:48.186224 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2212/4322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:47 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:48.661525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:48.662807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:48.676077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:48.676743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:48.677916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:48.678517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:48.701613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:48.702695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:48.714091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:48.717658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:48.720237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:48.721353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:49.066277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:49.078883 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac70f63a-58f1-491f-9819-e4c4575aa20f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.419044 Jun 04 21:13:49.090612 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2111/4323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:48 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:49.137165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:49.152347 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a359aa6b-c330-47d2-af8b-4ab4483d35a3 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.455886 Jun 04 21:13:49.153243 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2213/4324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:48 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:49.193701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:49.194538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:49.205027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:49.206172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:49.207841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:49.208503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:49.434859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:49.446859 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77b443bb-8bad-4567-bd83-236db11bb498 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.259213 Jun 04 21:13:49.448144 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2112/4325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:49 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:50.098128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:50.098904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:50.119372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:50.119910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:50.122596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:50.124408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:50.171750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:50.172361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:50.192223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:50.199839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:50.201010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:50.203166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:50.526127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:50.555956 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f06c049e-67ee-49ab-acfa-449dba3c4a1b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.456346 Jun 04 21:13:50.558273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2214/4326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:50 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:50.569910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:50.572923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:50.574041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:50.584724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecbd2550-e075-47d6-8ac0-2c724c17d3a7 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.417391 Jun 04 21:13:50.585739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2113/4327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:50 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:50.590184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:50.590639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:50.591478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:50.591895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:51.347300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:51.361933 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4da45f9b-079a-4144-bf63-85e1f455fcfc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.801095 Jun 04 21:13:51.363574 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2215/4328] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:50 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:51.576425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:51.577140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:51.590878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:51.591694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:51.592506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:51.592942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:51.602267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:51.602887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:51.610541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:51.611242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:51.612350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:51.613019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:51.976907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:51.977873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:52.004817 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-acc7adda-46bb-42d2-9a60-022eec599fdf tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.401570 Jun 04 21:13:52.006155 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2216/4329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:51 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:52.020789 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-069a3d9a-5076-4ff0-a207-73e843bbca4d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.448364 Jun 04 21:13:52.030360 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2114/4330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:51 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:52.380852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:52.381618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:52.394791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:52.396247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:52.397952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:52.398649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:52.633708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:52.660726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72964f51-6b8d-400b-b921-cc7502ef92b2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.284024 Jun 04 21:13:52.667825 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2217/4331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:52 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:52.761156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-33e8347e-0120-4f2e-9312-8b79972a7f86 req-ba77c49a-753c-461e-aed1-3e5e22ced449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef265e34-1e93-4dc9-913b-54f4ad3a160b", "name": "network-vif-plugged", "status": "completed", "tag": "1082c414-6ccf-43a6-85b2-7162c86c1f50"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:52.781129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-33e8347e-0120-4f2e-9312-8b79972a7f86 req-ba77c49a-753c-461e-aed1-3e5e22ced449 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:52.781881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-33e8347e-0120-4f2e-9312-8b79972a7f86 req-ba77c49a-753c-461e-aed1-3e5e22ced449 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:52.796700 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-33e8347e-0120-4f2e-9312-8b79972a7f86 req-ba77c49a-753c-461e-aed1-3e5e22ced449 service nova] Creating event network-vif-plugged:1082c414-6ccf-43a6-85b2-7162c86c1f50 for instance ef265e34-1e93-4dc9-913b-54f4ad3a160b on nch1-master-1 Jun 04 21:13:52.811610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-33e8347e-0120-4f2e-9312-8b79972a7f86 req-ba77c49a-753c-461e-aed1-3e5e22ced449 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055607 Jun 04 21:13:52.812459 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2115/4332] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:53.023620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:53.024954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:53.026558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:53.044617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:53.046104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:53.053360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:53.058191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:53.064254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:53.067306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:53.073061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:53.074108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:53.077315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:53.078545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:53.489480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:53.509287 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a96afe7f-6056-4ab2-b856-9d58b875eb07 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1308 microversion: 2.1 time: 0.474337 Jun 04 21:13:53.509914 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2116/4333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:53 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:53.611183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:53.624131 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55c13dc9-f6c3-46a8-a8f2-82f1861de1ff tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.605072 Jun 04 21:13:53.626495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2218/4334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:53 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:53.687367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:53.688101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:53.695239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:53.696144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:53.697096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:53.697542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:53.952122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:53.965615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-310ca640-94f9-45cc-bab2-2df2394bbf80 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.284084 Jun 04 21:13:53.966534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2117/4335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:53 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:54.526401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:54.527024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:54.540031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.540481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:54.541464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.544445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:54.644999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:54.646267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:54.660190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.668523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:54.671343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.672132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:54.866372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:54.880806 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f279535-3fb1-4c24-b53c-f3dd895e84ac tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1489 microversion: 2.1 time: 0.354197 Jun 04 21:13:54.896268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2219/4336] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:54 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1489 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:54.905314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-84b99a68-f979-4e7d-96e1-00b3553f772a req-7ff474ae-1346-4c41-aaa5-88291134ba1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d8902f-000b-4a45-9cca-5b4a4a0535ca", "name": "network-vif-plugged", "status": "completed", "tag": "a44f9e09-03ee-487d-bb66-08eb0d73e5f9"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:54.924302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-84b99a68-f979-4e7d-96e1-00b3553f772a req-7ff474ae-1346-4c41-aaa5-88291134ba1a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.925050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-84b99a68-f979-4e7d-96e1-00b3553f772a req-7ff474ae-1346-4c41-aaa5-88291134ba1a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:54.938972 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-84b99a68-f979-4e7d-96e1-00b3553f772a req-7ff474ae-1346-4c41-aaa5-88291134ba1a service nova] Creating event network-vif-plugged:a44f9e09-03ee-487d-bb66-08eb0d73e5f9 for instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca on nch1-master-1 Jun 04 21:13:54.947772 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-84b99a68-f979-4e7d-96e1-00b3553f772a req-7ff474ae-1346-4c41-aaa5-88291134ba1a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049690 Jun 04 21:13:54.950648 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2220/4337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:13:54.956606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:54.964859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1838490074"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:54.965854 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38d7893d-576f-4847-9f81-3e049f63f34e tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.324943 Jun 04 21:13:54.966667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:54.967915 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2118/4338] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:54 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:54.985521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.986254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:54.987332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:54.987973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.035597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:55.036396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:55.048490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.050025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.051102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.051622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.110614 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3464c7b7-0e7a-4d5f-b934-b54cc13f34d8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "PUT /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1075 microversion: 2.1 time: 0.150251 Jun 04 21:13:55.111724 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2221/4339] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:13:54 2022] PUT /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1075 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:55.128307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:55.129115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:55.135547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.136321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.137396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.138058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.498413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:55.511260 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dab91ba9-0e8c-44cd-adff-1ce1e4172096 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.526818 Jun 04 21:13:55.512324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2119/4340] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:54 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:55.580884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:55.591997 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4a261d1-74cd-46bd-b68c-0790f3d92fba tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1501 microversion: 2.1 time: 0.468559 Jun 04 21:13:55.599893 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2222/4341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:55 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:55.617452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:55.617997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:55.640625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.641308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.644047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.644688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.893335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:55.915552 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-05aeb2da-9f2b-40db-862d-0f718b41408c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1501 microversion: 2.1 time: 0.302031 Jun 04 21:13:55.917359 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2120/4342] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:55 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1501 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:55.934264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0f12b6a8-fcf5-465d-a3f5-be92692e26b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:13:55.941431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0f12b6a8-fcf5-465d-a3f5-be92692e26b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:55.942542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0f12b6a8-fcf5-465d-a3f5-be92692e26b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:55.971886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0f12b6a8-fcf5-465d-a3f5-be92692e26b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:13:55.985046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:55.986622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:56.001000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:56.002306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:56.003500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:56.004146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:56.059108 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0f12b6a8-fcf5-465d-a3f5-be92692e26b0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "POST /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b/action" status: 202 len: 0 microversion: 2.1 time: 0.127936 Jun 04 21:13:56.060542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2223/4343] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:13:55 2022] POST /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:13:56.077757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:56.077757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:56.085778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:56.086467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:56.088374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:56.089040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:56.442129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:56.456892 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-de57be86-44d2-44cf-8ff5-8d9467e76f46 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1313 microversion: 2.1 time: 0.475946 Jun 04 21:13:56.466850 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2121/4344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:55 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:56.535487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:56.546429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:56.552460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:56.553689 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-236e6898-04f2-4f43-84e0-e97d2560f0a4 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.484546 Jun 04 21:13:56.566675 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2224/4345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:56 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:56.566818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:56.566818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:56.566818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:56.566818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:56.803375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:56.815927 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d91eb908-5523-4b22-955e-2dc0a006770b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.288290 Jun 04 21:13:56.817036 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2122/4346] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:56 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:57.476406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:57.477744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:57.503018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:57.505619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:57.506638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:57.507177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:57.574392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:57.575016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:57.583561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:57.584281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:57.585402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:57.586355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:57.945992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:57.951487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:57.952534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:13:57.961047 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f1e79a33-d079-4743-956c-efd4e7fde6c0 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.390847 Jun 04 21:13:57.962261 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2123/4347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:57 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:13:57.967070 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be46e7d4-4626-41d4-aecf-83c511970d71 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1496 microversion: 2.1 time: 0.496199 Jun 04 21:13:57.968066 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2225/4348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:57 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1496 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:57.968321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:57.969118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:57.975849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:57.976523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:57.977732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:57.978154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:58.412540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:58.424571 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-07390047-e940-42a9-9928-402bf66af980 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.460996 Jun 04 21:13:58.425592 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2124/4349] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:57 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:58.983705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:58.984629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:58.994369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:58.995064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:58.996181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:58.996656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:59.198797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:59.208415 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1d5e20a7-0b5b-43a7-a6bd-345ac415da4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.228788 Jun 04 21:13:59.209022 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2226/4350] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:58 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:13:59.445335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:13:59.446045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:13:59.457334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:59.458263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:59.459079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:13:59.459562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:13:59.782317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:13:59.798355 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1fcf1daf-4584-4277-bc2c-f8368faa3a3a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1513 microversion: 2.1 time: 0.355545 Jun 04 21:13:59.798990 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2125/4351] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:13:59 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:00.226769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:00.227446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:00.235175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:00.235664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:00.236755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:00.237385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:00.426524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:00.441238 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-072233c9-d1de-4230-9772-90c51b652987 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.218529 Jun 04 21:14:00.444803 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2227/4352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:00 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:00.819186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:00.819943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:00.842184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:00.842640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:00.843437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:00.843913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.242870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:01.244003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:01.252847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.253950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.255057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.255727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.277360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:01.286779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:14:01.290153 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-659dc06f-a9b6-4b2c-8a20-ed73ce7669d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1490 microversion: 2.1 time: 0.476473 Jun 04 21:14:01.292524 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2126/4353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:00 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1490 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:01.310375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:01.311968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:01.328097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.328705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.331349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.331837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.410940 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cca40b4c-0b4b-4ae8-8f08-e28ae38ad6c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 200 len: 148 microversion: 2.1 time: 0.106430 Jun 04 21:14:01.411849 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2127/4354] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:01 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 148 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:01.425636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:01.426988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:01.438186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.438844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.440139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.440805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.447937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:01.448137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8b765ac-edb0-41d6-839b-b264d5ec72f4 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "DELETE /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 204 len: 0 microversion: 2.1 time: 0.208906 Jun 04 21:14:01.448613 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2228/4355] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:01 2022] DELETE /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:14:01.458456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:01.460219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:01.475944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.476572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.477535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.478113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.790359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:01.799057 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-380842b3-17e6-4a14-b063-4b21a7c0196c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.381206 Jun 04 21:14:01.800110 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2128/4356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:01 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:01.808163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:01.809157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:01.815657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:01.817305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.818006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.819075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.819755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.839804 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2b5e8a72-65ae-4bcc-93fe-f115a15d87da tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1502 microversion: 2.1 time: 0.386457 Jun 04 21:14:01.840738 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2229/4357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:01 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1502 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:01.845540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:01.846982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:01.855526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.856261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:01.857560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:01.858793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.133477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:02.141753 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0d54e13c-e9b6-4bfd-8154-85b22ffbfde0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.299951 Jun 04 21:14:02.142560 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2230/4358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:01 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:02.159488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:02.169275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:02.169714 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8b567a2-a99c-462a-b755-f89aabb5ec1c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.367879 Jun 04 21:14:02.171679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:02.180174 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2129/4359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:01 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:02.182420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:02.183084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.183895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:02.184338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.459026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:02.469250 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f27abb9f-5455-4390-af23-5803cd3fe7e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.314043 Jun 04 21:14:02.470431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2231/4360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:02 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:02.486987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:02.487727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:02.490610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:02.497433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:02.498099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.499088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:02.499764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.821485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:02.831767 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bcb13b80-8eb4-4465-9f98-7c36e41fe194 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.349206 Jun 04 21:14:02.832661 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2130/4361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:02 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:02.859549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:02.860477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:02.868286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:02.869096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.870122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:02.870879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:02.954441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-330906686", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "022d1b94-119f-49b9-8193-cbad0fb4c7b0"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:03.016894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] validate_networks() for [('022d1b94-119f-49b9-8193-cbad0fb4c7b0', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:14:03.474139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eccde33e4f44565b9e7ed25ba378948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f970c3882e940f98bab811c9fdd078a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:03.485671 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f011b213-eded-47dd-8964-46260a207e28 tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 200 len: 1502 microversion: 2.1 time: 0.630537 Jun 04 21:14:03.488456 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2232/4362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:02 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 1502 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:03.494743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:03.497692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:03.511108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:03.511826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:03.512957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:03.514341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:03.967380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:03.976903 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-995a6444-14bf-4025-ae66-3d53426a7dfb tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.485781 Jun 04 21:14:03.977468 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2233/4363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:03 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:03.995119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cc5bfd88-73f5-45a7-8c6f-dea321234252 req-84bfc095-ac0c-4e67-a929-25f120425a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d8902f-000b-4a45-9cca-5b4a4a0535ca", "name": "network-vif-deleted", "tag": "a44f9e09-03ee-487d-bb66-08eb0d73e5f9"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:04.005309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cc5bfd88-73f5-45a7-8c6f-dea321234252 req-84bfc095-ac0c-4e67-a929-25f120425a4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:04.008644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cc5bfd88-73f5-45a7-8c6f-dea321234252 req-84bfc095-ac0c-4e67-a929-25f120425a4e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:04.029598 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cc5bfd88-73f5-45a7-8c6f-dea321234252 req-84bfc095-ac0c-4e67-a929-25f120425a4e service nova] Creating event network-vif-deleted:a44f9e09-03ee-487d-bb66-08eb0d73e5f9 for instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca on nch1-master-1 Jun 04 21:14:04.039133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cc5bfd88-73f5-45a7-8c6f-dea321234252 req-84bfc095-ac0c-4e67-a929-25f120425a4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050072 Jun 04 21:14:04.039806 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2234/4364] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:04.284719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:14:04.285427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:14:04.285664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:14:04.286011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:14:04.286431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:14:04.312345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:04.312831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:04.316489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:04.317020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:04.399402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:14:04.411399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for user 09431bbdbc394df8b368770d3e24a306 and project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:14:04.451062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:14:04.454794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:14:04.512447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:04.513279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] [instance: 23d8902f-000b-4a45-9cca-5b4a4a0535ca] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:04.526360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:04.526934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:04.527668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:04.532475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:04.558560 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2345495e-8666-4180-97ce-ac2bbb66df33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.606246 Jun 04 21:14:04.559853 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2131/4365] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:14:04.570171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40d7a733-fca1-4909-be5c-704a36381d8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:04.571654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] HTTP exception thrown: Instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca could not be found. Jun 04 21:14:04.574252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40d7a733-fca1-4909-be5c-704a36381d8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Request method failure captured: Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca HTTP/1.1 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8r8bjIS7lCIHNPclRX3htHs71t5K2R76ZHq3XYdMTHC7aURAmpGHzq1lGn2dUta2aUq7wyOI_wRU44A1FhkMFha5R-Y_aSHiirn6wlwftrUNkAR2QlzuOjtysZ8i8tl5DMuJZl_oLH3M3poy52J6cEODz-p9k_ekrC7xQbcGePYEmk Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4f970c3882e940f98bab811c9fdd078a Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesActionsTest-685284692 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4f970c3882e940f98bab811c9fdd078a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f970c3882e940f98bab811c9fdd078a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4f970c3882e940f98bab811c9fdd078a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4f970c3882e940f98bab811c9fdd078a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesActionsTest-685284692 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4f970c3882e940f98bab811c9fdd078a Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesActionsTest-685284692 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesActionsTest-685284692-project Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 4eccde33e4f44565b9e7ed25ba378948 Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesActionsTest-685284692-project Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca could not be found. Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '23d8902f-000b-4a45-9cca-5b4a4a0535ca'} Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca could not be found. Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca could not be found. Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:04.575928 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca could not be found. Jun 04 21:14:04.581450 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:04.583359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] Returning 404 to user: Instance 23d8902f-000b-4a45-9cca-5b4a4a0535ca could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:04.587962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a042ff9a-8331-4fce-a9a4-d27cda9f9e7f tempest-VolumesActionsTest-685284692 tempest-VolumesActionsTest-685284692-project] 10.222.0.18 "GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca" status: 404 len: 111 microversion: 2.1 time: 0.081969 Jun 04 21:14:04.589214 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2235/4366] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:04 2022] GET /compute/v2.1/servers/23d8902f-000b-4a45-9cca-5b4a4a0535ca => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:04.716695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40d7a733-fca1-4909-be5c-704a36381d8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:04.731468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40d7a733-fca1-4909-be5c-704a36381d8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1214 microversion: 2.1 time: 0.165458 Jun 04 21:14:04.735400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2132/4367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:04 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:04.995442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:04.996482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:05.023694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:05.025343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:05.026231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:05.028073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:05.421978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:05.440021 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f31a143e-f3bf-4c3c-998b-0c163df44e04 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.448761 Jun 04 21:14:05.441053 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2236/4368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:04 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:05.760890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:05.761932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:05.781478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:05.784306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:05.786219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:05.787823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:05.890677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:05.906995 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d69238d9-af5c-4e0b-befa-3c5cf436b315 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1210 microversion: 2.1 time: 0.152691 Jun 04 21:14:05.908167 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2133/4369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:05 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:06.464627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:06.466589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:06.479376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:06.479906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:06.480963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:06.481691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:06.870782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:06.885452 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f8aeecb-4ba8-4b89-8453-08cdfff3b3de tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.429399 Jun 04 21:14:06.887871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2237/4370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:06 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:06.930334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:06.931064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:06.958674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:06.959088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:06.979542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:06.979542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:07.131599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:07.142522 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2fd12161-a7f3-4fd1-b25b-9dfbc4eb6f8e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1284 microversion: 2.1 time: 0.215710 Jun 04 21:14:07.144803 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2134/4371] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:06 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1284 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:07.910254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:07.911059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:07.923058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:07.923561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:07.924583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:07.930681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:08.164231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:08.164934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:08.177737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:08.179669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:08.181632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:08.183415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:08.209743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:08.227619 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35b488e1-78b3-44e9-9b11-8bf3517d17d3 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.323904 Jun 04 21:14:08.229088 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2238/4372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:07 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:08.317425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:08.333010 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50715160-8183-47b8-91ee-d938f301299f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1272 microversion: 2.1 time: 0.172132 Jun 04 21:14:08.333783 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2135/4373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:08 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:09.245714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:09.247054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:09.254669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:09.255475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:09.256464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:09.257071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:09.354808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:09.356559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:09.377917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:09.379669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:09.380541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:09.382739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:09.443031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:09.452747 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa51ee35-c5fe-437e-bc48-6e6dfe5eea87 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.210894 Jun 04 21:14:09.462573 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2239/4374] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:09 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:09.651343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:09.661973 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0f1c78c9-2598-4f8b-85f9-7633692520c5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.311421 Jun 04 21:14:09.665031 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2136/4375] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:09 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:10.481403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:10.482979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:10.493946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:10.494405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:10.495195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:10.496746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:10.663646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9913fd75-e977-4c5a-894e-32b31e82e36d req-0ff7bdba-1c64-42da-9af3-c327bd28ea59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c008cf-8b7e-4b17-af85-13228329846a", "tag": "96728599-aebf-4cdc-9898-644ff3b2e54a"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:10.721961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:10.744428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9913fd75-e977-4c5a-894e-32b31e82e36d req-0ff7bdba-1c64-42da-9af3-c327bd28ea59 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:10.746363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9913fd75-e977-4c5a-894e-32b31e82e36d req-0ff7bdba-1c64-42da-9af3-c327bd28ea59 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:10.754562 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-32dcb13d-ea9b-4650-832f-c46e46e76860 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.275815 Jun 04 21:14:10.756568 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2240/4376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:10 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:10.778101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9913fd75-e977-4c5a-894e-32b31e82e36d req-0ff7bdba-1c64-42da-9af3-c327bd28ea59 service nova] Creating event network-changed:96728599-aebf-4cdc-9898-644ff3b2e54a for instance 70c008cf-8b7e-4b17-af85-13228329846a on nch1-master-1 Jun 04 21:14:10.787931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:10.791477 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9913fd75-e977-4c5a-894e-32b31e82e36d req-0ff7bdba-1c64-42da-9af3-c327bd28ea59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135275 Jun 04 21:14:10.792408 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2137/4377] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:14:10.804169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:10.817333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:10.818333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:10.819686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:10.820312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:10.991206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:11.001586 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6e3762f-6fa3-4698-8905-be2b8f9dcbb3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.243015 Jun 04 21:14:11.002840 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2241/4378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:10 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:11.180827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d33b164-b5b0-4020-a9d6-bde4e75b030d tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Action: 'create', calling method: .version_select at 0x7f2d01a24a60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1343804380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiq1o/UBXd2aiqoyXM1MtAxvV/GenoqpeHIGQvIQySXjkrBDBQgw+eGeNW0boy1QX631vHGSd1Zq8Cn3nn6e52T1/knnGv7vKDeXfMVK0kyMtgMEoV3jlhRLzQiq0euGg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:11.209764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5d33b164-b5b0-4020-a9d6-bde4e75b030d tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Getting quotas for project a6f7eafafd554647ad42646ebdc1aa1b. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:14:11.216099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5d33b164-b5b0-4020-a9d6-bde4e75b030d tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Getting quotas for user 2ed5143e191a43cc892a9428a2a8376c and project a6f7eafafd554647ad42646ebdc1aa1b. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:14:11.248202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5d33b164-b5b0-4020-a9d6-bde4e75b030d tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.071831 Jun 04 21:14:11.248812 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2138/4379] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:14:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:11.773792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:11.774486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:11.790570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:11.791089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:11.792904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:11.793681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:11.798302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:12.020447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:12.021920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:12.030358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:12.031125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:12.032185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:12.033708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:12.059097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:12.073306 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5b0a77d-ebfc-4a6c-9809-9211ec7189d7 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.305990 Jun 04 21:14:12.074366 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2242/4380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:11 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:12.222582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:12.231889 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c9bd86d-b230-4c8b-8856-290b888a29d0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.217082 Jun 04 21:14:12.244078 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2139/4381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:12 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:12.927960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-84697896", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f35ce8e5-9954-4c05-b8de-30197fd428d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1343804380", "security_groups": [{"name": "tempest-secgroup-smoke-1495128488"}], "networks": [{"uuid": "6d939f10-4bc0-4cb4-9e50-51c52cb1624f"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:13.064639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] validate_networks() for [('6d939f10-4bc0-4cb4-9e50-51c52cb1624f', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:14:13.091571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:13.092205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:13.103972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:13.104432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:13.106130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:13.106572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:13.325117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:13.334046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63cc294c-2e9f-4b54-8aa1-8260f58e12d5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.247589 Jun 04 21:14:13.334978 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2140/4382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:13 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:13.339854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:13.340749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:13.348944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:13.349820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:13.351095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:13.351632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:13.554939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:13.563191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c477996b-0d94-4336-8c81-8231f544cc18 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.226842 Jun 04 21:14:13.563905 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2141/4383] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:13 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:13.707549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:14:13.708135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:14:13.708961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:14:13.709441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:14:13.711546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:14:13.726772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:13.727711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:13.731345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:13.732131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:13.760247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Getting quotas for project a6f7eafafd554647ad42646ebdc1aa1b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:14:13.768138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Getting quotas for user 2ed5143e191a43cc892a9428a2a8376c and project a6f7eafafd554647ad42646ebdc1aa1b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:14:13.886851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:14:13.889269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f35ce8e5-9954-4c05-b8de-30197fd428d2',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:14:14.204769 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d992532b-f7d0-4e1f-959c-3793acb6272c tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.282044 Jun 04 21:14:14.211292 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2243/4384] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:14:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:14:14.221582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69f6dc74-3b98-498f-b7ca-5193dcfd8699 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:14.222456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-69f6dc74-3b98-498f-b7ca-5193dcfd8699 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:14.327160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-69f6dc74-3b98-498f-b7ca-5193dcfd8699 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:14.331262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:14.338259 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69f6dc74-3b98-498f-b7ca-5193dcfd8699 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1097 microversion: 2.1 time: 0.125404 Jun 04 21:14:14.338824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2142/4385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:14 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1097 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:14.357134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:14.358612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:14.370745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:14.371753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:14.373132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:14.373810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:14.570361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:14.583643 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83727e8e-d901-405d-9f39-e1660a8d4b4c tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.233958 Jun 04 21:14:14.584980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:14.586074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:14.586932 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2244/4386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:14 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:14.594278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:14.594939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:14.596282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:14.597045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:14.772889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:14.784616 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38a7188f-7257-41a4-840a-b8118d633369 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.206084 Jun 04 21:14:14.786524 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2143/4387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:14 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:15.367662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:15.368301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:15.393216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:15.394028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:15.394820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:15.395257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:15.506223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:15.519151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8b055f1-b9fc-4de2-aba3-247d2a2be8c7 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1195 microversion: 2.1 time: 0.165034 Jun 04 21:14:15.520050 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2245/4388] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:15 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1195 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:15.603684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:15.604309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:15.616234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:15.616684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:15.617482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:15.619698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:15.802534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:15.803152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:15.812414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:15.812863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:15.813694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:15.814131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:16.020069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:16.028839 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ee18708-cae9-401a-baa7-639aeeafc381 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.430190 Jun 04 21:14:16.032920 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2144/4389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:15 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:16.188689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:16.206028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b0a8cb0c-2051-4fae-be87-563ab5862715 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.406173 Jun 04 21:14:16.216640 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2246/4390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:15 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:16.544659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:16.545077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:16.561115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:16.569812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:16.570787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:16.571229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:16.868852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cd1adab7-4919-4dcb-9c92-693cd78cadac req-5057de00-71b0-4832-a21a-8653b536673e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c008cf-8b7e-4b17-af85-13228329846a", "name": "network-vif-plugged", "status": "completed", "tag": "96728599-aebf-4cdc-9898-644ff3b2e54a"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:16.904218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd1adab7-4919-4dcb-9c92-693cd78cadac req-5057de00-71b0-4832-a21a-8653b536673e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:16.904685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd1adab7-4919-4dcb-9c92-693cd78cadac req-5057de00-71b0-4832-a21a-8653b536673e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:16.916662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:16.930604 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f1702b41-bd32-40f5-a44b-b21dd42ae789 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1281 microversion: 2.1 time: 0.396956 Jun 04 21:14:16.932124 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2145/4391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:16 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1281 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:16.937178 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cd1adab7-4919-4dcb-9c92-693cd78cadac req-5057de00-71b0-4832-a21a-8653b536673e service nova] Creating event network-vif-plugged:96728599-aebf-4cdc-9898-644ff3b2e54a for instance 70c008cf-8b7e-4b17-af85-13228329846a on nch1-master-1 Jun 04 21:14:16.953800 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cd1adab7-4919-4dcb-9c92-693cd78cadac req-5057de00-71b0-4832-a21a-8653b536673e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099290 Jun 04 21:14:16.954440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2247/4392] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:14:17.059637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:17.060599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:17.069750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.070252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.071049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.071484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.232012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:17.233664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:17.250463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.251273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.253072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.253711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.441433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:17.456086 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-062a52a1-1518-4ac2-b646-2dc8306ab34a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.409494 Jun 04 21:14:17.456989 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2146/4393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:17 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:17.566172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:17.578029 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-02b37aed-b058-447e-a7ad-8e67e3fbec34 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1314 microversion: 2.1 time: 0.356810 Jun 04 21:14:17.578990 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2248/4394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:17 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:17.884000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4c59ec51-96b1-49d1-b92c-e96238ee4be1 req-6955e25d-346d-4d8e-a1da-ed9a08e64894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:17.941743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4c59ec51-96b1-49d1-b92c-e96238ee4be1 req-6955e25d-346d-4d8e-a1da-ed9a08e64894 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.949225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:17.950455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:17.958409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4c59ec51-96b1-49d1-b92c-e96238ee4be1 req-6955e25d-346d-4d8e-a1da-ed9a08e64894 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.972401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.975596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.977949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:17.978609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:17.994722 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4c59ec51-96b1-49d1-b92c-e96238ee4be1 req-6955e25d-346d-4d8e-a1da-ed9a08e64894 service nova] Creating event network-changed:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:14:18.013083 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4c59ec51-96b1-49d1-b92c-e96238ee4be1 req-6955e25d-346d-4d8e-a1da-ed9a08e64894 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134755 Jun 04 21:14:18.017713 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2147/4395] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:18.356240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:18.374963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8c6bc2ae-7168-4a67-92aa-333893a3ffc5 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1269 microversion: 2.1 time: 0.429402 Jun 04 21:14:18.376317 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2249/4396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:17 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1269 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:18.473700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:18.474619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:18.481496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:18.482016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:18.483012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:18.483665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:18.595491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:18.596282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:18.603473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:18.604438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:18.605415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:18.606033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:19.044471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:19.054821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:19.055351 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b119e160-673e-4788-8966-5da0187e5748 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.586154 Jun 04 21:14:19.056073 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2148/4397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:18 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:19.069194 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f2fbd920-0af7-4e82-9310-f60dcc7797a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1502 microversion: 2.1 time: 0.477945 Jun 04 21:14:19.070233 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2250/4398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:18 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1502 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:19.098651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:19.099815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:19.117251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:19.117760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:19.120634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:19.121147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:19.192131 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db234136-1e6d-467b-bcd1-7c7cc745cd9f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.104489 Jun 04 21:14:19.192915 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2149/4399] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:19 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:19.393848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:19.394630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:19.402480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:19.403157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:19.404237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:19.404863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:19.689694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:19.699674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-846c3236-5252-4f67-9b73-1129741df9cd tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1269 microversion: 2.1 time: 0.310447 Jun 04 21:14:19.700852 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2251/4400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:19 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1269 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:20.074178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:20.074887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:20.082872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:20.083316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:20.084083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:20.084544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:20.087741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:20.205586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:20.207864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:20.216856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:20.217691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:20.219064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:20.219749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:20.245920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:20.255877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c607b10b-17e7-4f61-b134-11ce87b7ed83 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.185927 Jun 04 21:14:20.257432 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2150/4401] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:20 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:20.295382 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f214d208-615c-4bf6-bd06-82b959b651bc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.095031 Jun 04 21:14:20.296276 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2252/4402] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:20 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:20.717709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:20.718473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:20.725942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:20.726610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:20.727693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:20.728286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:20.888196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:20.898844 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aef96ac4-3370-4f38-bd34-72d75bed7785 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1269 microversion: 2.1 time: 0.183011 Jun 04 21:14:20.898844 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2151/4403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:20 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:21.275726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:21.276444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:21.286923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:21.288142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:21.289569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:21.290021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:21.308263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:21.309548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:21.333004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:21.333453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:21.334515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:21.335105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:21.425874 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7a5fa888-0181-45ac-ad68-7d914a39d4de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.122245 Jun 04 21:14:21.431659 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2152/4404] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:21 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:21.540647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:21.550687 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d752f2c8-d6ec-4c55-a50b-f23879881754 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.279732 Jun 04 21:14:21.561633 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2253/4405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:21 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:21.915063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:21.915887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:21.923601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:21.924387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:21.925181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:21.925628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:22.192291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:22.200848 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d6b6761c-6de7-4cc8-a2d4-33ac81c31fba tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1269 microversion: 2.1 time: 0.290058 Jun 04 21:14:22.201418 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2153/4406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:21 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1269 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:22.439312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:22.440543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:22.452690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:22.455609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:22.459140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:22.459648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:22.536155 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4fc3ff07-3242-4a07-a782-251cb522ec6a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.101006 Jun 04 21:14:22.536834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2254/4407] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:22 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:22.573141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:22.573873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:22.583308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:22.583999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:22.584993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:22.585593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:22.824552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:22.834231 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20c4ff56-e3e6-4cc7-a0b4-bead39671e73 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.266308 Jun 04 21:14:22.835712 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2154/4408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:22 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:23.218295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:23.219465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:23.222582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:23.233195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:23.234148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:23.234947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:23.235428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:23.472447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:23.480793 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-300d91a6-1df7-4c5d-bfe7-5180313c45af tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1269 microversion: 2.1 time: 0.266948 Jun 04 21:14:23.488195 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2255/4409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:23 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1269 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:23.546626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:23.547863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:23.555470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:23.556032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:23.557058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:23.557812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:23.617513 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecdd8781-5513-4d25-8904-87af03c6828e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.074645 Jun 04 21:14:23.621564 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2155/4410] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:23 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:23.852427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:23.853062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:23.856683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:23.857722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:23.864030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:23.864749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:23.865527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:23.866151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:24.117797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:24.126399 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a192774c-56bd-4f9a-bab2-a1cdf7fe5184 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.277800 Jun 04 21:14:24.127204 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2256/4411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:23 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:24.499784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:24.500860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:24.507183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:24.510529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:24.511342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:24.513381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:24.513823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:24.599467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3afca695-c2eb-446b-bdcc-eacdd6057db0 req-9142e60b-b7b8-402f-8570-bd3b88e23fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "name": "network-vif-plugged", "status": "completed", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:24.609169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3afca695-c2eb-446b-bdcc-eacdd6057db0 req-9142e60b-b7b8-402f-8570-bd3b88e23fff service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:24.609757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3afca695-c2eb-446b-bdcc-eacdd6057db0 req-9142e60b-b7b8-402f-8570-bd3b88e23fff service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:24.626421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3afca695-c2eb-446b-bdcc-eacdd6057db0 req-9142e60b-b7b8-402f-8570-bd3b88e23fff service nova] Creating event network-vif-plugged:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:14:24.634460 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3afca695-c2eb-446b-bdcc-eacdd6057db0 req-9142e60b-b7b8-402f-8570-bd3b88e23fff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038813 Jun 04 21:14:24.635191 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2257/4412] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:14:24.656390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:24.658290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:24.667181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:24.668574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:24.669608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:24.670309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:24.733866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dbc5ef18-9e10-4582-a27c-13bb35526188 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.097003 Jun 04 21:14:24.734902 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2258/4413] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:24 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:25.140749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:25.146542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:25.147332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:25.150437 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f24323c3-e9bf-4bfc-92d2-fb1e79c23501 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1269 microversion: 2.1 time: 0.655523 Jun 04 21:14:25.150745 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2156/4414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:24 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1269 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:25.162326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:25.162866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:25.163770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:25.164278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:25.516084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:25.526980 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e7cfe94f-89ce-418c-96e0-b2b35cb9bc0e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.385978 Jun 04 21:14:25.527895 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2259/4415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:25 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:25.746910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:25.747919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:25.756928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:25.757754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:25.758850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:25.759395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:25.821618 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb498810-2259-4ac1-a527-1eba7d738bfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.079273 Jun 04 21:14:25.822905 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2157/4416] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:25 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:26.169564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:26.170301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:26.179095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.180021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.181147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.181740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.422068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:26.433779 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b67cdfcf-b915-425b-8f10-e56ed5f02be6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1458 microversion: 2.1 time: 0.269874 Jun 04 21:14:26.435117 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2260/4417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:26 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1458 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:26.455385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:26.456156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:26.463823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.464281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.465071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.465513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.546623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:26.547893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:26.560112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.560619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.562675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.563135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.747088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:26.761379 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5ed4d74c-bf4a-49b0-8aae-d4616b77c0c6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1458 microversion: 2.1 time: 0.314372 Jun 04 21:14:26.762755 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2158/4418] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:26 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1458 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:26.831698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:26.833752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:26.835295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:26.835437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:26.850151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.851374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.851884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-083abc84-9d1b-460d-85f9-7a6207af5b3e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1511 microversion: 2.1 time: 0.308716 Jun 04 21:14:26.854118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:26.855410 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2261/4419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:26 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:26.857273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:26.933851 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b017225d-0744-4afc-aecb-ddb257c7c1e9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.104826 Jun 04 21:14:26.937712 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2159/4420] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:26 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 21:14:27.869848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:27.871199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:27.883779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:27.884240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:27.885049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:27.885519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:27.946219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:27.947348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:27.955181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:27.969970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:27.971911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:27.973095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:28.047814 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63d7e4f5-211f-46e8-be2a-717a9d06f52c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.105529 Jun 04 21:14:28.048622 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2160/4421] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:27 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 21:14:28.157562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:28.176049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e96db334-a19b-4dc2-b54b-5986e33f8f2a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1488 microversion: 2.1 time: 0.310657 Jun 04 21:14:28.178141 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2262/4422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:27 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1488 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:28.194831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1197120832"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:28.196514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:28.211165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:28.211910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:28.213412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:28.215088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:28.394173 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a9406c0-f6b2-454a-ba67-8b5ff78e8933 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "PUT /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1061 microversion: 2.1 time: 0.203763 Jun 04 21:14:28.403363 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2161/4423] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:14:28 2022] PUT /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1061 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:28.412203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:28.412829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:28.430692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:28.433271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:28.436282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:28.436863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:28.783818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:28.794529 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6140a3c1-f315-49ac-afda-168f142c43ca tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1488 microversion: 2.1 time: 0.388929 Jun 04 21:14:28.795185 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2263/4424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:28 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1488 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:28.812125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:28.814040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:28.823721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:28.824935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:28.826604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:28.827492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.062006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:29.063924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:29.072420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:29.073164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.074210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:29.074963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.141152 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fde69c58-5782-4e1a-81c9-c82b5d8acba0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.083663 Jun 04 21:14:29.143953 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2264/4425] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:29 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:29.194536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:29.216382 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-11ec0ccc-78aa-49e8-87c9-2582834eace9 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1488 microversion: 2.1 time: 0.409349 Jun 04 21:14:29.218800 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2162/4426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:28 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1488 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:29.234379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:29.235261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:29.244641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:29.245357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.246671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:29.247283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.289636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:14:29.479101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9b6d99f5-fa17-47ac-91c9-994f43786aa8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 204 len: 0 microversion: 2.1 time: 0.249056 Jun 04 21:14:29.480913 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2265/4427] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:29 2022] DELETE /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:14:29.489760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:29.490767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:29.508738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:29.509209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.510044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:29.510491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:29.777901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:29.786493 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7837eb31-5331-411c-81a6-a1d0a1a53b57 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1494 microversion: 2.1 time: 0.301440 Jun 04 21:14:29.788948 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2163/4428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:29 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1494 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:30.144320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-85290d99-ac4f-496e-9451-ebe8d2c96307 req-7663404d-6bf6-4bde-b227-01b5f7c9650d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:30.154408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:30.155379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:30.168621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-85290d99-ac4f-496e-9451-ebe8d2c96307 req-7663404d-6bf6-4bde-b227-01b5f7c9650d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:30.170080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-85290d99-ac4f-496e-9451-ebe8d2c96307 req-7663404d-6bf6-4bde-b227-01b5f7c9650d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:30.170311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:30.174385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:30.175750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:30.176277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:30.197421 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-85290d99-ac4f-496e-9451-ebe8d2c96307 req-7663404d-6bf6-4bde-b227-01b5f7c9650d service nova] Creating event network-changed:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:14:30.214589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-85290d99-ac4f-496e-9451-ebe8d2c96307 req-7663404d-6bf6-4bde-b227-01b5f7c9650d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071758 Jun 04 21:14:30.215640 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2266/4429] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:30.807313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:30.808298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:30.816538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:30.817911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:30.818932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:30.819688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:30.824150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20e52254-7a87-46a3-8e6c-72aec1bdf87d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 14 microversion: 2.1 time: 0.673419 Jun 04 21:14:30.829167 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2164/4430] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:30 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 14 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:14:31.140027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:31.156408 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7568fcad-0df3-48cd-8762-0816cc7e3485 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1494 microversion: 2.1 time: 0.352240 Jun 04 21:14:31.160289 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2267/4431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:30 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1494 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:31.835204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:31.836387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:31.848200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:31.849283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:31.851140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:31.870912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:31.970856 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c903a1e2-dec6-4a17-9ffd-e8cd52177d83 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action" status: 200 len: 8208 microversion: 2.1 time: 0.139024 Jun 04 21:14:31.972157 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2268/4432] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:31 2022] POST /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a/action => generated 8208 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:31.985318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:31.987044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:31.994873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:31.996265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:31.996699 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:31.997427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:31.997995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:31.998768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.017720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.018092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.021649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.026613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.040741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:14:32.174952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:32.215900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9da643d8-a4a5-4edb-901e-868145d961ca tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 204 len: 0 microversion: 2.42 time: 0.811594 Jun 04 21:14:32.222701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2165/4433] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:14:31 2022] DELETE /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 0 bytes in 820 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:14:32.231396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:32.240468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:32.271373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.272075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.272882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.274182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.352667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:32.460359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:32.478303 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3e93ec0d-1f96-469f-bffe-930fc8c71943 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1452 microversion: 2.1 time: 0.249518 Jun 04 21:14:32.479223 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2166/4434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:32 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1452 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:32.490399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:32.503255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:32.520073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:32.526993 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-082c208f-0aff-45e0-8103-9da823de1ab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.534002 Jun 04 21:14:32.530744 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2269/4435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:31 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:32.546618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.550422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.552026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fa8dd4f6-4147-4fba-bcb6-e1eb64878a0a req-3c636d08-1628-4964-ac89-3295b08a671c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}, {"name": "network-changed", "server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:32.554825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.559071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.577512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fa8dd4f6-4147-4fba-bcb6-e1eb64878a0a req-3c636d08-1628-4964-ac89-3295b08a671c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.580467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fa8dd4f6-4147-4fba-bcb6-e1eb64878a0a req-3c636d08-1628-4964-ac89-3295b08a671c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.616648 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fa8dd4f6-4147-4fba-bcb6-e1eb64878a0a req-3c636d08-1628-4964-ac89-3295b08a671c service nova] Creating event network-changed:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:14:32.617455 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fa8dd4f6-4147-4fba-bcb6-e1eb64878a0a req-3c636d08-1628-4964-ac89-3295b08a671c service nova] Creating event network-changed:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:14:32.627991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fa8dd4f6-4147-4fba-bcb6-e1eb64878a0a req-3c636d08-1628-4964-ac89-3295b08a671c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.095811 Jun 04 21:14:32.631942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2270/4436] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:32.658470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-705d872c-bf65-44f5-8aa8-dc99a98ef009 req-6393ee40-7614-444f-a82a-21f70537eb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef265e34-1e93-4dc9-913b-54f4ad3a160b", "name": "network-vif-deleted", "tag": "1082c414-6ccf-43a6-85b2-7162c86c1f50"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:32.681148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-705d872c-bf65-44f5-8aa8-dc99a98ef009 req-6393ee40-7614-444f-a82a-21f70537eb93 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.683501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-705d872c-bf65-44f5-8aa8-dc99a98ef009 req-6393ee40-7614-444f-a82a-21f70537eb93 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.712409 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-705d872c-bf65-44f5-8aa8-dc99a98ef009 req-6393ee40-7614-444f-a82a-21f70537eb93 service nova] Creating event network-vif-deleted:1082c414-6ccf-43a6-85b2-7162c86c1f50 for instance ef265e34-1e93-4dc9-913b-54f4ad3a160b on nch1-master-1 Jun 04 21:14:32.729361 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-705d872c-bf65-44f5-8aa8-dc99a98ef009 req-6393ee40-7614-444f-a82a-21f70537eb93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095709 Jun 04 21:14:32.730304 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2271/4437] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:32.741182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:32.741902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:32.761200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.761851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.762868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:32.763503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:32.994996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.016880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.020761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.023703 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98b13e55-270c-4f62-9a57-3e2f86c1c01d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2960 microversion: 2.42 time: 0.541610 Jun 04 21:14:33.025257 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2167/4438] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:32 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2960 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:33.063342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.074754 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e71a4052-d5a7-4eee-bcd2-2304be96baf2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.342897 Jun 04 21:14:33.078758 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2272/4439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:32 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:33.097307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:33.100167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:33.109767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.110476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.112014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.112925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.364969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.378686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0c2f61d4-4582-417e-a875-ea739bbb29ac tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.287890 Jun 04 21:14:33.380528 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2168/4440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:33 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:33.397147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:33.398119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:33.405874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.406674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.407976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.408689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.506924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:33.507819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:33.517640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.519388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.520467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.527865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.722711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.732961 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a5fcc50-05e1-4368-90aa-2435f87aa730 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1452 microversion: 2.1 time: 0.239689 Jun 04 21:14:33.733564 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2169/4441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:33 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:33.804183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:33.816437 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e621cdff-5017-4440-87a3-3d7f6dbdf352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.423521 Jun 04 21:14:33.827944 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2273/4442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:33 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:33.836618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:33.837571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:33.849728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.850601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.853646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:33.856200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:33.961695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Locking {{(pid=137229) lock /opt/stack/nova/nova/compute/api.py:4700}} Jun 04 21:14:34.044753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:34.045551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:34.054766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.055526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.056324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.057120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.073377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f39edc20-8137-405d-9b72-1a54261bf6ba tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.240677 Jun 04 21:14:34.075018 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2170/4443] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:33 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:34.083940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:34.084561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:34.092615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.093025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.093801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.094231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.551238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:34.570621 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7edf4529-f917-444c-aeb1-0d0931d18fb7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.491716 Jun 04 21:14:34.572128 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2171/4444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:34 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:34.588130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:34.590896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:34.601208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:34.603171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:34.609803 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a852cf46-cf1e-4346-8be1-584ce0ef692c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2960 microversion: 2.42 time: 0.564842 Jun 04 21:14:34.611775 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2274/4445] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:34 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2960 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:14:34.616360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.616823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.680297 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] HTTP exception thrown: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 is locked Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Request method failure captured: Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action HTTP/1.1 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 15 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pi-CvAxZC0oDOOr4jWw9iUi7-cw4wwmxr2oUy2B5oloTi8SImDW75GEsVZUGrerFh9T0U-Ar1-9aKLgpAGnhOl1hoNpbkI1LN0fKvtS712OMEMug-x_x5yKuxLAA1svxNBDGDC_f9t4Fs2f-mK2j-2l9M2MXFxw3plGZcrMsWETiA Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-108369637 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 09431bbdbc394df8b368770d3e24a306 Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: {"os-stop": {}} Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 is locked Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'fccc20f3-db1c-4c63-8b35-a1b344ee3b31', 'body': {'os-stop': {}}} Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 is locked Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 is locked Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 is locked Jun 04 21:14:34.682946 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:34.689520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Returning 409 to user: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 is locked {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:34.690894 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6e640e09-4478-49da-87cd-155cabebb1c0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 409 len: 107 microversion: 2.1 time: 0.104020 Jun 04 21:14:34.691897 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2172/4446] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:34 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 107 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 04 21:14:34.713137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:34.720265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:34.729601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.730135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.730899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.731535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.755558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:34.758919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:34.767340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.768322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.769666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.770402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.796505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Unlocking {{(pid=137228) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 04 21:14:34.864532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:34.874066 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2421310d-9b21-4c6d-a9fe-2c44ca6c2c5d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1292 microversion: 2.1 time: 0.126616 Jun 04 21:14:34.877446 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19216408-15b9-4c0f-ad8c-5aa10fc7e700 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.181126 Jun 04 21:14:34.878072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2275/4448] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:34 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:34.878282 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2173/4448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:34 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:34.887381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c50ed294-280a-4c60-9b0b-43254110c557 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:34.895675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50ed294-280a-4c60-9b0b-43254110c557 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:34.896370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c50ed294-280a-4c60-9b0b-43254110c557 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:34.930771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c50ed294-280a-4c60-9b0b-43254110c557 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:14:34.939933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:34.992012 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c50ed294-280a-4c60-9b0b-43254110c557 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.108257 Jun 04 21:14:34.993760 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2276/4449] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:34 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:35.007016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:35.009111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:35.020785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.022319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.023970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.025226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.324898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:35.333246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7968a280-2aff-4234-a841-8b139e0de2cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.334306 Jun 04 21:14:35.333826 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2174/4450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:34 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:35.632878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:35.633605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:35.647413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.647906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.669892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.670395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.892047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:35.893895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:35.902345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.902886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.904344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.905149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.945475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:35.946270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:35.946972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lazy-loading 'fault' on Instance uuid ef265e34-1e93-4dc9-913b-54f4ad3a160b {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:14:36.051757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:36.062714 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-979ea024-76e9-4d3b-bc2a-543f255a01c1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 200 len: 1310 microversion: 2.1 time: 0.174160 Jun 04 21:14:36.064326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2175/4451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:35 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 1310 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:36.194375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:36.211122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:36.216140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:36.219554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd67d086-4d87-4a69-9776-e3ebd894df1d tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2960 microversion: 2.42 time: 0.591168 Jun 04 21:14:36.220172 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2277/4452] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:35 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2960 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:36.350572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:36.351978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:36.369560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:36.370019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:36.377855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:36.378483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:36.641408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:36.663724 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-663934f1-fc5d-4e1a-8171-d1d38c3c062e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.317066 Jun 04 21:14:36.665291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2176/4453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:36 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:37.083752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.084207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.095653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.096512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.097546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.098422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.121525 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b HTTP/1.1 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ef265e34-1e93-4dc9-913b-54f4ad3a160b'} Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.123226 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.129616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f16fde5-eedb-4455-bcf5-8909be782d1a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 404 len: 111 microversion: 2.1 time: 0.046562 Jun 04 21:14:37.130923 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2278/4454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.138486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.139106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.170798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.173793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.178501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.181166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.225755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b HTTP/1.1 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ef265e34-1e93-4dc9-913b-54f4ad3a160b'} Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.232902 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.237427 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.239774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.242600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.243274 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5842e194-ddfa-49da-af6c-32d025711914 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 404 len: 111 microversion: 2.1 time: 0.106698 Jun 04 21:14:37.243412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.247063 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2177/4455] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:37 2022] DELETE /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.259257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.263003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: ef265e34-1e93-4dc9-913b-54f4ad3a160b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.266402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.267738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.270308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.270781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.272960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.273669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.278492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.285186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.344136 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b HTTP/1.1 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ef265e34-1e93-4dc9-913b-54f4ad3a160b'} Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.350816 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.355384 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.355384 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.355384 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.355384 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.355384 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. Jun 04 21:14:37.355384 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.358098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance ef265e34-1e93-4dc9-913b-54f4ad3a160b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.360645 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-630c8434-c483-4594-87d4-8d4ac60ac93b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b" status: 404 len: 111 microversion: 2.1 time: 0.111077 Jun 04 21:14:37.363582 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2178/4456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/ef265e34-1e93-4dc9-913b-54f4ad3a160b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.373377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.374456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.393335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.394726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.398898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.406825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.442271 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 HTTP/1.1 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'de9ce254-01db-43b3-8a06-48c93fb4d947'} Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.444641 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.448524 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.456280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.457174 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bfa02e4f-7da7-4b4e-950c-b1f503b63ba5 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 404 len: 111 microversion: 2.1 time: 0.089350 Jun 04 21:14:37.463116 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2179/4457] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:37 2022] DELETE /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.474214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.487649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: de9ce254-01db-43b3-8a06-48c93fb4d947] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.504550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.505257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.506880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.507614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.527653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 HTTP/1.1 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'de9ce254-01db-43b3-8a06-48c93fb4d947'} Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.529527 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.533730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.533730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.533730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.533730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.533730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. Jun 04 21:14:37.533730 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.536195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance de9ce254-01db-43b3-8a06-48c93fb4d947 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.537487 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ecf9ee5-c433-42c2-bb77-0138e62f1898 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947" status: 404 len: 111 microversion: 2.1 time: 0.075436 Jun 04 21:14:37.538654 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2180/4458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/de9ce254-01db-43b3-8a06-48c93fb4d947 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.567712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.568563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.577042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.577501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.579657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.580360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.601638 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a HTTP/1.1 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'eca7fd07-04ec-4514-8c50-277456484f5a'} Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.603249 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-30b179ea-4be0-4596-b29c-1cf15a104dd8 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 404 len: 111 microversion: 2.1 time: 0.062537 Jun 04 21:14:37.609515 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2181/4459] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:37 2022] DELETE /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.627914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.630468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: eca7fd07-04ec-4514-8c50-277456484f5a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.660514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.663202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.665721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.667151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.700172 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a HTTP/1.1 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'eca7fd07-04ec-4514-8c50-277456484f5a'} Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.702164 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.707103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.707103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.707103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.707103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.707103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. Jun 04 21:14:37.707103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.711225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance eca7fd07-04ec-4514-8c50-277456484f5a could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.713805 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0b54b6e-3c9b-4771-b5ff-a08b169fe14f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a" status: 404 len: 111 microversion: 2.1 time: 0.096875 Jun 04 21:14:37.714646 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2182/4460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/eca7fd07-04ec-4514-8c50-277456484f5a => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.733879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.736608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.750838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.752528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.752889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.755872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.832358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:37.857758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:37.859284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:37.864074 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b9a27ae7-2a82-4bc5-acb2-63a46037a57c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2939 microversion: 2.42 time: 0.628183 Jun 04 21:14:37.864887 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2279/4461] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2939 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:37.870912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.872025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.878848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.879637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.880649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.881290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.901287 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 HTTP/1.1 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '18d96768-43c1-4c0b-b27c-8bfe28b393a5'} Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.912403 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.916288 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.921144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.924473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f061d68f-ded3-4f7a-b143-ad00c37b5416 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 404 len: 111 microversion: 2.1 time: 0.058422 Jun 04 21:14:37.925341 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2280/4462] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:37 2022] DELETE /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:37.934718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:37.941094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 18d96768-43c1-4c0b-b27c-8bfe28b393a5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:37.954001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.957607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.958752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:37.961109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:37.986866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 HTTP/1.1 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '18d96768-43c1-4c0b-b27c-8bfe28b393a5'} Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.989662 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:37.994021 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:37.994021 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:37.994021 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:37.994021 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:37.994021 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. Jun 04 21:14:37.994021 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:37.996210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 18d96768-43c1-4c0b-b27c-8bfe28b393a5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:37.997669 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fa3ca89c-bd87-4623-b99b-801364d010a1 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5" status: 404 len: 111 microversion: 2.1 time: 0.066823 Jun 04 21:14:38.002545 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2281/4463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/18d96768-43c1-4c0b-b27c-8bfe28b393a5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:38.008515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.009579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.018820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.019700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.021069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.021971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.059580 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 HTTP/1.1 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '2865f1fb-ef6f-4e9c-883d-3ef6517118f4'} Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:38.063218 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.067284 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.069911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:38.075284 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f34f33f-4b3c-4ea9-a73d-a15d789d774a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 404 len: 111 microversion: 2.1 time: 0.068892 Jun 04 21:14:38.077331 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2282/4464] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:38 2022] DELETE /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:38.087833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.089199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2865f1fb-ef6f-4e9c-883d-3ef6517118f4] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.098585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.099178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.102590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.103171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.147416 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 HTTP/1.1 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '2865f1fb-ef6f-4e9c-883d-3ef6517118f4'} Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.150167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.155091 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.155091 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.155091 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:38.155091 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:38.155091 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. Jun 04 21:14:38.155091 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.157855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 2865f1fb-ef6f-4e9c-883d-3ef6517118f4 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:38.162667 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d3df6ff8-ade5-4a01-8da2-6292ea594070 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4" status: 404 len: 111 microversion: 2.1 time: 0.076308 Jun 04 21:14:38.167568 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2283/4465] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:38 2022] GET /compute/v2.1/servers/2865f1fb-ef6f-4e9c-883d-3ef6517118f4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:38.173997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:38.175718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.176629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.182538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-027d1e5c-a123-4910-b60b-d11047667b26 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.460046 Jun 04 21:14:38.185957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.186668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.188441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.189225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.192482 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2183/4466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:37 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:38.212277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b HTTP/1.1 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '02ab285f-4deb-4bf0-8d88-36599a0d805b'} Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:38.214497 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.218394 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.222198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:38.223299 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-255fe6e0-d271-47fe-9cbb-b4551797b975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 404 len: 111 microversion: 2.1 time: 0.054584 Jun 04 21:14:38.225200 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2284/4467] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:38 2022] DELETE /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:38.236327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.237606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 02ab285f-4deb-4bf0-8d88-36599a0d805b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.248054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.249234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.250149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.250689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.281755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b HTTP/1.1 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '02ab285f-4deb-4bf0-8d88-36599a0d805b'} Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.302408 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.307399 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.307399 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.307399 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:38.307399 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:38.307399 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. Jun 04 21:14:38.307399 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.308777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 02ab285f-4deb-4bf0-8d88-36599a0d805b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:38.316904 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8084f358-901d-4740-8cfe-8af0a6a36975 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b" status: 404 len: 111 microversion: 2.1 time: 0.087032 Jun 04 21:14:38.317979 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2184/4468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:38 2022] GET /compute/v2.1/servers/02ab285f-4deb-4bf0-8d88-36599a0d805b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:14:38.330348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e47f9e62-3a75-4eab-b5eb-01343a7e416b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.331216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e47f9e62-3a75-4eab-b5eb-01343a7e416b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 03097097-e8ad-4ef1-89bc-053132330a24] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.343827 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e47f9e62-3a75-4eab-b5eb-01343a7e416b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e47f9e62-3a75-4eab-b5eb-01343a7e416b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 HTTP/1.1 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '03097097-e8ad-4ef1-89bc-053132330a24'} Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.345813 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.350241 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.351807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e47f9e62-3a75-4eab-b5eb-01343a7e416b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:38.352838 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e47f9e62-3a75-4eab-b5eb-01343a7e416b tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24" status: 404 len: 111 microversion: 2.1 time: 0.030143 Jun 04 21:14:38.356845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2285/4469] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:38 2022] DELETE /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:38.373732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99e3e34e-2b08-44ce-8051-aa58de6b5a22 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.375049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-99e3e34e-2b08-44ce-8051-aa58de6b5a22 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 03097097-e8ad-4ef1-89bc-053132330a24] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.383172 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-99e3e34e-2b08-44ce-8051-aa58de6b5a22 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99e3e34e-2b08-44ce-8051-aa58de6b5a22 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 HTTP/1.1 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '03097097-e8ad-4ef1-89bc-053132330a24'} Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:38.384872 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:38.389770 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:38.389770 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:38.389770 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. Jun 04 21:14:38.389770 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:38.389770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99e3e34e-2b08-44ce-8051-aa58de6b5a22 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 03097097-e8ad-4ef1-89bc-053132330a24 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:38.391746 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-99e3e34e-2b08-44ce-8051-aa58de6b5a22 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24" status: 404 len: 111 microversion: 2.1 time: 0.033542 Jun 04 21:14:38.392613 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2185/4470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:38 2022] GET /compute/v2.1/servers/03097097-e8ad-4ef1-89bc-053132330a24 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:14:38.401810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.402253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.414108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.414518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.415322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.415812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.459160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:14:38.612163 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f85b11bf-0703-4b24-9e61-1bcccf1e512e tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 204 len: 0 microversion: 2.1 time: 0.213776 Jun 04 21:14:38.612863 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2286/4471] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:14:38 2022] DELETE /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:14:38.626410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.628321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.644464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.646752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.649447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.650391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.658073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:38.893055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:38.894030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:38.912871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.913969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:38.916458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:38.917015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:39.091445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:39.105532 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-96ae7e91-1d09-4933-b23b-7f3da56c646a tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1479 microversion: 2.1 time: 0.487837 Jun 04 21:14:39.107361 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2186/4472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:38 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1479 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:39.114122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3ef3b33d-cd93-4423-8ba9-1273ceca7b62 req-cbca7dae-1564-4c33-ad3d-a0955a8761bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-deleted", "tag": "51933103-024f-40de-a3da-309ec20b0d07"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:39.124185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3ef3b33d-cd93-4423-8ba9-1273ceca7b62 req-cbca7dae-1564-4c33-ad3d-a0955a8761bb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:39.124931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3ef3b33d-cd93-4423-8ba9-1273ceca7b62 req-cbca7dae-1564-4c33-ad3d-a0955a8761bb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:39.140652 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3ef3b33d-cd93-4423-8ba9-1273ceca7b62 req-cbca7dae-1564-4c33-ad3d-a0955a8761bb service nova] Creating event network-vif-deleted:51933103-024f-40de-a3da-309ec20b0d07 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:39.149502 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3ef3b33d-cd93-4423-8ba9-1273ceca7b62 req-cbca7dae-1564-4c33-ad3d-a0955a8761bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039921 Jun 04 21:14:39.150828 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2187/4473] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:39.158589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c4f4808d-f810-4515-bb63-290d9457e78c req-758b8b05-5d07-4e0e-b2ed-a0c76149d3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-unplugged", "status": "completed", "tag": "f88009bf-efdf-45e9-a270-b9a8b276b69f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:39.170767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c4f4808d-f810-4515-bb63-290d9457e78c req-758b8b05-5d07-4e0e-b2ed-a0c76149d3c0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:39.171218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c4f4808d-f810-4515-bb63-290d9457e78c req-758b8b05-5d07-4e0e-b2ed-a0c76149d3c0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:39.191266 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c4f4808d-f810-4515-bb63-290d9457e78c req-758b8b05-5d07-4e0e-b2ed-a0c76149d3c0 service nova] Creating event network-vif-unplugged:f88009bf-efdf-45e9-a270-b9a8b276b69f for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:39.200023 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c4f4808d-f810-4515-bb63-290d9457e78c req-758b8b05-5d07-4e0e-b2ed-a0c76149d3c0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046654 Jun 04 21:14:39.201656 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2188/4474] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:39.211120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:39.212809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:39.227814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:39.229065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:39.230206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:39.231148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:39.437365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:39.450751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:39.452022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:39.453316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-77b088d2-8688-47ec-8afa-3234c728327c tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2871 microversion: 2.42 time: 0.570728 Jun 04 21:14:39.463852 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2287/4475] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:38 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2871 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:39.642384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:39.653946 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d0c5d5c1-ab1e-4e36-ba13-51b8ae268acc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.449790 Jun 04 21:14:39.654934 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2189/4476] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:39 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:40.127213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:40.128351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:40.140784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:40.141179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:40.149011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:40.149476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:40.473120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:40.473709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:40.481335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:40.484047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:40.485795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:40.487852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:40.523124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:40.536027 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c27790a5-f961-4e70-a4e0-94b0f720c21d tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1479 microversion: 2.1 time: 0.416199 Jun 04 21:14:40.536617 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2288/4477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:40 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1479 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:40.673545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:40.674459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:40.684066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:40.684679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:40.686349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:40.687103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:41.141264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:41.152314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:41.162041 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4410c6e1-a27f-44a4-9477-6fb26ad389ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.494259 Jun 04 21:14:41.162639 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2289/4478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:40 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:41.165819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:41.170321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:41.172268 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-88300c57-3ba1-464f-8a50-b9b1de5e8909 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2663 microversion: 2.42 time: 0.703302 Jun 04 21:14:41.173330 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2190/4479] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:40 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2663 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:41.238940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-unplugged", "status": "completed", "tag": "f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-unplugged", "status": "completed", "tag": "2be49f23-9dc7-4218-8ae0-35037e1424eb"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-unplugged", "status": "completed", "tag": "611f4ee0-557c-4fa9-a580-d389ba7a7980"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:41.259144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:41.259633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:41.286457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] Creating event network-vif-unplugged:f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:41.286965 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] Creating event network-vif-unplugged:2be49f23-9dc7-4218-8ae0-35037e1424eb for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:41.295144 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] Creating event network-vif-unplugged:611f4ee0-557c-4fa9-a580-d389ba7a7980 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:41.305519 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-9acd1e66-6ed7-4965-826e-4bb84125abff req-fc44d3f9-c5e5-4d0d-8e38-5bf4a9d6a39f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.070946 Jun 04 21:14:41.306535 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2290/4480] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:41.525862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-24031f99-5dcf-49db-9642-ff520e5b910a req-9851fc49-914c-4452-9da3-e95f8be7ddb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-deleted", "tag": "f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-deleted", "tag": "2be49f23-9dc7-4218-8ae0-35037e1424eb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:41.541205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-24031f99-5dcf-49db-9642-ff520e5b910a req-9851fc49-914c-4452-9da3-e95f8be7ddb6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:41.541651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-24031f99-5dcf-49db-9642-ff520e5b910a req-9851fc49-914c-4452-9da3-e95f8be7ddb6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:41.557350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:41.558632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:41.575226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:41.576445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:41.577324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:41.582961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:41.587993 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-24031f99-5dcf-49db-9642-ff520e5b910a req-9851fc49-914c-4452-9da3-e95f8be7ddb6 service nova] Creating event network-vif-deleted:f04fb6ac-3b1b-4b4f-9e7d-1cfcac07647e for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:41.589373 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-24031f99-5dcf-49db-9642-ff520e5b910a req-9851fc49-914c-4452-9da3-e95f8be7ddb6 service nova] Creating event network-vif-deleted:2be49f23-9dc7-4218-8ae0-35037e1424eb for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:41.602888 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-24031f99-5dcf-49db-9642-ff520e5b910a req-9851fc49-914c-4452-9da3-e95f8be7ddb6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078397 Jun 04 21:14:41.604517 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2191/4481] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:41.810624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a7b7c72a80455381b2b9b4ee14eed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173e952f35b465898956477d2facf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:41.822112 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3113be8e-a9c3-4063-ac4e-815a859de306 tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 200 len: 1437 microversion: 2.1 time: 0.272139 Jun 04 21:14:41.822726 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2291/4482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:41 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 1437 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:42.180624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:42.181468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:42.192404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:42.193023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:42.203733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:42.204264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:42.208976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:42.209450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:42.210262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:42.211478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:42.212013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:42.212954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:42.607225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:42.623368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:42.625448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:42.628958 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e148763e-f554-4119-a08f-38d0d948cbf6 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2391 microversion: 2.42 time: 0.440068 Jun 04 21:14:42.630308 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2292/4483] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:42 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2391 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:42.650066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:42.669884 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd6d24f6-9231-4d96-a9e4-3c369935b688 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.493945 Jun 04 21:14:42.683763 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2192/4484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:42 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:42.845381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:42.846902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] [instance: 2e71dd12-8076-4390-a7f1-2c13462a8d7a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:42.864635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:42.865395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:42.871808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:42.876743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:42.914035 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] HTTP exception thrown: Instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a could not be found. Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Request method failure captured: Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a HTTP/1.1 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pdgU46kuUDJWwjK4DlSn2HEgs6yVgYdWE38X5LlHPhk69jbr195uQbQN4wtqi9f-6ILuvSD1pEVlO_Uk72IkBU8CbxItcBA51OcZVbEfUDroTe0X67A1KDI5PZVnE38-QoNrZR9R3aTPgKJOTBe5_wieL9-CJxBrNqEH8Pswhm0qE Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_e173e952f35b465898956477d2facf0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/e173e952f35b465898956477d2facf0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/e173e952f35b465898956477d2facf0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersTestJSON-1774952578 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: e173e952f35b465898956477d2facf0e Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersTestJSON-1774952578 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c3a7b7c72a80455381b2b9b4ee14eed3 Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersTestJSON-1774952578-project Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a could not be found. Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '2e71dd12-8076-4390-a7f1-2c13462a8d7a'} Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a could not be found. Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a could not be found. Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:42.916282 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:42.920609 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:42.920609 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:42.920609 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:42.920609 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:42.920609 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a could not be found. Jun 04 21:14:42.920609 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:42.925579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] Returning 404 to user: Instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:42.926756 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-36489b63-0ae6-4871-8343-844e7e53e85f tempest-ServersTestJSON-1774952578 tempest-ServersTestJSON-1774952578-project] 10.222.0.18 "GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a" status: 404 len: 111 microversion: 2.1 time: 0.091961 Jun 04 21:14:42.928860 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2293/4485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:42 2022] GET /compute/v2.1/servers/2e71dd12-8076-4390-a7f1-2c13462a8d7a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:14:43.625126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a7b05d47-6e81-43c4-b410-f75e61c6f8c5 req-511d4ce4-5269-49ab-85c6-b9b7f081dbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e71dd12-8076-4390-a7f1-2c13462a8d7a", "name": "network-vif-deleted", "tag": "629bffce-5ebc-4480-b299-58359eaaea52"}, {"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-deleted", "tag": "f88009bf-efdf-45e9-a270-b9a8b276b69f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:43.649791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a7b05d47-6e81-43c4-b410-f75e61c6f8c5 req-511d4ce4-5269-49ab-85c6-b9b7f081dbf4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:43.650024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a7b05d47-6e81-43c4-b410-f75e61c6f8c5 req-511d4ce4-5269-49ab-85c6-b9b7f081dbf4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:43.652182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:43.655382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:43.700188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:43.700836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:43.705901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:43.706451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:43.723720 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a7b05d47-6e81-43c4-b410-f75e61c6f8c5 req-511d4ce4-5269-49ab-85c6-b9b7f081dbf4 service nova] Creating event network-vif-deleted:629bffce-5ebc-4480-b299-58359eaaea52 for instance 2e71dd12-8076-4390-a7f1-2c13462a8d7a on nch2-master-1 Jun 04 21:14:43.724313 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a7b05d47-6e81-43c4-b410-f75e61c6f8c5 req-511d4ce4-5269-49ab-85c6-b9b7f081dbf4 service nova] Creating event network-vif-deleted:f88009bf-efdf-45e9-a270-b9a8b276b69f for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:43.746812 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a7b05d47-6e81-43c4-b410-f75e61c6f8c5 req-511d4ce4-5269-49ab-85c6-b9b7f081dbf4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.126877 Jun 04 21:14:43.747630 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2193/4486] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:14:43.754918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:43.756029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:43.764110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:43.764842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:43.765770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:43.766426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:44.015768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:44.041964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:44.044783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:44.046433 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a75c6b7-e7d6-48d8-93f8-15a0ff48c081 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 2276 microversion: 2.42 time: 0.400662 Jun 04 21:14:44.061816 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2294/4487] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:43 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 2276 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:14:44.270275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:44.282812 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7efdc38-ebaa-4e87-9256-5eff0c7c5687 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.529490 Jun 04 21:14:44.287832 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2194/4488] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:43 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:45.069071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:45.071344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:45.084478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:45.087126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:45.089899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:45.092530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:45.244106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:45.258462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:45.262197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33de20254305474aa55173591da1b6a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a41aa195bb047cfae9f16c5e29050cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:45.264736 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f49e4dca-c1ec-40a1-b280-2ad2f26b8a49 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 200 len: 1603 microversion: 2.42 time: 0.201375 Jun 04 21:14:45.267290 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2295/4489] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:45 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 1603 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:14:45.301315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:45.301939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:45.312887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:45.313822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:45.314917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:45.315784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:45.801624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cd1155fe-201a-456e-8011-dd9dd09f0916 req-133d53a0-d77a-4209-ab1b-d8399202a94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c39634-8689-4588-8006-03485c7e291c", "name": "network-vif-deleted", "tag": "611f4ee0-557c-4fa9-a580-d389ba7a7980"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:45.813006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd1155fe-201a-456e-8011-dd9dd09f0916 req-133d53a0-d77a-4209-ab1b-d8399202a94b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:45.814506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cd1155fe-201a-456e-8011-dd9dd09f0916 req-133d53a0-d77a-4209-ab1b-d8399202a94b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:45.832137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cd1155fe-201a-456e-8011-dd9dd09f0916 req-133d53a0-d77a-4209-ab1b-d8399202a94b service nova] Creating event network-vif-deleted:611f4ee0-557c-4fa9-a580-d389ba7a7980 for instance 66c39634-8689-4588-8006-03485c7e291c on nch1-master-1 Jun 04 21:14:45.841046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:45.854359 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cd1155fe-201a-456e-8011-dd9dd09f0916 req-133d53a0-d77a-4209-ab1b-d8399202a94b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054623 Jun 04 21:14:45.854873 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97468f1b-659e-458f-8b33-d3722271e0e3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.557008 Jun 04 21:14:45.859021 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2195/4491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:45 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:45.859366 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2296/4491] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:14:46.286345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:46.287288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:46.293750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:46.295168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:46.296267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:46.296855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:46.313550 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] HTTP exception thrown: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Request method failure captured: Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c HTTP/1.1 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8nJNctAlziFM9p17uXx3a3dmvQr6-P9TwOPqm5w5vFVYMyGDAhGzyOCsZHHZsUwPcymIqDIiT-RdmAX6Zn1LmFZmN0bgsrrNxHJuNS7bei8WFVjVvZGPlDBlZqwi9GyOR7yZ5ToE8tScQ9slzCPG_JbBMlG-dWFKd7OVgh7iLARjM4 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.42 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 3a41aa195bb047cfae9f16c5e29050cc Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 3a41aa195bb047cfae9f16c5e29050cc Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TaggedBootDevicesTest_v242-575962399-project Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 33de20254305474aa55173591da1b6a6 Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TaggedBootDevicesTest_v242-575962399-project Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '66c39634-8689-4588-8006-03485c7e291c'} Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:46.316158 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Returning 404 to user: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:46.321169 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b1038c57-a6ec-49a0-a60c-6dd1e34d5952 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 404 len: 111 microversion: 2.42 time: 0.035691 Jun 04 21:14:46.328677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2771e0bf-e98d-431f-a7ce-f96ede78e679 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '.version_select at 0x7f2d00d9ce50>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:46.333405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2196/4492] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:46 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:14:46.351753 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2771e0bf-e98d-431f-a7ce-f96ede78e679 tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459859254" status: 204 len: 0 microversion: 2.42 time: 0.028018 Jun 04 21:14:46.372149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2297/4493] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Jun 4 21:14:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459859254 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:14:46.876313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:46.877513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:46.885603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:46.886088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:46.888342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:46.889109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:47.348906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:47.369414 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5db84b8e-7186-489e-b6d6-876da2a1fbfe tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1658 microversion: 2.1 time: 0.498019 Jun 04 21:14:47.370005 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2197/4494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:46 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1658 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:47.389241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3fa66ff-8f89-43f8-9840-95eb77ecd298 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:47.393813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:47.422606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3fa66ff-8f89-43f8-9840-95eb77ecd298 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:47.427050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3fa66ff-8f89-43f8-9840-95eb77ecd298 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:47.505263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e3fa66ff-8f89-43f8-9840-95eb77ecd298 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Going to try to start instance {{(pid=137228) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:14:47.570924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:47.620327 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3fa66ff-8f89-43f8-9840-95eb77ecd298 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.234061 Jun 04 21:14:47.648998 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2298/4495] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:47 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:47.652557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:47.653462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:47.660655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:47.661582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:47.662664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:47.663182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:48.384494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:48.393917 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e10014b-f1ac-457e-90d9-58a3dfd50010 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1667 microversion: 2.1 time: 0.745075 Jun 04 21:14:48.394516 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2198/4496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:47 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1667 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:49.418046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:49.419314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:49.427272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:49.428065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:49.429588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:49.430194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:49.906421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:49.918379 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e7fd9018-981b-49d0-8a8a-50d538a8b26a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1667 microversion: 2.1 time: 0.510390 Jun 04 21:14:49.921665 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2299/4497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:49 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1667 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:50.163468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-861418048", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "cbb8604a-af59-42db-b06b-8d924357b0b3"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:50.286592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] validate_networks() for [('cbb8604a-af59-42db-b06b-8d924357b0b3', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:14:50.939579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:50.940340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:50.956405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:50.961462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:50.962672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:50.963326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:51.533412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:14:51.537886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:51.544962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:14:51.545493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:14:51.545919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:14:51.548989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:14:51.561773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f797e0d-0bfe-43c6-a0dd-90231147e204 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.627029 Jun 04 21:14:51.571962 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2300/4498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:50 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:51.576470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:51.577405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:51.578224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:51.578818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:51.591961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:51.592602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:51.614232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:51.614686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:51.615478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:51.615947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:51.627754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Getting quotas for project c7a8c28e867e4f068eda630b49aa76f1. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:14:51.636985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Getting quotas for user e3dd0290b6e94050919656b761898ffb and project c7a8c28e867e4f068eda630b49aa76f1. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:14:51.657423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:14:51.663544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:14:51.742833 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a9645e4-9e23-4355-b03f-ee8758779c9d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.583963 Jun 04 21:14:51.744241 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2199/4499] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:14:51.758384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c40a223-c146-4deb-903c-07baca918a5a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:51.759451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c40a223-c146-4deb-903c-07baca918a5a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:52.338788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c40a223-c146-4deb-903c-07baca918a5a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:52.347082 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c40a223-c146-4deb-903c-07baca918a5a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1213 microversion: 2.1 time: 0.593695 Jun 04 21:14:52.359652 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2200/4500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:51 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1213 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:52.522243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:52.536710 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5771ead4-e0d9-4957-a10a-568abbdbceea tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.956246 Jun 04 21:14:52.540357 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2301/4501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:51 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:52.556672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:52.557423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:52.572197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:52.572658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:52.573457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:52.573993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:52.680874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Unlocking {{(pid=137229) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 04 21:14:52.791919 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d620c112-f785-40a2-b614-6879e1c447fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.239038 Jun 04 21:14:52.819493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:52.819834 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2201/4502] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:52 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:52.820426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:52.828592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:52.829565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:52.831298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:52.834283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:53.385526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:53.386222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:53.401943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:53.402567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:53.403709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:53.404385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:53.443624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:53.466765 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-003ae659-42d2-4ab9-82ae-784579f287a0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.657170 Jun 04 21:14:53.467398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2302/4503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:52 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:53.486151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:53.487727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:53.498359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:53.498726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:53.499606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:53.499989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:53.632994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:53.646156 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d71d2af0-4285-4552-a01b-9b9380b3b225 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1265 microversion: 2.1 time: 0.264555 Jun 04 21:14:53.648363 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2202/4504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:53 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:14:53.896372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:53.925266 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3cc7b51f-2edb-4eb2-a59a-8a1792bf04ce tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.440076 Jun 04 21:14:53.930400 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2303/4505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:53 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:53.948580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:53.956125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:53.964427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:53.966809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:53.974130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:53.974900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.076755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:54.077623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:54.097421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.101822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.102812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.103250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.163352 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] HTTP exception thrown: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Request method failure captured: Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c HTTP/1.1 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8nJNctAlziFM9p17uXx3a3dmvQr6-P9TwOPqm5w5vFVYMyGDAhGzyOCsZHHZsUwPcymIqDIiT-RdmAX6Zn1LmFZmN0bgsrrNxHJuNS7bei8WFVjVvZGPlDBlZqwi9GyOR7yZ5ToE8tScQ9slzCPG_JbBMlG-dWFKd7OVgh7iLARjM4 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.42 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 3a41aa195bb047cfae9f16c5e29050cc Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 3a41aa195bb047cfae9f16c5e29050cc Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TaggedBootDevicesTest_v242-575962399-project Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 33de20254305474aa55173591da1b6a6 Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TaggedBootDevicesTest_v242-575962399-project Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '66c39634-8689-4588-8006-03485c7e291c'} Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:54.166682 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.172360 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.178757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Returning 404 to user: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:54.179987 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5eec4ac6-d828-4c2c-ad28-e56582bf559e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "DELETE /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 404 len: 111 microversion: 2.42 time: 0.111420 Jun 04 21:14:54.186993 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2304/4506] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:14:54 2022] DELETE /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:14:54.204251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:54.206331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] [instance: 66c39634-8689-4588-8006-03485c7e291c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:54.229862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.230327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.233485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.234598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.296397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] HTTP exception thrown: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Request method failure captured: Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c HTTP/1.1 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8nJNctAlziFM9p17uXx3a3dmvQr6-P9TwOPqm5w5vFVYMyGDAhGzyOCsZHHZsUwPcymIqDIiT-RdmAX6Zn1LmFZmN0bgsrrNxHJuNS7bei8WFVjVvZGPlDBlZqwi9GyOR7yZ5ToE8tScQ9slzCPG_JbBMlG-dWFKd7OVgh7iLARjM4 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.42 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 3a41aa195bb047cfae9f16c5e29050cc Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3a41aa195bb047cfae9f16c5e29050cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 3a41aa195bb047cfae9f16c5e29050cc Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-575962399 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TaggedBootDevicesTest_v242-575962399-project Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 33de20254305474aa55173591da1b6a6 Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TaggedBootDevicesTest_v242-575962399-project Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '66c39634-8689-4588-8006-03485c7e291c'} Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.312328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. Jun 04 21:14:54.322645 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:14:54.324796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] Returning 404 to user: Instance 66c39634-8689-4588-8006-03485c7e291c could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:14:54.327092 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fccec8ab-64e0-43d8-94a5-bda3c34eb25e tempest-TaggedBootDevicesTest_v242-575962399 tempest-TaggedBootDevicesTest_v242-575962399-project] 10.222.0.18 "GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c" status: 404 len: 111 microversion: 2.42 time: 0.133400 Jun 04 21:14:54.329073 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2305/4507] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:14:54 2022] GET /compute/v2.1/servers/66c39634-8689-4588-8006-03485c7e291c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:14:54.370140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:54.401904 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c516dab1-e5a7-4a69-ade0-8fcbb67d93fd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.454385 Jun 04 21:14:54.407540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2203/4508] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:53 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:54.426946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:54.430035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:54.448053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:54.450801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.451270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.454048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.459626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.613532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:14:54.640162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-424761445", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "63b8fcd1-63d3-4680-aec4-c7635e90835c"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:54.674574 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9eabfb76-77c9-46f1-a64f-0d1bc5f825b8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.255794 Jun 04 21:14:54.679780 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2204/4509] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:54 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:54.688521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:54.689448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:54.712613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.713421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.714856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.715775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.733035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] validate_networks() for [('63b8fcd1-63d3-4680-aec4-c7635e90835c', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:14:54.860776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:54.886124 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cca63bfb-44fd-4116-8e34-094d61debb3c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1271 microversion: 2.1 time: 0.200597 Jun 04 21:14:54.886848 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2205/4510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:54 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:54.895053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:54.899314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:54.915683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.918302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:54.919314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:54.920987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:55.251658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:55.266218 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23860dbc-832a-4a6a-b531-8c82328d92b1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1676 microversion: 2.1 time: 0.377879 Jun 04 21:14:55.267427 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2206/4511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:54 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1676 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:55.469845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:14:55.470385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:14:55.470781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:14:55.471378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:14:55.472012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:14:55.482352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:55.483229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:55.484875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:55.485492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:55.508474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Getting quotas for project 9be828d223874d6cbb4e57118acabfa4. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:14:55.516206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Getting quotas for user c8800a39664542548c4118863e1db800 and project 9be828d223874d6cbb4e57118acabfa4. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:14:55.536604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:14:55.539779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:14:55.609959 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a911a950-1ca7-4457-8caf-8847936917fd tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278868 Jun 04 21:14:55.618291 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2306/4512] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:14:55.623108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1a19b64-3da2-4635-b329-b2e1fbc8191c tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:55.623727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a1a19b64-3da2-4635-b329-b2e1fbc8191c tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:55.786368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a1a19b64-3da2-4635-b329-b2e1fbc8191c tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:55.798425 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1a19b64-3da2-4635-b329-b2e1fbc8191c tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1227 microversion: 2.1 time: 0.174386 Jun 04 21:14:55.799426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2207/4513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:55 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1227 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:55.905555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:55.906623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:55.930405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:55.931162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:55.932486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:55.932841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.047475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:56.056765 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7635bd3c-b2fe-4361-be62-f4d216f28d1e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1271 microversion: 2.1 time: 0.155508 Jun 04 21:14:56.058196 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2307/4514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:55 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:56.286489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:56.287047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:56.297171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.298144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.299740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.300365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.482385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:56.497488 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bcf96c9c-5ce4-4cca-9ff5-6b7d3995d43a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1656 microversion: 2.1 time: 0.215827 Jun 04 21:14:56.498917 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2208/4515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:56 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1656 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:56.519041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:14:56.520293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:56.528823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.529527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.530515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.531108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.644255 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60fa40a5-50d5-4035-af1e-3b4a5625f88c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.130816 Jun 04 21:14:56.645057 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2308/4516] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:14:56 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:14:56.654411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:56.655706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:56.665670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.666592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.667623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.668449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.819665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:56.820389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:56.837844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.838315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.839138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:56.839606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:56.879822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:56.893162 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e210db89-d830-453d-9da2-50637d33c2fb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1663 microversion: 2.1 time: 0.242871 Jun 04 21:14:56.903947 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2209/4517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:56 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1663 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:56.932218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:56.950112 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db611ed4-d319-406d-8e47-c6031a980796 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1279 microversion: 2.1 time: 0.134705 Jun 04 21:14:56.951354 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2309/4518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:56 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:57.082235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:57.083821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:57.097211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:57.098017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:57.127785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:57.128262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:57.754608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:57.765997 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-92cc7055-7bb5-41c2-b9a3-f7ccb3526178 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.689264 Jun 04 21:14:57.770534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2210/4519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:57 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:57.915035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:57.916932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:57.929906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:57.931476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:57.933964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:57.933964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:57.971031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:57.972461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:57.983483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:57.984918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:57.986544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:57.987897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:58.195458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:58.209460 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7e5773f1-22c3-468a-9663-02cbe469eac7 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1285 microversion: 2.1 time: 0.243451 Jun 04 21:14:58.211312 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2211/4520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:57 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:58.463948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:58.480313 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd0e9ac7-6e90-48a2-833b-07adb50f9554 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.572692 Jun 04 21:14:58.491870 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2310/4521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:57 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:58.497799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:58.498740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:58.511047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:58.515081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:58.516403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:58.517113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:58.788542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:58.790187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:58.797569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:58.798393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:58.799384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:58.800014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:59.633849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:14:59.649808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da4068dc-c847-47df-942d-61d6594ec471 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 1.156003 Jun 04 21:14:59.650761 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2212/4522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:58 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:14:59.655861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:14:59.656484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:14:59.684351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:59.684861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:59.685606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:14:59.695963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:14:59.983768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:00.004378 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1623ac85-43aa-4b00-94e4-124753e44cf1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 1.219577 Jun 04 21:15:00.014089 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2311/4523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:58 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:00.019105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e1d16130-b07f-4beb-98f4-5e4ebf61e84a req-7622bfd0-20f3-422b-a932-038f35852acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc1f6287-1945-4ac2-889e-a7ee705a91fa", "tag": "9e8360bb-6134-463c-a3cb-04820e8fcfc8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:00.037488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e1d16130-b07f-4beb-98f4-5e4ebf61e84a req-7622bfd0-20f3-422b-a932-038f35852acd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:00.038638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e1d16130-b07f-4beb-98f4-5e4ebf61e84a req-7622bfd0-20f3-422b-a932-038f35852acd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:00.058849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:00.068888 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e391cd9d-51cd-4ab0-9c9c-7443fcf5f106 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1285 microversion: 2.1 time: 0.416823 Jun 04 21:15:00.084788 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2213/4524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:14:59 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1285 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:00.098143 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e1d16130-b07f-4beb-98f4-5e4ebf61e84a req-7622bfd0-20f3-422b-a932-038f35852acd service nova] Creating event network-changed:9e8360bb-6134-463c-a3cb-04820e8fcfc8 for instance bc1f6287-1945-4ac2-889e-a7ee705a91fa on nch1-master-1 Jun 04 21:15:00.099691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:00.100570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:00.108187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:00.109039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:00.110370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:00.111604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:00.114984 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e1d16130-b07f-4beb-98f4-5e4ebf61e84a req-7622bfd0-20f3-422b-a932-038f35852acd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106499 Jun 04 21:15:00.118441 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2312/4525] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:00.618345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:00.634170 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ee33437a-9a0b-4f84-bd6a-b6dc6f94bacd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.541194 Jun 04 21:15:00.636413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2214/4526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:00 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:00.654742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:00.656010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:00.670175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:00.670815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:00.671423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:00.676051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.012828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:01.023630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:01.024627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:01.036358 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-628a8d8c-0369-429f-894b-55673a70e4a6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.386485 Jun 04 21:15:01.037518 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2313/4527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:00 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:01.048315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.048315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.048315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.048315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.057165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:01.058220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:01.070622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.084764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.086028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.086693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.391948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:01.404080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:01.410710 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc79b234-9bd8-4592-a8b5-fd2cf06882f2 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.392025 Jun 04 21:15:01.412708 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2215/4528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:01 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:01.417616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e70ae112-9d42-4b42-9384-1610d00174c7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.366615 Jun 04 21:15:01.418301 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2314/4529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:01 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:01.427184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:01.427971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:01.438448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.439460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.440295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.440735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.445827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:01.446448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:01.463047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.466288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.469978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:01.470592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:01.608213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:01.819408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:01.830851 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b745e836-51fb-4a4d-ac3c-a7514ef9b160 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.416449 Jun 04 21:15:01.843734 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2216/4530] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:01 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:01.905422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:01.951963 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-168b88db-556c-4515-a4f6-5e9c9db934c3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.510152 Jun 04 21:15:01.955923 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2315/4531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:01 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:02.430245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:02.430885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:02.444980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:02.445785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:02.446813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:02.449461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:02.806246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:02.828269 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8cef0fe4-8c3d-4680-b79c-7edca1140418 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.402593 Jun 04 21:15:02.839731 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2217/4532] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:02 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:02.850215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:02.851589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:02.865055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:02.865684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:02.866788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:02.867204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:02.876639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:03.161942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:03.178748 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-af7febe6-0fbb-469d-be64-187b9ce690c2 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.332338 Jun 04 21:15:03.180559 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2316/4533] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:02 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:03.267265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fe8f5c30-9710-48a0-9508-4bb7155c07ae req-e28a3fb8-a397-4286-95b0-29cb8dc08f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81467b08-0e62-4963-89d9-062a0d2b101e", "tag": "981513af-f085-4cc4-9d2a-c53860aa3cb0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:03.284686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe8f5c30-9710-48a0-9508-4bb7155c07ae req-e28a3fb8-a397-4286-95b0-29cb8dc08f12 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:03.285909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe8f5c30-9710-48a0-9508-4bb7155c07ae req-e28a3fb8-a397-4286-95b0-29cb8dc08f12 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:03.341227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fe8f5c30-9710-48a0-9508-4bb7155c07ae req-e28a3fb8-a397-4286-95b0-29cb8dc08f12 service nova] Creating event network-changed:981513af-f085-4cc4-9d2a-c53860aa3cb0 for instance 81467b08-0e62-4963-89d9-062a0d2b101e on nch1-master-1 Jun 04 21:15:03.354367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fe8f5c30-9710-48a0-9508-4bb7155c07ae req-e28a3fb8-a397-4286-95b0-29cb8dc08f12 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096014 Jun 04 21:15:03.360834 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2218/4534] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:03.849103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:03.849664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:03.871594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:03.873114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:03.891648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:03.892518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:04.199304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:04.200733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:04.214876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:04.220447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:04.226579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:04.227245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:04.786358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:04.804852 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eda6c51f-8fba-4347-8e65-7327f3c1b007 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.611059 Jun 04 21:15:04.815027 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2219/4535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:04 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:04.881077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:04.895981 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f63db109-5c80-4fa1-b1d1-e0d4d6ae67fc tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 1.051192 Jun 04 21:15:04.897291 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2317/4536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:03 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:05.826395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:05.830251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:05.838778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:05.877997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:05.878957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:05.880902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:05.884097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:05.926175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:05.927187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:05.948890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:05.949710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:05.952208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:05.953019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:05.954710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:05.955406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:06.571781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:06.583825 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d0664642-4571-42e0-b33a-92da4940039f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.671043 Jun 04 21:15:06.587117 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2318/4537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:05 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:06.665288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:06.674999 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a06d875b-6e7b-4a26-a727-d4ddb6f08b46 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.855125 Jun 04 21:15:06.675743 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2220/4538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:05 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:07.610626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:07.613045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:07.651134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:07.654558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:07.659392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:07.663846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:07.704146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:07.704913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:07.726221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:07.738605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:07.739944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:07.740611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:08.346894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:08.390707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cfda5e87-5918-4686-8880-64169754400d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.787313 Jun 04 21:15:08.394158 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2319/4539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:07 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:08.453948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:08.463700 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6530f78-1112-465a-9f80-6c72ccefab8f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.764823 Jun 04 21:15:08.464896 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2221/4540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:07 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:09.413465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:09.414160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:09.443404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:09.443959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:09.444956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:09.445337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1a94da63-229e-4ab6-b0e9-4b1a50072556 req-528eb4e0-c65b-460f-aaa8-506bcc18716d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1f6287-1945-4ac2-889e-a7ee705a91fa", "name": "network-vif-plugged", "status": "completed", "tag": "9e8360bb-6134-463c-a3cb-04820e8fcfc8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:09.452743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:09.481119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1a94da63-229e-4ab6-b0e9-4b1a50072556 req-528eb4e0-c65b-460f-aaa8-506bcc18716d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:09.484616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1a94da63-229e-4ab6-b0e9-4b1a50072556 req-528eb4e0-c65b-460f-aaa8-506bcc18716d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:09.539399 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1a94da63-229e-4ab6-b0e9-4b1a50072556 req-528eb4e0-c65b-460f-aaa8-506bcc18716d service nova] Creating event network-vif-plugged:9e8360bb-6134-463c-a3cb-04820e8fcfc8 for instance bc1f6287-1945-4ac2-889e-a7ee705a91fa on nch1-master-1 Jun 04 21:15:09.557786 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1a94da63-229e-4ab6-b0e9-4b1a50072556 req-528eb4e0-c65b-460f-aaa8-506bcc18716d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119404 Jun 04 21:15:09.558931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2222/4541] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:15:09.572021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:09.574654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:09.590023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:09.590481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:09.591309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:09.591770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:09.631440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:10.080322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:10.092526 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dadd9103-4250-405e-92ba-7c25f2634794 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.684010 Jun 04 21:15:10.108462 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2320/4542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:09 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:10.287776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:10.300571 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-33c33661-7786-4cfb-bfd9-1d48125ed8e4 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.739682 Jun 04 21:15:10.301504 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2223/4543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:09 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:11.115256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:11.115974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:11.133940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:11.134492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:11.137059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:11.137630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:11.319077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:11.320446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:11.338535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:11.338985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:11.339825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:11.340249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:11.954942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:11.964988 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d106f12e-2c51-46cd-b234-344802a47e57 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1313 microversion: 2.1 time: 0.856167 Jun 04 21:15:11.971940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2321/4544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:11 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1313 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:11.987858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0d4590e1-6741-4301-83b1-d11126b67a2a req-beef448b-e737-41a9-b1e8-5dfdc115c2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81467b08-0e62-4963-89d9-062a0d2b101e", "name": "network-vif-plugged", "status": "completed", "tag": "981513af-f085-4cc4-9d2a-c53860aa3cb0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:12.017586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0d4590e1-6741-4301-83b1-d11126b67a2a req-beef448b-e737-41a9-b1e8-5dfdc115c2f1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:12.019550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0d4590e1-6741-4301-83b1-d11126b67a2a req-beef448b-e737-41a9-b1e8-5dfdc115c2f1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:12.052258 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0d4590e1-6741-4301-83b1-d11126b67a2a req-beef448b-e737-41a9-b1e8-5dfdc115c2f1 service nova] Creating event network-vif-plugged:981513af-f085-4cc4-9d2a-c53860aa3cb0 for instance 81467b08-0e62-4963-89d9-062a0d2b101e on nch1-master-1 Jun 04 21:15:12.066694 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0d4590e1-6741-4301-83b1-d11126b67a2a req-beef448b-e737-41a9-b1e8-5dfdc115c2f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089385 Jun 04 21:15:12.067575 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2322/4545] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:12.187169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:12.216046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da5bd492-cf7b-4ea9-8b9b-0c919bf06c2f tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.901322 Jun 04 21:15:12.220008 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2224/4546] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:11 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:12.990859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:12.991690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:13.011779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:13.012489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:13.013526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:13.017393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:13.240763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:13.242105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:13.254289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:13.255312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:13.257303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:13.258038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:13.308163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:13.317245 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7831aff5-8688-4559-9e2d-45b1c6a6d6ba tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1496 microversion: 2.1 time: 0.332195 Jun 04 21:15:13.319900 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2323/4547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:12 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1496 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:13.742994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:13.751563 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d8b3e9a5-f5ac-414b-8162-2bb6f554c4a6 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1327 microversion: 2.1 time: 0.516090 Jun 04 21:15:13.765183 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2225/4548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:13 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1327 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:13.982414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:13.982933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:14.001684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:14.002453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:14.004873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:14.005512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:14.058702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:15:14.238160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1a5c587-9740-4d8e-b624-2049b90b83ce tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 204 len: 0 microversion: 2.1 time: 0.259285 Jun 04 21:15:14.243417 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2324/4549] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:13 2022] DELETE /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:14.249004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:14.249612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:14.265810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:14.266308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:14.267215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:14.267688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:14.629918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:14.642669 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-372f8f5b-aacd-4b9d-ac20-b140a741c6d1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1502 microversion: 2.1 time: 0.398892 Jun 04 21:15:14.653232 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2226/4550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:14 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:14.776878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:14.777814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:14.791182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:14.791685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:14.794063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:14.794516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.102402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:15.116130 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-559ceb7a-ca42-4565-883c-957ca51d7590 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1526 microversion: 2.1 time: 0.344607 Jun 04 21:15:15.118827 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2325/4551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:14 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1526 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:15.136946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:15.139742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:15.167759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:15.171120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.179851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:15.180613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.543440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:15.557163 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-353b2ef0-8dec-4094-956b-e36c71396871 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1526 microversion: 2.1 time: 0.427744 Jun 04 21:15:15.572654 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2227/4552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:15 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1526 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:15.677648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:15.678676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:15.689100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:15.689937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.690943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:15.691706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.945471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:15.946248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:15.955787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:15.956599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.957571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:15.958254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:15.978923 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] HTTP exception thrown: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Request method failure captured: Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e HTTP/1.1 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8tNt63bzTevylQ0bf67A90C6WKvCT6U3RpLvDOY94Hk02g_GdF3CRb3ND_9JAyfuCsR7ysdK_uN6Q0YL-297D6jAU-zJ0ejINz2SjNY-Ji6fuBoQKZ-v1llemTBxcqwG77r4R7gpBJ6xal0HUg9QaktpuGxAlobM6dPQs9c7BeKrEI Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6ec02a566ee846e29f1a7db17d54880e Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1337455292 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1337455292 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6ec02a566ee846e29f1a7db17d54880e Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1337455292 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1337455292-project Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 616c8321fb1b474abadcc0260311f455 Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1337455292-project Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '81467b08-0e62-4963-89d9-062a0d2b101e'} Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:15.981782 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:15.987032 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:15.989936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Returning 404 to user: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:15.998109 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-928dbb86-2dd4-49a5-ae7c-39691fdc5379 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] 10.222.0.18 "DELETE /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 404 len: 111 microversion: 2.1 time: 0.418436 Jun 04 21:15:16.000506 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2326/4553] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:15 2022] DELETE /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 111 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:15:16.114974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9b6fa4b8-b6ae-47ae-a21c-5ffe97c847c4 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:16.116787 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:15:16.116787 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:15:16.119538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6fa4b8-b6ae-47ae-a21c-5ffe97c847c4 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.121161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6fa4b8-b6ae-47ae-a21c-5ffe97c847c4 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.122321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6fa4b8-b6ae-47ae-a21c-5ffe97c847c4 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.126536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9b6fa4b8-b6ae-47ae-a21c-5ffe97c847c4 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.180363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:16.196374 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9b6fa4b8-b6ae-47ae-a21c-5ffe97c847c4 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.192510 Jun 04 21:15:16.197594 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-37592c08-feae-4f85-b604-9d174134351f tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1502 microversion: 2.1 time: 0.530415 Jun 04 21:15:16.199100 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2327/4554] 10.222.0.18 () {58 vars in 1184 bytes} [Sat Jun 4 21:15:16 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:16.200028 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2228/4555] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:15 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1502 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:16.206587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:16.208105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:16.218684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.219476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.220665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.221347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.445881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1218083752", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "e270b678-3758-442a-88c0-ba52b7c022fe"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:16.489439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:16.501888 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb2ce742-8d95-4eec-85a7-fbd0bb70a7ea tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1526 microversion: 2.1 time: 0.297020 Jun 04 21:15:16.516470 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2328/4556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:16 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1526 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:16.521965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Action: 'update', calling method: >, body: {"server": {"name": "81467b08-0e62-4963-89d9-062a0d2b101e_new"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:16.523437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:16.544516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.546236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.548813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.551357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.581017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] HTTP exception thrown: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Request method failure captured: Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: request: PUT /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e HTTP/1.1 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 64 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8tNt63bzTevylQ0bf67A90C6WKvCT6U3RpLvDOY94Hk02g_GdF3CRb3ND_9JAyfuCsR7ysdK_uN6Q0YL-297D6jAU-zJ0ejINz2SjNY-Ji6fuBoQKZ-v1llemTBxcqwG77r4R7gpBJ6xal0HUg9QaktpuGxAlobM6dPQs9c7BeKrEI Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6ec02a566ee846e29f1a7db17d54880e Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1337455292 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ec02a566ee846e29f1a7db17d54880e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1337455292 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6ec02a566ee846e29f1a7db17d54880e Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1337455292 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1337455292-project Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 616c8321fb1b474abadcc0260311f455 Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1337455292-project Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: {"server": {"name": "81467b08-0e62-4963-89d9-062a0d2b101e_new"}} Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '81467b08-0e62-4963-89d9-062a0d2b101e', 'body': {'server': {'name': '81467b08-0e62-4963-89d9-062a0d2b101e_new'}}} Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 04 21:15:16.592515 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:16.598655 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:16.601998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] Returning 404 to user: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:16.603423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] validate_networks() for [('e270b678-3758-442a-88c0-ba52b7c022fe', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:15:16.606858 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d9066e42-07a4-4915-9b8a-718c8ebc40b5 tempest-ServersNegativeTestMultiTenantJSON-1337455292 tempest-ServersNegativeTestMultiTenantJSON-1337455292-project] 10.222.0.18 "PUT /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 404 len: 111 microversion: 2.1 time: 0.089151 Jun 04 21:15:16.611428 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2329/4557] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:15:16 2022] PUT /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:16.622915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:16.626588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:16.640492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.641009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.646290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:16.647117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:16.781268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:15:16.987197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7c69f260-14c5-44e9-82af-10844f763fb9 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "DELETE /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 204 len: 0 microversion: 2.1 time: 0.373929 Jun 04 21:15:16.988170 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2330/4558] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:16 2022] DELETE /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:16.996805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5f853505-7851-4fb9-9b4e-87de4cc7aa02 req-8d3424df-a5cd-4cda-b845-b093ffaded91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1f6287-1945-4ac2-889e-a7ee705a91fa", "name": "network-vif-deleted", "tag": "9e8360bb-6134-463c-a3cb-04820e8fcfc8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:17.017381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5f853505-7851-4fb9-9b4e-87de4cc7aa02 req-8d3424df-a5cd-4cda-b845-b093ffaded91 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:17.018955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5f853505-7851-4fb9-9b4e-87de4cc7aa02 req-8d3424df-a5cd-4cda-b845-b093ffaded91 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:17.035370 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5f853505-7851-4fb9-9b4e-87de4cc7aa02 req-8d3424df-a5cd-4cda-b845-b093ffaded91 service nova] Creating event network-vif-deleted:9e8360bb-6134-463c-a3cb-04820e8fcfc8 for instance bc1f6287-1945-4ac2-889e-a7ee705a91fa on nch1-master-1 Jun 04 21:15:17.046515 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5f853505-7851-4fb9-9b4e-87de4cc7aa02 req-8d3424df-a5cd-4cda-b845-b093ffaded91 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054017 Jun 04 21:15:17.047626 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2331/4559] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:17.056858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:17.057783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:17.068830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:17.069684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:17.070714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:17.071551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:17.881997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:17.885746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:17.898684 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c7a299c1-06c6-48c5-b5d2-06306b212dde tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1532 microversion: 2.1 time: 0.849383 Jun 04 21:15:17.901766 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2332/4560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:17 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1532 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:17.915474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:17.918091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:17.932769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:17.936127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:17.936781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:17.937993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:17.942071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:18.035797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:18.039554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:18.040302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lazy-loading 'fault' on Instance uuid bc1f6287-1945-4ac2-889e-a7ee705a91fa {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:15:18.159282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:18.172575 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a31d75e-f6fc-45ca-a74f-8bcb100a9093 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 200 len: 1303 microversion: 2.1 time: 0.269286 Jun 04 21:15:18.186855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2333/4561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:17 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 1303 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:18.206921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:15:18.208447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:15:18.209149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:15:18.211251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:15:18.212146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:15:18.228293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:18.229284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:18.230311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:18.233208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:18.263683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Getting quotas for project 214ab8444b4949b0b1e6f1ee4929743b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:18.270789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Getting quotas for user 913b1fac19d748908e6b9f5980e8bde9 and project 214ab8444b4949b0b1e6f1ee4929743b. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:18.288235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:15:18.292453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:15:18.354642 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14d8a98b-1265-4df3-bf2e-e9f8bd686b0a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.914165 Jun 04 21:15:18.356729 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2229/4562] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:15:18.366571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5dac910f-4def-4e9e-a145-0cbd30610e40 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:18.368901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5dac910f-4def-4e9e-a145-0cbd30610e40 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:18.456201 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5dac910f-4def-4e9e-a145-0cbd30610e40 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1329 microversion: 2.1 time: 0.092705 Jun 04 21:15:18.457342 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2334/4563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:18 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1329 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:18.921792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:18.922830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:18.939885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:18.944653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:18.947996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:18.948689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:19.190356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:19.191023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: bc1f6287-1945-4ac2-889e-a7ee705a91fa] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:19.215706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:19.216171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:19.216968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:19.217406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:19.244168 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] HTTP exception thrown: Instance bc1f6287-1945-4ac2-889e-a7ee705a91fa could not be found. Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Request method failure captured: Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa HTTP/1.1 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8tHpVeEq56I4t8QXUfkcCeq1etOGkznrMvhT4tKLTiFQQR4UAoh01MAz2SSK5uPmWw0vT_QAtup_rVwYp3gP7TbRx_5awrShxRRhBx4jMhf1E4oG1wuS01_XaKCtk8OkYXHmhhLQceTUPFMndXBjaxQYiBT4Tv3bAup9u_RtVScsyY Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c7a8c28e867e4f068eda630b49aa76f1 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-VolumesActionsTest-459687928 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-VolumesActionsTest-459687928 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c7a8c28e867e4f068eda630b49aa76f1 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-VolumesActionsTest-459687928 Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-VolumesActionsTest-459687928-project Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: e3dd0290b6e94050919656b761898ffb Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-VolumesActionsTest-459687928-project Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance bc1f6287-1945-4ac2-889e-a7ee705a91fa could not be found. Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'bc1f6287-1945-4ac2-889e-a7ee705a91fa'} Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc1f6287-1945-4ac2-889e-a7ee705a91fa could not be found. Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc1f6287-1945-4ac2-889e-a7ee705a91fa could not be found. Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:19.246158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc1f6287-1945-4ac2-889e-a7ee705a91fa could not be found. Jun 04 21:15:19.250926 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:19.252518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Returning 404 to user: Instance bc1f6287-1945-4ac2-889e-a7ee705a91fa could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:19.253902 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14a73612-011e-43e3-8c65-697e26171107 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa" status: 404 len: 111 microversion: 2.1 time: 0.067579 Jun 04 21:15:19.257894 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2335/4564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:19 2022] GET /compute/v2.1/servers/bc1f6287-1945-4ac2-889e-a7ee705a91fa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:15:19.456658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:19.463423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-669002059", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "cbb8604a-af59-42db-b06b-8d924357b0b3"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:19.483980 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f51970c8-22ba-414b-bcff-2bf9c8a87510 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1532 microversion: 2.1 time: 0.562573 Jun 04 21:15:19.497010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2230/4565] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:18 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1532 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:19.524626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:19.525261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:19.541356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:19.541356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:19.542262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:19.542893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:19.617741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] validate_networks() for [('cbb8604a-af59-42db-b06b-8d924357b0b3', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:15:19.784502 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e9d53805-4359-4f99-a5e9-3e1b39fe8cd7 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1338 microversion: 2.1 time: 0.277785 Jun 04 21:15:19.785862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2231/4566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:19 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1338 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:20.224170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c32ef607-dae2-4d82-9db8-e4580cfb3dca req-eca0bc19-6ea5-4a4b-b063-8095a1016096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81467b08-0e62-4963-89d9-062a0d2b101e", "name": "network-vif-deleted", "tag": "981513af-f085-4cc4-9d2a-c53860aa3cb0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:20.250256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c32ef607-dae2-4d82-9db8-e4580cfb3dca req-eca0bc19-6ea5-4a4b-b063-8095a1016096 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.250940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c32ef607-dae2-4d82-9db8-e4580cfb3dca req-eca0bc19-6ea5-4a4b-b063-8095a1016096 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.290811 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c32ef607-dae2-4d82-9db8-e4580cfb3dca req-eca0bc19-6ea5-4a4b-b063-8095a1016096 service nova] Creating event network-vif-deleted:981513af-f085-4cc4-9d2a-c53860aa3cb0 for instance 81467b08-0e62-4963-89d9-062a0d2b101e on nch1-master-1 Jun 04 21:15:20.311208 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c32ef607-dae2-4d82-9db8-e4580cfb3dca req-eca0bc19-6ea5-4a4b-b063-8095a1016096 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090589 Jun 04 21:15:20.312405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2232/4567] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:15:20.503633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:20.512740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:20.534495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.534944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.539784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.540684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.595099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:15:20.596744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:15:20.597381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:15:20.597801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:15:20.598215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:15:20.614870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.615796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.616862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.617510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.637882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Getting quotas for project c7a8c28e867e4f068eda630b49aa76f1. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:20.639335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.639856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.640330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lazy-loading 'fault' on Instance uuid 81467b08-0e62-4963-89d9-062a0d2b101e {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:15:20.646848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Getting quotas for user e3dd0290b6e94050919656b761898ffb and project c7a8c28e867e4f068eda630b49aa76f1. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:20.665344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:15:20.669197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:15:20.751334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8800a39664542548c4118863e1db800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be828d223874d6cbb4e57118acabfa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:20.759725 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e332177-1418-493a-8e69-5dd763fbb91b tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306316 Jun 04 21:15:20.761780 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2336/4568] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:15:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:15:20.763572 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b2e683e-59a8-4cd9-8b61-b8dbeb43cb59 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 200 len: 1317 microversion: 2.1 time: 0.265237 Jun 04 21:15:20.767730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2233/4569] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:20 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:20.773369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c89bfdb5-1424-4baf-b858-beec4bfef03c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:20.775752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c89bfdb5-1424-4baf-b858-beec4bfef03c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:20.805302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:20.807352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:20.820104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.823267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.825761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:20.826701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:20.912806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c89bfdb5-1424-4baf-b858-beec4bfef03c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:20.925449 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c89bfdb5-1424-4baf-b858-beec4bfef03c tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1213 microversion: 2.1 time: 0.157142 Jun 04 21:15:20.930298 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2337/4570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:20 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:20.965482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-65233a2c-e2a6-4419-b4c1-2d6b47eda3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1424 microversion: 2.1 time: 0.165300 Jun 04 21:15:20.966079 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2234/4571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:20 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1424 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:21.789295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:21.790599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] [instance: 81467b08-0e62-4963-89d9-062a0d2b101e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:21.800316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:21.800606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:21.801537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:21.802144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:21.819171 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] HTTP exception thrown: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Request method failure captured: Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e HTTP/1.1 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8tJBGNZxE00IAMKisBFxkXyXq8Zy_MthGNM87xuxn73fc9VavByGb167V9eN1vXpZlDYrlKQdQl0T5HHKFGRbOocx-GAtum4SKzmI8X3sFplAnXSeqPkwRS3ccyHsihJQxQSOEb1xo4aZgKUl-B_6qtgDjMOwqfm2be08O5D2cfnqc Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 9be828d223874d6cbb4e57118acabfa4 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-549133007 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9be828d223874d6cbb4e57118acabfa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be828d223874d6cbb4e57118acabfa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9be828d223874d6cbb4e57118acabfa4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9be828d223874d6cbb4e57118acabfa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-549133007 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 9be828d223874d6cbb4e57118acabfa4 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-549133007 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestMultiTenantJSON-549133007-project Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c8800a39664542548c4118863e1db800 Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-549133007-project Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '81467b08-0e62-4963-89d9-062a0d2b101e'} Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:21.821013 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. Jun 04 21:15:21.825760 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:21.827687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] Returning 404 to user: Instance 81467b08-0e62-4963-89d9-062a0d2b101e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:21.829121 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-48a17adb-8160-4b2d-ac17-a90f4b9d43d5 tempest-ServersNegativeTestMultiTenantJSON-549133007 tempest-ServersNegativeTestMultiTenantJSON-549133007-project] 10.222.0.18 "GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e" status: 404 len: 111 microversion: 2.1 time: 0.044458 Jun 04 21:15:21.829741 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2338/4572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:21 2022] GET /compute/v2.1/servers/81467b08-0e62-4963-89d9-062a0d2b101e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:21.950828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:21.952358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:21.972394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:21.974180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:21.975403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:21.976123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:21.985966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:21.987083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:22.003880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:22.004815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:22.005619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:22.006717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:22.171951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:22.187176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b7d3c78-1de5-4d33-8b90-ce9b77bdf1ca tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1265 microversion: 2.1 time: 0.241888 Jun 04 21:15:22.197708 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2235/4573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:21 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:22.215661 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9290ad6-90db-4039-8fd9-ba774399a0d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1422 microversion: 2.1 time: 0.235315 Jun 04 21:15:22.218923 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2339/4574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:21 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1422 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:23.206543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:23.207342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:23.223502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:23.224378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:23.225490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:23.226709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:23.235876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:23.237167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:23.253078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:23.253639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:23.254570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:23.255223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:23.440927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:23.451572 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04a29b8b-cdad-40da-9eb1-4ab3c60c032d tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1271 microversion: 2.1 time: 0.249503 Jun 04 21:15:23.453454 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2236/4575] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:23 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:23.743295 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-115f7309-8a75-4bba-bd70-2288968c7f74 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1464 microversion: 2.1 time: 0.510491 Jun 04 21:15:23.745327 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2340/4576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:23 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1464 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:23.815533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4d49204a-7916-4929-ace4-2f26dd50a51d req-1fa2ea96-57c7-4d4e-801d-633a005b502f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abedb9b-85a2-4678-b1c7-5bb198e6cefc", "tag": "7d8ec11b-dc2d-4ba2-9d6f-8f3696da553d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:23.853749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d49204a-7916-4929-ace4-2f26dd50a51d req-1fa2ea96-57c7-4d4e-801d-633a005b502f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:23.854842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4d49204a-7916-4929-ace4-2f26dd50a51d req-1fa2ea96-57c7-4d4e-801d-633a005b502f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:23.878653 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4d49204a-7916-4929-ace4-2f26dd50a51d req-1fa2ea96-57c7-4d4e-801d-633a005b502f service nova] Creating event network-changed:7d8ec11b-dc2d-4ba2-9d6f-8f3696da553d for instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc on nch2-master-1 Jun 04 21:15:23.886723 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4d49204a-7916-4929-ace4-2f26dd50a51d req-1fa2ea96-57c7-4d4e-801d-633a005b502f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074676 Jun 04 21:15:23.887986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2237/4577] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:24.470228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:24.471153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:24.479479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:24.484912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:24.487475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:24.488712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:24.766067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:24.767854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:24.776310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:24.779874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:24.780830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:24.782647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:24.784066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:25.212239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:25.222524 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79cb1017-faa0-4ca6-a3cf-dffba213d2a1 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.757336 Jun 04 21:15:25.224135 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2341/4578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:24 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:25.431651 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-812c7e64-9987-47fc-add9-a8af9fa1e1d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1464 microversion: 2.1 time: 0.672828 Jun 04 21:15:25.442494 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2238/4579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:24 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1464 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:26.241872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:26.242734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:26.253046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:26.253511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:26.260238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:26.260823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:26.402934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-44dfc77c-ebf9-4c53-a2b4-25843bba5a18 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Action: 'create', calling method: .version_select at 0x7f2d00d195e0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-831822007", "policies": ["affinity"]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:26.469431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-44dfc77c-ebf9-4c53-a2b4-25843bba5a18 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:26.481834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-44dfc77c-ebf9-4c53-a2b4-25843bba5a18 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:26.613486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-44dfc77c-ebf9-4c53-a2b4-25843bba5a18 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:26.626425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:26.634205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-44dfc77c-ebf9-4c53-a2b4-25843bba5a18 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:26.656815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6164e388-8aab-4c1a-bb07-903e281066bb tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.415880 Jun 04 21:15:26.663621 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2239/4580] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:26 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:26.677896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ce82e488-fbbb-45c7-bf73-2d4ae43db45e req-36a94fb1-c880-45db-87ca-5a0c406872aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc62820-497a-449c-8d4e-ce45c68fe8b5", "tag": "e794b431-2b66-408f-9aef-c914289b5144"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:26.692985 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-44dfc77c-ebf9-4c53-a2b4-25843bba5a18 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.697527 Jun 04 21:15:26.694486 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2342/4581] 10.222.0.18 () {60 vars in 1173 bytes} [Sat Jun 4 21:15:25 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:26.714467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ce82e488-fbbb-45c7-bf73-2d4ae43db45e req-36a94fb1-c880-45db-87ca-5a0c406872aa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:26.715237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ce82e488-fbbb-45c7-bf73-2d4ae43db45e req-36a94fb1-c880-45db-87ca-5a0c406872aa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:26.722258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:26.727405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:26.754543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:26.757400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:26.758399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:26.760005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:26.784730 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ce82e488-fbbb-45c7-bf73-2d4ae43db45e req-36a94fb1-c880-45db-87ca-5a0c406872aa service nova] Creating event network-changed:e794b431-2b66-408f-9aef-c914289b5144 for instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 on nch1-master-1 Jun 04 21:15:26.821337 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ce82e488-fbbb-45c7-bf73-2d4ae43db45e req-36a94fb1-c880-45db-87ca-5a0c406872aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154104 Jun 04 21:15:26.826701 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2240/4582] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:26.861292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04ceb9bb-fa34-435a-a1ed-081c78d9d433 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Action: 'create', calling method: .version_select at 0x7f2d00e16d30>, body: {"server_group": {"name": "tempest-server-group-1175330061", "policies": ["affinity"]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:26.907629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-04ceb9bb-fa34-435a-a1ed-081c78d9d433 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:26.922266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-04ceb9bb-fa34-435a-a1ed-081c78d9d433 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.019269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-04ceb9bb-fa34-435a-a1ed-081c78d9d433 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.026417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-04ceb9bb-fa34-435a-a1ed-081c78d9d433 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.056353 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04ceb9bb-fa34-435a-a1ed-081c78d9d433 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.225461 Jun 04 21:15:27.059361 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2241/4583] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Jun 4 21:15:26 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:27.069587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5967170e-3084-407f-9423-ddcec71d900a tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Action: 'create', calling method: .version_select at 0x7f2d00e16f70>, body: {"server_group": {"name": "tempest-server-group-1175330061", "policies": ["affinity"]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:27.107477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5967170e-3084-407f-9423-ddcec71d900a tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.114486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5967170e-3084-407f-9423-ddcec71d900a tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.176663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5967170e-3084-407f-9423-ddcec71d900a tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.182122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5967170e-3084-407f-9423-ddcec71d900a tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.199909 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5967170e-3084-407f-9423-ddcec71d900a tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.134742 Jun 04 21:15:27.205643 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2242/4584] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Jun 4 21:15:27 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:27.211568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77e409de-d294-48bd-b91f-dfa32fe9adc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.256932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77e409de-d294-48bd-b91f-dfa32fe9adc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/fba68f7b-99a4-4cea-a640-180c17e6a450" status: 204 len: 0 microversion: 2.1 time: 0.049339 Jun 04 21:15:27.259860 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2243/4585] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:27 2022] DELETE /compute/v2.1/os-server-groups/fba68f7b-99a4-4cea-a640-180c17e6a450 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:27.285625 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aafa2bbd-c70a-4e9f-ab0f-790c5690f4dd tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1464 microversion: 2.1 time: 0.589365 Jun 04 21:15:27.288581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fcf2af6c-6587-47bc-9e3d-f6432a6ec310 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.290047 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2343/4586] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:26 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1464 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:27.317262 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fcf2af6c-6587-47bc-9e3d-f6432a6ec310 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.038555 Jun 04 21:15:27.318314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2244/4587] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:15:27 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:27.330925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b3ee50af-bebe-457f-bc44-32eef2866832 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.387618 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b3ee50af-bebe-457f-bc44-32eef2866832 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/bc38a4db-dc0f-4fe8-9500-00c5ba088631" status: 204 len: 0 microversion: 2.1 time: 0.062951 Jun 04 21:15:27.388262 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2344/4588] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:27 2022] DELETE /compute/v2.1/os-server-groups/bc38a4db-dc0f-4fe8-9500-00c5ba088631 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:27.397885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae08a760-30ed-4f92-8f38-1108b59f34a0 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.408948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae08a760-30ed-4f92-8f38-1108b59f34a0 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.015364 Jun 04 21:15:27.410202 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2245/4589] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:15:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:27.424868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b52b79ea-cdf7-403d-9c94-760d769d2fe4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Action: 'create', calling method: .version_select at 0x7f2d00cce9d0>, body: {"server_group": {"name": "tempest-server-group-1639519944", "policies": ["affinity"]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:27.444314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b52b79ea-cdf7-403d-9c94-760d769d2fe4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.450207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b52b79ea-cdf7-403d-9c94-760d769d2fe4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.512851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b52b79ea-cdf7-403d-9c94-760d769d2fe4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.533185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b52b79ea-cdf7-403d-9c94-760d769d2fe4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.556693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:27.559500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b52b79ea-cdf7-403d-9c94-760d769d2fe4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.139776 Jun 04 21:15:27.565391 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2345/4590] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Jun 4 21:15:27 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:15:27.572289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b36c9386-8938-4205-9121-4235d3acaeb6 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.604662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:27.605895 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b36c9386-8938-4205-9121-4235d3acaeb6 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/80d05bda-c866-4642-a7ae-3753770a5453" status: 204 len: 0 microversion: 2.1 time: 0.038440 Jun 04 21:15:27.606087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:27.611046 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2246/4591] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:27 2022] DELETE /compute/v2.1/os-server-groups/80d05bda-c866-4642-a7ae-3753770a5453 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:27.617212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cfc609bd-3700-40fe-a59d-a3402ba85ce3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.618165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:27.618692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:27.633226 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cfc609bd-3700-40fe-a59d-a3402ba85ce3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.020613 Jun 04 21:15:27.633896 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2247/4592] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:15:27 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:27.635868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:27.636347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:27.650261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b621f89a-cfd5-4319-87e9-5e53ba221d4b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Action: 'create', calling method: .version_select at 0x7f2d00e45670>, body: {"server_group": {"name": "tempest-server-group-110009032", "policies": ["anti-affinity"]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:27.671169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b621f89a-cfd5-4319-87e9-5e53ba221d4b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.684211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b621f89a-cfd5-4319-87e9-5e53ba221d4b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.734589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:27.748480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b621f89a-cfd5-4319-87e9-5e53ba221d4b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:27.760236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b621f89a-cfd5-4319-87e9-5e53ba221d4b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_groups'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:27.776102 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff799f83-b9af-4090-bd77-43c1043d3951 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.181705 Jun 04 21:15:27.776772 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2346/4593] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:15:27 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:15:27.780830 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b621f89a-cfd5-4319-87e9-5e53ba221d4b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.137339 Jun 04 21:15:27.786284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.788213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:27.795815 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2248/4594] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Jun 4 21:15:27 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:27.797769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:27.798204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:27.799146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:27.799575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:27.814913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:27.823141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:27.837306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:27.838205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:27.839664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:27.840446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:28.097221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:28.117079 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9698c040-04c9-4029-8996-0f7c9227c4d5 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.338698 Jun 04 21:15:28.117678 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2347/4595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:27 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:28.130288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd60e07a-398d-4939-af56-88c3195eecc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:28.161954 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd60e07a-398d-4939-af56-88c3195eecc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/54d24fe9-9396-4328-80e4-32e45ceeb0a5" status: 204 len: 0 microversion: 2.1 time: 0.035423 Jun 04 21:15:28.162535 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2348/4596] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:28 2022] DELETE /compute/v2.1/os-server-groups/54d24fe9-9396-4328-80e4-32e45ceeb0a5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:28.170502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bdae800b-6e7b-4574-a958-9d0f4b0b711b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:28.186377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:28.190850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bdae800b-6e7b-4574-a958-9d0f4b0b711b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023819 Jun 04 21:15:28.193470 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2349/4597] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:15:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:28.208663 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fcbd54f9-09d7-4d98-87e6-98578889313d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1673 microversion: 2.1 time: 0.409549 Jun 04 21:15:28.209494 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2249/4598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:27 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1673 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:28.311309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:28.311999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:28.323349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:28.331947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:28.333261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:28.333892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:28.349030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-757654506", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "c2555c19-5d0b-4eee-95bf-29fed63c1d03"}]}, "os:scheduler_hints": {"group": "bbf161fb-00ad-4d0a-8685-bcdd7dcd6810"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:28.359089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:28.456621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] validate_networks() for [('c2555c19-5d0b-4eee-95bf-29fed63c1d03', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:15:28.801108 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1464 microversion: 2.1 time: 0.497526 Jun 04 21:15:28.806249 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2350/4599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:28 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1464 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:29.013693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:29.015134 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82ceded9-6a2d-4cee-a0f9-5737f61afcab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001456 Jun 04 21:15:29.015934 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2351/4600] 10.222.0.18 () {56 vars in 885 bytes} [Sat Jun 4 21:15:29 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 04 21:15:29.112876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0db5dbfa-1bbb-4724-ae3e-d43c87555549 req-3beb3478-60d5-4701-ba5d-01a36aa8f87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abedb9b-85a2-4678-b1c7-5bb198e6cefc", "name": "network-vif-plugged", "status": "completed", "tag": "7d8ec11b-dc2d-4ba2-9d6f-8f3696da553d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:29.125598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0db5dbfa-1bbb-4724-ae3e-d43c87555549 req-3beb3478-60d5-4701-ba5d-01a36aa8f87c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.126421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0db5dbfa-1bbb-4724-ae3e-d43c87555549 req-3beb3478-60d5-4701-ba5d-01a36aa8f87c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.142185 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0db5dbfa-1bbb-4724-ae3e-d43c87555549 req-3beb3478-60d5-4701-ba5d-01a36aa8f87c service nova] Creating event network-vif-plugged:7d8ec11b-dc2d-4ba2-9d6f-8f3696da553d for instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc on nch2-master-1 Jun 04 21:15:29.149501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0db5dbfa-1bbb-4724-ae3e-d43c87555549 req-3beb3478-60d5-4701-ba5d-01a36aa8f87c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040939 Jun 04 21:15:29.150890 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2352/4601] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:29.165678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:29.166510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:29.174446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.174993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.176205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.176884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.617103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:15:29.618138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:15:29.618640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:15:29.619062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:15:29.619479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:15:29.640994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.641330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.642390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.643957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.649398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:29.657554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eddc0658-e58e-4833-a1a1-41a454f610b6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.503713 Jun 04 21:15:29.658792 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2353/4602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:29 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:29.672792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:29.673433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:29.679003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:29.685049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.685497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.686284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.686719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.695440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:29.723367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:15:29.730161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:15:29.786381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137229) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 04 21:15:29.808139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_group_members'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:29.814091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_group_members'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:29.867634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_group_members'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:29.874006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Getting quotas for user 1c1c95716bde4e28ac2a957eae09bb03 and project 1cfc7c15670542ce979fe1ab45cf7034. Resources: {'server_group_members'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:29.906658 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c966bc0e-2e08-4ef4-8e0a-cf10a3fea990 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.561265 Jun 04 21:15:29.907965 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2250/4603] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:15:29.913107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:29.914000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:29.934388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.934843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.935662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:29.939327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:29.944262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:30.046057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:30.057342 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a09d885-9c73-4331-87e8-86a4442c0241 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1673 microversion: 2.1 time: 0.397291 Jun 04 21:15:30.057950 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2354/4604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:29 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1673 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:30.065063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a6effe0-db56-43f3-af99-3fb73f194308 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:30.065672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a6effe0-db56-43f3-af99-3fb73f194308 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:30.168424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a6effe0-db56-43f3-af99-3fb73f194308 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:30.177123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a6effe0-db56-43f3-af99-3fb73f194308 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1212 microversion: 2.1 time: 0.118096 Jun 04 21:15:30.186450 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43e74486-d197-4b19-97ec-e7fd317d897e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1464 microversion: 2.1 time: 0.277086 Jun 04 21:15:30.186986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2355/4605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:30 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1212 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:30.187588 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2251/4606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:29 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:30.674408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:30.675027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:30.677118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:30.685834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:30.686739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:30.688333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:30.688774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:30.888248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:30.897517 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b6cf95a3-f401-4a7f-b605-13e0a7801152 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.227005 Jun 04 21:15:30.909161 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2356/4607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:30 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:31.076932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:31.078174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:31.086992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.088007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.088864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.089567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.196169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:31.197783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:31.211443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.214076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.216468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.217528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.277288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:31.290808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ab553e9-41d4-40d5-8634-a77068adbe0c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1678 microversion: 2.1 time: 0.220330 Jun 04 21:15:31.292467 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2252/4608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:31 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:31.297713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:31.298591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:31.306937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.307497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.308353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.308938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.365983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:31.381451 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0359f23d-2d36-4fb2-8cc7-aee571bbcca7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1264 microversion: 2.1 time: 0.189362 Jun 04 21:15:31.383389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2357/4609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:31 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:31.578738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7977aa5a-5404-467f-b25f-962451c003c2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1649 microversion: 2.1 time: 0.284842 Jun 04 21:15:31.580453 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2253/4610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:31 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1649 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:31.598378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:31.599004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:31.608506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.608955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.614284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.616846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.892026 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6af36ef8-5038-4123-b4ea-f42574b1d488 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1649 microversion: 2.1 time: 0.297088 Jun 04 21:15:31.894099 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2358/4611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:31 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1649 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:31.914764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:31.915403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:31.916303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:31.924102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:31.933031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.934180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.935105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.935729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.936317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.936478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:31.937205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:31.937701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:32.549388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:32.552979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:32.561884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a0fab24-e241-449d-876e-ffa829439221 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.650921 Jun 04 21:15:32.564239 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1649 microversion: 2.1 time: 0.657896 Jun 04 21:15:32.565229 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2254/4612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:31 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1649 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:32.566643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:32.568032 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e98f8a5-d9a8-473f-b3ba-dc75d7e495a3 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001576 Jun 04 21:15:32.568576 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2255/4613] 10.222.0.18 () {56 vars in 885 bytes} [Sat Jun 4 21:15:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 04 21:15:32.572242 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2359/4614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:31 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:32.575217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:32.576047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:32.578455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:32.579610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:32.587298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:32.587996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:32.589324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:32.593754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:32.594226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:32.595239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:32.596118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:32.600241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:32.733278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:32.746957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3fd3e79f-8434-4f72-9a2c-f6ca9f6e7a73 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1270 microversion: 2.1 time: 0.172574 Jun 04 21:15:32.759744 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2360/4615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:32 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:32.759744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1045770673", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "e270b678-3758-442a-88c0-ba52b7c022fe"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:32.856363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:32.858551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] validate_networks() for [('e270b678-3758-442a-88c0-ba52b7c022fe', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:15:32.870484 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2eced300-55ea-43da-8bec-6b680bea031c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.300060 Jun 04 21:15:32.871835 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2256/4616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:32 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:33.254873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-163ea3fd-bb01-4f5a-98c6-76504b398c03 req-6dbcaacc-be4a-4625-b0fc-d86b09129356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc62820-497a-449c-8d4e-ce45c68fe8b5", "name": "network-vif-plugged", "status": "completed", "tag": "e794b431-2b66-408f-9aef-c914289b5144"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:33.273507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-163ea3fd-bb01-4f5a-98c6-76504b398c03 req-6dbcaacc-be4a-4625-b0fc-d86b09129356 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:33.274349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-163ea3fd-bb01-4f5a-98c6-76504b398c03 req-6dbcaacc-be4a-4625-b0fc-d86b09129356 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:33.297099 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-163ea3fd-bb01-4f5a-98c6-76504b398c03 req-6dbcaacc-be4a-4625-b0fc-d86b09129356 service nova] Creating event network-vif-plugged:e794b431-2b66-408f-9aef-c914289b5144 for instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 on nch1-master-1 Jun 04 21:15:33.307760 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-163ea3fd-bb01-4f5a-98c6-76504b398c03 req-6dbcaacc-be4a-4625-b0fc-d86b09129356 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063221 Jun 04 21:15:33.309777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2257/4617] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:33.590111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:33.591631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:33.598973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:33.599692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:33.601178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:33.601930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:33.870613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:15:33.871440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:15:33.872015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:15:33.872488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:15:33.873168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:15:33.887043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:33.887834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:33.889525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:33.891424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:33.913555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Getting quotas for project 214ab8444b4949b0b1e6f1ee4929743b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:33.926306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Getting quotas for user 913b1fac19d748908e6b9f5980e8bde9 and project 214ab8444b4949b0b1e6f1ee4929743b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:33.953497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:15:33.957338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:15:33.985745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:33.995691 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-827212ca-2f0d-446d-827f-49720d45d2c6 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1313 microversion: 2.1 time: 0.420583 Jun 04 21:15:33.996843 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2258/4618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:33 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:34.001952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:34.002903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:34.010894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:34.012401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:34.013679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:34.014220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:34.033828 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21f092a4-c115-485e-9e6c-c0fbc60824ab tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278981 Jun 04 21:15:34.035808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2361/4619] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:15:34.048630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8298f186-9c23-445a-bceb-0eb3279ae392 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:34.049267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8298f186-9c23-445a-bceb-0eb3279ae392 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:34.205295 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8298f186-9c23-445a-bceb-0eb3279ae392 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1329 microversion: 2.1 time: 0.160928 Jun 04 21:15:34.206043 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2362/4620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:34 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1329 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:34.332955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:34.346085 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62bf32c7-06b6-4172-acdb-14b1a7fc67ff tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.347889 Jun 04 21:15:34.347456 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2259/4621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:33 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:35.016998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:35.017703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:35.033504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:35.033961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:35.034758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:35.035201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:35.222770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:35.224068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:35.230641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:35.237047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:35.238548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:35.240740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:35.475865 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a98229ee-ccdb-4902-b1ef-af946b0fee0d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1338 microversion: 2.1 time: 0.256690 Jun 04 21:15:35.486788 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2260/4622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:35 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1338 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:35.493339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:35.494226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:35.503660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:35.510644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:35.511895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:35.512860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:35.539763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:35.552550 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5aa92d8b-247b-4650-8a1e-b0b572cbeb29 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1496 microversion: 2.1 time: 0.542467 Jun 04 21:15:35.560098 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2363/4623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:35 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1496 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:36.029823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:36.049924 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b1bc0b8a-c8a1-4961-8cd9-7a89cc2a324d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.554947 Jun 04 21:15:36.050982 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2261/4624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:35 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:36.495150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:36.499578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:36.500827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:36.503956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:36.526332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:36.526797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:36.527720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:36.532051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:36.532924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:36.533573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:36.534684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:36.540335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:36.587116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:15:36.768939 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-309a433d-59ed-4306-a217-42bee32c487e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1422 microversion: 2.1 time: 0.274120 Jun 04 21:15:36.775461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2364/4625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:36 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1422 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:36.790577 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23428c28-4801-4c27-9fa9-b2a8acd2b56e tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 204 len: 0 microversion: 2.1 time: 0.299196 Jun 04 21:15:36.801613 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2262/4626] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:36 2022] DELETE /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:36.804080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:36.805082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:36.818754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:36.819764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:36.821749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:36.822650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.072695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:37.073562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:37.081375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.082204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.083238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.085044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.150664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:37.178056 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85c41646-ef72-4548-9a7c-61b90d5d3e8a tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1502 microversion: 2.1 time: 0.371363 Jun 04 21:15:37.179267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2365/4627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:36 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1502 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:37.185741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-965184f4-bf92-4c68-b6da-5a16b1c0b6b9 req-cbcb5457-5d44-4d98-990c-7812e6aff4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13126a23-1f1f-4860-a97b-521d01fd85d3", "tag": "cb5892ba-bdda-46fb-969e-14cc126c401e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:37.197776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-965184f4-bf92-4c68-b6da-5a16b1c0b6b9 req-cbcb5457-5d44-4d98-990c-7812e6aff4f1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.198655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-965184f4-bf92-4c68-b6da-5a16b1c0b6b9 req-cbcb5457-5d44-4d98-990c-7812e6aff4f1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.228146 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-965184f4-bf92-4c68-b6da-5a16b1c0b6b9 req-cbcb5457-5d44-4d98-990c-7812e6aff4f1 service nova] Creating event network-changed:cb5892ba-bdda-46fb-969e-14cc126c401e for instance 13126a23-1f1f-4860-a97b-521d01fd85d3 on nch1-master-1 Jun 04 21:15:37.236203 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-965184f4-bf92-4c68-b6da-5a16b1c0b6b9 req-cbcb5457-5d44-4d98-990c-7812e6aff4f1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055293 Jun 04 21:15:37.237430 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2366/4628] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:37.755863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:37.793064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:37.794410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:37.798426 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-20c689c2-262b-4173-8f7f-53bec86a77d8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.724474 Jun 04 21:15:37.801242 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2263/4629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:37 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:37.811651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.812157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.812965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.813410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.825658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:37.826582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:37.841474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.844253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.847004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:37.850584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:37.936352 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61ce1162-02b3-46d7-9c4a-887e87b16ac5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1422 microversion: 2.1 time: 0.148228 Jun 04 21:15:37.939925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2367/4630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:37 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1422 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:37.962319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:15:38.180419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-290cf11c-f1a5-46c6-a029-dc6b51a98a51 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "DELETE /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 204 len: 0 microversion: 2.1 time: 0.358970 Jun 04 21:15:38.181556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2264/4631] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:37 2022] DELETE /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:15:38.195485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:38.196586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:38.215857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:38.216058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:38.216778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:38.219053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:38.219187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:38.219922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:38.239999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:38.241167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:38.243307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:38.245102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:38.758156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:38.795546 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-32e831f4-bbda-4971-a4b6-073a43929bbf tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1583 microversion: 2.1 time: 0.606644 Jun 04 21:15:38.806739 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2368/4632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:38 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1583 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:38.831836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:38.832982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:38.844997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:38.845839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:38.846960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:38.848155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:39.093736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:39.107628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a1dcd96f-5c51-46ea-bb29-0cebd20becbf tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1502 microversion: 2.1 time: 0.905180 Jun 04 21:15:39.109358 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2265/4633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:38 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1502 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:39.117613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:39.119203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:39.128524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:39.131303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:39.134109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:39.135054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:39.153978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:39.574325 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3ce38a8-a8e4-4ab8-9d86-515796e87b81 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.463156 Jun 04 21:15:39.576576 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2266/4634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:39 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:39.582578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7b141861-01b9-4756-b882-a288dd972dca req-58120fd5-d177-4039-91fc-9585504bd299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:39.606086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7b141861-01b9-4756-b882-a288dd972dca req-58120fd5-d177-4039-91fc-9585504bd299 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:39.606834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7b141861-01b9-4756-b882-a288dd972dca req-58120fd5-d177-4039-91fc-9585504bd299 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:39.642178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7b141861-01b9-4756-b882-a288dd972dca req-58120fd5-d177-4039-91fc-9585504bd299 service nova] Creating event network-changed:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:15:39.645031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:39.654463 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4d77f490-75cf-4dc8-9f92-a5dab363596e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.839697 Jun 04 21:15:39.664061 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2369/4635] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:38 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:39.669594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:39.672933 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7b141861-01b9-4756-b882-a288dd972dca req-58120fd5-d177-4039-91fc-9585504bd299 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094442 Jun 04 21:15:39.673599 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2267/4636] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:39.827863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:39.829179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:39.837152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:39.838104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:39.839372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:39.840272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:40.122944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=44 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:40.129705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:40.130708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:40.134599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:40.140269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:40.141805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:40.142807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:40.143835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:40.427036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:40.442897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc89d548-2594-4aa9-8d36-84086dda3074 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1583 microversion: 2.1 time: 0.617191 Jun 04 21:15:40.445198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2370/4637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:39 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1583 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:40.579162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:40.591208 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4b10dc6c-bbf0-419c-bdb4-05c7bf1ea8a3 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1502 microversion: 2.1 time: 0.465415 Jun 04 21:15:40.592025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2268/4638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:40 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1502 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:40.592521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:40.593238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:40.605452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:40.605912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:40.606711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:40.607321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:40.673999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:40.674750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:40.690987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:40.694450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:40.697143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:40.697697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.005619 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a62b8aa-21d9-4fa0-b111-517c4beb45c5 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.416654 Jun 04 21:15:41.008539 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2371/4639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:40 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:41.106495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:41.117320 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a0bc3fd-5c0c-48c3-b024-cec571cb97b2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.449455 Jun 04 21:15:41.119758 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2269/4640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:40 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:41.340980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1238b2e5-9fa3-48af-aabd-23cfe09d07b0 req-c2b4882c-8b31-41ff-991b-2b0d0cccde0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc62820-497a-449c-8d4e-ce45c68fe8b5", "name": "network-vif-deleted", "tag": "e794b431-2b66-408f-9aef-c914289b5144"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:41.352571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1238b2e5-9fa3-48af-aabd-23cfe09d07b0 req-c2b4882c-8b31-41ff-991b-2b0d0cccde0c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.353074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1238b2e5-9fa3-48af-aabd-23cfe09d07b0 req-c2b4882c-8b31-41ff-991b-2b0d0cccde0c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.466364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:41.467247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:41.478402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.479218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.480306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.488698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.570324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.571150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.571889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lazy-loading 'fault' on Instance uuid 0b8265c0-0c03-4478-a6d3-adaf59500c06 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:15:41.653051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ed5143e191a43cc892a9428a2a8376c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f7eafafd554647ad42646ebdc1aa1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:41.669245 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-084c1897-8cc7-4433-8aa8-d1709537e8a6 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 200 len: 1233 microversion: 2.1 time: 0.208596 Jun 04 21:15:41.669938 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2270/4641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:41 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 1233 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:41.687703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:41.689118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:41.717436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.717785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.720797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.721413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.829770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:41.831329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:41.833895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lazy-loading 'fault' on Instance uuid ccc62820-497a-449c-8d4e-ce45c68fe8b5 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:15:41.943785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dd0290b6e94050919656b761898ffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8c28e867e4f068eda630b49aa76f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:41.959105 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-329e824e-e173-456c-86d1-48718c4adfae tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 200 len: 1303 microversion: 2.1 time: 0.287032 Jun 04 21:15:41.962343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2271/4642] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:41 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 1303 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:41.976426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ed93e523-8256-46ed-b505-6d1b2d095260 req-16754596-728e-4b5c-9825-ab88de2a9720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b8265c0-0c03-4478-a6d3-adaf59500c06", "name": "network-vif-deleted", "tag": "f751f064-0d24-4c71-a4e5-b857a56e4da1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:42.006440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ed93e523-8256-46ed-b505-6d1b2d095260 req-16754596-728e-4b5c-9825-ab88de2a9720 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.006914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ed93e523-8256-46ed-b505-6d1b2d095260 req-16754596-728e-4b5c-9825-ab88de2a9720 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.022056 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1238b2e5-9fa3-48af-aabd-23cfe09d07b0 req-c2b4882c-8b31-41ff-991b-2b0d0cccde0c service nova] Creating event network-vif-deleted:e794b431-2b66-408f-9aef-c914289b5144 for instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 on nch1-master-1 Jun 04 21:15:42.033500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1238b2e5-9fa3-48af-aabd-23cfe09d07b0 req-c2b4882c-8b31-41ff-991b-2b0d0cccde0c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.696596 Jun 04 21:15:42.040690 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2372/4643] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:42.053668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:42.054603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:42.056980 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ed93e523-8256-46ed-b505-6d1b2d095260 req-16754596-728e-4b5c-9825-ab88de2a9720 service nova] Creating event network-vif-deleted:f751f064-0d24-4c71-a4e5-b857a56e4da1 for instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 on nch2-master-1 Jun 04 21:15:42.063457 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ed93e523-8256-46ed-b505-6d1b2d095260 req-16754596-728e-4b5c-9825-ab88de2a9720 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096927 Jun 04 21:15:42.064980 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2272/4644] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:42.088235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.089236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.090962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.091929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.145345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:42.146285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:42.153411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.154245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.155415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.155943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.565330 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6c33b5d4-0332-40ee-bdd7-4cf7781f8909 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.523038 Jun 04 21:15:42.575731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2373/4645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:42 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:42.621609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:42.630251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a2f673fb-a05c-40be-b826-ac37da91fa7d tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.496999 Jun 04 21:15:42.640567 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2273/4646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:42 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:42.693997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:42.694761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] [instance: 0b8265c0-0c03-4478-a6d3-adaf59500c06] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:42.703868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.704673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.705961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.706646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.739320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] HTTP exception thrown: Instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 could not be found. Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Request method failure captured: Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 HTTP/1.1 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8r9WQOHI2YM7mwP6ykXMqC6CR0dKEG7dfiCdNnpjWZVxa2QoAiJGji7cmNPootQQ19rHTEKXEVnpzcXi2osaVe7uHrnuI4q_gEh4S1_0gloAiPinuueG19Fer5bySAiXwKC7RoySLK5ZymsrpZyOWcRFcJy7_OzvZ_LGs8RovtJ72g Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: a6f7eafafd554647ad42646ebdc1aa1b Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBackupRestore-633667600 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a6f7eafafd554647ad42646ebdc1aa1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6f7eafafd554647ad42646ebdc1aa1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a6f7eafafd554647ad42646ebdc1aa1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a6f7eafafd554647ad42646ebdc1aa1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBackupRestore-633667600 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: a6f7eafafd554647ad42646ebdc1aa1b Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBackupRestore-633667600 Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBackupRestore-633667600-project Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2ed5143e191a43cc892a9428a2a8376c Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBackupRestore-633667600-project Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 could not be found. Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '0b8265c0-0c03-4478-a6d3-adaf59500c06'} Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 could not be found. Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 could not be found. Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:42.741469 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 could not be found. Jun 04 21:15:42.746470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:42.748678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Returning 404 to user: Instance 0b8265c0-0c03-4478-a6d3-adaf59500c06 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:42.750154 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2039f8ad-476f-4076-ae9d-389b57f308df tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06" status: 404 len: 111 microversion: 2.1 time: 0.060983 Jun 04 21:15:42.751378 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2374/4647] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:42 2022] GET /compute/v2.1/servers/0b8265c0-0c03-4478-a6d3-adaf59500c06 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:42.981341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:42.982015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] [instance: ccc62820-497a-449c-8d4e-ce45c68fe8b5] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:42.989420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.990894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:42.991969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:42.992577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:43.012738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] HTTP exception thrown: Instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 could not be found. Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Request method failure captured: Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 HTTP/1.1 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8tHpVeEq56I4t8QXUfkcCeq1etOGkznrMvhT4tKLTiFQQR4UAoh01MAz2SSK5uPmWw0vT_QAtup_rVwYp3gP7TbRx_5awrShxRRhBx4jMhf1E4oG1wuS01_XaKCtk8OkYXHmhhLQceTUPFMndXBjaxQYiBT4Tv3bAup9u_RtVScsyY Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c7a8c28e867e4f068eda630b49aa76f1 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesActionsTest-459687928 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c7a8c28e867e4f068eda630b49aa76f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesActionsTest-459687928 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c7a8c28e867e4f068eda630b49aa76f1 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesActionsTest-459687928 Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesActionsTest-459687928-project Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e3dd0290b6e94050919656b761898ffb Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesActionsTest-459687928-project Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 could not be found. Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ccc62820-497a-449c-8d4e-ce45c68fe8b5'} Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 could not be found. Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 could not be found. Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:43.014709 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 could not be found. Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:15:43.020703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] Returning 404 to user: Instance ccc62820-497a-449c-8d4e-ce45c68fe8b5 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:43.022596 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-abb408ad-e242-4a09-96b1-477747aa7ff9 tempest-VolumesActionsTest-459687928 tempest-VolumesActionsTest-459687928-project] 10.222.0.18 "GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5" status: 404 len: 111 microversion: 2.1 time: 0.045152 Jun 04 21:15:43.023633 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2274/4648] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:42 2022] GET /compute/v2.1/servers/ccc62820-497a-449c-8d4e-ce45c68fe8b5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:43.584647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:43.586089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:43.602008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:43.605056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:43.607321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:43.608976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:43.629190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-64f173bb-ad7f-4c56-85f5-41f5e7d9ca26 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] Calling method '.version_select at 0x7f2d00e64a60>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:43.679682 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-64f173bb-ad7f-4c56-85f5-41f5e7d9ca26 tempest-TestVolumeBackupRestore-633667600 tempest-TestVolumeBackupRestore-633667600-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1343804380" status: 202 len: 0 microversion: 2.1 time: 0.057200 Jun 04 21:15:43.680276 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2275/4649] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:15:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1343804380 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:15:43.691199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:43.699672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:43.711588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:43.712058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:43.712860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:43.713365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:43.902497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:44.132973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:44.133616 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-161f1be1-5f05-4851-a57e-384bb892838a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.554902 Jun 04 21:15:44.136334 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2375/4650] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:43 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:44.153776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c605c29e-dc9d-47ee-a61d-710202a7a117 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.466732 Jun 04 21:15:44.166113 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2276/4651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:43 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:44.166888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a35b4dc8-64ad-48ef-b4b6-2605d493f57f req-a313c11a-ce01-4558-bbd8-7ad16209cbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c6b0bf-52b7-497f-a6e8-4d41c016e04f", "tag": "bf32e7e1-a6bf-42c5-a8e3-7e90a6d0646b"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:44.191486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a35b4dc8-64ad-48ef-b4b6-2605d493f57f req-a313c11a-ce01-4558-bbd8-7ad16209cbf9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:44.196696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a35b4dc8-64ad-48ef-b4b6-2605d493f57f req-a313c11a-ce01-4558-bbd8-7ad16209cbf9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:44.202987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=36 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:44.213330 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a35b4dc8-64ad-48ef-b4b6-2605d493f57f req-a313c11a-ce01-4558-bbd8-7ad16209cbf9 service nova] Creating event network-changed:bf32e7e1-a6bf-42c5-a8e3-7e90a6d0646b for instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f on nch1-master-1 Jun 04 21:15:44.220518 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a35b4dc8-64ad-48ef-b4b6-2605d493f57f req-a313c11a-ce01-4558-bbd8-7ad16209cbf9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079375 Jun 04 21:15:44.221748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2376/4652] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:45.167034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:45.168591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:45.177651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:45.179357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:45.210368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:45.210810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:45.221423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:45.224275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:45.245518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:45.249844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:45.254710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:45.257304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:45.894699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b2726767-dabd-4a83-9503-5470bda26f38 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.744397 Jun 04 21:15:45.903039 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2277/4653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:45 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:45.906181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:45.925673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b2e729fa-b239-47b2-a682-681c6b0dca98 req-f8d6cff8-b393-444c-ab7d-a5567c898797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13126a23-1f1f-4860-a97b-521d01fd85d3", "name": "network-vif-plugged", "status": "completed", "tag": "cb5892ba-bdda-46fb-969e-14cc126c401e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:45.937499 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2dfa9c6d-df26-41fe-b6df-b80e2dd81e40 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.767882 Jun 04 21:15:45.941764 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2377/4654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:45 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:45.957123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b2e729fa-b239-47b2-a682-681c6b0dca98 req-f8d6cff8-b393-444c-ab7d-a5567c898797 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:45.958112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b2e729fa-b239-47b2-a682-681c6b0dca98 req-f8d6cff8-b393-444c-ab7d-a5567c898797 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:45.996615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b2e729fa-b239-47b2-a682-681c6b0dca98 req-f8d6cff8-b393-444c-ab7d-a5567c898797 service nova] Creating event network-vif-plugged:cb5892ba-bdda-46fb-969e-14cc126c401e for instance 13126a23-1f1f-4860-a97b-521d01fd85d3 on nch1-master-1 Jun 04 21:15:46.009278 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b2e729fa-b239-47b2-a682-681c6b0dca98 req-f8d6cff8-b393-444c-ab7d-a5567c898797 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104284 Jun 04 21:15:46.012146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2278/4655] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:46.921655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:46.922426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:46.932051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:46.932501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:46.946864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:46.947683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:46.958835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:46.959466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:46.970840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:47.004856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:47.005932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:47.006394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:47.629740 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eee2df12-effe-4ded-b464-d5614d70a167 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.713719 Jun 04 21:15:47.631628 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2378/4656] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:46 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:47.654284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:47.669941 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bc9357fa-36f2-4ba7-b75c-686d07cff05b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1312 microversion: 2.1 time: 0.715471 Jun 04 21:15:47.674658 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2279/4657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:46 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1312 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:48.648577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:48.649209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:48.674172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:48.674976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:48.687253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:48.687900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:48.689167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:48.691477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:48.699461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:48.700216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:48.701589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:48.702177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:49.294995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:49.309278 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe0d2c53-60b5-4c1e-8e55-75ce52fadbf8 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1497 microversion: 2.1 time: 0.625765 Jun 04 21:15:49.312249 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2280/4658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:48 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1497 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:49.338710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-130c7020-15d1-4081-b1cc-0d921555e9b4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:49.357480 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3beb13e0-a0ed-4b12-b589-ee9ca13eeacc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.701326 Jun 04 21:15:49.359405 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2379/4659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:48 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:49.382248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.server_groups [None req-130c7020-15d1-4081-b1cc-0d921555e9b4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Querying cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) for 1 instances {{(pid=137229) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 04 21:15:49.383562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-130c7020-15d1-4081-b1cc-0d921555e9b4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:49.387012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-130c7020-15d1-4081-b1cc-0d921555e9b4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:49.429970 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-130c7020-15d1-4081-b1cc-0d921555e9b4 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/bbf161fb-00ad-4d0a-8685-bcdd7dcd6810" status: 200 len: 221 microversion: 2.1 time: 0.102281 Jun 04 21:15:49.432552 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2281/4660] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:15:49 2022] GET /compute/v2.1/os-server-groups/bbf161fb-00ad-4d0a-8685-bcdd7dcd6810 => generated 221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:49.444112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:49.444934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:49.455825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:49.457808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:49.458828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:49.462416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:49.527195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:15:49.540744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:49.790845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:49.816320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c99f2ac-872b-4c8b-b822-c29070c14ba3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 204 len: 0 microversion: 2.1 time: 0.377211 Jun 04 21:15:49.817296 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2380/4661] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:49 2022] DELETE /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:49.829492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:49.830824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:49.847669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:49.849751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:49.850757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:49.853509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:50.253577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:50.266109 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-760cb4f7-107c-4583-ad6b-640d387d29d7 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1503 microversion: 2.1 time: 0.443896 Jun 04 21:15:50.267052 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2282/4662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:49 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1503 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:50.379025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:50.379938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:50.399736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:50.400158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:50.400968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:50.401402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:50.973520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4cf0f5c-1c91-4c8c-8553-3f1f9dbd9f3f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'create', calling method: .version_select at 0x7f2d00e0aaf0>, body: {"keypair": {"name": "tempest-keypair-1688031173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9cYP3rOtdqytuiNvQhgnBlDX+y3scihiykbzz60uEoKWytIW+7VjvaaCSYX5WKEtWsQBYGjujp0i7RFYZ4QSxj12VLhQBR+HS76qnsdCpZkP8v+YReHBDhrMf3A8wvgA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:51.006164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f4cf0f5c-1c91-4c8c-8553-3f1f9dbd9f3f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:15:51.013621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f4cf0f5c-1c91-4c8c-8553-3f1f9dbd9f3f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for user bff665dac5de4530ab70f20ba2da386d and project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:15:51.063683 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4cf0f5c-1c91-4c8c-8553-3f1f9dbd9f3f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.564265 Jun 04 21:15:51.066842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2283/4663] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 21:15:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 570 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 04 21:15:51.089602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-342641b1-b996-40c8-a04a-f25e125ed3ef req-ac0840a9-2cd4-4ac9-91ee-02f1e6ae11f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c6b0bf-52b7-497f-a6e8-4d41c016e04f", "name": "network-vif-plugged", "status": "completed", "tag": "bf32e7e1-a6bf-42c5-a8e3-7e90a6d0646b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:51.105294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-342641b1-b996-40c8-a04a-f25e125ed3ef req-ac0840a9-2cd4-4ac9-91ee-02f1e6ae11f7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:51.106400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-342641b1-b996-40c8-a04a-f25e125ed3ef req-ac0840a9-2cd4-4ac9-91ee-02f1e6ae11f7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:51.145072 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-342641b1-b996-40c8-a04a-f25e125ed3ef req-ac0840a9-2cd4-4ac9-91ee-02f1e6ae11f7 service nova] Creating event network-vif-plugged:bf32e7e1-a6bf-42c5-a8e3-7e90a6d0646b for instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f on nch1-master-1 Jun 04 21:15:51.155409 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-342641b1-b996-40c8-a04a-f25e125ed3ef req-ac0840a9-2cd4-4ac9-91ee-02f1e6ae11f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083679 Jun 04 21:15:51.158173 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2284/4664] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:51.287496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:51.288536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:51.308321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:51.317012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:51.329693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:51.330974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:51.948733 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8af3a931-fcb6-47f5-96e3-a5ba1b3d4042 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 1.577751 Jun 04 21:15:51.953756 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2381/4665] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:50 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:52.536901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:52.553287 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66091643-dd0a-427e-a5ab-c722570b062b tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1503 microversion: 2.1 time: 1.271335 Jun 04 21:15:52.554613 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2285/4666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:51 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1503 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:15:52.970395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:52.971687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:52.983325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:52.984135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:52.984918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:52.995854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:53.526504 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fbc5bb96-535c-47e8-9f6d-91fd57e986d2 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1464 microversion: 2.1 time: 0.559072 Jun 04 21:15:53.527730 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2382/4667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:52 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1464 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:53.570926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:53.571565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:53.592592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:53.593375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:53.594357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:53.595134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:53.800918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1c95716bde4e28ac2a957eae09bb03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cfc7c15670542ce979fe1ab45cf7034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:15:53.818466 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-06d89206-e5d1-4bcb-9172-e3468a316828 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 200 len: 1461 microversion: 2.1 time: 0.251868 Jun 04 21:15:53.824185 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2286/4668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:53 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 1461 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:53.956994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6d15ba33-a6c8-4039-ad78-e7f00d5fccdf req-34ef1a6f-18c0-41e9-b7d0-f1b8feb1382c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13126a23-1f1f-4860-a97b-521d01fd85d3", "name": "network-vif-deleted", "tag": "cb5892ba-bdda-46fb-969e-14cc126c401e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:53.973282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6d15ba33-a6c8-4039-ad78-e7f00d5fccdf req-34ef1a6f-18c0-41e9-b7d0-f1b8feb1382c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:53.975106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6d15ba33-a6c8-4039-ad78-e7f00d5fccdf req-34ef1a6f-18c0-41e9-b7d0-f1b8feb1382c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:54.002486 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6d15ba33-a6c8-4039-ad78-e7f00d5fccdf req-34ef1a6f-18c0-41e9-b7d0-f1b8feb1382c service nova] Creating event network-vif-deleted:cb5892ba-bdda-46fb-969e-14cc126c401e for instance 13126a23-1f1f-4860-a97b-521d01fd85d3 on nch1-master-1 Jun 04 21:15:54.009990 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6d15ba33-a6c8-4039-ad78-e7f00d5fccdf req-34ef1a6f-18c0-41e9-b7d0-f1b8feb1382c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070556 Jun 04 21:15:54.011697 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2383/4669] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:54.545239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:54.546200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:54.555053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:54.555791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:54.556737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:54.557311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:54.846234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:54.854309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:54.887596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:54.900015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:54.903715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:54.904120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:54.995835 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 HTTP/1.1 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '13126a23-1f1f-4860-a97b-521d01fd85d3'} Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:54.997560 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.003368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.020637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-139098f8-4376-477c-b721-394179d4547c tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 404 len: 111 microversion: 2.1 time: 0.184415 Jun 04 21:15:55.029619 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2384/4670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:54 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:55.037244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15370bcb-4faf-400e-9afb-6632ca7db041 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.119258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.compute.server_groups [None req-15370bcb-4faf-400e-9afb-6632ca7db041 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Querying cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) for 1 instances {{(pid=137228) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 04 21:15:55.127945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15370bcb-4faf-400e-9afb-6632ca7db041 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.139475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15370bcb-4faf-400e-9afb-6632ca7db041 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.172781 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15370bcb-4faf-400e-9afb-6632ca7db041 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.141905 Jun 04 21:15:55.177923 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2385/4671] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:15:55 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:15:55.190630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb820d53-97c1-4049-81de-e940ee27b55e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.219696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.compute.server_groups [None req-eb820d53-97c1-4049-81de-e940ee27b55e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Querying cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) for 1 instances {{(pid=137228) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 04 21:15:55.227009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb820d53-97c1-4049-81de-e940ee27b55e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.227804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb820d53-97c1-4049-81de-e940ee27b55e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.256235 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb820d53-97c1-4049-81de-e940ee27b55e tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/os-server-groups/bbf161fb-00ad-4d0a-8685-bcdd7dcd6810" status: 200 len: 183 microversion: 2.1 time: 0.070259 Jun 04 21:15:55.257389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2386/4672] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:15:55 2022] GET /compute/v2.1/os-server-groups/bbf161fb-00ad-4d0a-8685-bcdd7dcd6810 => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:15:55.267653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:15:55.269345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.270027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:55.283489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.284625 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34d2d2b1-23d2-4ab9-8157-ccb3f30be53d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1649 microversion: 2.1 time: 0.744384 Jun 04 21:15:55.286885 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2287/4673] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:54 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1649 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:55.287486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.288565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.289006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.324330 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.324881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 HTTP/1.1 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '13126a23-1f1f-4860-a97b-521d01fd85d3'} Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:55.326108 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.331232 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.331904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:55.336092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.337423 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d4078ace-ed25-497b-98b3-97d5d4f609fc tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 404 len: 111 microversion: 2.1 time: 0.073338 Jun 04 21:15:55.340044 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2387/4674] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:55 2022] DELETE /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:15:55.352988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.354246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] [instance: 13126a23-1f1f-4860-a97b-521d01fd85d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:55.363608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.366838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.368751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.372393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.373299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.374681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:55.375217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.375590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:55.409084 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 HTTP/1.1 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '13126a23-1f1f-4860-a97b-521d01fd85d3'} Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.418107 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. Jun 04 21:15:55.423059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.426290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance 13126a23-1f1f-4860-a97b-521d01fd85d3 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.427426 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da7c2158-2ae7-43ae-a5f4-9becb97195b3 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3" status: 404 len: 111 microversion: 2.1 time: 0.082977 Jun 04 21:15:55.428343 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2388/4675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:55 2022] GET /compute/v2.1/servers/13126a23-1f1f-4860-a97b-521d01fd85d3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:15:55.457098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-191587d4-9d67-4ea1-907f-fbbcae650b31 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.472072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-191587d4-9d67-4ea1-907f-fbbcae650b31 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance group 54d24fe9-9396-4328-80e4-32e45ceeb0a5 could not be found. Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-191587d4-9d67-4ea1-907f-fbbcae650b31 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-server-groups/54d24fe9-9396-4328-80e4-32e45ceeb0a5 HTTP/1.1 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance group 54d24fe9-9396-4328-80e4-32e45ceeb0a5 could not be found. Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '54d24fe9-9396-4328-80e4-32e45ceeb0a5'} Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 54d24fe9-9396-4328-80e4-32e45ceeb0a5 could not be found. Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 54d24fe9-9396-4328-80e4-32e45ceeb0a5 could not be found. Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.484502 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.489278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.489278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.489278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.489278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.489278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 54d24fe9-9396-4328-80e4-32e45ceeb0a5 could not be found. Jun 04 21:15:55.489278 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.492535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-191587d4-9d67-4ea1-907f-fbbcae650b31 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance group 54d24fe9-9396-4328-80e4-32e45ceeb0a5 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.494076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-191587d4-9d67-4ea1-907f-fbbcae650b31 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/54d24fe9-9396-4328-80e4-32e45ceeb0a5" status: 404 len: 117 microversion: 2.1 time: 0.052341 Jun 04 21:15:55.494880 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2389/4676] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:55 2022] DELETE /compute/v2.1/os-server-groups/54d24fe9-9396-4328-80e4-32e45ceeb0a5 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:55.516232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc3d6858-e986-4d1d-9e6f-ffc8958508a2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.529832 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-dc3d6858-e986-4d1d-9e6f-ffc8958508a2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance group 80d05bda-c866-4642-a7ae-3753770a5453 could not be found. Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc3d6858-e986-4d1d-9e6f-ffc8958508a2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-server-groups/80d05bda-c866-4642-a7ae-3753770a5453 HTTP/1.1 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance group 80d05bda-c866-4642-a7ae-3753770a5453 could not be found. Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '80d05bda-c866-4642-a7ae-3753770a5453'} Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 80d05bda-c866-4642-a7ae-3753770a5453 could not be found. Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 80d05bda-c866-4642-a7ae-3753770a5453 could not be found. Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.534287 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 80d05bda-c866-4642-a7ae-3753770a5453 could not be found. Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc3d6858-e986-4d1d-9e6f-ffc8958508a2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance group 80d05bda-c866-4642-a7ae-3753770a5453 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dc3d6858-e986-4d1d-9e6f-ffc8958508a2 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/80d05bda-c866-4642-a7ae-3753770a5453" status: 404 len: 117 microversion: 2.1 time: 0.037521 Jun 04 21:15:55.543295 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2390/4677] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:55 2022] DELETE /compute/v2.1/os-server-groups/80d05bda-c866-4642-a7ae-3753770a5453 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:55.553075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cb936e9-b7db-4d91-9e17-e260d0073bc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.570615 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8cb936e9-b7db-4d91-9e17-e260d0073bc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance group bc38a4db-dc0f-4fe8-9500-00c5ba088631 could not be found. Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cb936e9-b7db-4d91-9e17-e260d0073bc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-server-groups/bc38a4db-dc0f-4fe8-9500-00c5ba088631 HTTP/1.1 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance group bc38a4db-dc0f-4fe8-9500-00c5ba088631 could not be found. Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'bc38a4db-dc0f-4fe8-9500-00c5ba088631'} Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bc38a4db-dc0f-4fe8-9500-00c5ba088631 could not be found. Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bc38a4db-dc0f-4fe8-9500-00c5ba088631 could not be found. Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.576657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bc38a4db-dc0f-4fe8-9500-00c5ba088631 could not be found. Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8cb936e9-b7db-4d91-9e17-e260d0073bc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance group bc38a4db-dc0f-4fe8-9500-00c5ba088631 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.581573 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8cb936e9-b7db-4d91-9e17-e260d0073bc1 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/bc38a4db-dc0f-4fe8-9500-00c5ba088631" status: 404 len: 117 microversion: 2.1 time: 0.035844 Jun 04 21:15:55.582842 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2391/4678] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:55 2022] DELETE /compute/v2.1/os-server-groups/bc38a4db-dc0f-4fe8-9500-00c5ba088631 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:55.591321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1199b3e-8252-4e22-8cb7-8d5dc2829765 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.608962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-c1199b3e-8252-4e22-8cb7-8d5dc2829765 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] HTTP exception thrown: Instance group fba68f7b-99a4-4cea-a640-180c17e6a450 could not be found. Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1199b3e-8252-4e22-8cb7-8d5dc2829765 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Request method failure captured: Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/os-server-groups/fba68f7b-99a4-4cea-a640-180c17e6a450 HTTP/1.1 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8ttOejuIBkyt41W7eUWEAWQyurY4QQQBLif9_emTvvUa0H2n93n3zmrpUZSg7bQtyfniJDX7_XnIXumYyKPWgcO3zUAEgv_SI5W6Xf3f7K49FYY5BO_tAxrgBvNwlunAOXyLl06FdEpgq2WQNZu-Dti3vr08Ono7cq6VpRIobLgQrg Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1cfc7c15670542ce979fe1ab45cf7034"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 1cfc7c15670542ce979fe1ab45cf7034 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerGroupTestJSON-929573059 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1c1c95716bde4e28ac2a957eae09bb03 Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerGroupTestJSON-929573059-project Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance group fba68f7b-99a4-4cea-a640-180c17e6a450 could not be found. Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'fba68f7b-99a4-4cea-a640-180c17e6a450'} Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fba68f7b-99a4-4cea-a640-180c17e6a450 could not be found. Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fba68f7b-99a4-4cea-a640-180c17e6a450 could not be found. Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.616741 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:15:55.621365 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:15:55.621365 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:15:55.621365 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:15:55.621365 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:15:55.621365 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fba68f7b-99a4-4cea-a640-180c17e6a450 could not be found. Jun 04 21:15:55.621365 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:15:55.623423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1199b3e-8252-4e22-8cb7-8d5dc2829765 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Returning 404 to user: Instance group fba68f7b-99a4-4cea-a640-180c17e6a450 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:15:55.624655 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1199b3e-8252-4e22-8cb7-8d5dc2829765 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/fba68f7b-99a4-4cea-a640-180c17e6a450" status: 404 len: 117 microversion: 2.1 time: 0.041423 Jun 04 21:15:55.625718 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2392/4679] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:55 2022] DELETE /compute/v2.1/os-server-groups/fba68f7b-99a4-4cea-a640-180c17e6a450 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:15:55.643905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4640a50d-9256-49bf-9126-c4e935557319 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:55.727925 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4640a50d-9256-49bf-9126-c4e935557319 tempest-ServerGroupTestJSON-929573059 tempest-ServerGroupTestJSON-929573059-project] 10.222.0.18 "DELETE /compute/v2.1/os-server-groups/bbf161fb-00ad-4d0a-8685-bcdd7dcd6810" status: 204 len: 0 microversion: 2.1 time: 0.092788 Jun 04 21:15:55.727925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2393/4680] 10.222.0.18 () {58 vars in 1265 bytes} [Sat Jun 4 21:15:55 2022] DELETE /compute/v2.1/os-server-groups/bbf161fb-00ad-4d0a-8685-bcdd7dcd6810 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:56.096488 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6e7291c-2a14-4d99-8281-8b7cc710250a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1649 microversion: 2.1 time: 0.798054 Jun 04 21:15:56.097101 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2288/4681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:55 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1649 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:56.113815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:56.115029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:56.139303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:56.140432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:56.150987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:56.156167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:56.786009 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6052a67-ee6d-464f-865c-2573dd5ab4e1 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1649 microversion: 2.1 time: 0.676729 Jun 04 21:15:56.789747 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2394/4682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:56 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1649 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:56.804563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:56.805158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:56.817400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:56.821658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:56.829168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:56.829917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:56.899863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:15:57.073798 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ea7e6f5-04b9-4295-8a22-3b9bff4951b9 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 204 len: 0 microversion: 2.1 time: 0.273798 Jun 04 21:15:57.077908 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2289/4683] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:15:56 2022] DELETE /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:15:57.083144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:57.084033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:57.097399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:57.097968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:57.098887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:57.101640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:57.484974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e9458175-d52a-4115-a702-cb658b6ce703 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1655 microversion: 2.1 time: 0.402751 Jun 04 21:15:57.485709 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2395/4684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:57 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1655 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:58.180279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1813989834", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22f1edcf-47b5-4128-977f-2c43af547030"}], "security_groups": [{"name": "tempest-securitygroup--1623341290"}], "key_name": "tempest-keypair-1688031173", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:15:58.503113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:15:58.503800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:15:58.528691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:58.529158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:58.529963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:58.549094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:58.879937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] validate_networks() for [('22f1edcf-47b5-4128-977f-2c43af547030', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:15:59.144962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-452cada5-bb1d-4d08-9a6d-cff24028a6dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1655 microversion: 2.1 time: 0.646304 Jun 04 21:15:59.177954 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2396/4685] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:15:58 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1655 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:15:59.933226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:15:59.934624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:15:59.936837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:15:59.937739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:15:59.938788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:15:59.965713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:59.968526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:15:59.969612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:15:59.970377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:00.068968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:16:00.076647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for user bff665dac5de4530ab70f20ba2da386d and project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:16:00.110688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:16:00.113752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:16:00.181073 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:00.182353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:00.205223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:00.209204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:00.210168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:00.214466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:00.228629 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0c1fb5c-28b1-4f3a-b9ee-872a8cc8e11b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.048721 Jun 04 21:16:00.238937 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2290/4686] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:15:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:16:00.282538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-909d8b4e-da3c-4aee-ad0a-d2b52fade362 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:00.283536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-909d8b4e-da3c-4aee-ad0a-d2b52fade362 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:00.738045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-909d8b4e-da3c-4aee-ad0a-d2b52fade362 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:00.758918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-909d8b4e-da3c-4aee-ad0a-d2b52fade362 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:00.763353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-909d8b4e-da3c-4aee-ad0a-d2b52fade362 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:00.768648 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-909d8b4e-da3c-4aee-ad0a-d2b52fade362 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1282 microversion: 2.20 time: 0.522758 Jun 04 21:16:00.787559 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2291/4687] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:00 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1282 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:00.999441 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-90e163d8-ea07-4195-8fde-4e53d3bad301 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1655 microversion: 2.1 time: 0.822429 Jun 04 21:16:01.000277 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2397/4688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:00 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1655 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:01.474480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c7212f56-fdc8-47cb-b8ed-74fb474129ca req-0fa71c3f-c1da-4894-b24f-96c92f92280f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c6b0bf-52b7-497f-a6e8-4d41c016e04f", "name": "network-vif-deleted", "tag": "bf32e7e1-a6bf-42c5-a8e3-7e90a6d0646b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:01.490529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c7212f56-fdc8-47cb-b8ed-74fb474129ca req-0fa71c3f-c1da-4894-b24f-96c92f92280f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:01.494842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c7212f56-fdc8-47cb-b8ed-74fb474129ca req-0fa71c3f-c1da-4894-b24f-96c92f92280f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:01.526552 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c7212f56-fdc8-47cb-b8ed-74fb474129ca req-0fa71c3f-c1da-4894-b24f-96c92f92280f service nova] Creating event network-vif-deleted:bf32e7e1-a6bf-42c5-a8e3-7e90a6d0646b for instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f on nch1-master-1 Jun 04 21:16:01.541472 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c7212f56-fdc8-47cb-b8ed-74fb474129ca req-0fa71c3f-c1da-4894-b24f-96c92f92280f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072062 Jun 04 21:16:01.544956 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2292/4689] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:01.795779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:01.796435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:01.804314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:01.804767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:01.812081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:01.812536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:01.991864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:02.012218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:02.027244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:02.028140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:02.032153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:02.033704 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cdfd7d5d-c452-4875-b2a3-168447825b6d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1334 microversion: 2.20 time: 0.240589 Jun 04 21:16:02.038886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2398/4690] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:01 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1334 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:02.074208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:02.075119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:02.076276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:02.078813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:02.171089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:02.171917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:02.173036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lazy-loading 'fault' on Instance uuid f6c6b0bf-52b7-497f-a6e8-4d41c016e04f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:16:02.268947 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-117ad817-61ab-45ed-9309-1db58ff8a34e tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 200 len: 1454 microversion: 2.1 time: 0.255339 Jun 04 21:16:02.271355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2293/4691] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:02 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 1454 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:03.059216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:03.061084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:03.074132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.080814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.085004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.085738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.287541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:03.335061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:03.337158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:03.338726 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e7fe8b31-aaa3-4e0f-8a41-ef66c0c93d33 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1340 microversion: 2.20 time: 0.284385 Jun 04 21:16:03.339871 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2294/4692] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:03 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1340 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:16:03.347215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:03.350579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: f6c6b0bf-52b7-497f-a6e8-4d41c016e04f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:03.375676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.380468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.384655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.385356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.394384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-394357366", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "9f3ded24-35f9-4e63-bf30-72abb8e4a943"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:03.433709 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] HTTP exception thrown: Instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f could not be found. Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Request method failure captured: Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f HTTP/1.1 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8tj4BlAON9gRt36EFZKcgHMuisWIdElWkZuGOcGkpozHw4SEERJaIt2XH9GAA7GoCHe1qhVW9wJzkl34lXDazzfa-K6x2Jc15jWrE7IvyHbqQGBgTpzN4VinrtOaFxCxM2oNqCO0CExAETawUAsyg4j0Q9BbsQKFmZbuS1OV2Pblrg Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 214ab8444b4949b0b1e6f1ee4929743b Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestServerMultinode-147668295 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestServerMultinode-147668295 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 214ab8444b4949b0b1e6f1ee4929743b Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestServerMultinode-147668295 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestServerMultinode-147668295-project-admin Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 913b1fac19d748908e6b9f5980e8bde9 Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestServerMultinode-147668295-project-admin Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f could not be found. Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f6c6b0bf-52b7-497f-a6e8-4d41c016e04f'} Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f could not be found. Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f could not be found. Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:16:03.439419 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f could not be found. Jun 04 21:16:03.445917 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:03.448343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Returning 404 to user: Instance f6c6b0bf-52b7-497f-a6e8-4d41c016e04f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:16:03.452708 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc17dce1-2d2d-48e3-a6d9-3474afc8f3d8 tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f" status: 404 len: 111 microversion: 2.1 time: 0.111222 Jun 04 21:16:03.458456 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2295/4693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:03 2022] GET /compute/v2.1/servers/f6c6b0bf-52b7-497f-a6e8-4d41c016e04f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:16:03.480168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:03.480689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:03.494113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:03.514120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.514778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.515859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.516344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.538568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] validate_networks() for [('9f3ded24-35f9-4e63-bf30-72abb8e4a943', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:16:03.587537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:16:03.733097 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81bffc31-1e03-441d-88b2-1058ce3347dc tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "DELETE /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 204 len: 0 microversion: 2.1 time: 0.265229 Jun 04 21:16:03.735118 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2296/4694] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:16:03 2022] DELETE /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:16:03.750317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:03.751838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:03.766375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.767621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:03.768930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:03.770131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:04.410076 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca8dab0d-d28e-4731-831f-cca43308768d tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1655 microversion: 2.1 time: 0.669888 Jun 04 21:16:04.426819 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2297/4695] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:03 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1655 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:04.432083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:04.432960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:04.440028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:04.446044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:04.447194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:04.447854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:04.972902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:04.986529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:04.989999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:04.993680 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a0fef67e-60b1-4b22-865d-da311467d4f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 0.564325 Jun 04 21:16:04.996419 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2298/4696] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:04 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:05.421913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:16:05.423028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:16:05.423994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:16:05.424989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:16:05.425636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:16:05.478057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:05.484376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:05.497095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:05.499919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:05.591669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Getting quotas for project 85c8d0cb10be4ebeb3b8c7e899d66228. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:16:05.616704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Getting quotas for user 25ed8e5857cc4e46a4354a26613413a9 and project 85c8d0cb10be4ebeb3b8c7e899d66228. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:16:05.683646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:16:05.694156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:16:05.781140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:05.781816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:05.803028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:05.819063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:05.825126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:05.826067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:05.865581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9fe2acb3-b31b-475b-959f-cdb372557dc9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.815207 Jun 04 21:16:05.882101 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2399/4697] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:16:05.889630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:05.893344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:05.915142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:05.920385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:05.921554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:05.922165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.299644 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-197c62b6-b59d-4f62-91bf-75fb1533244a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1655 microversion: 2.1 time: 1.416296 Jun 04 21:16:07.305990 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2400/4698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:05 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1655 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:07.317831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a718aeb9-53d8-4d89-af8b-dbd8344571f5 req-6a2fa5ea-7c34-4fd7-b155-ecc9e0297c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:07.338622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a718aeb9-53d8-4d89-af8b-dbd8344571f5 req-6a2fa5ea-7c34-4fd7-b155-ecc9e0297c78 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.340315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a718aeb9-53d8-4d89-af8b-dbd8344571f5 req-6a2fa5ea-7c34-4fd7-b155-ecc9e0297c78 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.376564 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a718aeb9-53d8-4d89-af8b-dbd8344571f5 req-6a2fa5ea-7c34-4fd7-b155-ecc9e0297c78 service nova] Creating event network-changed:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:16:07.394995 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a718aeb9-53d8-4d89-af8b-dbd8344571f5 req-6a2fa5ea-7c34-4fd7-b155-ecc9e0297c78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084531 Jun 04 21:16:07.397146 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2401/4699] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:07.414482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:07.417741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:07.449715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.450480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.451446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.452601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.463591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:07.477788 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-505a9e55-ee2b-498e-93ac-d4b5f210bcfa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 2.165697 Jun 04 21:16:07.494111 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2299/4700] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:05 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:07.501141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:07.502016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:07.509906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.510854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.512181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.512787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.743052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:07.763208 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2856c016-6c29-462e-8744-6493f5213e4b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1267 microversion: 2.1 time: 0.364091 Jun 04 21:16:07.770026 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2402/4701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:07 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1267 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:07.789665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:07.792012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:07.820673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.821680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:07.823226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:07.824698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.143984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:08.160160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:08.164169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:08.167531 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bbc6f5dd-cef4-4ae4-84af-467cc688ed9e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 0.672064 Jun 04 21:16:08.169104 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2300/4702] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:07 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:08.316802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:08.322428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:08.323064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:08.331715 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c79cc37c-f991-45b1-8952-3c80a47a0465 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.559492 Jun 04 21:16:08.334644 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2403/4703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:07 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:08.348511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.349213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.350200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.350730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:08.350970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.351529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:08.372047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.372511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.373308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.378880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.465598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.469771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.472143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lazy-loading 'fault' on Instance uuid 4abedb9b-85a2-4678-b1c7-5bb198e6cefc {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:16:08.793713 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1155e73d-bb6c-4134-aceb-44283166f94c tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 200 len: 1454 microversion: 2.1 time: 0.475873 Jun 04 21:16:08.795115 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2301/4704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:08 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 1454 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:08.804635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:08.805601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:08.830813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.831479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:08.832498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:08.833035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.094935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:09.120331 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eaf257b9-f91c-463a-9075-b908d503a5cd tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1275 microversion: 2.1 time: 0.322355 Jun 04 21:16:09.128365 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2302/4705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:08 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1275 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:09.171487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:09.191382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:09.192830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:09.208661 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ded51418-fd7d-47c1-aaf7-e2ba59b3dfcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.861295 Jun 04 21:16:09.211629 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2404/4706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:08 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:09.212805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.213544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.214591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.215386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.228474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:09.229590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:09.244009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.246155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.248521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.261317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.314821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:09.845412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:09.857991 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ba3677b-133b-4755-8994-1f4c281de50d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.634629 Jun 04 21:16:09.860495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2405/4707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:09 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:09.869730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f2028dac-9a5f-46b1-a55d-7cda307d7bda req-08150449-e772-4c07-aa3a-440513c88968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abedb9b-85a2-4678-b1c7-5bb198e6cefc", "name": "network-vif-deleted", "tag": "7d8ec11b-dc2d-4ba2-9d6f-8f3696da553d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:09.910192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:09.912110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f2028dac-9a5f-46b1-a55d-7cda307d7bda req-08150449-e772-4c07-aa3a-440513c88968 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.913519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f2028dac-9a5f-46b1-a55d-7cda307d7bda req-08150449-e772-4c07-aa3a-440513c88968 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.924740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:09.926253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:09.927397 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-094b2d1e-e5c7-4494-bec6-74085f14f689 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 0.744144 Jun 04 21:16:09.930918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:09.948200 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2303/4708] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:09 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:09.953119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:09.953745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] [instance: 4abedb9b-85a2-4678-b1c7-5bb198e6cefc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:09.970100 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f2028dac-9a5f-46b1-a55d-7cda307d7bda req-08150449-e772-4c07-aa3a-440513c88968 service nova] Creating event network-vif-deleted:7d8ec11b-dc2d-4ba2-9d6f-8f3696da553d for instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc on nch2-master-1 Jun 04 21:16:09.971496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.971984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.972774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:09.973210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:09.990250 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f2028dac-9a5f-46b1-a55d-7cda307d7bda req-08150449-e772-4c07-aa3a-440513c88968 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128144 Jun 04 21:16:09.991242 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2406/4709] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:09.997809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1057875966", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "022d1b94-119f-49b9-8193-cbad0fb4c7b0"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:10.006149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:10.017074 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] HTTP exception thrown: Instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc could not be found. Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Request method failure captured: Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc HTTP/1.1 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8tj4BlAON9gRt36EFZKcgHMuisWIdElWkZuGOcGkpozHw4SEERJaIt2XH9GAA7GoCHe1qhVW9wJzkl34lXDazzfa-K6x2Jc15jWrE7IvyHbqQGBgTpzN4VinrtOaFxCxM2oNqCO0CExAETawUAsyg4j0Q9BbsQKFmZbuS1OV2Pblrg Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 214ab8444b4949b0b1e6f1ee4929743b Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestServerMultinode-147668295 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/214ab8444b4949b0b1e6f1ee4929743b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestServerMultinode-147668295 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 214ab8444b4949b0b1e6f1ee4929743b Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestServerMultinode-147668295 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestServerMultinode-147668295-project-admin Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 913b1fac19d748908e6b9f5980e8bde9 Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestServerMultinode-147668295-project-admin Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc could not be found. Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '4abedb9b-85a2-4678-b1c7-5bb198e6cefc'} Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc could not be found. Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc could not be found. Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:16:10.023103 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc could not be found. Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] Returning 404 to user: Instance 4abedb9b-85a2-4678-b1c7-5bb198e6cefc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:16:10.027790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c5426712-e606-456c-9499-afa3abdea27a tempest-TestServerMultinode-147668295 tempest-TestServerMultinode-147668295-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc" status: 404 len: 111 microversion: 2.1 time: 0.075390 Jun 04 21:16:10.030760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2304/4710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:09 2022] GET /compute/v2.1/servers/4abedb9b-85a2-4678-b1c7-5bb198e6cefc => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:16:10.098064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] validate_networks() for [('022d1b94-119f-49b9-8193-cbad0fb4c7b0', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:16:10.153477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:10.154100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:10.169605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:10.170526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:10.171231 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:10.171721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:10.334842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:10.344374 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f8b6e62-c513-4680-a7b8-1fbde1a44884 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1273 microversion: 2.1 time: 0.194710 Jun 04 21:16:10.350260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2305/4711] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:10 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:10.965955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:10.966621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:10.969378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:10.978859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:10.979311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:10.980141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:10.980575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:11.511291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:16:11.511805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:16:11.512206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:16:11.512613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:16:11.513024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:16:11.533716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:11.534192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:11.534970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:11.535409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:11.586679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:16:11.600611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for user 09431bbdbc394df8b368770d3e24a306 and project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:16:11.627189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:16:11.629679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:16:11.641935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:11.652680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:11.654184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:11.655664 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9709fee4-05e2-409b-b703-f25a8d0ae709 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 0.693819 Jun 04 21:16:11.668892 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2306/4712] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:10 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:16:11.687170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:11.687824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:11.718792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:11.719257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:11.724714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:11.728498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:11.792182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ee3a8f5d-5af7-4b37-ac61-3675fa25762c tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799303 Jun 04 21:16:11.792820 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2407/4713] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:16:11.809997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d55a458-7174-45fe-ae6b-9c1da7e359bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:11.810625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d55a458-7174-45fe-ae6b-9c1da7e359bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:12.090176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:12.100060 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-491c2520-71e6-4bd1-a5c5-3818671c5a3f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1273 microversion: 2.1 time: 0.418780 Jun 04 21:16:12.112995 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2307/4714] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:11 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1273 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:12.123771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7d55a458-7174-45fe-ae6b-9c1da7e359bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:12.136391 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d55a458-7174-45fe-ae6b-9c1da7e359bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1215 microversion: 2.1 time: 0.337070 Jun 04 21:16:12.140226 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2408/4715] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:11 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1215 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:12.687898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:12.688714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:12.699689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:12.701110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:12.705446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:12.706071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:13.129730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:13.131177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:13.160128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:13.161221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:13.162234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:13.163318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:14.338345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:14.347775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:14.394690 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df9282a4-2e5d-4f7b-bf4c-18446348e53f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 1.269513 Jun 04 21:16:14.396170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:14.399477 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2409/4716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:13 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:14.415182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:14.418206 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0c9e687c-d4e6-4797-a7e5-ea4a6593cc97 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 1.734597 Jun 04 21:16:14.420585 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2308/4717] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:12 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:14.424381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:14.425329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:14.430049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:14.436961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:14.437741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:14.438937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:14.439714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:14.558488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:14.619911 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6506374a-9bb5-4254-84c3-aeb9ac99cc17 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1273 microversion: 2.1 time: 0.211883 Jun 04 21:16:14.651231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2410/4718] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:14 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:15.415937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:15.420181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:15.442285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:15.444457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:15.466236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:15.469918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:15.474910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:15.476921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:15.477451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:15.479905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:15.480892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:15.482105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:16.242556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:16.271030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:16.279967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:16.283360 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-479f9f48-9267-4b68-b982-355642d2fd9f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.871782 Jun 04 21:16:16.284601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:16.304844 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2309/4719] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:15 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:16.308550 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64172e27-0cfd-430b-867b-36765ac50a90 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 0.851176 Jun 04 21:16:16.314402 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2411/4720] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:15 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:16:16.321402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:16.322016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:16.340734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:16.343016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:16.345381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:16.349339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:16.369201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0b2c0878-9d98-41cc-8547-6d83f825fb4b req-29924a49-90a8-4181-9718-38b97d59d448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "name": "network-vif-plugged", "status": "completed", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:16.392639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0b2c0878-9d98-41cc-8547-6d83f825fb4b req-29924a49-90a8-4181-9718-38b97d59d448 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:16.396060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0b2c0878-9d98-41cc-8547-6d83f825fb4b req-29924a49-90a8-4181-9718-38b97d59d448 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:16.424971 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0b2c0878-9d98-41cc-8547-6d83f825fb4b req-29924a49-90a8-4181-9718-38b97d59d448 service nova] Creating event network-vif-plugged:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:16:16.436659 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0b2c0878-9d98-41cc-8547-6d83f825fb4b req-29924a49-90a8-4181-9718-38b97d59d448 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081310 Jun 04 21:16:16.452649 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2412/4721] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:16.538691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:16.568005 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6502ffbc-2c52-4e4f-81a4-2573fde9c695 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1273 microversion: 2.1 time: 0.257233 Jun 04 21:16:16.570923 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2310/4722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:16 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:17.314998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:17.317140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:17.332601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:17.333595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:17.334899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:17.335644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:17.336886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:17.346245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:17.355092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:17.355643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:17.361339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:17.361840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:17.875561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:17.887208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:17.889233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:17.893743 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cccd662c-1f83-485f-9af6-4353bba85cd1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1408 microversion: 2.20 time: 0.566473 Jun 04 21:16:17.894847 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2311/4723] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:17 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1408 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:17.923537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:17.927076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:17.956608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:17.958821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:17.961597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:17.963792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:18.201263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:18.219707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb098bc5-cd46-4fe2-9a35-06e2783a3703 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.906161 Jun 04 21:16:18.221892 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2413/4724] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:17 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:18.241611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-8e7a63c3-75c3-45a3-b4bd-eeb9ee25edd9 req-f0d26c11-59df-40ae-97a9-01bd888b2fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a85e351-4de7-47f4-85c2-9a58e4a69c26", "tag": "9b24b22c-9b18-4a58-b2c7-cc1acaba2412"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:18.273912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8e7a63c3-75c3-45a3-b4bd-eeb9ee25edd9 req-f0d26c11-59df-40ae-97a9-01bd888b2fb1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:18.274890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8e7a63c3-75c3-45a3-b4bd-eeb9ee25edd9 req-f0d26c11-59df-40ae-97a9-01bd888b2fb1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:18.342017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-8e7a63c3-75c3-45a3-b4bd-eeb9ee25edd9 req-f0d26c11-59df-40ae-97a9-01bd888b2fb1 service nova] Creating event network-changed:9b24b22c-9b18-4a58-b2c7-cc1acaba2412 for instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 on nch1-master-1 Jun 04 21:16:18.360293 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-8e7a63c3-75c3-45a3-b4bd-eeb9ee25edd9 req-f0d26c11-59df-40ae-97a9-01bd888b2fb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135628 Jun 04 21:16:18.365446 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2414/4725] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:18.668027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:18.679960 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1f82c637-75c4-42e1-9d90-939f56796bca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.779136 Jun 04 21:16:18.689118 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2312/4726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:17 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:18.915409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:18.916188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:18.939587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:18.943388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:18.944937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:18.948186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:19.240260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:19.240867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:19.250611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:19.251675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:19.253225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:19.255977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:19.257757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:19.268897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:19.271524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:19.275794 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e82da790-1b99-4862-888a-b056d94514a9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1601 microversion: 2.20 time: 0.366273 Jun 04 21:16:19.277628 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2415/4727] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:16:18 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1601 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:16:19.296082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:19.297306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:19.321971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:19.326977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:19.329750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:19.332729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:19.485745 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d4e1b168-b69e-43a5-8270-e43158a63173 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.195983 Jun 04 21:16:19.491997 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2416/4728] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Jun 4 21:16:19 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:16:19.649400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:19.661112 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c45352d-3b6b-4af3-a30c-5d6f11c03162 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.421079 Jun 04 21:16:19.661744 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2313/4729] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:19 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:19.707911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:19.708665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:19.722969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:19.724178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:19.725368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:19.726021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:20.062714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:20.124367 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc69e1a5-5f07-4dd6-9251-928f2c603b77 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.415591 Jun 04 21:16:20.125486 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2417/4730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:19 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:20.679038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:20.679707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:20.693423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:20.695545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:20.699456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:20.703461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:21.156699 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:21.159477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:21.170341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:21.171443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:21.178273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:21.179002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:21.436015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:21.457436 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69d2e640-af1a-447a-9e06-679abfd628a1 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.777382 Jun 04 21:16:21.459584 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2314/4731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:20 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:21.479843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:21.490418 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3ea05135-cbb8-4b3a-8482-f30d067bca6f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.351486 Jun 04 21:16:21.491694 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2418/4732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:21 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:22.474285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:22.478215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:22.489487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:22.493396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:22.499354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:22.504777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:22.508340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:22.508963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:22.512676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:22.515295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:22.539287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:22.549533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:22.550922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:22.551662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:23.292864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:23.301646 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98ba2c94-5d08-4b34-9ce6-dd0e69f15e3f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.797818 Jun 04 21:16:23.305495 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2419/4733] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:22 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:23.337509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:23.348697 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83c5b48c-baa3-448e-a87c-05f05c58740b tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.876328 Jun 04 21:16:23.352652 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2315/4734] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:22 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:23.454965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-98c28090-439c-4d47-8169-65c1cd10c634 req-a94690ad-4d42-49e1-8d85-5b93ba391aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d304e214-5fc8-48e8-b10c-e2ceb408f65c", "tag": "311c47f6-88d5-45dc-8e09-fbf1f6ebdc90"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:23.469622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-98c28090-439c-4d47-8169-65c1cd10c634 req-a94690ad-4d42-49e1-8d85-5b93ba391aa2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:23.470075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-98c28090-439c-4d47-8169-65c1cd10c634 req-a94690ad-4d42-49e1-8d85-5b93ba391aa2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:23.502790 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-98c28090-439c-4d47-8169-65c1cd10c634 req-a94690ad-4d42-49e1-8d85-5b93ba391aa2 service nova] Creating event network-changed:311c47f6-88d5-45dc-8e09-fbf1f6ebdc90 for instance d304e214-5fc8-48e8-b10c-e2ceb408f65c on nch2-master-1 Jun 04 21:16:23.521540 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-98c28090-439c-4d47-8169-65c1cd10c634 req-a94690ad-4d42-49e1-8d85-5b93ba391aa2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075815 Jun 04 21:16:23.527236 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2420/4735] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:24.323338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:24.324863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:24.346430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:24.346803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:24.347628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:24.348076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:24.368338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:24.369431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:24.382325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:24.382785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:24.383612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:24.384058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:24.812045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:24.821181 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-868c5f82-73ae-4ab4-9b80-2e99f4108770 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.502948 Jun 04 21:16:24.821778 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2316/4736] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:24 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:24.983374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:24.998576 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2fdad1a5-aa1a-4173-a69d-cceb3b733887 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.633150 Jun 04 21:16:25.003489 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2421/4737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:24 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:25.554442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-877ba66a-fbea-4f3b-8ee6-2eb9ddad86f0 req-e8a5af1e-1335-459b-aef5-ac0e836477ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:25.573650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-877ba66a-fbea-4f3b-8ee6-2eb9ddad86f0 req-e8a5af1e-1335-459b-aef5-ac0e836477ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:25.574405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-877ba66a-fbea-4f3b-8ee6-2eb9ddad86f0 req-e8a5af1e-1335-459b-aef5-ac0e836477ca service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:25.601314 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-877ba66a-fbea-4f3b-8ee6-2eb9ddad86f0 req-e8a5af1e-1335-459b-aef5-ac0e836477ca service nova] Creating event network-changed:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:16:25.624220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-877ba66a-fbea-4f3b-8ee6-2eb9ddad86f0 req-e8a5af1e-1335-459b-aef5-ac0e836477ca service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071977 Jun 04 21:16:25.625404 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2317/4738] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:25.848977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:25.850542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:25.869893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:25.871836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:25.876166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:25.877069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:26.020559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:26.022013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:26.035418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:26.035904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:26.042676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:26.043287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:26.140580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:26.190583 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-295ceed1-dd1d-4c4d-b25b-63b1582cfab1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.354774 Jun 04 21:16:26.192026 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2422/4739] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:25 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:26.372664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cc6f07ce-2236-4c88-9218-1352ba00e066 req-1f6445a7-7a7e-482f-8075-8c06529cafe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a85e351-4de7-47f4-85c2-9a58e4a69c26", "name": "network-vif-plugged", "status": "completed", "tag": "9b24b22c-9b18-4a58-b2c7-cc1acaba2412"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:26.390888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cc6f07ce-2236-4c88-9218-1352ba00e066 req-1f6445a7-7a7e-482f-8075-8c06529cafe2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:26.391834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cc6f07ce-2236-4c88-9218-1352ba00e066 req-1f6445a7-7a7e-482f-8075-8c06529cafe2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:26.416442 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cc6f07ce-2236-4c88-9218-1352ba00e066 req-1f6445a7-7a7e-482f-8075-8c06529cafe2 service nova] Creating event network-vif-plugged:9b24b22c-9b18-4a58-b2c7-cc1acaba2412 for instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 on nch1-master-1 Jun 04 21:16:26.434804 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cc6f07ce-2236-4c88-9218-1352ba00e066 req-1f6445a7-7a7e-482f-8075-8c06529cafe2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066180 Jun 04 21:16:26.435834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2423/4740] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:26.532729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:26.541865 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b9c4b72d-4e99-4a65-aeb7-b50abb7df553 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.526590 Jun 04 21:16:26.542469 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2318/4741] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:26 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:27.210725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:27.213002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:27.223474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:27.224324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:27.227019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:27.227727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:27.559197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:27.559855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:27.573246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:27.574273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:27.576954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:27.577917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:27.779245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:27.787037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c32d4c49-b3d0-4e2b-a800-66e226658dcb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.581133 Jun 04 21:16:27.788136 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2424/4742] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:27 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:27.997403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:28.010416 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-590b6134-e9e0-460f-a4a8-cfc6868e6357 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1315 microversion: 2.1 time: 0.455014 Jun 04 21:16:28.011317 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2319/4743] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:27 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:28.808274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:28.809090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:28.826146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:28.827034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:28.828709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:28.829273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.028629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:29.029615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:29.037524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.037972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.038743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.039169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.576406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:29.589010 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0078c290-3f78-4d3f-9c74-c7c9019656df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.788724 Jun 04 21:16:29.601541 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2425/4744] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:28 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:29.610336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-65be762f-71f7-4bf9-afd8-d98ec32f5847 req-aab103ab-15a2-4421-b8a8-775f8dbcf020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d304e214-5fc8-48e8-b10c-e2ceb408f65c", "name": "network-vif-plugged", "status": "completed", "tag": "311c47f6-88d5-45dc-8e09-fbf1f6ebdc90"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:29.620674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-65be762f-71f7-4bf9-afd8-d98ec32f5847 req-aab103ab-15a2-4421-b8a8-775f8dbcf020 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.622194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-65be762f-71f7-4bf9-afd8-d98ec32f5847 req-aab103ab-15a2-4421-b8a8-775f8dbcf020 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.637658 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-65be762f-71f7-4bf9-afd8-d98ec32f5847 req-aab103ab-15a2-4421-b8a8-775f8dbcf020 service nova] Creating event network-vif-plugged:311c47f6-88d5-45dc-8e09-fbf1f6ebdc90 for instance d304e214-5fc8-48e8-b10c-e2ceb408f65c on nch2-master-1 Jun 04 21:16:29.643953 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-65be762f-71f7-4bf9-afd8-d98ec32f5847 req-aab103ab-15a2-4421-b8a8-775f8dbcf020 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040555 Jun 04 21:16:29.645005 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2426/4745] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:29.652706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:29.662210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cae1f7f1-7113-4486-99e1-64773d281360 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1504 microversion: 2.1 time: 0.637990 Jun 04 21:16:29.674758 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2320/4746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:29 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:29.682566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:29.683482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:29.691167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.691899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.692873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.693752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.788045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:29.804429 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-335dd8a3-ea20-44d4-b714-df90256ea3f5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.127469 Jun 04 21:16:29.805249 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2427/4747] 10.222.0.18 () {58 vars in 1295 bytes} [Sat Jun 4 21:16:29 2022] DELETE /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26/os-server-password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:16:29.816280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:29.817114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:29.823955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.824629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.825623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.826301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.842269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:29.866693 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-453f002b-48cc-409b-b64a-fe6c744f8ef5 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.055799 Jun 04 21:16:29.868073 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2321/4748] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:16:29 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26/os-server-password => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:16:29.880507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:29.881166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:29.890185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.890649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.892437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:29.893722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:29.938667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:16:30.080292 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0400349-7728-483d-ba95-0fafcd3bbf6d tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 204 len: 0 microversion: 2.1 time: 0.205045 Jun 04 21:16:30.085731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2428/4749] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:16:29 2022] DELETE /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:16:30.094796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:30.096132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:30.103535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:30.104653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:30.105601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:30.106338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:30.382335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:30.390530 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ac94da13-5d89-4356-8744-f6df0f23064f tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1510 microversion: 2.1 time: 0.300453 Jun 04 21:16:30.406742 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2322/4750] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:30 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:30.608672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:30.609454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:30.616931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:30.620857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:30.623104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:30.624117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:31.051733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:31.059841 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad5b636e-5e85-49f5-b83b-f9993a108f40 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1315 microversion: 2.1 time: 0.456526 Jun 04 21:16:31.067849 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2429/4751] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:30 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:31.416578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:31.417454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:31.432048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:31.432588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:31.433460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:31.433968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:31.716392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:31.731804 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32526091-e7fe-4986-9eed-bd1fe6366ce9 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1510 microversion: 2.1 time: 0.319805 Jun 04 21:16:31.732902 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2323/4752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:31 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:32.077327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:32.078233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:32.093564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:32.094051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:32.095495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:32.099716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:32.482739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:32.501528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a2276dd-7e1e-4311-9d28-c6df50ee516f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1503 microversion: 2.1 time: 0.429483 Jun 04 21:16:32.502319 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2430/4753] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:32 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1503 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:32.518733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:32.519955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:32.527268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:32.528506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:32.529518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:32.530559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:32.771968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:32.772815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Removing security group e52f99fb-8fa7-406c-ba87-dd5bad8ca991 from port 311c47f6-88d5-45dc-8e09-fbf1f6ebdc90 Jun 04 21:16:32.773877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:32.783881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:32.784493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:32.785710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:32.803744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:33.016408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25ed8e5857cc4e46a4354a26613413a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c8d0cb10be4ebeb3b8c7e899d66228', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:33.037279 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-90ed4b2f-1318-43df-a51a-ec843ac13336 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 200 len: 1468 microversion: 2.1 time: 0.290163 Jun 04 21:16:33.038467 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2431/4754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:32 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:33.051152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-db3d2201-35e9-4eb1-88fe-0c5597706146 req-ce34b621-7fd1-4246-9b5a-1c456a840262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a85e351-4de7-47f4-85c2-9a58e4a69c26", "name": "network-vif-deleted", "tag": "9b24b22c-9b18-4a58-b2c7-cc1acaba2412"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:33.074806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-db3d2201-35e9-4eb1-88fe-0c5597706146 req-ce34b621-7fd1-4246-9b5a-1c456a840262 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:33.076138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-db3d2201-35e9-4eb1-88fe-0c5597706146 req-ce34b621-7fd1-4246-9b5a-1c456a840262 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:33.094941 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-db3d2201-35e9-4eb1-88fe-0c5597706146 req-ce34b621-7fd1-4246-9b5a-1c456a840262 service nova] Creating event network-vif-deleted:9b24b22c-9b18-4a58-b2c7-cc1acaba2412 for instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 on nch1-master-1 Jun 04 21:16:33.102289 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-db3d2201-35e9-4eb1-88fe-0c5597706146 req-ce34b621-7fd1-4246-9b5a-1c456a840262 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062115 Jun 04 21:16:33.103863 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2432/4755] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:33.623688 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7a6f1f1-3be5-403c-928f-bda6b8c81cc0 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c/action" status: 202 len: 0 microversion: 2.1 time: 1.109098 Jun 04 21:16:33.624657 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2324/4756] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:16:32 2022] POST /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:16:33.633140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bb71ef17-1792-48b8-9bba-ddeadcfc8070 req-484a2a9f-989d-4a99-a8ef-b97c58710319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d304e214-5fc8-48e8-b10c-e2ceb408f65c", "tag": "311c47f6-88d5-45dc-8e09-fbf1f6ebdc90"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:33.635078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:33.636207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:33.638170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:33.657637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:33.666542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bb71ef17-1792-48b8-9bba-ddeadcfc8070 req-484a2a9f-989d-4a99-a8ef-b97c58710319 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:33.667154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:33.667500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bb71ef17-1792-48b8-9bba-ddeadcfc8070 req-484a2a9f-989d-4a99-a8ef-b97c58710319 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:33.670131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:33.670618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:33.701744 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bb71ef17-1792-48b8-9bba-ddeadcfc8070 req-484a2a9f-989d-4a99-a8ef-b97c58710319 service nova] Creating event network-changed:311c47f6-88d5-45dc-8e09-fbf1f6ebdc90 for instance d304e214-5fc8-48e8-b10c-e2ceb408f65c on nch2-master-1 Jun 04 21:16:33.712295 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bb71ef17-1792-48b8-9bba-ddeadcfc8070 req-484a2a9f-989d-4a99-a8ef-b97c58710319 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082704 Jun 04 21:16:33.715768 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2325/4757] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:16:33.978372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:34.004412 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e1cb042f-1f54-49db-9ceb-cd10a30d7b8d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1461 microversion: 2.1 time: 0.375087 Jun 04 21:16:34.005834 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2433/4758] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:33 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1461 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:34.022556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:34.023270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:34.038548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:34.039007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:34.039847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:34.040284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:34.056114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:34.056981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] [instance: 1a85e351-4de7-47f4-85c2-9a58e4a69c26] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:34.068843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:34.070489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:34.072322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:34.073043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:34.096530 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] HTTP exception thrown: Instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 could not be found. Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Request method failure captured: Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 HTTP/1.1 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8uSKgZhn28vo4VxMwjVTvSvFBYCE4up8wav5YfWRMuWAbbV18txPtEWEWtXRn4ge_1uwa4g7GFei1K5hnlrEU3W9hD8yDnfXfxcS_l7Gmgzj5HOyhO6bv5PXCFT4ROIbA68ntEuh65xLIbo69-LwGIg9myCQpmqyhCUcnH4TiY7ico Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 85c8d0cb10be4ebeb3b8c7e899d66228 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerPasswordTestJSON-697480325 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_85c8d0cb10be4ebeb3b8c7e899d66228"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85c8d0cb10be4ebeb3b8c7e899d66228"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/85c8d0cb10be4ebeb3b8c7e899d66228"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/85c8d0cb10be4ebeb3b8c7e899d66228"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerPasswordTestJSON-697480325 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 85c8d0cb10be4ebeb3b8c7e899d66228 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerPasswordTestJSON-697480325 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerPasswordTestJSON-697480325-project Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 25ed8e5857cc4e46a4354a26613413a9 Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerPasswordTestJSON-697480325-project Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 could not be found. Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1a85e351-4de7-47f4-85c2-9a58e4a69c26'} Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 could not be found. Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 could not be found. Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:16:34.100564 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 could not be found. Jun 04 21:16:34.105057 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:16:34.109068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] Returning 404 to user: Instance 1a85e351-4de7-47f4-85c2-9a58e4a69c26 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:16:34.110046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-964c13f0-0a01-4de3-8c59-e1e2ecd3f673 tempest-ServerPasswordTestJSON-697480325 tempest-ServerPasswordTestJSON-697480325-project] 10.222.0.18 "GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26" status: 404 len: 111 microversion: 2.1 time: 0.058892 Jun 04 21:16:34.111484 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2434/4759] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:34 2022] GET /compute/v2.1/servers/1a85e351-4de7-47f4-85c2-9a58e4a69c26 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:16:34.438363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:34.449996 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5cd03af-98a5-4c38-a42e-3e44dd3357c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.431867 Jun 04 21:16:34.455463 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2326/4760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:34 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:34.471656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:34.472330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:34.483900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:34.484370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:34.485184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:34.485638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:34.971842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:34.982483 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c76c0c38-0234-4199-8866-31915b170288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.515410 Jun 04 21:16:34.983279 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2435/4761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:34 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:35.000939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:35.002233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:35.014863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:35.016216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:35.017242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:35.018216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:35.330996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:35.344001 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d0316c29-472d-4a96-adce-07dbcd6690fa tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.348800 Jun 04 21:16:35.348175 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2327/4762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:34 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:35.369526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:35.370700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:35.384676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:35.385201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:35.386996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:35.387778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:35.615449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:35.628933 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e4a90fe-a732-465c-8a32-4478f4827631 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.268267 Jun 04 21:16:35.633182 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2436/4763] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:35 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:35.844308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1847191462", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "022d1b94-119f-49b9-8193-cbad0fb4c7b0"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:35.937096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] validate_networks() for [('022d1b94-119f-49b9-8193-cbad0fb4c7b0', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:16:37.170217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:16:37.171246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:16:37.171246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:16:37.171478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:16:37.172330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:16:37.200693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:37.201555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:37.202694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:37.205155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:37.273076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:16:37.282721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Getting quotas for user 09431bbdbc394df8b368770d3e24a306 and project 0dc813c0affe4551bd334712c53fdd3c. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:16:37.311957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:16:37.317819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:16:37.439154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f28e67a8-c0bb-4395-b5ce-0ae05290c6c8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.598930 Jun 04 21:16:37.451340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e0b9b4fa-f660-40da-b40a-8201162a787b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:37.452689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e0b9b4fa-f660-40da-b40a-8201162a787b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:37.453612 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2328/4764] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:16:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:16:37.652729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e0b9b4fa-f660-40da-b40a-8201162a787b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:37.669845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e0b9b4fa-f660-40da-b40a-8201162a787b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1215 microversion: 2.1 time: 0.223709 Jun 04 21:16:37.674810 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2437/4765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:37 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:38.692003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:38.693333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:38.714844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:38.717067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:38.718164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:38.718827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:38.803711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:38.816733 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2614bf76-5642-47b9-8c0c-92b1f4a3dc09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1267 microversion: 2.1 time: 0.128865 Jun 04 21:16:38.829324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2329/4766] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:38 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:39.836693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:39.838005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:39.854962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:39.856232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:39.857389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:39.857853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:39.981919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:39.995796 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fe7502ab-278b-4a7f-8584-e7a821d84d76 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1273 microversion: 2.1 time: 0.163017 Jun 04 21:16:40.009103 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2438/4767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:39 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:41.019320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:41.021298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:41.048336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:41.049055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:41.053998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:41.055412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:41.222789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:41.237547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8b29e257-6527-4331-bb96-ae07f7a56385 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1273 microversion: 2.1 time: 0.226778 Jun 04 21:16:41.259678 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2330/4768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:41 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:42.259953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:42.261231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:42.277201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:42.280534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:42.283366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:42.285316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:42.749898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:42.763789 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-234a9121-254e-4056-bfc9-16fab462ae68 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.512187 Jun 04 21:16:42.775608 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2439/4769] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:42 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:43.786261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:43.788436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:43.802017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:43.802878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:43.803935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:43.805220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:44.266904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:44.296040 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a2809fd3-8378-40e8-9ce4-f9fbcd92aed8 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.508749 Jun 04 21:16:44.308600 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2331/4770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:43 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:45.315952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:45.317406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:45.321249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:45.354656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:45.377196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:45.378775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:45.383759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:45.818153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:45.829955 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f5ea7391-d108-4736-91a4-5a99d7a99b54 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.518219 Jun 04 21:16:45.830572 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2440/4771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:45 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:46.793500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0ff3ae67-cd9f-4481-97bb-501b92075470 req-7042c2d9-aa81-48eb-8d37-4545229cc71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed323b4c-e457-4672-ae3d-4b7238721ce6", "tag": "aaaa0959-ea7a-417a-9856-c0c203d4dd3b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:46.816975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0ff3ae67-cd9f-4481-97bb-501b92075470 req-7042c2d9-aa81-48eb-8d37-4545229cc71b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:46.817950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0ff3ae67-cd9f-4481-97bb-501b92075470 req-7042c2d9-aa81-48eb-8d37-4545229cc71b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:46.843960 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0ff3ae67-cd9f-4481-97bb-501b92075470 req-7042c2d9-aa81-48eb-8d37-4545229cc71b service nova] Creating event network-changed:aaaa0959-ea7a-417a-9856-c0c203d4dd3b for instance ed323b4c-e457-4672-ae3d-4b7238721ce6 on nch1-master-1 Jun 04 21:16:46.848947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:46.849741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:46.863046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0ff3ae67-cd9f-4481-97bb-501b92075470 req-7042c2d9-aa81-48eb-8d37-4545229cc71b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073181 Jun 04 21:16:46.863465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:46.864434 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2332/4772] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:46.865031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:46.865864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:46.866285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:47.244556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:47.260707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b3c7d42c-b7ac-43b3-b4c5-a5e55778e64f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.414039 Jun 04 21:16:47.263099 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2441/4773] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:46 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:48.281143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:48.282827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:48.284616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:48.287786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:48.316308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:48.319342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:48.322701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:48.324441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:49.889158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:49.908671 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-24723662-48eb-48c4-b9fe-2541ff84b796 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 1.632421 Jun 04 21:16:49.909580 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2333/4774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:48 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:50.924372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:50.931254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:50.932429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:50.949944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:50.950910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:50.952568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:50.953258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:51.365629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:51.379675 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-efc947b9-26f9-4da1-890a-c7d4caa7fe21 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.456702 Jun 04 21:16:51.381001 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2442/4775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:50 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:52.397689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:52.398984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:52.443374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:52.444156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:52.447307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:52.450673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:53.159866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:53.175267 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3207965d-d1f8-4cfc-b978-270b3ade0284 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.781604 Jun 04 21:16:53.176437 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2334/4776] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:52 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:54.197486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:54.201474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:54.226219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:54.228702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:54.233937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:54.234797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:54.815325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:54.836119 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2fa08bab-aef8-4663-bb3c-2d024cfbd81f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.634053 Jun 04 21:16:54.837387 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2443/4777] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:54 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:54.912436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a13a592e-1cd0-400f-a44f-27b7e2a06754 req-77cb9cee-1aed-4a53-901a-0f79f886e4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed323b4c-e457-4672-ae3d-4b7238721ce6", "name": "network-vif-plugged", "status": "completed", "tag": "aaaa0959-ea7a-417a-9856-c0c203d4dd3b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:54.929255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a13a592e-1cd0-400f-a44f-27b7e2a06754 req-77cb9cee-1aed-4a53-901a-0f79f886e4c5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:54.929810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a13a592e-1cd0-400f-a44f-27b7e2a06754 req-77cb9cee-1aed-4a53-901a-0f79f886e4c5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:54.952579 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a13a592e-1cd0-400f-a44f-27b7e2a06754 req-77cb9cee-1aed-4a53-901a-0f79f886e4c5 service nova] Creating event network-vif-plugged:aaaa0959-ea7a-417a-9856-c0c203d4dd3b for instance ed323b4c-e457-4672-ae3d-4b7238721ce6 on nch1-master-1 Jun 04 21:16:54.976866 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a13a592e-1cd0-400f-a44f-27b7e2a06754 req-77cb9cee-1aed-4a53-901a-0f79f886e4c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070728 Jun 04 21:16:54.979647 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2335/4778] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:16:55.855983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:55.856928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:55.885724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:55.890371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:55.891731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:55.892355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:56.107992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-353566200", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:56.238230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] validate_networks() for [('5bf41cf5-ca2b-4742-8980-16b3c9c41734', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:16:56.686667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:56.703281 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5d2f0039-0df3-4a8c-8c71-92e9763560d2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1315 microversion: 2.1 time: 0.853118 Jun 04 21:16:56.713418 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2336/4779] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:55 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:57.721377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:57.722107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:57.734364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:57.735984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:57.736201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:16:57.736815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:57.737263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:57.737551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:16:57.738402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:16:57.738520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:16:57.738837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:16:57.749242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:57.749964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:57.750724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:57.751442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:57.810793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Getting quotas for project c284c2855bac423280d7e234dee6b7ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:16:57.822510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Getting quotas for user 2166b66a28214ff9802da4f955b5a4c5 and project c284c2855bac423280d7e234dee6b7ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:16:57.839475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:16:57.842497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:16:57.907569 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7cf4244a-81d0-4fe9-9d9a-a2b1156589d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.163233 Jun 04 21:16:57.911668 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2444/4780] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:16:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:16:57.918869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9d0386ee-55f6-43cf-99fa-33a9542b7d6f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:57.919861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9d0386ee-55f6-43cf-99fa-33a9542b7d6f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:58.136005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9d0386ee-55f6-43cf-99fa-33a9542b7d6f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:58.148049 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9d0386ee-55f6-43cf-99fa-33a9542b7d6f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1213 microversion: 2.1 time: 0.233292 Jun 04 21:16:58.152797 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2445/4781] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:57 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1213 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:16:58.158504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:58.168276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:58.177896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:58.178449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:58.179345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:58.180528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:58.207561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:16:58.213499 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b5588c35-afc9-4490-84e9-2e9ff255c25d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/ips" status: 200 len: 152 microversion: 2.20 time: 0.058861 Jun 04 21:16:58.214238 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2446/4782] 10.222.0.18 () {60 vars in 1288 bytes} [Sat Jun 4 21:16:58 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:16:58.355098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:58.366936 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b702fb2b-ddee-44ea-b23b-d26ce40d8aee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1502 microversion: 2.1 time: 0.647638 Jun 04 21:16:58.368774 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2337/4783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:57 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1502 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:58.386808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:16:58.391896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:58.414564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:58.415121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:58.416579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:58.421904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:58.589321 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61dc8ee3-a113-423c-bc5f-c5fc5062a679 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6/action" status: 202 len: 0 microversion: 2.1 time: 0.204233 Jun 04 21:16:58.593113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2447/4784] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:16:58 2022] POST /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:16:58.601675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:58.602675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:58.612794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:58.626468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:58.633521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:58.642269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:59.194502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:16:59.197104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:16:59.210553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:59.211054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:59.212010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:16:59.212645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:16:59.359157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:59.375863 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3b77f305-a6a0-45bc-acb8-e2eef23299c8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1217 microversion: 2.1 time: 0.209300 Jun 04 21:16:59.381963 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2448/4785] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:59 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1217 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:16:59.390754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:16:59.403353 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-54a1ee30-eeb7-4a88-afc2-0ac0bfc09497 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1507 microversion: 2.1 time: 0.806965 Jun 04 21:16:59.417929 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2338/4786] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:16:58 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1507 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:00.398936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:00.399599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:00.409558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.414826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.416329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.416971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.435771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:00.437085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:00.447931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.449025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.450428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.451396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.461830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=86 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:00.664270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:00.691185 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fbcabcab-1efb-4e51-845b-23bce746edd0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1271 microversion: 2.1 time: 0.296548 Jun 04 21:17:00.691840 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2449/4787] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:00 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:00.703984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:00.705319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:00.718883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.719345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.720238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.725523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.746818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:00.757062 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02f93a48-4a22-4367-9b26-709bda0cba79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1487 microversion: 2.1 time: 0.334380 Jun 04 21:17:00.759168 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2339/4788] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:00 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1487 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:00.778509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lazy-loading 'flavor' on Instance uuid c61574d2-73e7-4234-a592-ee9c151ebf69 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:17:00.786504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:00.787706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:00.798816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.799733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.800850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:00.801527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:00.845921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lazy-loading 'flavor' on Instance uuid ed323b4c-e457-4672-ae3d-4b7238721ce6 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:17:01.365900 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e051c1c7-1c8c-4f4e-b823-1f14aa6d23f3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/action" status: 202 len: 0 microversion: 2.20 time: 0.672547 Jun 04 21:17:01.367869 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2450/4789] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:17:00 2022] POST /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:17:01.374202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6fe968f7-e01a-4bb6-909a-f7da8721045b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6/action" status: 202 len: 0 microversion: 2.1 time: 0.600374 Jun 04 21:17:01.380119 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2340/4790] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:00 2022] POST /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:17:01.390704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1968864185", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "8d4d4fdb-bf58-48a1-9c15-08a6fdd28310"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:01.401952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:01.402954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:01.459756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:01.471833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:01.475774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:01.481883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:01.511045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] validate_networks() for [('8d4d4fdb-bf58-48a1-9c15-08a6fdd28310', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:17:01.831351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:01.845351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:01.846879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:01.848468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a723b779-bb0e-46d9-9dbd-bf14a49951fb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.466875 Jun 04 21:17:01.849557 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2341/4791] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:01 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:01.855230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:01.856258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:01.863741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:01.864479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:01.865326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:01.865772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:02.191653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:02.201718 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04a25473-97a5-420e-b073-31a3f3d86207 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1493 microversion: 2.1 time: 0.350874 Jun 04 21:17:02.203625 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2342/4792] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:01 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1493 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:02.217955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:02.219365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:02.232890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:02.239603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:02.241433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:02.243951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:02.283318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:17:02.283661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:17:02.284854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:17:02.285450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:17:02.286209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:17:02.302975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:02.308630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:02.309653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:02.311691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:02.336750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Getting quotas for project 82e56305a8994e3ca45920448336ba18. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:17:02.369876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Getting quotas for user 59e619953f32406891051e0e029c1670 and project 82e56305a8994e3ca45920448336ba18. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:17:02.436942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:17:02.447447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:17:02.564295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:02.576784 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0faacae-2e35-4f22-915a-56c3e6b2520f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1313 microversion: 2.1 time: 0.367924 Jun 04 21:17:02.578071 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2343/4793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:02 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:02.584751 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6664efb5-591f-4220-b50e-b68b1e028123 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214838 Jun 04 21:17:02.585528 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2451/4794] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:17:02.597010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-147af908-f0bf-4a9e-90d5-7493e1eb40ac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:02.597651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-147af908-f0bf-4a9e-90d5-7493e1eb40ac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:02.823216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-147af908-f0bf-4a9e-90d5-7493e1eb40ac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:02.834946 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-147af908-f0bf-4a9e-90d5-7493e1eb40ac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1219 microversion: 2.1 time: 0.242001 Jun 04 21:17:02.835624 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2344/4795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:02 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:02.869679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:02.870310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:02.887445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:02.889978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:02.891824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:02.893825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.202378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:03.216194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:03.221780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:03.222585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:03.223834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:03.228058 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dc9be61a-6ab9-4b5b-8b90-06c06e53d5cf tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.363778 Jun 04 21:17:03.228817 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2452/4796] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:02 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:03.240560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.240560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.240969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.241140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.422209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-340e777c-39ba-415a-b21c-c9bb91f8e472 req-4d80ba0f-0260-44c8-b8bd-3abd9731e915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54", "tag": "35bb9932-fcba-4ca3-986f-4c8306fcd0c0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:03.431193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-340e777c-39ba-415a-b21c-c9bb91f8e472 req-4d80ba0f-0260-44c8-b8bd-3abd9731e915 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.436409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-340e777c-39ba-415a-b21c-c9bb91f8e472 req-4d80ba0f-0260-44c8-b8bd-3abd9731e915 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.534960 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-340e777c-39ba-415a-b21c-c9bb91f8e472 req-4d80ba0f-0260-44c8-b8bd-3abd9731e915 service nova] Creating event network-changed:35bb9932-fcba-4ca3-986f-4c8306fcd0c0 for instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 on nch2-master-1 Jun 04 21:17:03.550027 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-340e777c-39ba-415a-b21c-c9bb91f8e472 req-4d80ba0f-0260-44c8-b8bd-3abd9731e915 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133183 Jun 04 21:17:03.552578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2453/4797] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:03.557098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:03.569395 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2181015c-a1c3-434b-8f91-05ab0ce51b48 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1514 microversion: 2.1 time: 0.353331 Jun 04 21:17:03.582516 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2345/4798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:03 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:03.597728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:03.599112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:03.640260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.641261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.649222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.650236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.854372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:03.863395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:03.865935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:03.888133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.890482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:03.894033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:03.894920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:04.054362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:04.064476 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d62a3870-c101-44f9-9f9d-005768d0ae1a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1271 microversion: 2.1 time: 0.215527 Jun 04 21:17:04.077877 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2346/4799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:03 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:04.253913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:04.254802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:04.269632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:04.270086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:04.274386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:04.276173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:04.540545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:04.567159 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1800b950-adf0-421f-97fc-76495c2bedd8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1313 microversion: 2.1 time: 0.966854 Jun 04 21:17:04.567159 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2454/4800] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:03 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1313 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:04.573169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-457bb711-7894-4445-a17f-5cd62c06833b req-96e0028d-e7a7-424b-8328-36ec624fa738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed323b4c-e457-4672-ae3d-4b7238721ce6", "name": "network-vif-plugged", "status": "completed", "tag": "aaaa0959-ea7a-417a-9856-c0c203d4dd3b"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:04.590715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-457bb711-7894-4445-a17f-5cd62c06833b req-96e0028d-e7a7-424b-8328-36ec624fa738 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:04.593014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-457bb711-7894-4445-a17f-5cd62c06833b req-96e0028d-e7a7-424b-8328-36ec624fa738 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:04.639457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-457bb711-7894-4445-a17f-5cd62c06833b req-96e0028d-e7a7-424b-8328-36ec624fa738 service nova] Creating event network-vif-plugged:aaaa0959-ea7a-417a-9856-c0c203d4dd3b for instance ed323b4c-e457-4672-ae3d-4b7238721ce6 on nch1-master-1 Jun 04 21:17:04.656135 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-457bb711-7894-4445-a17f-5cd62c06833b req-96e0028d-e7a7-424b-8328-36ec624fa738 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092216 Jun 04 21:17:04.658383 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2455/4801] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:04.671102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:04.677480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:04.705432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:04.706207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:04.707195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:04.707873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:04.900346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:04.925825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:04.928460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:04.929911 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8f3313d-2c02-44d3-8e08-66a09189f96c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.685431 Jun 04 21:17:04.930657 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2347/4802] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:04 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:05.083174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:05.083851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:05.096643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:05.097115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:05.097909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:05.098350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:05.156295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:05.170448 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01b6a890-1f3d-406c-8168-a7c5baf72815 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.507056 Jun 04 21:17:05.171875 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2456/4803] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:04 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:05.242990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:05.254974 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9298d689-fdb3-4b23-a3e4-cec1cd357cac tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1277 microversion: 2.1 time: 0.176065 Jun 04 21:17:05.266133 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2348/4804] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:05 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:05.577490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:05.578135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:05.586179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:05.586632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:05.596042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:05.596921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:05.952280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:05.953118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:05.968631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:05.973767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:05.975029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:05.979048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:06.540538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:06.556589 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-835ed769-0172-464d-9ea4-cf9d40e57b69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1313 microversion: 2.1 time: 0.985382 Jun 04 21:17:06.566905 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2457/4805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:05 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1313 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:06.579404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:06.580370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:06.598212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:06.598981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:06.600023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:06.600639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:06.825908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:06.855980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:06.859061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:06.861806 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fc1130bb-8c33-46a3-ae55-9035a702117a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.915953 Jun 04 21:17:06.864093 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2349/4806] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:05 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:06.881957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:06.882718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:06.895831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:06.898463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:06.899737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:06.900052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:07.016307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:07.025179 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7486cb1c-4fc0-4cc3-abd7-12ce729f954b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.456733 Jun 04 21:17:07.026115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2458/4807] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:06 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:07.244519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:07.263062 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83eea33e-c232-48a8-b798-c412d0d197c3 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.397330 Jun 04 21:17:07.266584 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2350/4808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:06 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:07.575648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:07.576307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:07.593860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:07.595990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:07.597448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:07.598004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:07.886751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:07.887555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:07.903445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:07.903983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:07.904795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:07.905245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:08.159707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:08.183971 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-117488c3-3d8e-4fcf-8e7c-c00926f7c231 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1313 microversion: 2.1 time: 0.614395 Jun 04 21:17:08.192088 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2459/4809] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:07 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:08.216088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:08.218301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:08.234058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:08.235343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:08.236978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:08.237605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:08.824560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:08.848554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:08.850345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:08.854619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:08.857688 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6c32e06-e46a-46ce-a4a1-9eb48a25d571 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.977350 Jun 04 21:17:08.863499 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8fae7dca-0f62-44db-9ce3-c3b25705b0bb tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.669609 Jun 04 21:17:08.864273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2460/4810] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:08 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:08.869877 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2351/4811] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:07 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:08.876559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1f5eb77c-ec58-41a6-b655-8c0a3e974be0 req-d1c43079-8cfd-4466-a264-675c932b5823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5624805-3a75-403f-a25e-623132acd041", "tag": "0c5af0c2-9607-4ea6-8551-bdceea100ee4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:08.879621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:08.880420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:08.900440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:08.902931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:08.904553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:08.908059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:08.919439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1f5eb77c-ec58-41a6-b655-8c0a3e974be0 req-d1c43079-8cfd-4466-a264-675c932b5823 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:08.920775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1f5eb77c-ec58-41a6-b655-8c0a3e974be0 req-d1c43079-8cfd-4466-a264-675c932b5823 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:08.970249 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1f5eb77c-ec58-41a6-b655-8c0a3e974be0 req-d1c43079-8cfd-4466-a264-675c932b5823 service nova] Creating event network-changed:0c5af0c2-9607-4ea6-8551-bdceea100ee4 for instance b5624805-3a75-403f-a25e-623132acd041 on nch1-master-1 Jun 04 21:17:09.003891 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1f5eb77c-ec58-41a6-b655-8c0a3e974be0 req-d1c43079-8cfd-4466-a264-675c932b5823 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132203 Jun 04 21:17:09.005363 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2352/4812] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:09.209817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:09.210522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:09.224864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:09.225196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:09.232590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:09.233349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:09.319791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:09.339145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-915d580b-7ee4-4150-811d-30c3c8d793e1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.473572 Jun 04 21:17:09.339792 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2461/4813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:08 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:09.574993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:09.588596 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73959338-7caa-46d1-95c8-47e854b7c7d8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1313 microversion: 2.1 time: 0.383293 Jun 04 21:17:09.589922 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2353/4814] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:09 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:09.884434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:09.885785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:09.886817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:09.887797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:09.896788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:09.901205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:09.902115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:09.902436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:09.902583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:09.903255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:09.904351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:09.904959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:09.942801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:10.691942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:10.720123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:10.725542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:10.730043 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98fba470-c4f2-4a84-b8af-0c5a56c37bf1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.857644 Jun 04 21:17:10.742160 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2462/4815] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:09 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:10.749774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:10.750752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:10.758908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:10.759722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:10.761228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:10.761879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:10.829947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:10.841199 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7d2f1ad-670c-4fbc-9813-47bc3ec86e0e tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.959095 Jun 04 21:17:10.850431 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2354/4816] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:09 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:10.874047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b5fd558a-5a37-4a24-8db2-67e29e7fbe09 req-f7d92345-f006-4150-8c37-5512e7fb6ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54", "name": "network-vif-plugged", "status": "completed", "tag": "35bb9932-fcba-4ca3-986f-4c8306fcd0c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:10.928025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b5fd558a-5a37-4a24-8db2-67e29e7fbe09 req-f7d92345-f006-4150-8c37-5512e7fb6ee4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:10.930207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b5fd558a-5a37-4a24-8db2-67e29e7fbe09 req-f7d92345-f006-4150-8c37-5512e7fb6ee4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:10.953784 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b5fd558a-5a37-4a24-8db2-67e29e7fbe09 req-f7d92345-f006-4150-8c37-5512e7fb6ee4 service nova] Creating event network-vif-plugged:35bb9932-fcba-4ca3-986f-4c8306fcd0c0 for instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 on nch2-master-1 Jun 04 21:17:10.961857 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b5fd558a-5a37-4a24-8db2-67e29e7fbe09 req-f7d92345-f006-4150-8c37-5512e7fb6ee4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107813 Jun 04 21:17:10.968285 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2355/4817] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:10.983565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:10.988659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:11.018004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:11.018957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:11.019974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:11.020509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:11.023852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:11.180394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:11.198920 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5a172bdc-68ad-4200-a727-840e62f421bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.448262 Jun 04 21:17:11.200000 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2463/4818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:10 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:11.400483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:11.409057 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72c522d3-331b-466b-9142-612dda960c38 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1313 microversion: 2.1 time: 0.438830 Jun 04 21:17:11.412457 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2356/4819] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:10 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:11.751803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:11.752417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:11.776601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:11.779075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:11.797197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:11.798488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:11.859293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:11.860077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:11.873450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:11.874091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:11.875075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:11.876128 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:12.323872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:12.412298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:12.550598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:12.569753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:12.578538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:12.580492 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9374bdb3-99f1-4382-a125-9b90efbabf54 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.835156 Jun 04 21:17:12.586074 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2464/4820] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:11 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:12.602601 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:12.616437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:12.635095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:12.635834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:12.640590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:12.641390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:12.746881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:12.756157 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-817f72da-ab78-4369-879b-225452284519 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.901718 Jun 04 21:17:12.767780 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2357/4821] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:11 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:12.772996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:12.774057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:12.790087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:12.790921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:12.793703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:12.797116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:12.838635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:12.991899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:13.001028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6430670a-366b-4821-a754-11f0f02d0812 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.413301 Jun 04 21:17:13.005768 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2465/4822] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:12 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:13.114970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:13.127857 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1f099e82-0001-46e1-be4f-064bccc8d2de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1499 microversion: 2.1 time: 0.358484 Jun 04 21:17:13.128463 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2358/4823] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:12 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1499 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:13.147126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:13.148500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:13.156440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.157179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.158734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.159471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.186490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lazy-loading 'flavor' on Instance uuid 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:17:13.306827 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dcc7a767-f279-47a6-bb4e-2ad5e7e4339b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "POST /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54/action" status: 200 len: 32 microversion: 2.1 time: 0.164189 Jun 04 21:17:13.307812 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2466/4824] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:13 2022] POST /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:17:13.318604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:13.319383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:13.331919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.333725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.335179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.337500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.605106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:13.605817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:13.617565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.618377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.619709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.623900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.832278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:13.846413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0f60f3de-7753-49d5-88ab-17b1f656de3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.531768 Jun 04 21:17:13.854019 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2359/4825] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:13 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:13.898169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:13.898811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:13.939449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.940085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:13.940888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:13.942589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:14.066002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:14.076003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:14.077495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:14.081269 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39ee93a7-680e-47a0-98d3-4564048cf8c4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.482638 Jun 04 21:17:14.087068 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2467/4826] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:13 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:14.093374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:14.094419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:14.117036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:14.124598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:14.129618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:14.130367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:14.288793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:14.300293 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-08beec52-eb8f-4e97-ab86-f556170c2f33 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.445045 Jun 04 21:17:14.300895 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2360/4827] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:13 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:14.390166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:14.401233 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c96b08eb-0bcc-40c9-baaf-e7d31c065690 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.312393 Jun 04 21:17:14.402227 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2468/4828] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:14 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:14.863012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:14.864511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:14.877226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:14.878156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:14.880403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:14.882573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:15.103383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:15.104231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:15.128430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:15.129161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:15.134999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:15.136311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:15.973773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:15.977890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:15.994862 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d206bb43-014f-4d0f-8cf9-b251a4b7ff0e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 1.135667 Jun 04 21:17:15.997845 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2361/4829] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:14 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:16.008665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:16.014849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4608cd71-aba6-449b-8c75-a8b23fee9b5c req-f11238cd-83ee-4166-aa82-3f0480f6e612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5624805-3a75-403f-a25e-623132acd041", "name": "network-vif-plugged", "status": "completed", "tag": "0c5af0c2-9607-4ea6-8551-bdceea100ee4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:16.020016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:16.024972 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a7de30c2-9f45-4596-b2e1-ae95d82107df tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.925223 Jun 04 21:17:16.042552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2469/4830] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:15 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:16.048621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:16.049698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:16.076896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4608cd71-aba6-449b-8c75-a8b23fee9b5c req-f11238cd-83ee-4166-aa82-3f0480f6e612 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:16.079917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4608cd71-aba6-449b-8c75-a8b23fee9b5c req-f11238cd-83ee-4166-aa82-3f0480f6e612 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:16.086029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:16.097029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:16.097029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:16.109404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:16.110048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:16.134242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4608cd71-aba6-449b-8c75-a8b23fee9b5c req-f11238cd-83ee-4166-aa82-3f0480f6e612 service nova] Creating event network-vif-plugged:0c5af0c2-9607-4ea6-8551-bdceea100ee4 for instance b5624805-3a75-403f-a25e-623132acd041 on nch1-master-1 Jun 04 21:17:16.145290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4608cd71-aba6-449b-8c75-a8b23fee9b5c req-f11238cd-83ee-4166-aa82-3f0480f6e612 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134813 Jun 04 21:17:16.147744 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2362/4831] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:16.181240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:16.182902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:16.228567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:16.242788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:16.244356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:16.246560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:16.581197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:16.599157 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c27d5c78-a0a0-46ed-b253-548e2daa6741 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.442098 Jun 04 21:17:16.611166 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2363/4832] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:16 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:16.635567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:16.644742 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-88a4393f-2e04-4200-a17b-81cbb03d8ac1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.610572 Jun 04 21:17:16.645352 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2470/4833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:16 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:17.015533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:17.016127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:17.040564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.040564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.040564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.040564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.051029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:17.051692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:17.072348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.073263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.074315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.075030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.477449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:17.488302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:17.497417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:17.499014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:17.499276 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e658b679-e1c2-416b-a0c8-e545d30af154 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.452417 Jun 04 21:17:17.500364 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2471/4834] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:17 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:17.513162 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e5ea3022-43df-4a04-8bd9-eaff2c62fd69 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.499500 Jun 04 21:17:17.514502 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2364/4835] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:17 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:17.617562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:17.618617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:17.634387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.640743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.641974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.644330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.662216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:17.663391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:17.672202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.676725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:17.679202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:17.680016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:18.133662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:18.146308 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fc8a53b-0883-4f64-a8ff-d5a3a56e3a35 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.488488 Jun 04 21:17:18.165161 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2365/4836] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:17 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:18.184294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:18.197663 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e998f1c-8278-4c91-904e-65bbc57d8ca6 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1319 microversion: 2.1 time: 0.584567 Jun 04 21:17:18.200012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2472/4837] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:17 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1319 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:18.518878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:18.519934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:18.537947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:18.539322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:18.543855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:18.544342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:18.545163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:18.545605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:18.552352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:18.556041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:18.557209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:18.557880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:19.401777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:19.416119 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-12301e88-ee00-4bb3-84c0-7387f6c512c0 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.881551 Jun 04 21:17:19.420780 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2473/4838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:18 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:19.436008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:19.437177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:19.453636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:19.459976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:19.461001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:19.463129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:19.567399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:19.585679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:19.587157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:19.588439 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-467fb4cf-1032-4f23-8ca5-237dd8043661 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1746 microversion: 2.20 time: 1.074270 Jun 04 21:17:19.589016 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2366/4839] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:18 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1746 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:19.608411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:19.615585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:19.632790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:19.633524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:19.634598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:19.635351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:20.164240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:20.213125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-675386be-9a4e-4dd0-b9bc-214ce49a5bf7 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.788528 Jun 04 21:17:20.219303 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2474/4840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:19 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:20.314211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:20.323242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b055d934-2eb5-4ab1-bd0d-0febf2e50262 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1506 microversion: 2.1 time: 0.728315 Jun 04 21:17:20.324431 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2367/4841] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:19 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1506 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:20.438203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:20.438853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:20.465440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:20.466027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:20.466891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:20.467339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:20.631186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:20.631929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:20.658132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:20.658132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:20.658132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:20.658132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:21.240499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:21.259647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:21.261389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:21.262681 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ac72f74-ae8e-4b3e-a145-0a954ccf4fb3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.657632 Jun 04 21:17:21.264792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2368/4842] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:20 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:21.288798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:21.309191 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7161d8c7-072f-4737-84c7-6973f8f4867d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.868093 Jun 04 21:17:21.309893 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2475/4843] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:20 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:21.311787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:21.312609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:21.325916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:21.327835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:21.330809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:21.331486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:21.687944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:21.697386 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-18d2a402-777b-499d-a610-7f096c34ecbd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.414553 Jun 04 21:17:21.705124 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2369/4844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:21 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:22.282641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:22.283591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:22.294408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:22.301657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:22.302775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:22.303477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:22.327087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:22.327753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:22.347711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:22.356632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:22.359484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:22.359997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:22.783804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:22.798406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1539e799-8091-4ce8-9b2c-43413537f2b6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.475503 Jun 04 21:17:22.814929 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2370/4845] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:22 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:22.820388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:22.825770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:22.841081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:22.841844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:22.844451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:22.845418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:22.927486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:22.957178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:22.959457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:22.966117 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f8e052c5-559f-4f36-9aa4-0822dcdb8bf6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.685959 Jun 04 21:17:22.972755 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2476/4846] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:22 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:23.207993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:23.222428 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-577923c5-03d8-4dd0-81c3-6c7120ef65f5 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.405956 Jun 04 21:17:23.223850 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2371/4847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:22 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:23.283947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a4659cf5-7db4-484e-819c-536e9c096e6d req-2cc15105-02b0-4936-8850-7cc5f61cbd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "name": "network-vif-plugged", "status": "completed", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:23.306515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a4659cf5-7db4-484e-819c-536e9c096e6d req-2cc15105-02b0-4936-8850-7cc5f61cbd65 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:23.307227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a4659cf5-7db4-484e-819c-536e9c096e6d req-2cc15105-02b0-4936-8850-7cc5f61cbd65 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:23.344660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:23.350203 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a4659cf5-7db4-484e-819c-536e9c096e6d req-2cc15105-02b0-4936-8850-7cc5f61cbd65 service nova] Creating event network-vif-plugged:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:17:23.367787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a4659cf5-7db4-484e-819c-536e9c096e6d req-2cc15105-02b0-4936-8850-7cc5f61cbd65 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083277 Jun 04 21:17:23.379952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2477/4848] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:23.821527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:23.822912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:23.839711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:23.844103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:23.845992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:23.846613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:23.994065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:23.995084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:24.009088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:24.009860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:24.012683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:24.014540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:24.302293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:24.319218 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa5e2277-98ff-4c0a-9ef8-c2fee78cbc57 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.501483 Jun 04 21:17:24.327129 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2372/4849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:23 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:24.345175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:24.346117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:24.356588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:24.367067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:24.369416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:24.370396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:24.426822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:26.474109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:26.495284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:26.500732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:26.507687 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fb6367a-8762-48fc-8a25-2d9494b0fd02 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 2.178108 Jun 04 21:17:26.508970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:26.509147 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2373/4850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:24 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:26.513013 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2411c697-32b4-4cbb-b186-e8675a57500a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 2.523234 Jun 04 21:17:26.515563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:26.516865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:26.519203 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2478/4851] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:23 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 2530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:26.525607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:26.526477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:26.527742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:26.528419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:26.953003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:26.962147 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cdb4f34a-57a4-4ca6-bb66-82b3e44f7e3d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.451767 Jun 04 21:17:26.994426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2374/4852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:26 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:27.528332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:27.529661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:27.541392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:27.541858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:27.559495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:27.562925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:27.565072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:27.565218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:27.565845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:27.582123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:27.595908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:27.600423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:28.124443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:28.138431 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff682dcc-87dc-4e1f-9151-a74df4d3d7ca tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.611828 Jun 04 21:17:28.139198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2479/4853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:27 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:28.150972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:28.157542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:28.180529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:28.180997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:28.182942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:28.186764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:28.404963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:28.422800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:28.426953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:28.432323 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d396fa2c-cccd-4118-8e0e-46a8f0318bf7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.896781 Jun 04 21:17:28.433846 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2375/4854] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:27 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:28.566355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:28.582104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3dac03ae-556d-4308-9bfb-3ded0ef7bab8 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.439019 Jun 04 21:17:28.583309 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2480/4855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:28 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:29.160748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:29.161320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:29.175979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:29.176447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:29.177250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:29.177701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:29.455656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:29.456289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:29.487992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:29.488597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:29.489461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:29.489905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:29.586701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:29.602975 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b60b982a-2455-4e6a-b593-36c557036b8b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1509 microversion: 2.1 time: 0.450318 Jun 04 21:17:29.609678 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2376/4856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:29 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:29.620468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:29.622544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:29.640258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:29.640701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:29.651016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:29.651924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:29.918125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:29.931686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-675f2176-d848-4448-b8d1-06870ca7219c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.320310 Jun 04 21:17:29.932277 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2377/4857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:29 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:29.958271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:29.973857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:29.975721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:29.977119 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-57982168-6e79-488b-8e89-e0a39d45723c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.526692 Jun 04 21:17:29.980175 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2481/4858] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:29 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:30.628945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:30.640149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:30.660180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:30.662351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:30.663557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:30.665085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:30.950740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:30.951621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:30.968331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:30.969098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:30.974090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:30.993843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:31.050536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:31.060682 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3f5f8b15-a412-4bb1-a9f2-788a037461de tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1506 microversion: 2.1 time: 0.441590 Jun 04 21:17:31.066542 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2378/4859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:30 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:31.079479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:31.087290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:31.100542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:31.107032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:31.108176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:31.108883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:31.426717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:31.440222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:31.441998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:31.449986 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d6bbb629-4768-43dc-92c3-a794a49807d8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.375650 Jun 04 21:17:31.450981 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2379/4860] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:31 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:31.942097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3653e205-45ec-46b3-95f9-bebd5c89c493", "device": "/dev/sdb"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:31.943562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:31.969039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:31.969880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:31.971353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:31.972195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:31.979724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:31.995054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-86d4ccef-c454-40c0-a03a-3927c95eaa0d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 1.048884 Jun 04 21:17:31.995690 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2482/4861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:30 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:32.083958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:32.084863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:32.095413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:32.102253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:32.103540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:32.104200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:32.530640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:32.550013 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-be3afcb0-8be5-419f-a6de-47d7245e22a1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1506 microversion: 2.1 time: 0.470068 Jun 04 21:17:32.554182 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2483/4862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:32 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:32.570484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:32.572335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:32.601392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:32.602569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:32.604157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:32.605304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:32.877420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:32.894866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:32.899058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:32.901915 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-481fa3e3-8e09-4cfe-86c2-f561225c2785 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.336363 Jun 04 21:17:32.915802 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2484/4863] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:32 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:33.013639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:33.014933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:33.022363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:33.023095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:33.024083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:33.024683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:33.270485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:33.278654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b3091dc-5b9b-4182-ae75-ad71abda9ca7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.269442 Jun 04 21:17:33.280292 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2485/4864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:33 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:33.341908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ffa355e6-5768-4c06-af30-0cc92e7d1c6e req-23d7558e-3eb0-450e-a29b-744c16201ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed323b4c-e457-4672-ae3d-4b7238721ce6", "name": "network-vif-unplugged", "status": "completed", "tag": "aaaa0959-ea7a-417a-9856-c0c203d4dd3b"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:33.362919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ffa355e6-5768-4c06-af30-0cc92e7d1c6e req-23d7558e-3eb0-450e-a29b-744c16201ad5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:33.367395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ffa355e6-5768-4c06-af30-0cc92e7d1c6e req-23d7558e-3eb0-450e-a29b-744c16201ad5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:33.406254 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ffa355e6-5768-4c06-af30-0cc92e7d1c6e req-23d7558e-3eb0-450e-a29b-744c16201ad5 service nova] Creating event network-vif-unplugged:aaaa0959-ea7a-417a-9856-c0c203d4dd3b for instance ed323b4c-e457-4672-ae3d-4b7238721ce6 on nch1-master-1 Jun 04 21:17:33.412637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ffa355e6-5768-4c06-af30-0cc92e7d1c6e req-23d7558e-3eb0-450e-a29b-744c16201ad5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075941 Jun 04 21:17:33.421769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2486/4865] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:17:33.575473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:33.576690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:33.601296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:33.602550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:33.603906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:33.606530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:33.948108 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8220b9fb-5ff7-4a8f-a852-19e1483a48a1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "POST /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.014297 Jun 04 21:17:33.950838 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2380/4866] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:17:31 2022] POST /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041/os-volume_attachments => generated 194 bytes in 2019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:17:33.970342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:34.000220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:34.028051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=70 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:34.033344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:34.050435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:34.051333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:34.057897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:34.067992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:34.080398 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aeb6ed8d-e610-4142-a493-84cba0412ad9 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1506 microversion: 2.1 time: 0.511811 Jun 04 21:17:34.083716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2487/4867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:33 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:34.298575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:34.300379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:34.311807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:34.319935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:34.321946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:34.322744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:34.423461 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:34.435787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:34.456090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:34.457408 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b63c76d3-b32b-4622-baf9-3b3f2dc6ee49 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.504614 Jun 04 21:17:34.461283 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2381/4868] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:33 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:34.599473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:34.611736 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f896f5fe-e886-49ae-a1f2-943fb4e3fc77 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.318555 Jun 04 21:17:34.612898 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2488/4869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:34 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:35.099347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:35.100666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:35.111346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:35.117223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:35.118271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:35.119028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:35.481797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:35.483133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:35.506563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:35.508043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:35.513218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:35.515413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:36.336092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:36.380454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:36.396954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:36.402807 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ea98d12d-9bc8-49c4-b039-fe3590587084 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.925347 Jun 04 21:17:36.405437 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2489/4870] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:35 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:36.421206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:36.423683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:36.447947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:36.448659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:36.450486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:36.450943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:36.511176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:36.523847 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2bf4e01c-09e3-428c-980b-22ede31618df tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 200 len: 1449 microversion: 2.1 time: 1.428555 Jun 04 21:17:36.540913 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2382/4871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:35 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 1449 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:36.549043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:36.550018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:36.559306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:36.560122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:36.561152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:36.561794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.021409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:37.032153 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f08d819-fda6-4840-bb78-258cbcc3ae48 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.624600 Jun 04 21:17:37.050747 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2490/4872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:36 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:37.106649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:37.125645 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-45accd67-5def-42c1-b8f7-f599f291fd39 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.581143 Jun 04 21:17:37.128704 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2383/4873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:36 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:37.150577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:37.152826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:37.164725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:37.165365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.166257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:37.166949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.434817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:37.435466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:37.454373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:37.454836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.455661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:37.456101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.736338 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:37.747725 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a72dd49-8ee0-48a0-91d6-d136199c3b30 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.601388 Jun 04 21:17:37.749587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2491/4874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:37 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:37.771260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:37.772258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:37.782954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:37.786022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.787167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:37.790760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:37.850300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:37.868076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:37.870641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:37.874507 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f3f7d02-0ee7-4c75-b7a9-b3641b40d294 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.448692 Jun 04 21:17:37.883982 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2384/4875] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:37 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:38.051332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:38.051982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:38.059412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.066342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:38.067614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.069993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:38.105706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:38.119473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-56c525d8-c1dc-4bd9-b829-88bc3bbb28ec tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.352653 Jun 04 21:17:38.123244 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2492/4876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:37 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:38.141940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:38.143393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:38.163664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.166230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:38.171999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.172656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:38.358072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:38.373894 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-58f76b8e-e010-4da4-9634-c8eaed50f6c2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.327489 Jun 04 21:17:38.375232 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2385/4877] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:38 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:38.388568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-725173430", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4138dc87-e3fb-498c-9009-16923484c128", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4f8dc4cf-e0c9-460c-b458-27f360b796ed"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:38.511382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:38.521123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ca91d5c-d6ec-42c0-a796-1fd6741d54ff tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.384863 Jun 04 21:17:38.522307 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2493/4878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:38 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:38.542401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef499e44-124d-431f-bd25-914ab88a3942 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:38.558214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef499e44-124d-431f-bd25-914ab88a3942 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.559063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef499e44-124d-431f-bd25-914ab88a3942 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:38.623701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef499e44-124d-431f-bd25-914ab88a3942 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:17:38.637847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] validate_networks() for [('4f8dc4cf-e0c9-460c-b458-27f360b796ed', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:17:38.674523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:38.737227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef499e44-124d-431f-bd25-914ab88a3942 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.200101 Jun 04 21:17:38.738795 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2494/4879] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:38 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:17:38.761180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:38.763477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:38.773804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.774632 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:38.775769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:38.776668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.155642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:39.174017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-388d2043-957c-41fd-b989-a9467aaf81bf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.426577 Jun 04 21:17:39.176257 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2495/4880] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:38 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:39.189843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:39.191593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:39.216077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:39.216747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.220456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:39.220974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.453628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:17:39.454510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:17:39.454510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:17:39.454891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:17:39.455501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:17:39.467448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:39.467928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.468960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:39.469404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.491682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:17:39.498805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:17:39.499683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:39.515158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:17:39.518581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4138dc87-e3fb-498c-9009-16923484c128',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:17:39.520098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:39.522200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:39.523916 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2b5c5a6e-9a46-4896-a35f-d4066bca2eef tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.346501 Jun 04 21:17:39.536978 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2496/4881] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:39 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:39.549663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:39.551374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:39.561478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:39.562013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.562814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:39.563260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:39.656055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04595ef9-a8a8-4902-9863-e495344f0da1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.277614 Jun 04 21:17:39.666249 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2386/4882] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:17:39.673298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8192711-6987-41f4-b476-1de813a01978 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:39.674329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d8192711-6987-41f4-b476-1de813a01978 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:39.766026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d8192711-6987-41f4-b476-1de813a01978 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:39.779367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d8192711-6987-41f4-b476-1de813a01978 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1056 microversion: 2.1 time: 0.111462 Jun 04 21:17:39.780001 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2387/4883] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:39 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1056 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:39.851072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:39.860419 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-75fc919e-822c-4e77-94cb-74873544fbb7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.322102 Jun 04 21:17:39.862345 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2497/4884] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:39 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:40.197929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:40.198907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:40.219027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.220182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.229687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.242285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.503917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:40.525315 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-710c08ac-c0bb-43c3-b72c-22d4c199fd9d tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.334758 Jun 04 21:17:40.526535 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2388/4885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:40 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:40.547378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:40.548150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:40.556499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.556969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.558046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.559220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.797545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:40.798172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:40.811208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.814484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:40.815137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.816199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.825104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.831453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:40.838620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:40.840294 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6253889-a80c-4b7e-96b5-7c1cf079fab4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.299385 Jun 04 21:17:40.840907 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2498/4886] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:40 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:40.882794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:40.883425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:40.897577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.898608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.900677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:40.914292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:40.980706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:40.989554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a9f4e6df-fa29-4b5c-8ec3-932596c5d262 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1052 microversion: 2.1 time: 0.196718 Jun 04 21:17:40.992285 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2389/4887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:40 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1052 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:41.146019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:41.155994 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-780f76c2-f44e-4939-9203-a0edc2a6f035 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.277484 Jun 04 21:17:41.167386 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2499/4888] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:40 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:41.547480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:41.548130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:41.567414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:41.568799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:41.569904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:41.570611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:41.640203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:41.858983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:41.859654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:41.879067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:41.879640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:41.880525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:41.881038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:42.166346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:42.178135 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-53d59c0b-fcd3-4157-9a63-db93bb700046 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.637750 Jun 04 21:17:42.184530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2390/4889] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:41 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:42.189804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:42.197198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:42.210377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:42.211120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:42.212160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:42.213153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:42.293680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:42.308683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:42.311565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:42.314022 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7034df9f-83c8-404f-a062-0e807f063f42 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.458748 Jun 04 21:17:42.323803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:42.324287 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2500/4890] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:41 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:42.333362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:42.339886 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-678cd68b-5eec-4e0b-8779-ad20c92e1cb0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1126 microversion: 2.1 time: 0.153075 Jun 04 21:17:42.341088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:42.341532 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2391/4891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:42 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1126 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:42.360160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:42.360931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:42.361907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:42.362512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:42.619476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:42.635973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d200b62-e183-4b75-ab37-03243145393a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1505 microversion: 2.1 time: 0.304004 Jun 04 21:17:42.639367 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2501/4892] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:42 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:43.202448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:43.202949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:43.216130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.216583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.220693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.222037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.338099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:43.339484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:43.352846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.355776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.358276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.360834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.824969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:43.844060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:43.858634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:43.863722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:43.868398 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72a529d6-9ee0-4791-8d24-20a320c9ce61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1741 microversion: 2.20 time: 0.537225 Jun 04 21:17:43.873616 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2502/4893] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:43 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1741 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:43.885361 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-05917115-3f4e-453d-aff9-9efaa3f5729a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.687084 Jun 04 21:17:43.887541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:43.889225 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2392/4894] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:43 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:43.890018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:43.907159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:43.910386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:43.912500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.915389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.919898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.922613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.934905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.935410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:43.950917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:43.951557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:44.303669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:44.319161 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-30a5771d-a45e-4d36-828d-86dce069e42c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1485 microversion: 2.1 time: 0.428068 Jun 04 21:17:44.320681 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2393/4895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:43 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1485 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:44.328688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:44.339059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4796742b-3902-454c-836e-f39e3af88c15 req-54285c3a-f5f5-45f1-b9f8-52f16a401be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98f8f0a-3689-4e58-b810-a554cba65cb1", "tag": "68e98dfa-9692-4638-82bd-2bba01f58891"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:44.348824 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-03de1413-7999-4012-ab4e-5c43ebaa5625 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1168 microversion: 2.1 time: 0.473779 Jun 04 21:17:44.350732 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2503/4896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:43 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1168 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:44.359885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4796742b-3902-454c-836e-f39e3af88c15 req-54285c3a-f5f5-45f1-b9f8-52f16a401be8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:44.360570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4796742b-3902-454c-836e-f39e3af88c15 req-54285c3a-f5f5-45f1-b9f8-52f16a401be8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:44.380034 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4796742b-3902-454c-836e-f39e3af88c15 req-54285c3a-f5f5-45f1-b9f8-52f16a401be8 service nova] Creating event network-changed:68e98dfa-9692-4638-82bd-2bba01f58891 for instance a98f8f0a-3689-4e58-b810-a554cba65cb1 on nch1-master-1 Jun 04 21:17:44.390195 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4796742b-3902-454c-836e-f39e3af88c15 req-54285c3a-f5f5-45f1-b9f8-52f16a401be8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058554 Jun 04 21:17:44.391339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2394/4897] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:44.514785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-253238115", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:44.581044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] validate_networks() for [('5bf41cf5-ca2b-4742-8980-16b3c9c41734', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:17:44.891746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:44.893528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:44.901787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:44.905037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:44.906315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:44.906879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.102635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:17:45.103594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:17:45.104097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:17:45.104959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:17:45.105675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:17:45.120084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:45.121202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.122266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:45.122950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.130451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:45.140852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:45.145886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:45.148529 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fa0094e2-6f64-4cf7-8626-b981aa3d788d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1723 microversion: 2.20 time: 0.262909 Jun 04 21:17:45.149108 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2395/4898] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:44 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:45.158098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:45.163170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:45.176011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Getting quotas for project c284c2855bac423280d7e234dee6b7ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:17:45.176603 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:45.177294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.178318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:45.179006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.185210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Getting quotas for user 2166b66a28214ff9802da4f955b5a4c5 and project c284c2855bac423280d7e234dee6b7ac. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:17:45.202593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:17:45.205301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:17:45.271255 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39461ed1-fabb-4dca-b915-66f632e68a63 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.760836 Jun 04 21:17:45.272559 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2504/4899] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:17:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:17:45.292565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-754c3a6a-a465-49e6-b6b6-18e9b2fd9abd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:45.293250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-754c3a6a-a465-49e6-b6b6-18e9b2fd9abd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:45.407920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-754c3a6a-a465-49e6-b6b6-18e9b2fd9abd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:45.414176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:45.416516 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-754c3a6a-a465-49e6-b6b6-18e9b2fd9abd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1213 microversion: 2.1 time: 0.138079 Jun 04 21:17:45.419327 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2505/4900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:45 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:45.426823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:45.427708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:45.428547 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f453d4d-63aa-462e-b592-35e419208acf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.275970 Jun 04 21:17:45.429704 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2396/4901] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:45 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:45.439729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:45.440371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.441320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:45.442064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:45.610565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:45.621804 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21327f8f-bcf2-4b75-8b01-39f4ba14c6f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1168 microversion: 2.1 time: 0.199312 Jun 04 21:17:45.624300 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2506/4902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:45 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:46.168412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:46.169041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:46.177733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.178848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.179785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.180423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.364473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:46.373672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:46.384945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:46.386853 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-429afb1e-7b05-45c3-8926-c8c03d1d70e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1723 microversion: 2.20 time: 0.222487 Jun 04 21:17:46.391069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2397/4903] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:46 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:46.435787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:46.436678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:46.446068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:46.447439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:46.447923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.448362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.449963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:46.453059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.453794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.460033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.460692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.461816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.462424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.559594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:46.575491 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bb5acc7-6bc7-46ba-9962-38e487a99c2b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1273 microversion: 2.1 time: 0.140312 Jun 04 21:17:46.576615 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2507/4904] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:46 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:46.641522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:46.642489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:46.653225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.654218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.655042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:46.655488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:46.724373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:46.737368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b7fc3e13-ae38-4d71-a359-c9c67e073b09 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.294758 Jun 04 21:17:46.738704 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2398/4905] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:46 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:46.949932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:46.960427 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1210eb5b-2a55-4628-b8c5-927982a5c9e5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1168 microversion: 2.1 time: 0.322909 Jun 04 21:17:46.963869 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2508/4906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:46 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1168 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:47.032793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ded1cd95-8eda-48f7-8822-fd3eed1c7dcb req-6cbbdcf7-e2ce-466d-8076-9603fbfae795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "name": "network-vif-unplugged", "status": "completed", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:47.048262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ded1cd95-8eda-48f7-8822-fd3eed1c7dcb req-6cbbdcf7-e2ce-466d-8076-9603fbfae795 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.048848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ded1cd95-8eda-48f7-8822-fd3eed1c7dcb req-6cbbdcf7-e2ce-466d-8076-9603fbfae795 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.070966 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ded1cd95-8eda-48f7-8822-fd3eed1c7dcb req-6cbbdcf7-e2ce-466d-8076-9603fbfae795 service nova] Creating event network-vif-unplugged:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:17:47.082078 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ded1cd95-8eda-48f7-8822-fd3eed1c7dcb req-6cbbdcf7-e2ce-466d-8076-9603fbfae795 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053403 Jun 04 21:17:47.083680 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2399/4907] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:47.411948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:47.412650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:47.420122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.420820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.421612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.422055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.562232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:47.570561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:47.572149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:47.573278 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-292642e9-90ef-427d-a5b7-542b81a8a0cc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1723 microversion: 2.20 time: 0.165540 Jun 04 21:17:47.574051 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2509/4908] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:47 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:47.595261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:47.596186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:47.602787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.603309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.604181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.604625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.736920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:47.744855 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6e6a6d31-0e64-41c9-a911-6cbb86e93d59 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.154931 Jun 04 21:17:47.745622 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2400/4909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:47 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:47.754467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:47.755076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:47.761637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.762086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.762882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.763317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.919397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:47.929708 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-279fb5a9-c85f-4190-b425-4d7201136105 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.179106 Jun 04 21:17:47.930303 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2510/4910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:47 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:47.986100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:47.987132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:47.993606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.994323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:47.995331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:47.996149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.218382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:48.228020 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b2c5dd6e-b11e-46f3-8f02-a0179da42b63 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1214 microversion: 2.1 time: 0.245825 Jun 04 21:17:48.230667 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2401/4911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:47 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:48.240054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-77631d11-63c9-48c0-8150-8ea5ead07dec req-0009f4ef-ee1e-4459-a078-a6781cb54326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98908967-b008-45eb-8379-680e26ded755", "tag": "87a8b3a6-f225-498a-b49e-cce7f69c8c49"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:48.256004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-77631d11-63c9-48c0-8150-8ea5ead07dec req-0009f4ef-ee1e-4459-a078-a6781cb54326 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.258121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-77631d11-63c9-48c0-8150-8ea5ead07dec req-0009f4ef-ee1e-4459-a078-a6781cb54326 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.281727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-77631d11-63c9-48c0-8150-8ea5ead07dec req-0009f4ef-ee1e-4459-a078-a6781cb54326 service nova] Creating event network-changed:87a8b3a6-f225-498a-b49e-cce7f69c8c49 for instance 98908967-b008-45eb-8379-680e26ded755 on nch2-master-1 Jun 04 21:17:48.287698 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-77631d11-63c9-48c0-8150-8ea5ead07dec req-0009f4ef-ee1e-4459-a078-a6781cb54326 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051414 Jun 04 21:17:48.289012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2511/4912] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:17:48.592323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:48.592996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:48.600142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.600791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.601352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.601821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.734041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:48.742956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:48.744565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:48.745938 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9496645-72e5-4038-b541-def2e3314e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1726 microversion: 2.20 time: 0.157676 Jun 04 21:17:48.746931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2402/4913] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:48 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:48.764832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0af00c0-1332-46a0-b28a-878815945d12"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:48.765101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:48.765587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:48.766134 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:48.772938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.773389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.773668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.774126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.774262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.774596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:48.774905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:48.775345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.130365 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a83e097-9bfc-4538-b9fb-e4398cd2b732 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.369831 Jun 04 21:17:49.131076 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2403/4914] 10.222.0.18 () {62 vars in 1363 bytes} [Sat Jun 4 21:17:48 2022] POST /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments => generated 188 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:17:49.139777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:49.140396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:49.147214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.147701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.148486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.148919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.298190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:49.307394 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd685a93-3e76-48d3-9130-1b1240dc00da tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.547038 Jun 04 21:17:49.308255 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2512/4915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:48 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:49.314096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:49.314729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:49.322684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.323135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.323976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.325066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.331346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:49.341527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:49.351415 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c8c7695-3154-489d-8c83-6b37e01d83ae tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1681 microversion: 2.1 time: 0.218157 Jun 04 21:17:49.353721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2404/4916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:49 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:49.372314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:49.373489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:49.381745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.382658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.385745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.387698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.484997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:49.485795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:49.579456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f62531d0-4aad-4747-9e3a-e911cb5b9b5f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/action" status: 202 len: 0 microversion: 2.20 time: 0.223681 Jun 04 21:17:49.584041 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2405/4917] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:17:49 2022] POST /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:17:49.593026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:49.595081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:49.607880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.609276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.610890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:49.611606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:49.635771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:49.644960 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2eb15b9-fc09-46b4-a4bc-3a18202b2af2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1202 microversion: 2.1 time: 0.334965 Jun 04 21:17:49.655097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2513/4918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:49 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1202 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:49.771698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:49.795680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:49.806287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:49.808520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:49.810049 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a448e636-7134-4fbc-bd92-192ea0c80b06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1752 microversion: 2.20 time: 0.224797 Jun 04 21:17:49.810823 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2406/4919] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:49 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:50.328753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:50.330141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:50.340457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.340925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.341735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.342174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.374958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:50.376060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:50.389453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.391675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.392856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.393290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.570483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:50.581546 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ec0d0ed0-79e2-4a77-a44b-82d53c7e13f5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.260236 Jun 04 21:17:50.582898 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2514/4920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:50 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:50.608433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:50.618453 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-086a5079-bd54-469e-8bf8-73ea4e5a9be2 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1658 microversion: 2.1 time: 0.249055 Jun 04 21:17:50.619476 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2407/4921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:50 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1658 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:50.635384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8cf1507-249a-4e41-8c17-8482e824a47b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:50.645022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8cf1507-249a-4e41-8c17-8482e824a47b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.645485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8cf1507-249a-4e41-8c17-8482e824a47b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.662637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:50.663429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:50.669886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.670337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.671103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.671558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.675038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8cf1507-249a-4e41-8c17-8482e824a47b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Going to try to start instance {{(pid=137228) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:17:50.729530 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8cf1507-249a-4e41-8c17-8482e824a47b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.098019 Jun 04 21:17:50.730250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2515/4922] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:50 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:17:50.747146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:50.748440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:50.755122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.755721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.756502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.756943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.886342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:50.902430 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-424fedb2-58bd-4043-a2ff-3cafcaeab835 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1202 microversion: 2.1 time: 0.238613 Jun 04 21:17:50.903260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2408/4923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:50 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1202 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:50.920434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:50.921077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:50.935886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.936350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:50.937155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:50.937593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:51.024633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:51.043344 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6fbded77-9cbd-4a66-95fa-9e7a39d10970 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1667 microversion: 2.1 time: 0.299586 Jun 04 21:17:51.055360 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2516/4924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:50 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1667 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:51.205554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:51.216089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:51.217755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:51.219028 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c4ecb37c-8300-4d65-b6bb-1057f7e06074 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1754 microversion: 2.20 time: 0.314592 Jun 04 21:17:51.219960 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2409/4925] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:50 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1754 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:51.602231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:51.602933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:51.611948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:51.612631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:51.613624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:51.614790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:51.810584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:51.823155 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3a65aded-9ff0-46f0-8882-61f5040f7b7d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.227207 Jun 04 21:17:51.826064 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2517/4926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:51 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:51.928067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:51.931266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:51.951693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:51.953340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:51.956103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:51.957373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:52.063831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:52.064674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:52.081380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:52.088337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:52.089582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:52.090475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:52.241343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:52.249370 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8180370b-49b1-46e2-b7ba-8c6bf19a5f65 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1202 microversion: 2.1 time: 0.332914 Jun 04 21:17:52.249972 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2410/4927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:51 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1202 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:52.265297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:52.266168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:52.273296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:52.273758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:52.274552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:52.275010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:52.375543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:52.391652 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a54dcdf0-9f2c-4941-a2e9-5cfbede7c5c1 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1667 microversion: 2.1 time: 0.332947 Jun 04 21:17:52.402979 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2518/4928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:52 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1667 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:52.438460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:52.447995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:52.449920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:52.451107 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-180c1d78-dc1b-45f7-a860-723bba3cc501 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1754 microversion: 2.20 time: 0.190322 Jun 04 21:17:52.452021 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2411/4929] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:52 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:52.841366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:52.842017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:52.849508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:52.849969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:52.850760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:52.851238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.008730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.020395 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-36c4c35f-31eb-46c6-a579-300303026df5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.183138 Jun 04 21:17:53.031537 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2519/4930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:52 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:53.072360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4085b3a0-598e-4a4b-a9d5-c5ac719610b7 req-b0fa5444-f254-4023-98fe-dca664b41cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98f8f0a-3689-4e58-b810-a554cba65cb1", "name": "network-vif-plugged", "status": "completed", "tag": "68e98dfa-9692-4638-82bd-2bba01f58891"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:53.086094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4085b3a0-598e-4a4b-a9d5-c5ac719610b7 req-b0fa5444-f254-4023-98fe-dca664b41cbe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.087171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4085b3a0-598e-4a4b-a9d5-c5ac719610b7 req-b0fa5444-f254-4023-98fe-dca664b41cbe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.103347 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4085b3a0-598e-4a4b-a9d5-c5ac719610b7 req-b0fa5444-f254-4023-98fe-dca664b41cbe service nova] Creating event network-vif-plugged:68e98dfa-9692-4638-82bd-2bba01f58891 for instance a98f8f0a-3689-4e58-b810-a554cba65cb1 on nch1-master-1 Jun 04 21:17:53.114385 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4085b3a0-598e-4a4b-a9d5-c5ac719610b7 req-b0fa5444-f254-4023-98fe-dca664b41cbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044922 Jun 04 21:17:53.116074 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2412/4931] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:53.268204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:53.269393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:53.279763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.280292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.281171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.281667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.411435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:53.412349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:53.419895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.421304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.422319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.422973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.466516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.475784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c8a7e92a-b8e5-479b-a94e-dbefd2d2e5da tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1202 microversion: 2.1 time: 0.211870 Jun 04 21:17:53.480136 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2520/4932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:53 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1202 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:53.486512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:53.487599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:53.496326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.497091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.498424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.499080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.645311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.653339 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9898cdd5-b61f-45da-9b22-e3dc7a737d4a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.246975 Jun 04 21:17:53.654257 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2413/4933] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:53 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:53.671873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:53.673119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:53.680407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.681483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.682839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.683616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.705105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.721021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.724313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.726228 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7b12e3c-9f28-4617-a4cf-a9b779fbb74f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.244753 Jun 04 21:17:53.727810 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2521/4934] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:53 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:53.847959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:53.857342 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a75b8f64-4b93-49da-88de-dc15313f5193 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.190283 Jun 04 21:17:53.857947 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2414/4935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:53 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:53.877589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:53.878374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:53.886689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.887157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:53.888136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:53.888589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.038474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:54.039568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.044965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.051037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.052872 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-795ed2fb-24f6-49de-90da-49cbb0f48865 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.179298 Jun 04 21:17:54.053316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.063547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.063547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.064398 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2522/4936] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:53 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:54.073053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:54.073944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.081146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.081916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.082990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.085432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.299943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.310750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7294d375-a198-4c02-bcad-2ab1aaf1407e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.276327 Jun 04 21:17:54.311610 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2415/4937] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:54 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:54.312022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.320111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1bbbacdd-549e-4e04-9eb1-0ffd77c7c6ad tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.253294 Jun 04 21:17:54.320819 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2523/4938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:54 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:54.336211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:54.336812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.343115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.343598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.344371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.344843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.493731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:54.494346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.504241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.505193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.505617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.507399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.507875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.513755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c1ad543-9975-4873-960a-f333e4542b15 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.181378 Jun 04 21:17:54.514661 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2416/4939] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:54 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:54.531808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:54.532515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.540177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.541884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.543200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.544047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.576788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lazy-loading 'flavor' on Instance uuid fccc20f3-db1c-4c63-8b35-a1b344ee3b31 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:17:54.681443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.685662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6980df7d-fe00-4e99-93e5-0efc62f0b530 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.158457 Jun 04 21:17:54.689256 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2417/4940] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:54 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:17:54.695263 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a32d3075-7d86-4a9a-a0a9-9e5e3c41ea3a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1202 microversion: 2.1 time: 0.205479 Jun 04 21:17:54.696180 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2524/4941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:54 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1202 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:54.701852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:54.702569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.710688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.711435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.712325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.713539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.746275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:54.746786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:54.754937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.755578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.756356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:54.756796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:54.944031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.953993 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff533f38-f351-4ae6-8f19-9ed37b71480a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1679 microversion: 2.1 time: 0.262777 Jun 04 21:17:54.954583 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2418/4942] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:54 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:54.988981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:54.999337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:55.001803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:55.003117 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-06bec005-6ec6-4e8a-a373-d587127bca06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.261810 Jun 04 21:17:55.004357 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2525/4943] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:54 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:17:55.133248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ec703660-fc2f-4e6d-ad1e-f5256cbeea38 req-048806c9-b2e2-4288-8602-52a9a5ad9bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98908967-b008-45eb-8379-680e26ded755", "name": "network-vif-plugged", "status": "completed", "tag": "87a8b3a6-f225-498a-b49e-cce7f69c8c49"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:55.150494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ec703660-fc2f-4e6d-ad1e-f5256cbeea38 req-048806c9-b2e2-4288-8602-52a9a5ad9bf7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.150950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ec703660-fc2f-4e6d-ad1e-f5256cbeea38 req-048806c9-b2e2-4288-8602-52a9a5ad9bf7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.200983 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ec703660-fc2f-4e6d-ad1e-f5256cbeea38 req-048806c9-b2e2-4288-8602-52a9a5ad9bf7 service nova] Creating event network-vif-plugged:87a8b3a6-f225-498a-b49e-cce7f69c8c49 for instance 98908967-b008-45eb-8379-680e26ded755 on nch2-master-1 Jun 04 21:17:55.210506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ec703660-fc2f-4e6d-ad1e-f5256cbeea38 req-048806c9-b2e2-4288-8602-52a9a5ad9bf7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081108 Jun 04 21:17:55.211291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2419/4944] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:17:55.339907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:55.341547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:55.356062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:55.362264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.362752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.363792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.368330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.420104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:55.560437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:55.572659 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e7ec5271-cff3-48db-8ba3-57ea1df6869f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1313 microversion: 2.1 time: 0.246935 Jun 04 21:17:55.574321 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2526/4945] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:55 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:55.715308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:55.716035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:55.723766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.724524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.725504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.726163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.907268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:55.917467 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3fca4b3b-28ec-40fe-9c9a-eb44b1b4abf9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1389 microversion: 2.1 time: 0.208523 Jun 04 21:17:55.918478 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2420/4946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:55 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1389 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:55.936156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:55.936806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:55.946839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.947875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.949065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.949672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.971983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:55.972965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:55.982099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.989476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:55.990575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:55.991232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.000273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:56.325229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:56.337423 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45b9c3f7-93fc-48e1-b9fe-54e1884ab5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1389 microversion: 2.1 time: 0.405437 Jun 04 21:17:56.340626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:56.349446 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2527/4947] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:55 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1389 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:56.349446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:56.350008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:56.352870 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25cd7d32-3727-4729-a29a-e3b1ce3922d6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1662 microversion: 2.1 time: 0.384457 Jun 04 21:17:56.354155 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2421/4948] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:55 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1662 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:56.361377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:56.362270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:56.368022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.368485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.369142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:56.371919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.372390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.372956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.373596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.374553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.375146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.769109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:56.774300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:17:56.785665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:56.787839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:56.789432 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37be63f0-cd3e-4d81-8f30-28f1f8992e95 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.444586 Jun 04 21:17:56.790581 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2528/4949] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:56 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:56.796266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:56.797204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:56.801010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:56.806476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.807065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.808029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.808550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.818456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d74607e-bc87-4cc9-b2fa-d9830ef984db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1389 microversion: 2.1 time: 0.463055 Jun 04 21:17:56.821491 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2422/4950] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:56 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1389 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:56.831838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:56.832480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:56.851114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.851550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.852399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.852841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.950823 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba12ac43-afd6-4701-82ee-f19c926860a3 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action" status: 202 len: 0 microversion: 2.1 time: 0.158384 Jun 04 21:17:56.951626 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2529/4951] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:56 2022] POST /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:17:56.963207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:56.964874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:56.974806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.975839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:56.976869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:56.977757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.031043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:17:57.082116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:57.090856 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-42e72f8d-29d2-4df7-8d25-ff2942c93686 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1498 microversion: 2.1 time: 0.268505 Jun 04 21:17:57.092233 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2423/4952] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:56 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1498 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:57.114051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:57.116797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:57.146772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.147286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.148192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.148642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.229371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f4f12467-cab8-4bc6-abff-b429509cee97 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 204 len: 0 microversion: 2.1 time: 0.275903 Jun 04 21:17:57.230113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2530/4953] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:17:56 2022] DELETE /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:17:57.241973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:17:57.247992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:57.266680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.267760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.268761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.269392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.336861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lazy-loading 'flavor' on Instance uuid 98908967-b008-45eb-8379-680e26ded755 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:17:57.430468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:57.446468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6efd449-7620-40c2-a6cb-ed3b47850352 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1668 microversion: 2.1 time: 0.349017 Jun 04 21:17:57.447279 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2424/4954] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:57 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1668 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:57.454408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:57.455488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:57.461778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-598e3afa-ad5b-4df1-b6f5-8d9b4fa30c86 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "POST /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755/action" status: 200 len: 32 microversion: 2.1 time: 0.230170 Jun 04 21:17:57.462715 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2531/4955] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:17:57 2022] POST /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755/action => generated 32 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:17:57.487330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.488184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.489028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.489469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.491081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:57.492887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:57.506778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.520575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.525035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.526029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.943065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:57.947933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:57.962521 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b9bf24d-c2ec-47fc-a070-92f6987a08e4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.513908 Jun 04 21:17:57.963129 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2425/4956] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:57 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:57.973465 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ddee2820-8aea-4cce-a635-d408fc11853b tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.485674 Jun 04 21:17:57.974298 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2532/4957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:57 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:17:57.979441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:57.980873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:57.987651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.988422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:57.989399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:57.990032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:58.276391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:58.292074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:58.293776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:58.295005 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-13c43798-1d00-46b8-b4a6-edec584e615f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.319742 Jun 04 21:17:58.306111 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2426/4958] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:57 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:58.466516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:58.467198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:58.475055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:58.475677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:58.476475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:58.476928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:58.658104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:58.667773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6bcbd60a-8792-4885-90bb-bcaa1c1c6fd4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1668 microversion: 2.1 time: 0.205643 Jun 04 21:17:58.679971 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2533/4959] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:58 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:58.980692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:58.982309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:58.991279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:58.992616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:58.993669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:58.994197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.006453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:59.007490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:59.023559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.024128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.025598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.026109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.266192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:59.275535 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-50633f01-e11c-410f-8977-211f2383f4ef tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.299607 Jun 04 21:17:59.280567 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2427/4960] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:58 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:59.302341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:59.315482 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-58028733-5af5-4ca6-bebe-f4bd4d0e9784 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.327866 Jun 04 21:17:59.316791 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2534/4961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:58 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:59.325416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:59.326144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:59.346320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.347167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.354882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.356470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.579597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:59.596875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:59.599077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:59.604102 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9042fc87-b890-4314-bd4b-06d55a2a8afe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.291267 Jun 04 21:17:59.606314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2428/4962] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:17:59 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:17:59.697808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:59.699328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:59.706061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.706783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.707784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.708224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.899336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:17:59.908987 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c61f361e-5081-4921-a009-3ae250f9ce79 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.227787 Jun 04 21:17:59.915491 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2535/4963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:59 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:17:59.926329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:17:59.927095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:17:59.943714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.944816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:17:59.945843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:17:59.947434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.147951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:00.157157 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73e9e5aa-d04c-459c-ade9-75eb12e4f4ed tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1671 microversion: 2.1 time: 0.234802 Jun 04 21:18:00.157672 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2429/4964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:17:59 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:00.175239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:00.175916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:00.191220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.191707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.193743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.195488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.224898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:00.232034 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.compute.api [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Working on deleting snapshot 296e421a-d72c-40eb-b993-c7c9fab1e9d0 from shelved instance... Jun 04 21:18:00.297534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:00.298151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:00.305859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.306311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.314624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.316174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.592934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:00.604086 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-735a2001-3eb4-4445-b1d6-6ea734f7fb9e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.310393 Jun 04 21:18:00.605749 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2430/4965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:00 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:00.618882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:00.620676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:00.635144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.636786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.637593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.638036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.893696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:00.903637 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b6337ea1-676e-4889-93ec-4ee3a9c4f061 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.292916 Jun 04 21:18:00.904631 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2431/4966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:00 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:00.911297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:00.912419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:00.921025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.922050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:00.923251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:00.924447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:01.196707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:01.207882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:01.209691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:01.212238 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9664a66-9958-472d-9b66-c10e580d2756 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.306279 Jun 04 21:18:01.213962 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2432/4967] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:00 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:01.628725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:01.629440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:01.637738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:01.638197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:01.639348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:01.640184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:01.924973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:01.947976 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f891a14c-6271-4966-969c-f107ea367db0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.323389 Jun 04 21:18:01.949496 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2433/4968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:01 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:01.953314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Doing local delete in cell 72b7e698-4334-4986-b8f6-aecb1ad8743a(cell1) {{(pid=137228) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 04 21:18:01.954810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:01.959305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:01.960145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.compute.api [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 04 21:18:01.961580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:01.962226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:01.970589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] deallocate_for_instance() {{(pid=137228) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} Jun 04 21:18:01.991256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:01.995884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:01.997258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:01.998149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:02.345069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:02.353105 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bee78ad3-c228-40ab-95ff-addb3aca9bf1 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.402056 Jun 04 21:18:02.353957 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2434/4969] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:01 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:02.360363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:02.361909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:02.372890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:02.373948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:02.377701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:02.379253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:02.622672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:02.633124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:02.634756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:02.637036 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae8b5f96-8352-4f30-b5c8-d284960f5ef7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.282001 Jun 04 21:18:02.641315 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2435/4970] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:02 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:02.947454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Updating instance_info_cache with network_info: [] {{(pid=137228) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 04 21:18:02.951308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-200e3f8c-bef6-488e-b60d-df93b491b905 req-fb887977-90dc-4a3c-85f4-3941c1e02a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed323b4c-e457-4672-ae3d-4b7238721ce6", "name": "network-vif-deleted", "tag": "aaaa0959-ea7a-417a-9856-c0c203d4dd3b"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:02.984246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-200e3f8c-bef6-488e-b60d-df93b491b905 req-fb887977-90dc-4a3c-85f4-3941c1e02a56 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:02.985884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-200e3f8c-bef6-488e-b60d-df93b491b905 req-fb887977-90dc-4a3c-85f4-3941c1e02a56 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.025326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.compute.server_external_events [req-200e3f8c-bef6-488e-b60d-df93b491b905 req-fb887977-90dc-4a3c-85f4-3941c1e02a56 service nova] Unable to find a host for instance ed323b4c-e457-4672-ae3d-4b7238721ce6. Dropping event network-vif-deleted {{(pid=137229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 21:18:03.028606 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-200e3f8c-bef6-488e-b60d-df93b491b905 req-fb887977-90dc-4a3c-85f4-3941c1e02a56 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091606 Jun 04 21:18:03.033923 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2436/4971] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 93 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 04 21:18:03.044194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:03.045587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:03.070276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.070819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.071818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.073809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.306920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:03.320791 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d30456fc-22cb-4b94-b305-74f7ab04094a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.285529 Jun 04 21:18:03.325523 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2437/4972] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:03 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:03.373105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:03.375009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:03.393239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.396430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.398126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.400403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.431494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:03.737724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:03.752613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-05a61562-dfba-467f-a0d4-18156217f38c tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.385926 Jun 04 21:18:03.762884 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2438/4973] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:03 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:03.769513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:03.770385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:03.778391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.778824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.780008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.780604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.782651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=9,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:03.957391 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-614e1ae5-c9ec-45e9-b113-7afbfa3a3162 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 204 len: 0 microversion: 2.1 time: 3.785790 Jun 04 21:18:03.967811 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2536/4974] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:00 2022] DELETE /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 0 bytes in 3790 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:18:03.980059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:03.983798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: ed323b4c-e457-4672-ae3d-4b7238721ce6] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:03.997417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.997796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:03.998811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:03.999347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.023343 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] HTTP exception thrown: Instance ed323b4c-e457-4672-ae3d-4b7238721ce6 could not be found. Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Request method failure captured: Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 HTTP/1.1 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pi-CvAxZC0oDOOr4jWw9iUi7-cw4wwmxr2oUy2B5oloTi8SImDW75GEsVZUGrerFh9T0U-Ar1-9aKLgpAGnhOl1hoNpbkI1LN0fKvtS712OMEMug-x_x5yKuxLAA1svxNBDGDC_f9t4Fs2f-mK2j-2l9M2MXFxw3plGZcrMsWETiA Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 09431bbdbc394df8b368770d3e24a306 Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ed323b4c-e457-4672-ae3d-4b7238721ce6 could not be found. Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ed323b4c-e457-4672-ae3d-4b7238721ce6'} Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed323b4c-e457-4672-ae3d-4b7238721ce6 could not be found. Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed323b4c-e457-4672-ae3d-4b7238721ce6 could not be found. Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:04.025470 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed323b4c-e457-4672-ae3d-4b7238721ce6 could not be found. Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Returning 404 to user: Instance ed323b4c-e457-4672-ae3d-4b7238721ce6 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:04.030681 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dfb3c6c0-cc6a-44f9-9524-da7d4f73db20 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6" status: 404 len: 111 microversion: 2.1 time: 0.057442 Jun 04 21:18:04.032896 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2537/4975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:03 2022] GET /compute/v2.1/servers/ed323b4c-e457-4672-ae3d-4b7238721ce6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:04.045465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:04.046174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:04.055640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.055640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.055640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.055640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.060956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:04.075465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:04.078104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:04.079918 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-90dd5285-2075-4274-9e01-3890e2d642fe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.315300 Jun 04 21:18:04.088903 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2439/4976] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:03 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:04.106869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:04.203281 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ab8c7e9-a3bc-48a0-b8bb-f42bf1c83143 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 204 len: 0 microversion: 2.1 time: 0.166268 Jun 04 21:18:04.203939 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2538/4977] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:04 2022] DELETE /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:04.212885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:04.213928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:04.220662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.221119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.221897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.222340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.311470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:04.322990 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e7821699-94a8-4e3d-bc31-c4cd77b96771 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1467 microversion: 2.1 time: 0.113923 Jun 04 21:18:04.324286 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2440/4978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:04 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1467 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:04.343107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:04.343870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:04.350402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.350852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.351743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.352394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.501966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:04.510238 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-21482f3b-d73d-4486-850e-fe975e6e42c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.171780 Jun 04 21:18:04.512262 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2539/4979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:04 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:04.771198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:04.771826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:04.779968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.780427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.781297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:04.781865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:04.923388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:04.931317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-31b988d7-6b51-4bea-a57a-130fcabea42d tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.164930 Jun 04 21:18:04.931920 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2441/4980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:04 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:05.102129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:05.102740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:05.110248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.110693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.111454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.111918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.250674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:05.259640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:05.261190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:05.262369 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc754cd9-5ad2-4597-bcd3-bf4e1858726f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.164486 Jun 04 21:18:05.262903 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2540/4981] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:05 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:05.341643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:05.342274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:05.349655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.350122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.350905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.351355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.444743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:05.456777 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4256b246-e0c0-4e39-bef7-1c38371556cf tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1467 microversion: 2.1 time: 0.119284 Jun 04 21:18:05.457397 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2442/4982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:05 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1467 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:05.529594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:05.530255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:05.536922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.537379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.538160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.538392 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:18:05.538606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.546565 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 21:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:18:05.768210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:05.778000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a296d4bf-633b-4d7e-ba76-8c1eda00d7e3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1395 microversion: 2.1 time: 0.252683 Jun 04 21:18:05.778846 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2541/4983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:05 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1395 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:05.948991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:05.950605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:05.957478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.958230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:05.959132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:05.959639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.198600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4b456213-aa6a-420b-9f5a-d22c0323513d req-d42865bd-1e1e-4f05-b606-03bf6214aeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98f8f0a-3689-4e58-b810-a554cba65cb1", "name": "network-vif-deleted", "tag": "68e98dfa-9692-4638-82bd-2bba01f58891"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:06.202661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:06.208724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4b456213-aa6a-420b-9f5a-d22c0323513d req-d42865bd-1e1e-4f05-b606-03bf6214aeda service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.209159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4b456213-aa6a-420b-9f5a-d22c0323513d req-d42865bd-1e1e-4f05-b606-03bf6214aeda service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.215671 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d826aa53-db92-42c0-bf7c-c80cebb3a13f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.271011 Jun 04 21:18:06.222689 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4b456213-aa6a-420b-9f5a-d22c0323513d req-d42865bd-1e1e-4f05-b606-03bf6214aeda service nova] Creating event network-vif-deleted:68e98dfa-9692-4638-82bd-2bba01f58891 for instance a98f8f0a-3689-4e58-b810-a554cba65cb1 on nch1-master-1 Jun 04 21:18:06.227098 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2443/4984] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:05 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:06.228754 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4b456213-aa6a-420b-9f5a-d22c0323513d req-d42865bd-1e1e-4f05-b606-03bf6214aeda service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034833 Jun 04 21:18:06.229573 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2542/4985] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:18:06.282823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:06.283449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:06.292250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.292718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.293543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.293989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.444098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0e1826b9-78b0-479f-a28b-ceead4cca555 req-feef0bd9-2a4b-41a5-93f1-40f2654cbcfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d304e214-5fc8-48e8-b10c-e2ceb408f65c", "name": "network-vif-deleted", "tag": "311c47f6-88d5-45dc-8e09-fbf1f6ebdc90"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:06.463225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0e1826b9-78b0-479f-a28b-ceead4cca555 req-feef0bd9-2a4b-41a5-93f1-40f2654cbcfa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.464110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0e1826b9-78b0-479f-a28b-ceead4cca555 req-feef0bd9-2a4b-41a5-93f1-40f2654cbcfa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.478072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0e1826b9-78b0-479f-a28b-ceead4cca555 req-feef0bd9-2a4b-41a5-93f1-40f2654cbcfa service nova] Creating event network-vif-deleted:311c47f6-88d5-45dc-8e09-fbf1f6ebdc90 for instance d304e214-5fc8-48e8-b10c-e2ceb408f65c on nch2-master-1 Jun 04 21:18:06.485046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0e1826b9-78b0-479f-a28b-ceead4cca555 req-feef0bd9-2a4b-41a5-93f1-40f2654cbcfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046251 Jun 04 21:18:06.486402 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2543/4986] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:06.493556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:06.494581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:06.502710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.503486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.504514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.505134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.568678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:06.582017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:06.585326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:06.588536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae9f2743-462c-474c-80da-4c6a63893abc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.309834 Jun 04 21:18:06.590521 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2444/4987] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:06 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:06.628141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:06.636535 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9f29ae4f-735f-4069-b8b3-645e775a3ddd tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 200 len: 1300 microversion: 2.1 time: 0.148809 Jun 04 21:18:06.637149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2544/4988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:06 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:06.797832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:06.797832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:06.806918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.807383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.808249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:06.808689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:06.888112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:06.897719 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a41a916-ac1f-418e-974b-9d272e272f03 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 200 len: 1187 microversion: 2.1 time: 0.105521 Jun 04 21:18:06.898282 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2445/4989] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:06 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:07.234857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.236141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:07.246549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.247195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.248009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.248453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.420825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:07.429294 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f819406a-6989-467e-862a-10191687ce90 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.199727 Jun 04 21:18:07.430226 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2545/4990] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:07 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:07.609493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.610102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:07.619057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.619534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.620569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.621393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.657957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.658798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: d304e214-5fc8-48e8-b10c-e2ceb408f65c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:07.669157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.669624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.670624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.671956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.694866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] HTTP exception thrown: Instance d304e214-5fc8-48e8-b10c-e2ceb408f65c could not be found. Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Request method failure captured: Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c HTTP/1.1 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pi-CvAxZC0oDOOr4jWw9iUi7-cw4wwmxr2oUy2B5oloTi8SImDW75GEsVZUGrerFh9T0U-Ar1-9aKLgpAGnhOl1hoNpbkI1LN0fKvtS712OMEMug-x_x5yKuxLAA1svxNBDGDC_f9t4Fs2f-mK2j-2l9M2MXFxw3plGZcrMsWETiA Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 09431bbdbc394df8b368770d3e24a306 Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance d304e214-5fc8-48e8-b10c-e2ceb408f65c could not be found. Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'd304e214-5fc8-48e8-b10c-e2ceb408f65c'} Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d304e214-5fc8-48e8-b10c-e2ceb408f65c could not be found. Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d304e214-5fc8-48e8-b10c-e2ceb408f65c could not be found. Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:07.697036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d304e214-5fc8-48e8-b10c-e2ceb408f65c could not be found. Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Returning 404 to user: Instance d304e214-5fc8-48e8-b10c-e2ceb408f65c could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:07.703219 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-03dac366-9f0a-464f-93ac-bb6dbf20c30b tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c" status: 404 len: 111 microversion: 2.1 time: 0.048626 Jun 04 21:18:07.704652 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2546/4991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:07 2022] GET /compute/v2.1/servers/d304e214-5fc8-48e8-b10c-e2ceb408f65c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:18:07.710629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.711062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:07.718415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:07.720386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.721281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.722229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.722968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.760222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:07.792408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:07.802743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:07.804697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:07.806242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2af1cf12-fa52-4b18-80e5-0e532be328b7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.201410 Jun 04 21:18:07.807006 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2446/4992] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:07 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:18:07.875030 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ec2577f-cd33-462a-a3be-fcfca52c9b67 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "DELETE /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 204 len: 0 microversion: 2.1 time: 0.169849 Jun 04 21:18:07.876036 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2547/4993] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:07 2022] DELETE /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:07.884577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.885315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:07.894080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.894787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.896021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.896492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.918390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.919119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:07.925670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.926125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.927116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:07.927589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:07.960042 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 HTTP/1.1 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a98f8f0a-3689-4e58-b810-a554cba65cb1'} Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:07.961732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45c5ea01-1a7d-430d-8dc5-ca76adef0281 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 404 len: 111 microversion: 2.1 time: 0.049415 Jun 04 21:18:07.970973 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2548/4994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:07 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:07.997189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:07.997748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:08.005263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.005729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.006512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.006952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.021692 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 HTTP/1.1 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a98f8f0a-3689-4e58-b810-a554cba65cb1'} Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:08.023395 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a20267ef-1d1b-45d9-ac67-130ba810e3b7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 404 len: 111 microversion: 2.1 time: 0.032480 Jun 04 21:18:08.032011 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2549/4995] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:07 2022] DELETE /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:18:08.037505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:08.038125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: a98f8f0a-3689-4e58-b810-a554cba65cb1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:08.044471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.044914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.045682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.046118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.052313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:08.060216 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09727ec5-e39f-4a18-94c8-ac5754c01aef tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1508 microversion: 2.1 time: 0.179492 Jun 04 21:18:08.060430 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.060727 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2447/4996] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:07 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 HTTP/1.1 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'a98f8f0a-3689-4e58-b810-a554cba65cb1'} Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:08.062047 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance a98f8f0a-3689-4e58-b810-a554cba65cb1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae82a7b6-9e1e-47fb-b9c4-b494f2cde465 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1" status: 404 len: 111 microversion: 2.1 time: 0.032633 Jun 04 21:18:08.067037 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2550/4997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:08 2022] GET /compute/v2.1/servers/a98f8f0a-3689-4e58-b810-a554cba65cb1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:08.447602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:08.448257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:08.454552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.455041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.455940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.456381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.602054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:08.610410 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2488ec71-3f96-4088-8b48-a0f34c9220ad tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.166764 Jun 04 21:18:08.611024 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2448/4998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:08 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:08.826006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:08.826620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:08.833896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.834271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:08.835040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:08.835493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:09.012177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:09.022473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:09.024004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:09.025195 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fe7a9090-da34-4e7e-af09-a1800f76486b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.203589 Jun 04 21:18:09.025938 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2551/4999] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:08 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:09.078524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:09.079150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:09.087275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:09.087750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:09.088531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:09.089067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:09.308409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:09.327819 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34451189-8d28-499c-a197-845e1812b63f tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1508 microversion: 2.1 time: 0.255233 Jun 04 21:18:09.328434 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2449/5000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:09 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:09.629421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:09.630216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:09.640678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:09.641468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:09.642990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:09.643630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:09.671790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:09.841110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:09.852327 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df869e98-1898-4fe3-ad05-daa94b1f861a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.227296 Jun 04 21:18:09.862598 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2552/5001] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:09 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:10.045137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:10.051644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:10.059374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.062386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.064202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.065548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.152193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-16df2f82-8ab2-4763-af55-6021ca5d0e4f req-5132e3c2-40d3-400a-b95b-873bc4f0cab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c008cf-8b7e-4b17-af85-13228329846a", "name": "network-vif-deleted", "tag": "96728599-aebf-4cdc-9898-644ff3b2e54a"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:10.163377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-16df2f82-8ab2-4763-af55-6021ca5d0e4f req-5132e3c2-40d3-400a-b95b-873bc4f0cab1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.163937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-16df2f82-8ab2-4763-af55-6021ca5d0e4f req-5132e3c2-40d3-400a-b95b-873bc4f0cab1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.192831 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-16df2f82-8ab2-4763-af55-6021ca5d0e4f req-5132e3c2-40d3-400a-b95b-873bc4f0cab1 service nova] Creating event network-vif-deleted:96728599-aebf-4cdc-9898-644ff3b2e54a for instance 70c008cf-8b7e-4b17-af85-13228329846a on nch1-master-1 Jun 04 21:18:10.200181 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-16df2f82-8ab2-4763-af55-6021ca5d0e4f req-5132e3c2-40d3-400a-b95b-873bc4f0cab1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056052 Jun 04 21:18:10.201425 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2553/5002] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:18:10.248994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:10.259767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:10.263179 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:10.264430 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-28a86f92-bd94-4488-a1ff-7be1e924b9b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.224279 Jun 04 21:18:10.275721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2450/5003] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:10 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:10.347687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:10.348445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:10.355689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.356176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.356925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.357392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.395089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.395622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.396079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lazy-loading 'fault' on Instance uuid 70c008cf-8b7e-4b17-af85-13228329846a {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:18:10.443491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:10.453766 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3eb7c7e3-b686-4d9b-b606-ef0a7cfb755a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 200 len: 1304 microversion: 2.1 time: 0.111814 Jun 04 21:18:10.454762 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2554/5004] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:10 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:10.872465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:10.873326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:10.880913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.881364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:10.882707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:10.883486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.057851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:11.066662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1ff89ad7-e8f5-4722-a280-2856970dd8b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.200724 Jun 04 21:18:11.067241 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2451/5005] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:10 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:11.198446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-7185d708-75a0-4f8f-9ecb-000135473dd7 req-b60705f9-72cb-406f-935b-07fe20e7d7ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "name": "network-vif-plugged", "status": "completed", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:11.209291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7185d708-75a0-4f8f-9ecb-000135473dd7 req-b60705f9-72cb-406f-935b-07fe20e7d7ea service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.209291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7185d708-75a0-4f8f-9ecb-000135473dd7 req-b60705f9-72cb-406f-935b-07fe20e7d7ea service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.221323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-7185d708-75a0-4f8f-9ecb-000135473dd7 req-b60705f9-72cb-406f-935b-07fe20e7d7ea service nova] Creating event network-vif-plugged:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:18:11.226406 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-7185d708-75a0-4f8f-9ecb-000135473dd7 req-b60705f9-72cb-406f-935b-07fe20e7d7ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033457 Jun 04 21:18:11.227268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2555/5006] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:11.283311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:11.283805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:11.292002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.292451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.294680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.295368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.453112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:11.465335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:11.468114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:11.469338 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-89975541-05f5-42d6-b7c2-78195b16c907 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.190845 Jun 04 21:18:11.470086 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2452/5007] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:11 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:18:11.474063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:11.477025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: 70c008cf-8b7e-4b17-af85-13228329846a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:11.485866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.486327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.487109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.487782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.519215 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] HTTP exception thrown: Instance 70c008cf-8b7e-4b17-af85-13228329846a could not be found. Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Request method failure captured: Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a HTTP/1.1 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pi-CvAxZC0oDOOr4jWw9iUi7-cw4wwmxr2oUy2B5oloTi8SImDW75GEsVZUGrerFh9T0U-Ar1-9aKLgpAGnhOl1hoNpbkI1LN0fKvtS712OMEMug-x_x5yKuxLAA1svxNBDGDC_f9t4Fs2f-mK2j-2l9M2MXFxw3plGZcrMsWETiA Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 09431bbdbc394df8b368770d3e24a306 Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 70c008cf-8b7e-4b17-af85-13228329846a could not be found. Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '70c008cf-8b7e-4b17-af85-13228329846a'} Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c008cf-8b7e-4b17-af85-13228329846a could not be found. Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c008cf-8b7e-4b17-af85-13228329846a could not be found. Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:11.521149 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c008cf-8b7e-4b17-af85-13228329846a could not be found. Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Returning 404 to user: Instance 70c008cf-8b7e-4b17-af85-13228329846a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ca53959c-664d-4adf-851a-fe0ea9fa272a tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a" status: 404 len: 111 microversion: 2.1 time: 0.055952 Jun 04 21:18:11.527452 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2556/5008] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:11 2022] GET /compute/v2.1/servers/70c008cf-8b7e-4b17-af85-13228329846a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:18:11.531549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:11.531897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:11.541186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.541641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.542484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.542922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.586601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:11.645174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:11.687761 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-57ef7bd6-be68-4e35-9e24-bf479847df65 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 204 len: 0 microversion: 2.1 time: 0.159707 Jun 04 21:18:11.688790 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2453/5009] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:11 2022] DELETE /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:11.698516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:11.699438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:11.706137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.706624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.707410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:11.707887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:11.863823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:11.872667 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1feca4b6-07b2-4a6f-9e29-fb878231e3ee tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1496 microversion: 2.1 time: 0.179603 Jun 04 21:18:11.874350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2557/5010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:11 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:12.084386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:12.085090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:12.091799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:12.092250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:12.093032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:12.093466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:12.240554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:12.248999 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95c7ff1c-0f61-4ca2-b992-d4634d37534e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.168891 Jun 04 21:18:12.249786 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2454/5011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:12 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:12.491583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:12.492223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:12.500588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:12.501009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:12.501907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:12.502320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:12.649767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:12.662431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:12.664882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:12.666827 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2c39b6bc-5bd5-4186-b0e4-52c0b323a1aa tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.181553 Jun 04 21:18:12.668092 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2558/5012] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:12 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:12.892465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:12.893081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:12.901015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:12.902010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:12.902796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:12.903220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:13.047734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:13.058431 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43868e59-8326-408d-943c-c876190e00ab tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1496 microversion: 2.1 time: 0.169943 Jun 04 21:18:13.058955 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2455/5013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:12 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1496 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:13.266614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:13.267862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:13.276226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:13.276906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:13.277775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:13.278425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:13.475066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:13.485685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1e3ec4f-2c52-4c44-926b-91f89bb2de8f tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.223040 Jun 04 21:18:13.496824 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2559/5014] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:13 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:13.692819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:13.693884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:13.702788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:13.703790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:13.707570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:13.708329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:13.770921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b19b31e6-78cd-4d4f-8ee0-b7ead882d416 req-b3903318-527a-4eae-9df3-0c823bcdeab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb609fdf-9184-45fb-a65e-d1c466a13b40", "name": "network-vif-deleted", "tag": "8a058226-3db6-4aae-b937-e66a694a910d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:13.805188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b19b31e6-78cd-4d4f-8ee0-b7ead882d416 req-b3903318-527a-4eae-9df3-0c823bcdeab2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:13.815366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b19b31e6-78cd-4d4f-8ee0-b7ead882d416 req-b3903318-527a-4eae-9df3-0c823bcdeab2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:13.878554 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b19b31e6-78cd-4d4f-8ee0-b7ead882d416 req-b3903318-527a-4eae-9df3-0c823bcdeab2 service nova] Creating event network-vif-deleted:8a058226-3db6-4aae-b937-e66a694a910d for instance bb609fdf-9184-45fb-a65e-d1c466a13b40 on nch2-master-1 Jun 04 21:18:13.886309 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b19b31e6-78cd-4d4f-8ee0-b7ead882d416 req-b3903318-527a-4eae-9df3-0c823bcdeab2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120737 Jun 04 21:18:13.889162 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2560/5015] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:14.076231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:14.077607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:14.087005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.088161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.089229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.091764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.129124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.129562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.130032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lazy-loading 'fault' on Instance uuid bb609fdf-9184-45fb-a65e-d1c466a13b40 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:18:14.273244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:14.283297 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71e187e9-9c09-430e-b92c-f724dc3e66a4 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 200 len: 1305 microversion: 2.1 time: 0.211257 Jun 04 21:18:14.284638 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2561/5016] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:14 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:14.290621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-521714520", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a03e5283-6e7a-4d35-ba39-48cc091eeeba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4f8dc4cf-e0c9-460c-b458-27f360b796ed"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:14.312586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:14.333035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:14.336027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:14.339015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6c4cb659-cc0d-4044-a6ca-32eaf713b64c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1810 microversion: 2.20 time: 0.651399 Jun 04 21:18:14.340823 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2456/5017] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:13 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1810 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:18:14.363129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] validate_networks() for [('4f8dc4cf-e0c9-460c-b458-27f360b796ed', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:18:14.503409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:14.504501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:14.511627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.512080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.512859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.513289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.726819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:14.734799 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e1bb03a2-a7dc-4f77-a388-0a0ca70fa020 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.235750 Jun 04 21:18:14.735383 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2457/5018] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:14 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:14.852767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:18:14.853350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:18:14.853658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:18:14.855004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:18:14.855173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:18:14.867453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.867977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.868823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:14.869264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:14.890461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:18:14.896690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:18:14.955672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:18:14.957810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a03e5283-6e7a-4d35-ba39-48cc091eeeba',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:18:15.146725 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b1b3106-4702-4ff1-ab2d-85513953b372 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860459 Jun 04 21:18:15.148519 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2562/5019] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:18:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:18:15.170839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e4c380c0-a1d0-41cd-9ace-bdfb306342a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:15.172862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e4c380c0-a1d0-41cd-9ace-bdfb306342a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:15.241225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e4c380c0-a1d0-41cd-9ace-bdfb306342a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:15.264328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e4c380c0-a1d0-41cd-9ace-bdfb306342a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1070 microversion: 2.1 time: 0.109269 Jun 04 21:18:15.265179 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2458/5020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:15 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1070 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:15.307797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:15.308606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: bb609fdf-9184-45fb-a65e-d1c466a13b40] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:15.317259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.317757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.319405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.319889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.336813 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] HTTP exception thrown: Instance bb609fdf-9184-45fb-a65e-d1c466a13b40 could not be found. Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Request method failure captured: Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 HTTP/1.1 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pi-CvAxZC0oDOOr4jWw9iUi7-cw4wwmxr2oUy2B5oloTi8SImDW75GEsVZUGrerFh9T0U-Ar1-9aKLgpAGnhOl1hoNpbkI1LN0fKvtS712OMEMug-x_x5yKuxLAA1svxNBDGDC_f9t4Fs2f-mK2j-2l9M2MXFxw3plGZcrMsWETiA Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 09431bbdbc394df8b368770d3e24a306 Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance bb609fdf-9184-45fb-a65e-d1c466a13b40 could not be found. Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'bb609fdf-9184-45fb-a65e-d1c466a13b40'} Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb609fdf-9184-45fb-a65e-d1c466a13b40 could not be found. Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb609fdf-9184-45fb-a65e-d1c466a13b40 could not be found. Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:15.339657 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb609fdf-9184-45fb-a65e-d1c466a13b40 could not be found. Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Returning 404 to user: Instance bb609fdf-9184-45fb-a65e-d1c466a13b40 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f1264aa7-e849-4e01-8463-092f6fc03129 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40" status: 404 len: 111 microversion: 2.1 time: 0.042609 Jun 04 21:18:15.344732 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2563/5021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:15 2022] GET /compute/v2.1/servers/bb609fdf-9184-45fb-a65e-d1c466a13b40 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:15.350261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:15.350847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:15.360220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:15.361660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:15.369079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.369532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.370412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.377868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.378303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.379471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.381649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.382316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.410196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:15.532085 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe938784-c502-41a4-bd04-3fabbf0cbe41 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "DELETE /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 204 len: 0 microversion: 2.1 time: 0.184052 Jun 04 21:18:15.535709 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2459/5022] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:15 2022] DELETE /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:15.551878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:15.553237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:15.562414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.563169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.564452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.565249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.590409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:15.602502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:15.604126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:15.605896 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d7e7a7c0-7411-46fd-b470-e25fcc6f3d34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1797 microversion: 2.20 time: 0.251585 Jun 04 21:18:15.606645 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2564/5023] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:15 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1797 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:15.726056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:15.734555 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-afbef0cf-8578-4678-b510-cd029a6d0288 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1677 microversion: 2.1 time: 0.192678 Jun 04 21:18:15.744400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2460/5024] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:15 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:15.751972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:15.752889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:15.759489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.759973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.760821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:15.761263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:15.916026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:15.924388 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-029e14c3-eac1-4923-8531-a0021107cdb2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.176271 Jun 04 21:18:15.924972 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2565/5025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:15 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:16.282584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:16.283093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:16.293217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:16.294140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:16.295750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:16.296508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:16.402168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:16.413636 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7fa039a3-20d5-4c9e-b9f8-02db037ae1cc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1176 microversion: 2.1 time: 0.135072 Jun 04 21:18:16.414361 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2461/5026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:16 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1176 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:16.753463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:16.754439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:16.762420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:16.763186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:16.764300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:16.764627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:16.940794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:16.945465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:16.946368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:16.950220 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a403b563-018f-4f4f-9047-80416b967d44 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1677 microversion: 2.1 time: 0.201365 Jun 04 21:18:16.951399 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2566/5027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:16 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:16.960775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:16.961586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:16.962703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:16.963146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:17.128886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:17.137439 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1944ef5f-1914-4ef1-bb33-903406bb47b7 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.198765 Jun 04 21:18:17.138628 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2462/5028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:16 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:17.431220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:17.431876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:17.440393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:17.441245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:17.442325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:17.443852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:17.667449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:17.679992 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-da27a7d0-9683-4d02-bf9d-2f2959e0402f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1228 microversion: 2.1 time: 0.252377 Jun 04 21:18:17.684118 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2567/5029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:17 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1228 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:17.978607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:17.980541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:17.996507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.000080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.001082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.002387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-205ca616-430f-4692-a722-3f05e50d7db6 req-8991d10e-ab19-409c-a05c-97b277aacbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e532119b-b549-43d3-8258-da2251c0b971", "tag": "95790dff-7d4f-4e68-ae4a-ed66f11e62ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:18.005831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.025509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-205ca616-430f-4692-a722-3f05e50d7db6 req-8991d10e-ab19-409c-a05c-97b277aacbee service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.027251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-205ca616-430f-4692-a722-3f05e50d7db6 req-8991d10e-ab19-409c-a05c-97b277aacbee service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.049368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-205ca616-430f-4692-a722-3f05e50d7db6 req-8991d10e-ab19-409c-a05c-97b277aacbee service nova] Creating event network-changed:95790dff-7d4f-4e68-ae4a-ed66f11e62ad for instance e532119b-b549-43d3-8258-da2251c0b971 on nch1-master-1 Jun 04 21:18:18.063283 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-205ca616-430f-4692-a722-3f05e50d7db6 req-8991d10e-ab19-409c-a05c-97b277aacbee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073793 Jun 04 21:18:18.064276 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2568/5030] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:18:18.125142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:18.139037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ae8624d-2a51-4431-982a-66704519cc97 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1609 microversion: 2.1 time: 0.174702 Jun 04 21:18:18.139989 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2463/5031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:17 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1609 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:18.161184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:18.162203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:18.170538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.171167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.172224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.173118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.396406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:18.404892 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f9b6e48d-9448-44b9-bd13-899c817cb6e3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.250700 Jun 04 21:18:18.405503 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2569/5032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:18 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:18.581107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c32dcc1f-0017-41df-8392-dd61a99fc289 req-575ec5dc-d69b-45ee-93dd-019feed6bb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fccc20f3-db1c-4c63-8b35-a1b344ee3b31", "name": "network-vif-deleted", "tag": "4f7782e4-e0c7-4e31-9a26-4ca151dd38f3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:18.591432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c32dcc1f-0017-41df-8392-dd61a99fc289 req-575ec5dc-d69b-45ee-93dd-019feed6bb36 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.592096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c32dcc1f-0017-41df-8392-dd61a99fc289 req-575ec5dc-d69b-45ee-93dd-019feed6bb36 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.606017 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c32dcc1f-0017-41df-8392-dd61a99fc289 req-575ec5dc-d69b-45ee-93dd-019feed6bb36 service nova] Creating event network-vif-deleted:4f7782e4-e0c7-4e31-9a26-4ca151dd38f3 for instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 on nch2-master-1 Jun 04 21:18:18.612007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c32dcc1f-0017-41df-8392-dd61a99fc289 req-575ec5dc-d69b-45ee-93dd-019feed6bb36 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034489 Jun 04 21:18:18.613547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2464/5033] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:18.701016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:18.701643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:18.711162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.711647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.712440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:18.716695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:18.892506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:18.900869 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad0ea711-a8a3-40ce-8a0f-63b1b4453ebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1216 microversion: 2.1 time: 0.203771 Jun 04 21:18:18.901498 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2570/5034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:18 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:19.161845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:19.164299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:19.175568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:19.177969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.178557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:19.179671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.180137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:19.227836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.228571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:19.229430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lazy-loading 'fault' on Instance uuid fccc20f3-db1c-4c63-8b35-a1b344ee3b31 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:18:19.285782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09431bbdbc394df8b368770d3e24a306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc813c0affe4551bd334712c53fdd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:19.295655 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1dac597e-e8c4-4f4f-a8a0-e15b986fb918 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 200 len: 1328 microversion: 2.1 time: 0.141803 Jun 04 21:18:19.296341 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2465/5035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:19 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:19.423768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:19.425125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:19.433714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.434412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:19.435427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.435908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:19.599430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:19.608496 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ffee8694-a088-4c77-9902-2313e804439e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.189388 Jun 04 21:18:19.609098 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2571/5036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:19 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:19.918746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:19.919590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:19.925937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.926489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:19.927392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:19.927917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:20.066465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:20.074456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6c5d68ce-ee2a-4c14-b6e2-31a2d1662162 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1216 microversion: 2.1 time: 0.159905 Jun 04 21:18:20.075129 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2466/5037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:19 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:20.316665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:20.317448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] [instance: fccc20f3-db1c-4c63-8b35-a1b344ee3b31] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:20.324923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:20.325464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:20.326174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:20.326618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:20.342236 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] HTTP exception thrown: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 could not be found. Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Request method failure captured: Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 HTTP/1.1 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8pi-CvAxZC0oDOOr4jWw9iUi7-cw4wwmxr2oUy2B5oloTi8SImDW75GEsVZUGrerFh9T0U-Ar1-9aKLgpAGnhOl1hoNpbkI1LN0fKvtS712OMEMug-x_x5yKuxLAA1svxNBDGDC_f9t4Fs2f-mK2j-2l9M2MXFxw3plGZcrMsWETiA Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0dc813c0affe4551bd334712c53fdd3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0dc813c0affe4551bd334712c53fdd3c Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-108369637 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 09431bbdbc394df8b368770d3e24a306 Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-108369637-project Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 could not be found. Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'fccc20f3-db1c-4c63-8b35-a1b344ee3b31'} Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 could not be found. Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 could not be found. Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:20.344054 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 could not be found. Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Returning 404 to user: Instance fccc20f3-db1c-4c63-8b35-a1b344ee3b31 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-180b3ad1-0714-4d4e-b4f3-8ed1894840c6 tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31" status: 404 len: 111 microversion: 2.1 time: 0.033387 Jun 04 21:18:20.350416 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2572/5038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:20 2022] GET /compute/v2.1/servers/fccc20f3-db1c-4c63-8b35-a1b344ee3b31 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:20.355621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-135d70bf-18a9-40c1-b2eb-506a0c2429dc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] Calling method '.version_select at 0x7f2d00e0a8b0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:20.382674 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-135d70bf-18a9-40c1-b2eb-506a0c2429dc tempest-ServerActionsTestJSON-108369637 tempest-ServerActionsTestJSON-108369637-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964913124" status: 202 len: 0 microversion: 2.1 time: 0.031778 Jun 04 21:18:20.383280 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2467/5039] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964913124 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:18:20.626162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:20.626815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:20.633930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:20.634391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:20.635161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:20.635941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:20.771427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:20.775259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:20.780894 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bd45bca-bc97-4e9a-b5c7-3e2c4699dab5 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.158772 Jun 04 21:18:20.781577 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2573/5040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:20 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:21.097285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:21.098062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:21.106517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:21.106967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:21.107808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:21.108244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:21.254439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:21.263282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d340bc2e-f5bf-4e3e-a778-e05609a16b76 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1216 microversion: 2.1 time: 0.170418 Jun 04 21:18:21.264131 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2468/5041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:21 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:21.798880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:21.799684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:21.807384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:21.808017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:21.808969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:21.809432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:21.942802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:21.951191 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7bcee7f1-ed86-4039-a579-d90ac84f19d2 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.156302 Jun 04 21:18:21.952013 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2574/5042] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:21 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:22.281756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:22.283041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:22.292034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:22.292609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:22.293663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:22.293992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:22.459730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:22.469281 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26380d10-71ac-48da-8be1-18a56301d45f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1216 microversion: 2.1 time: 0.191506 Jun 04 21:18:22.469892 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2469/5043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:22 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:22.969853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:22.971263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:22.982923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:22.982923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:22.983961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:22.984869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:23.134190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:23.143498 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4529c6e3-67b2-45d7-9d28-8f3417afb962 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.178741 Jun 04 21:18:23.144206 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2575/5044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:22 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:23.393188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-faba0eaf-eb69-4bf7-9ace-28a4252625c5 req-bf3f551c-df74-4643-b1fd-33521dbbc98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e532119b-b549-43d3-8258-da2251c0b971", "name": "network-vif-plugged", "status": "completed", "tag": "95790dff-7d4f-4e68-ae4a-ed66f11e62ad"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:23.410980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-faba0eaf-eb69-4bf7-9ace-28a4252625c5 req-bf3f551c-df74-4643-b1fd-33521dbbc98f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:23.411747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-faba0eaf-eb69-4bf7-9ace-28a4252625c5 req-bf3f551c-df74-4643-b1fd-33521dbbc98f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:23.427004 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-faba0eaf-eb69-4bf7-9ace-28a4252625c5 req-bf3f551c-df74-4643-b1fd-33521dbbc98f service nova] Creating event network-vif-plugged:95790dff-7d4f-4e68-ae4a-ed66f11e62ad for instance e532119b-b549-43d3-8258-da2251c0b971 on nch1-master-1 Jun 04 21:18:23.432367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-faba0eaf-eb69-4bf7-9ace-28a4252625c5 req-bf3f551c-df74-4643-b1fd-33521dbbc98f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043880 Jun 04 21:18:23.433801 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2470/5045] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:23.491069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:23.492329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:23.512191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:23.512651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:23.514005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:23.514466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:23.678342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:23.686427 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c24539c9-d50e-4905-b801-2baf6905acb8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1216 microversion: 2.1 time: 0.203560 Jun 04 21:18:23.687018 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2576/5046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:23 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1216 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:24.166821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:24.167616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:24.174638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:24.175760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:24.176543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:24.176974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:24.194474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:24.434045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:24.447398 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d6f7c1c7-fce2-4f72-bae4-7da3f55249de tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.286197 Jun 04 21:18:24.463149 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2471/5047] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:24 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:24.704768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:24.705516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:24.728429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:24.729924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:24.730295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:24.730988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:24.878466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:24.903469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:24.928115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:24.938692 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-abefd883-f686-4b81-8387-21c63c861f43 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1216 microversion: 2.1 time: 0.237773 Jun 04 21:18:24.940256 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2577/5048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:24 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1216 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:25.480357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:25.481133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:25.483771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:25.491492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:25.491981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:25.492775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:25.493223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:25.666821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:25.674469 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-def58c42-8fc5-4bbb-9690-c83bb0e14194 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.198299 Jun 04 21:18:25.675136 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2472/5049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:25 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:25.957326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:25.957952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:25.965221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:25.965684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:25.966473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:25.967021 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.138595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:26.147773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2bfe998d-6c11-48df-b345-8aa42237f13f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1403 microversion: 2.1 time: 0.194536 Jun 04 21:18:26.148513 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2578/5050] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:25 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1403 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:26.170841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:26.171472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:26.177848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:26.178503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.180363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:26.181711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.441618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:26.452442 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7056b212-b212-47ae-a453-ebb17545bc46 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1403 microversion: 2.1 time: 0.288106 Jun 04 21:18:26.453069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2473/5051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:26 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1403 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:26.470091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2037577020"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:26.471154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:26.477674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:26.478102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.479016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:26.479546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.589454 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.compute.api [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Attempting to quiesce instance before volume snapshot. Jun 04 21:18:26.675652 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.compute.api [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jun 04 21:18:26.693354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:26.694769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:26.705071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:26.706289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.707163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:26.708443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:26.764985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Creating snapshot from volume a03e5283-6e7a-4d35-ba39-48cc091eeeba. {{(pid=137228) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jun 04 21:18:26.857584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:26.865865 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01dcdec0-3ad7-44ee-9a94-8592f8e64297 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.178085 Jun 04 21:18:26.866460 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2474/5052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:26 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:18:27.002892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f503cf89-248f-4568-9d6a-3f639a86c510 tempest-ComputeTenantNetworksTest-206316442 tempest-ComputeTenantNetworksTest-206316442-project] Calling method '.version_select at 0x7f2d025f4700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:27.204001 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f503cf89-248f-4568-9d6a-3f639a86c510 tempest-ComputeTenantNetworksTest-206316442 tempest-ComputeTenantNetworksTest-206316442-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.336427 Jun 04 21:18:27.204677 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2475/5053] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 21:18:26 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:27.214538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d9d021f8-c526-470c-b322-e856db10246f tempest-ComputeTenantNetworksTest-206316442 tempest-ComputeTenantNetworksTest-206316442-project] Calling method '.version_select at 0x7f2d00e169d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:27.311142 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d9d021f8-c526-470c-b322-e856db10246f tempest-ComputeTenantNetworksTest-206316442 tempest-ComputeTenantNetworksTest-206316442-project] 10.222.0.18 "GET /compute/v2.1/os-tenant-networks/d6eb8012-4ff7-4fc5-a449-7e3272bb3a7c" status: 200 len: 139 microversion: 2.1 time: 0.100441 Jun 04 21:18:27.311802 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2476/5054] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:18:27 2022] GET /compute/v2.1/os-tenant-networks/d6eb8012-4ff7-4fc5-a449-7e3272bb3a7c => generated 139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:18:27.689684 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3953f863-1808-4c3e-a09a-040a3fac35e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971/action" status: 202 len: 0 microversion: 2.1 time: 1.223778 Jun 04 21:18:27.691173 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2579/5055] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:18:26 2022] POST /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971/action => generated 0 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 21:18:27.883875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:27.884506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:27.893332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:27.893817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:27.894616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:27.895063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:28.077775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:28.088582 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-362455c0-ccba-4c10-b680-7e347a8870b9 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.208542 Jun 04 21:18:28.089419 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2477/5056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:27 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:28.929200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-723313959", "imageRef": "892098db-cbaa-4fe4-9817-914bb8c33b55", "flavorRef": "452", "networks": [{"uuid": "4f8dc4cf-e0c9-460c-b458-27f360b796ed"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:29.000025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] validate_networks() for [('4f8dc4cf-e0c9-460c-b458-27f360b796ed', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:18:29.093102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Action: 'create', calling method: .version_select at 0x7f2d0bd5f310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-220472246", "metadata": {"Type": "work"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:29.434290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3887eb25-f08a-403d-9519-a5ccb8ddf9f0 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.471393 Jun 04 21:18:29.441093 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2478/5057] 10.222.0.18 () {60 vars in 1155 bytes} [Sat Jun 4 21:18:28 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 474 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 04 21:18:29.442833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:29.443757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:29.457168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:29.457660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:29.458464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:29.458902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:29.668724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:29.679356 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce21fc01-05f1-4baa-a301-99991ed2cafc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.242286 Jun 04 21:18:29.680616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2479/5058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:29 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:29.687330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da9ce024-f99f-4ac3-9741-17a3c9f83743 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Calling method '.version_select at 0x7f2d0167c5e0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:29.748413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da9ce024-f99f-4ac3-9741-17a3c9f83743 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e" status: 200 len: 345 microversion: 2.1 time: 0.065936 Jun 04 21:18:29.748413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2480/5059] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:18:29 2022] GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:29.828055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:18:29.828495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:18:29.829404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:18:29.830686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:18:29.830686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:18:29.840722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:29.841857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:29.844346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:29.845302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:29.869031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:18:29.874612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:18:29.884294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:29.889484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:18:29.892592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='67af8623-01a7-4b50-8986-81991195999d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:18:29.972418 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8b8405a6-fde8-401d-a738-158a67687209 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049141 Jun 04 21:18:29.973149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2580/5060] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:18:29.984598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0c5e262-54ab-4fcd-aa23-b747f574538b tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:29.985312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0c5e262-54ab-4fcd-aa23-b747f574538b tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:30.050306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0c5e262-54ab-4fcd-aa23-b747f574538b tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:30.058352 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0c5e262-54ab-4fcd-aa23-b747f574538b tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1229 microversion: 2.1 time: 0.078848 Jun 04 21:18:30.058931 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2481/5061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:29 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1229 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:30.703863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:30.707086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:30.714649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:30.715225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:30.716143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:30.716685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:30.761200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f923e358-75c1-489c-82ac-cfad9231d1ee tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Calling method '.version_select at 0x7f2d0167c3a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:30.830067 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f923e358-75c1-489c-82ac-cfad9231d1ee tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e" status: 200 len: 346 microversion: 2.1 time: 0.073274 Jun 04 21:18:30.831069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2482/5062] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:18:30 2022] GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:30.846294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5d166b9-b4e6-4847-abd7-c1100b5c0d38 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Calling method '.version_select at 0x7f2d00d15700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:30.918264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5d166b9-b4e6-4847-abd7-c1100b5c0d38 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e" status: 200 len: 346 microversion: 2.1 time: 0.078988 Jun 04 21:18:30.919355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2483/5063] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:18:30 2022] GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:30.930510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:30.931042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Calling method '.version_select at 0x7f2d00ec69d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:30.940160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7760eb66-475e-4b6d-83b2-7cd267e2c292 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.242484 Jun 04 21:18:30.940643 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2581/5064] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:30 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:31.001685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aabac88e-d3bf-411f-844c-bf1c1b4c7c55 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e" status: 202 len: 0 microversion: 2.1 time: 0.074593 Jun 04 21:18:31.002616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2484/5065] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:18:30 2022] DELETE /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:18:31.013060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d2dc811-9e63-4b53-a835-8e03038e1079 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Calling method '.version_select at 0x7f2d01544310>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:31.076707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:31.077979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:31.087357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:31.088081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:31.090349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:31.090976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:31.109953 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d2dc811-9e63-4b53-a835-8e03038e1079 tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e" status: 200 len: 345 microversion: 2.1 time: 0.102941 Jun 04 21:18:31.111122 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2582/5066] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:18:31 2022] GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:31.203552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:31.216101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e92b5cea-bb32-4693-bedf-7a92ee532a87 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1281 microversion: 2.1 time: 0.139922 Jun 04 21:18:31.216740 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2485/5067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:31 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:31.961226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:31.961850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:31.975786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:31.976358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:31.977117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:31.977478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:32.124216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e8ef3d9-6a5d-41c4-b09f-cbb63e6da64b tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Calling method '.version_select at 0x7f2d00e58550>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:32.193708 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7e8ef3d9-6a5d-41c4-b09f-cbb63e6da64b tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] HTTP exception thrown: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e8ef3d9-6a5d-41c4-b09f-cbb63e6da64b tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Request method failure captured: Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e HTTP/1.1 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8wkllLJaBeqiUG00PfrOdmnHYp04LbzZJ3yr1no8bvIkLfpZg6hwJMkzENljKuWQqlGUxUk3oHkHgALr6g_LcG0Hxlg-ag4mOD-X10-kbo1QXdSmDrreJxVeCf7kFfSbbsWBHYPLVkTQjFJKPGnE3CgVm9C3C33nurKnmu59VhC4oU Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 87608a2ca91846cab148c802519d40b2 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesGetTestJSON-1692901552 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_87608a2ca91846cab148c802519d40b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/87608a2ca91846cab148c802519d40b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/87608a2ca91846cab148c802519d40b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/87608a2ca91846cab148c802519d40b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesGetTestJSON-1692901552 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 87608a2ca91846cab148c802519d40b2 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesGetTestJSON-1692901552 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesGetTestJSON-1692901552-project Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: d96cade4cead4edeb39f14ad902985d0 Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesGetTestJSON-1692901552-project Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: method: Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: exception: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '107ae096-ea35-42c9-ad18-2b1696f2a64e'} Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. (HTTP 404) (Request-ID: req-61882a5f-6962-4ece-a5bc-8b3f61035d1d) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 04 21:18:32.203074 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. Jun 04 21:18:32.209128 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:32.212336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e8ef3d9-6a5d-41c4-b09f-cbb63e6da64b tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] Returning 404 to user: Volume 107ae096-ea35-42c9-ad18-2b1696f2a64e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:32.218573 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7e8ef3d9-6a5d-41c4-b09f-cbb63e6da64b tempest-VolumesGetTestJSON-1692901552 tempest-VolumesGetTestJSON-1692901552-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e" status: 404 len: 109 microversion: 2.1 time: 0.099191 Jun 04 21:18:32.219943 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2486/5068] 10.222.0.18 () {58 vars in 1244 bytes} [Sat Jun 4 21:18:32 2022] GET /compute/v2.1/os-volumes/107ae096-ea35-42c9-ad18-2b1696f2a64e => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:32.236326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:32.238968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:32.257370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:32.257972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:32.259490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:32.261330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:32.434390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:32.458214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6e6606ed-d9fc-451a-baf5-1994f02b8f47 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1484 microversion: 2.1 time: 0.503736 Jun 04 21:18:32.460242 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2583/5069] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:31 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1484 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:32.481812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:32.485165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:32.513554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:32.515593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:32.518553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:32.521838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:32.628136 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7429714a-dac6-4a2d-9005-fd2a39756fe6 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "POST /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755/action" status: 202 len: 0 microversion: 2.1 time: 0.153049 Jun 04 21:18:32.629841 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2584/5070] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:18:32 2022] POST /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:18:32.644484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:32.654137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:32.655477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:32.663544 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c2d9e03-4fc2-420e-a3b2-5700e704d615 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1341 microversion: 2.1 time: 0.433476 Jun 04 21:18:32.665031 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2487/5071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:32 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1341 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:32.695249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:32.695955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:32.697229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:32.697380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:33.012561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:33.021922 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2ab79400-564f-4039-82d5-8860b45d0c30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1492 microversion: 2.1 time: 0.380097 Jun 04 21:18:33.022872 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2585/5072] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:32 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1492 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:33.212426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-52261eec-bd79-422a-916e-48e7309b9913 req-f949fb7c-87fc-4282-b629-929d15c3e2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecf890d2-6576-46f8-96ba-369ffba2495f", "tag": "f9993cc7-5312-4caa-a13e-647587999867"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:33.233674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-52261eec-bd79-422a-916e-48e7309b9913 req-f949fb7c-87fc-4282-b629-929d15c3e2d1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:33.234585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-52261eec-bd79-422a-916e-48e7309b9913 req-f949fb7c-87fc-4282-b629-929d15c3e2d1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:33.272599 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-52261eec-bd79-422a-916e-48e7309b9913 req-f949fb7c-87fc-4282-b629-929d15c3e2d1 service nova] Creating event network-changed:f9993cc7-5312-4caa-a13e-647587999867 for instance ecf890d2-6576-46f8-96ba-369ffba2495f on nch2-master-1 Jun 04 21:18:33.278359 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-52261eec-bd79-422a-916e-48e7309b9913 req-f949fb7c-87fc-4282-b629-929d15c3e2d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069777 Jun 04 21:18:33.278979 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2488/5073] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:18:33.686784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:33.688145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:33.697142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:33.697772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:33.698893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:33.699410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:33.855342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:33.865093 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d4f55919-9928-405e-bfd9-4038c7e57e99 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1341 microversion: 2.1 time: 0.186427 Jun 04 21:18:33.865673 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2586/5074] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:33 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:34.041240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:34.042078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:34.049595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:34.050208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:34.051038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:34.051626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:34.196315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:34.204704 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2d3a6d0b-9f6f-4a25-a903-cac9514497be tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1492 microversion: 2.1 time: 0.169005 Jun 04 21:18:34.205277 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2489/5075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:34 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1492 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:34.882784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:34.884203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:34.892650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:34.893221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:34.894223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:34.894843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.092459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:35.101498 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f531c72f-5772-446f-bfd3-f5122a107cd8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1341 microversion: 2.1 time: 0.222988 Jun 04 21:18:35.103202 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2587/5076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:34 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:35.222411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:35.223116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:35.232477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:35.233141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.234100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:35.234718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.406014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:35.415264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8a1865c3-4b7a-4d4d-9548-f7e2bb0f574a tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1498 microversion: 2.1 time: 0.196899 Jun 04 21:18:35.416589 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2490/5077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:35 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:35.437118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:35.437631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:35.444204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:35.444890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.445681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:35.446128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.483751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:35.499031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:35.622847 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2b66164f-84bc-4411-9ac1-8116b98d7d27 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "DELETE /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 204 len: 0 microversion: 2.1 time: 0.188844 Jun 04 21:18:35.623942 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2588/5078] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:35 2022] DELETE /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:35.631935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:35.632668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:35.642057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:35.642477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.643336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:35.643854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:35.839529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:35.847836 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87c4f53a-645f-4728-b5bd-25a1a00a2481 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.219825 Jun 04 21:18:35.848436 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2491/5079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:35 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:36.120366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:36.121214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:36.129955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:36.130419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:36.131205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:36.131684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:36.304971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:36.312954 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b44b0b0e-eaaa-46cf-837b-fe89135bcc6a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1341 microversion: 2.1 time: 0.197802 Jun 04 21:18:36.313552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2589/5080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:36 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:36.865039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:36.865853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:36.874804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:36.875264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:36.876099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:36.876597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:37.059119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:37.077393 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76d5c6a2-b10c-4ae5-b4f3-fc5f4bf723b3 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.216576 Jun 04 21:18:37.078065 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2492/5081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:36 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:37.330363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:37.331733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:37.339622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:37.340061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:37.340991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:37.341301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:37.505366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:37.514515 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-beacbe4e-8bff-4131-b690-cbe680baa373 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1341 microversion: 2.1 time: 0.188114 Jun 04 21:18:37.515102 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2590/5082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:37 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:38.094606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:38.095264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:38.102761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:38.103308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:38.104365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:38.104884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:38.256003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:38.265758 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f2fdbe36-e537-43b5-b60e-6431a36d4929 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1504 microversion: 2.1 time: 0.174735 Jun 04 21:18:38.266374 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2493/5083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:38 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:38.535164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:38.535825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:38.543915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:38.544384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:38.545181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:38.545669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:38.700681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:38.709948 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1c27025-0557-4d30-a8c2-f1585655ff75 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1375 microversion: 2.1 time: 0.178768 Jun 04 21:18:38.720093 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2591/5084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:38 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:39.290564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:39.291285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:39.299095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:39.299878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:39.300860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:39.301469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:39.348349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-27134333-b3c4-4852-b451-100ac11a6d14 req-693bbc58-880b-414d-9af9-b746ad93d1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98908967-b008-45eb-8379-680e26ded755", "name": "network-vif-deleted", "tag": "87a8b3a6-f225-498a-b49e-cce7f69c8c49"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:39.367713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-27134333-b3c4-4852-b451-100ac11a6d14 req-693bbc58-880b-414d-9af9-b746ad93d1c5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:39.369581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-27134333-b3c4-4852-b451-100ac11a6d14 req-693bbc58-880b-414d-9af9-b746ad93d1c5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:39.394082 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-27134333-b3c4-4852-b451-100ac11a6d14 req-693bbc58-880b-414d-9af9-b746ad93d1c5 service nova] Creating event network-vif-deleted:87a8b3a6-f225-498a-b49e-cce7f69c8c49 for instance 98908967-b008-45eb-8379-680e26ded755 on nch2-master-1 Jun 04 21:18:39.403478 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-27134333-b3c4-4852-b451-100ac11a6d14 req-693bbc58-880b-414d-9af9-b746ad93d1c5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058648 Jun 04 21:18:39.408071 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2592/5085] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:39.426688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:39.437143 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7ee7026c-f95a-49ec-a39b-eb134133a9dc tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 200 len: 1462 microversion: 2.1 time: 0.155445 Jun 04 21:18:39.438213 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2494/5086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:39 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 1462 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:39.728606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:39.730633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:39.738985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:39.739446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:39.740331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:39.740782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:39.860363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:39.882523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:39.884906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:39.893500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04618554-640a-41b5-9460-63173a457e74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1375 microversion: 2.1 time: 0.169239 Jun 04 21:18:39.894091 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2593/5087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:39 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:40.456336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:40.457180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 98908967-b008-45eb-8379-680e26ded755] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:40.459303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:40.467199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.467700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.468486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.468953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.483906 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] HTTP exception thrown: Instance 98908967-b008-45eb-8379-680e26ded755 could not be found. Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Request method failure captured: Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 HTTP/1.1 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vHv_GL0Xva3ZXokdpmK2_mDe1zCEbiO7zwFL4NFuXNhN304Gn-NUvsVxRWmza4xi-KBTGvDSoF7nM4JJo3qrwtuOsHjXg7W5qgCQfCBr0sLGJ81-RgUgvg-_DouMcyEVTqfk8Fk7y88i5x_6oTQnr9QuZI2MRIYjyN-ceSzexB50A Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: c284c2855bac423280d7e234dee6b7ac Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerRescueTestJSON-98919370 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerRescueTestJSON-98919370 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: c284c2855bac423280d7e234dee6b7ac Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerRescueTestJSON-98919370 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerRescueTestJSON-98919370-project Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2166b66a28214ff9802da4f955b5a4c5 Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerRescueTestJSON-98919370-project Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 98908967-b008-45eb-8379-680e26ded755 could not be found. Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '98908967-b008-45eb-8379-680e26ded755'} Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98908967-b008-45eb-8379-680e26ded755 could not be found. Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98908967-b008-45eb-8379-680e26ded755 could not be found. Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:40.485606 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98908967-b008-45eb-8379-680e26ded755 could not be found. Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Returning 404 to user: Instance 98908967-b008-45eb-8379-680e26ded755 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c63bbd8-300c-409e-857d-862686e87bcd tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755" status: 404 len: 111 microversion: 2.1 time: 0.035152 Jun 04 21:18:40.490716 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2495/5088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:40 2022] GET /compute/v2.1/servers/98908967-b008-45eb-8379-680e26ded755 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:40.497812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:40.498320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:40.505024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.505490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.506297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.506732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.534383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:40.626949 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a0eb762-bd14-49ae-89ad-6fc03a886f30 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 204 len: 0 microversion: 2.1 time: 0.133192 Jun 04 21:18:40.628025 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2594/5089] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:40 2022] DELETE /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:40.640868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:40.641595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:40.649809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.650407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.651406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.651891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.857880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:40.866408 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8257b1a7-77ac-4552-858e-7c3c0460cd68 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1491 microversion: 2.1 time: 0.230828 Jun 04 21:18:40.867077 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2496/5090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:40 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1491 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:40.911006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:40.911927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:40.919659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.920134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:40.920933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:40.921392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:41.067339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:41.077741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2989f162-2ad5-43cf-98cb-468eca12373d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1375 microversion: 2.1 time: 0.170981 Jun 04 21:18:41.078434 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2595/5091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:40 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:41.884293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:41.885545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:41.895556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:41.896040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:41.896857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:41.897291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:42.077400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:42.085907 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0604b64b-c0d0-4b3c-a710-8fe930150697 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1491 microversion: 2.1 time: 0.205865 Jun 04 21:18:42.086630 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2497/5092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:41 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1491 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:42.098130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:42.098860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:42.106809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:42.107276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:42.108094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:42.108683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:42.261949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:42.271137 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f93bdf34-3f16-4cae-970b-d024e4056549 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1375 microversion: 2.1 time: 0.177681 Jun 04 21:18:42.272358 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2596/5093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:42 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:43.111760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:43.112714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:43.123155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:43.124897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:43.126069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:43.126672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:43.171569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=100 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:43.181425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2eb13a31-af72-43f4-abad-8261a385c83b req-c3bfc368-592c-4d96-b7da-4c37829d2899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54", "name": "network-vif-deleted", "tag": "35bb9932-fcba-4ca3-986f-4c8306fcd0c0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:43.202581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2eb13a31-af72-43f4-abad-8261a385c83b req-c3bfc368-592c-4d96-b7da-4c37829d2899 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:43.202976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2eb13a31-af72-43f4-abad-8261a385c83b req-c3bfc368-592c-4d96-b7da-4c37829d2899 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:43.226989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2eb13a31-af72-43f4-abad-8261a385c83b req-c3bfc368-592c-4d96-b7da-4c37829d2899 service nova] Creating event network-vif-deleted:35bb9932-fcba-4ca3-986f-4c8306fcd0c0 for instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 on nch2-master-1 Jun 04 21:18:43.240226 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2eb13a31-af72-43f4-abad-8261a385c83b req-c3bfc368-592c-4d96-b7da-4c37829d2899 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066681 Jun 04 21:18:43.261137 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2597/5094] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:43.280676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2166b66a28214ff9802da4f955b5a4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c284c2855bac423280d7e234dee6b7ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:43.289719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:43.290463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:43.293635 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e2fa6696-9bf3-4eb4-ba34-ea1cb66d3003 tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 200 len: 1449 microversion: 2.1 time: 0.192935 Jun 04 21:18:43.295029 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2498/5095] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:43 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 1449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:43.314491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:43.314973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:43.315819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:43.316462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:43.509621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:43.519844 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aa521219-5eee-418b-be20-db4801e4267c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1375 microversion: 2.1 time: 0.234486 Jun 04 21:18:43.520468 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2598/5096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:43 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1375 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:43.995397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4e7adecd-e7b2-4d9b-815f-f961bfa6f4ce req-4800f5ef-5280-422a-842f-bec988fc0a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf890d2-6576-46f8-96ba-369ffba2495f", "name": "network-vif-plugged", "status": "completed", "tag": "f9993cc7-5312-4caa-a13e-647587999867"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:44.004560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e7adecd-e7b2-4d9b-815f-f961bfa6f4ce req-4800f5ef-5280-422a-842f-bec988fc0a48 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:44.005072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e7adecd-e7b2-4d9b-815f-f961bfa6f4ce req-4800f5ef-5280-422a-842f-bec988fc0a48 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:44.020923 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4e7adecd-e7b2-4d9b-815f-f961bfa6f4ce req-4800f5ef-5280-422a-842f-bec988fc0a48 service nova] Creating event network-vif-plugged:f9993cc7-5312-4caa-a13e-647587999867 for instance ecf890d2-6576-46f8-96ba-369ffba2495f on nch2-master-1 Jun 04 21:18:44.026123 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4e7adecd-e7b2-4d9b-815f-f961bfa6f4ce req-4800f5ef-5280-422a-842f-bec988fc0a48 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268223 Jun 04 21:18:44.027087 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2499/5097] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:44.310724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:44.312150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] [instance: 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:44.319589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:44.320268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:44.322978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:44.323412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:44.340907 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] HTTP exception thrown: Instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 could not be found. Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Request method failure captured: Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 HTTP/1.1 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vHv_GL0Xva3ZXokdpmK2_mDe1zCEbiO7zwFL4NFuXNhN304Gn-NUvsVxRWmza4xi-KBTGvDSoF7nM4JJo3qrwtuOsHjXg7W5qgCQfCBr0sLGJ81-RgUgvg-_DouMcyEVTqfk8Fk7y88i5x_6oTQnr9QuZI2MRIYjyN-ceSzexB50A Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: c284c2855bac423280d7e234dee6b7ac Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerRescueTestJSON-98919370 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c284c2855bac423280d7e234dee6b7ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerRescueTestJSON-98919370 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: c284c2855bac423280d7e234dee6b7ac Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerRescueTestJSON-98919370 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerRescueTestJSON-98919370-project Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2166b66a28214ff9802da4f955b5a4c5 Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerRescueTestJSON-98919370-project Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 could not be found. Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54'} Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 could not be found. Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 could not be found. Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:44.342592 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 could not be found. Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] Returning 404 to user: Instance 8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de3f5d36-ab27-41ba-8ce9-4d07847c557e tempest-ServerRescueTestJSON-98919370 tempest-ServerRescueTestJSON-98919370-project] 10.222.0.18 "GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54" status: 404 len: 111 microversion: 2.1 time: 0.037683 Jun 04 21:18:44.348059 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2599/5098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:44 2022] GET /compute/v2.1/servers/8de1e35a-2856-42c4-8fcd-0bfc0b9a9c54 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:44.541145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:44.543992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:44.551666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:44.555947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:44.556834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:44.557792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:44.713066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:44.721861 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-796980f4-898a-41d4-97b9-f5b3ed5d4087 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1375 microversion: 2.1 time: 0.186982 Jun 04 21:18:44.722699 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2500/5099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:44 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:45.739869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:45.741430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:45.749959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:45.750514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:45.751544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:45.752220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:45.914957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:45.923534 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0abe63b4-19e7-4925-8cf1-837e955bff26 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1562 microversion: 2.1 time: 0.187709 Jun 04 21:18:45.924598 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2600/5100] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:45 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:45.939813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:45.940860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:45.948706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:45.949445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:45.950244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:45.951001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:46.117855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:46.126357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-968bad3a-fb3a-4e5f-a7d3-9f015b2c0b32 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1562 microversion: 2.1 time: 0.190498 Jun 04 21:18:46.126950 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2501/5101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:45 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:46.211564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:46.212892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:46.219813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:46.220285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:46.221173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:46.221641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:46.252785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:46.380980 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fa139502-be0f-48e0-876b-4d1c82d192b3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 204 len: 0 microversion: 2.1 time: 0.172896 Jun 04 21:18:46.382538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2601/5102] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:18:46 2022] DELETE /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:46.392327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:46.393355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:46.401620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:46.402450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:46.403473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:46.405821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:46.732230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:46.740982 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e117d14e-21a1-4d9d-a371-549bbffb7b10 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1568 microversion: 2.1 time: 0.353773 Jun 04 21:18:46.742926 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2502/5103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:46 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:47.761446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:47.762205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:47.769761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:47.770195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:47.770980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:47.771407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:47.954526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:47.957369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:47.965778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39c9c2b3-f774-4ceb-9b63-3599c8787c33 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1568 microversion: 2.1 time: 0.208996 Jun 04 21:18:47.966910 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2602/5104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:47 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:48.450644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:48.452312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:48.459850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:48.460695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:48.462492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:48.463264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:48.514834 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-03778fed-b825-4303-a8c6-5f039e8ec89b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments/f0af00c0-1332-46a0-b28a-878815945d12" status: 200 len: 194 microversion: 2.20 time: 0.068235 Jun 04 21:18:48.515899 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2503/5105] 10.222.0.18 () {60 vars in 1453 bytes} [Sat Jun 4 21:18:48 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments/f0af00c0-1332-46a0-b28a-878815945d12 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:18:48.600243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:48.600992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:48.612564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:48.614242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:48.616072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:48.617565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:48.809337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lazy-loading 'services' on Instance uuid c61574d2-73e7-4234-a592-ee9c151ebf69 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:18:49.000120 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59274173-c837-403a-ab01-1b90270f0df7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments/f0af00c0-1332-46a0-b28a-878815945d12" status: 202 len: 0 microversion: 2.20 time: 0.405065 Jun 04 21:18:49.008188 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2603/5106] 10.222.0.18 () {60 vars in 1456 bytes} [Sat Jun 4 21:18:48 2022] DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments/f0af00c0-1332-46a0-b28a-878815945d12 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:18:49.030861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:49.031636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:49.048758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:49.052595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:49.054259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:49.055219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:49.236689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5b83d669-b1c3-4045-86d6-ddb74bd18abd req-3e5e077e-9504-4270-b667-5ba5d99dd2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecf890d2-6576-46f8-96ba-369ffba2495f", "name": "network-vif-deleted", "tag": "f9993cc7-5312-4caa-a13e-647587999867"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:49.248327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:49.254159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:49.260850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4a546e9-5c31-4d2c-99a5-7a3bf022244c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 200 len: 1360 microversion: 2.1 time: 0.247208 Jun 04 21:18:49.262304 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2604/5107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:49 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 1360 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:49.262897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5b83d669-b1c3-4045-86d6-ddb74bd18abd req-3e5e077e-9504-4270-b667-5ba5d99dd2f5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:49.263365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5b83d669-b1c3-4045-86d6-ddb74bd18abd req-3e5e077e-9504-4270-b667-5ba5d99dd2f5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:49.268609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:49.270136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:49.279410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:49.280609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:49.282717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:49.283416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:49.328127 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5b83d669-b1c3-4045-86d6-ddb74bd18abd req-3e5e077e-9504-4270-b667-5ba5d99dd2f5 service nova] Creating event network-vif-deleted:f9993cc7-5312-4caa-a13e-647587999867 for instance ecf890d2-6576-46f8-96ba-369ffba2495f on nch2-master-1 Jun 04 21:18:49.334920 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5248e4b9-8036-4bf4-8f93-ea9786ae429b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070542 Jun 04 21:18:49.336471 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2605/5108] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Jun 4 21:18:49 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:18:49.342099 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5b83d669-b1c3-4045-86d6-ddb74bd18abd req-3e5e077e-9504-4270-b667-5ba5d99dd2f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.611065 Jun 04 21:18:49.345194 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2504/5109] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:50.279279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:50.279949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:50.288027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.288812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.289668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.290132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.309399 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f HTTP/1.1 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ecf890d2-6576-46f8-96ba-369ffba2495f'} Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:50.311697 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:18:50.317746 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:18:50.319871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:50.321208 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-460b3aeb-8e62-4b4a-af72-53dde0d11cf8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 404 len: 111 microversion: 2.1 time: 0.046534 Jun 04 21:18:50.326730 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2606/5110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:18:50 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:18:50.351075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:50.353540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:50.367138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.367138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.367527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.369572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.424129 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74200f17-0d73-4030-b3d7-bfa8d6254a40 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079837 Jun 04 21:18:50.430603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2505/5111] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Jun 4 21:18:50 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:18:50.514081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:50.514651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:50.522810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.523316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.524191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.524832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.552944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:18:50.671674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d765a9b8-27bb-46ee-81c4-f4e239126ac7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 204 len: 0 microversion: 2.20 time: 0.162845 Jun 04 21:18:50.673216 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2607/5112] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:18:50 2022] DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:18:50.686284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:50.686903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:50.693592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.693925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.694712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:50.695199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:50.851565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:50.862295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:50.864493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:50.865943 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c42cf58-7b90-4e92-b0f1-7aeaead90d7c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.185012 Jun 04 21:18:50.866662 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2506/5113] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:50 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:50.950273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d251d6fc-7571-43cb-940a-abca7749cbe2 tempest-ExtensionsTest-1935851393 tempest-ExtensionsTest-1935851393-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:50.951945 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d251d6fc-7571-43cb-940a-abca7749cbe2 tempest-ExtensionsTest-1935851393 tempest-ExtensionsTest-1935851393-project] 10.222.0.18 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.266985 Jun 04 21:18:50.952491 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2608/5114] 10.222.0.18 () {58 vars in 1169 bytes} [Sat Jun 4 21:18:50 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:50.961607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43db6751-7fb9-459f-a66e-af9be14cadde tempest-ExtensionsTest-1935851393 tempest-ExtensionsTest-1935851393-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:50.963811 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43db6751-7fb9-459f-a66e-af9be14cadde tempest-ExtensionsTest-1935851393 tempest-ExtensionsTest-1935851393-project] 10.222.0.18 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006075 Jun 04 21:18:50.967550 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2507/5115] 10.222.0.18 () {58 vars in 1133 bytes} [Sat Jun 4 21:18:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:18:51.886165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:51.888234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:51.900666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:51.901766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:51.902610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:51.903411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:52.053149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:52.062892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:52.064906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:52.066331 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-612c5f20-c1fb-49bd-8c51-7e6e110b602a tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.185880 Jun 04 21:18:52.067127 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2609/5116] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:51 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:52.952097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-160714f8-442c-4f06-8ee0-a9ec2632ab1b tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Calling method '.version_select at 0x7f2d00e5e820>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:53.029815 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-160714f8-442c-4f06-8ee0-a9ec2632ab1b tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.236872 Jun 04 21:18:53.030355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2508/5117] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:18:52 2022] GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7/defaults => generated 371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:53.043553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f29e171b-aec2-424d-907d-6311ce9a14a4 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Calling method '.version_select at 0x7f2d022cf550>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:53.090071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:53.090807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:53.100591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:53.101175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:53.102441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:53.102892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:53.145185 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f29e171b-aec2-424d-907d-6311ce9a14a4 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7" status: 200 len: 371 microversion: 2.1 time: 0.106324 Jun 04 21:18:53.146986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2610/5118] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:18:53 2022] GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7 => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:53.164209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a05a7bb6-b5bc-4070-8860-c3a0d08e506a tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Calling method '.version_select at 0x7f2d01962f70>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:53.283756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:53.294607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:53.296233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:53.298049 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c63f0f14-6a80-457a-b4cd-ca79b4a791b9 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1725 microversion: 2.20 time: 0.215966 Jun 04 21:18:53.299078 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2509/5119] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:53 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:18:53.426600 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a05a7bb6-b5bc-4070-8860-c3a0d08e506a tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.268744 Jun 04 21:18:53.427266 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2611/5120] 10.222.0.18 () {58 vars in 1268 bytes} [Sat Jun 4 21:18:53 2022] GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7/defaults => generated 371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:18:53.441315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebcaf0e1-c1fc-4988-a0bd-3f6b72fb1917 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Calling method '.version_select at 0x7f2d01543ca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:53.533415 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebcaf0e1-c1fc-4988-a0bd-3f6b72fb1917 tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7" status: 200 len: 371 microversion: 2.1 time: 0.096382 Jun 04 21:18:53.534291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2510/5121] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:18:53 2022] GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:53.545460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a0262373-8133-48e6-b288-cfb9716aefab tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] Calling method '.version_select at 0x7f2d019621f0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:53.670305 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a0262373-8133-48e6-b288-cfb9716aefab tempest-QuotasTestJSON-662859298 tempest-QuotasTestJSON-662859298-project] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7?user_id=f799e8e6063f4f468d861c38bbc0b33c" status: 200 len: 371 microversion: 2.1 time: 0.128962 Jun 04 21:18:53.671134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2612/5122] 10.222.0.18 () {58 vars in 1322 bytes} [Sat Jun 4 21:18:53 2022] GET /compute/v2.1/os-quota-sets/85f797331b314055a74ecc2ce59b58f7?user_id=f799e8e6063f4f468d861c38bbc0b33c => generated 371 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:53.749203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d99e20e0-dc63-4b1c-ac98-dd4f6dd7df07 req-72c239fb-1b8b-4b7d-8032-0d7ce5d23c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61574d2-73e7-4234-a592-ee9c151ebf69", "name": "network-vif-deleted", "tag": "8febd187-32ad-445f-8c25-18f25711b6d6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:53.759249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d99e20e0-dc63-4b1c-ac98-dd4f6dd7df07 req-72c239fb-1b8b-4b7d-8032-0d7ce5d23c31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:53.760316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d99e20e0-dc63-4b1c-ac98-dd4f6dd7df07 req-72c239fb-1b8b-4b7d-8032-0d7ce5d23c31 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:53.789512 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d99e20e0-dc63-4b1c-ac98-dd4f6dd7df07 req-72c239fb-1b8b-4b7d-8032-0d7ce5d23c31 service nova] Creating event network-vif-deleted:8febd187-32ad-445f-8c25-18f25711b6d6 for instance c61574d2-73e7-4234-a592-ee9c151ebf69 on nch1-master-1 Jun 04 21:18:53.797024 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d99e20e0-dc63-4b1c-ac98-dd4f6dd7df07 req-72c239fb-1b8b-4b7d-8032-0d7ce5d23c31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052004 Jun 04 21:18:53.801219 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2511/5123] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:54.317536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:54.318306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:54.326033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:54.326587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:54.327648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:54.328072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:54.365926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:54.366734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:54.367382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lazy-loading 'fault' on Instance uuid c61574d2-73e7-4234-a592-ee9c151ebf69 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:18:54.435559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:54.450893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:54.452736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:54.457038 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bef6665a-7967-453e-b68b-85c29295efcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 200 len: 1372 microversion: 2.20 time: 0.143771 Jun 04 21:18:54.457965 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2613/5124] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:54 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:18:55.477939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:55.479309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:55.489599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:55.491795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:55.492746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:55.493282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:55.512284 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] HTTP exception thrown: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Request method failure captured: Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 HTTP/1.1 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8uGShlDS5_xAk8RwsSd-_2Ekpju4vKFRjiCh7Xe5WBGZ9H8qBoVD6kmP1SVwqhE1CTwse-1llKA1Jt5kpatYwuim3OHx4OJBTG2-bUBv2HP6Wuysb_SdO6z_6Yqdx2Cl3LOzb9hQ1bOpSkxrSD6hftLFFI9svFRg5fASrlFI-XjFlM Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: bff665dac5de4530ab70f20ba2da386d Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'c61574d2-73e7-4234-a592-ee9c151ebf69'} Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:55.514190 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Returning 404 to user: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 404 len: 111 microversion: 2.20 time: 0.044331 Jun 04 21:18:55.519932 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2512/5125] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:55 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:18:55.529932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82800f59-6e43-4caa-a1e8-9d082804b45b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '.version_select at 0x7f2d022cf4c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:55.538888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:18:55.561778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82800f59-6e43-4caa-a1e8-9d082804b45b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688031173" status: 204 len: 0 microversion: 2.20 time: 0.039175 Jun 04 21:18:55.562779 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2614/5126] 10.222.0.18 () {60 vars in 1261 bytes} [Sat Jun 4 21:18:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1688031173 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:18:55.712157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:55.713285 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001536 Jun 04 21:18:55.713899 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2513/5127] 10.222.0.18 () {56 vars in 885 bytes} [Sat Jun 4 21:18:55 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 04 21:18:55.720567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82800f59-6e43-4caa-a1e8-9d082804b45b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:55.721703 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82800f59-6e43-4caa-a1e8-9d082804b45b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001678 Jun 04 21:18:55.722089 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2615/5128] 10.222.0.18 () {54 vars in 1034 bytes} [Sat Jun 4 21:18:55 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jun 04 21:18:55.728201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:55.729529 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ea7d4c2f-2dad-42c6-801e-1dc6613634dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001807 Jun 04 21:18:55.730443 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2514/5129] 10.222.0.18 () {54 vars in 1040 bytes} [Sat Jun 4 21:18:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:18:55.737679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-82800f59-6e43-4caa-a1e8-9d082804b45b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:55.738706 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-82800f59-6e43-4caa-a1e8-9d082804b45b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001534 Jun 04 21:18:55.739044 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2616/5130] 10.222.0.18 () {56 vars in 885 bytes} [Sat Jun 4 21:18:55 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 04 21:18:56.768929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb613e89-0f00-4984-be44-eeb6a9b8e799 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'create', calling method: .version_select at 0x7f2d00eea040>, body: {"keypair": {"name": "tempest-keypair-266260891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvA1YxFwKDejmSNKCTG0LQ9W0bnIB+BxAwpXobmGcBYyBLOlv36BmK/f9eSmicuJfq1NDVpkyNspidUN5LUiQ1R5S2NpLp+LZPQ8XVsMbA66aCBv/zu4OsiiEkVuyEGiQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:56.789702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cb613e89-0f00-4984-be44-eeb6a9b8e799 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:18:56.799183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cb613e89-0f00-4984-be44-eeb6a9b8e799 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for user bff665dac5de4530ab70f20ba2da386d and project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:18:56.849497 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb613e89-0f00-4984-be44-eeb6a9b8e799 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.085702 Jun 04 21:18:56.850416 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2515/5131] 10.222.0.18 () {62 vars in 1199 bytes} [Sat Jun 4 21:18:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 04 21:18:58.649649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-491817002", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "22f1edcf-47b5-4128-977f-2c43af547030"}], "security_groups": [{"name": "tempest-securitygroup--1269574007"}], "key_name": "tempest-keypair-266260891", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:18:58.775777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] validate_networks() for [('22f1edcf-47b5-4128-977f-2c43af547030', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:18:59.308207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:18:59.308652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:18:59.309139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:18:59.309792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:18:59.310222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:18:59.330257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:59.330729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:59.333706 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:18:59.335093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:18:59.368872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:18:59.392097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Getting quotas for user bff665dac5de4530ab70f20ba2da386d and project d7752a37a5984bc99d2acfcc327fc14e. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:18:59.411263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:18:59.414147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:18:59.487141 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ad9e0cbd-1f96-4815-9c51-6fd8fdac10e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.841115 Jun 04 21:18:59.488713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2617/5132] 10.222.0.18 () {62 vars in 1187 bytes} [Sat Jun 4 21:18:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 04 21:18:59.505595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b5e5a65-6af1-4bf0-9a25-e3022014dadd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:18:59.506236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b5e5a65-6af1-4bf0-9a25-e3022014dadd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:18:59.652886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b5e5a65-6af1-4bf0-9a25-e3022014dadd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:59.663732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b5e5a65-6af1-4bf0-9a25-e3022014dadd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:59.667479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b5e5a65-6af1-4bf0-9a25-e3022014dadd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:18:59.670974 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b5e5a65-6af1-4bf0-9a25-e3022014dadd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1280 microversion: 2.20 time: 0.173407 Jun 04 21:18:59.686573 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2516/5133] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:18:59 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:00.694139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:00.694909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:00.703244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:00.704235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:00.705724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:00.706439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:00.780163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:00.792327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:00.794251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:00.801661 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df630ff1-4438-404e-9436-80eb9f39ebd6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1332 microversion: 2.20 time: 0.112575 Jun 04 21:19:00.805797 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2618/5134] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:00 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:19:01.246802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Calling method '.version_select at 0x7f2d016993a0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:01.248039 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:19:01.248039 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:19:01.249623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:01.251852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:01.275321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:01.276924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:01.293713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:01.294582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:01.314498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f182ef03-6457-4eae-a494-e3160eaf1059 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2112088691-project-admin] 10.222.0.18 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.261429 Jun 04 21:19:01.315570 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2517/5135] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:19:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:01.852267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:01.856878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:01.871911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:01.873152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:01.874339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:01.875191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:02.021131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:02.048442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:02.055618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:02.061775 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4ee6583-6a5a-41b0-bdfb-3f463418cdcc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1338 microversion: 2.20 time: 0.234976 Jun 04 21:19:02.072956 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2619/5136] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:01 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1338 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:03.080990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:03.082289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:03.093677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:03.097160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:03.098146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:03.098595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:03.268836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-589ddb51-a88e-408e-85b1-55c4367b4ef1 req-cda5af46-b9c9-47c8-9085-4cabe7887853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:03.292949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-589ddb51-a88e-408e-85b1-55c4367b4ef1 req-cda5af46-b9c9-47c8-9085-4cabe7887853 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:03.295432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-589ddb51-a88e-408e-85b1-55c4367b4ef1 req-cda5af46-b9c9-47c8-9085-4cabe7887853 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:03.324539 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-589ddb51-a88e-408e-85b1-55c4367b4ef1 req-cda5af46-b9c9-47c8-9085-4cabe7887853 service nova] Creating event network-changed:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch2-master-1 Jun 04 21:19:03.332609 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-589ddb51-a88e-408e-85b1-55c4367b4ef1 req-cda5af46-b9c9-47c8-9085-4cabe7887853 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067915 Jun 04 21:19:03.333681 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2620/5137] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:03.564650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:03.580929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:03.582795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:03.586949 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-55663cc6-5b1a-4074-8272-f487784e1c3b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1406 microversion: 2.20 time: 0.510169 Jun 04 21:19:03.598470 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2518/5138] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:03 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1406 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:04.625179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:04.625909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:04.651165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:04.651692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:04.652503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:04.653885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:04.953245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:04.968057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:04.969961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:04.971633 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99bb9a87-f7cb-437f-a576-837652491ffe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1406 microversion: 2.20 time: 0.369509 Jun 04 21:19:04.972799 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2621/5139] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:04 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:05.607343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cce30ce5-ef17-4f02-8696-25257fe320bb tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: .version_select at 0x7f2d015dcca0>, body: {"keypair": {"name": "tempest-keypair-1496873593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObbkzI67V+Hfxhm3J9eJNo84qhiVQEz4zutGVhL2N4GROYoKizcjPgrBuYNTmPrroVfJ4qAlHNQfn0IIX25vy0SeZUOsFjjgxJwviNUqOdM0E3ckS3d22OfmVIgkrbZ8A=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:05.635041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cce30ce5-ef17-4f02-8696-25257fe320bb tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:19:05.647020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cce30ce5-ef17-4f02-8696-25257fe320bb tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:19:05.687699 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cce30ce5-ef17-4f02-8696-25257fe320bb tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166466 Jun 04 21:19:05.688395 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2519/5140] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:19:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:05.993416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:05.994966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:06.010484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:06.010955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:06.011833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:06.012431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:06.290332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:06.300373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:06.302253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:06.303676 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84cac66d-4d88-4a38-8179-63cfcd7e11ac tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1406 microversion: 2.20 time: 0.316074 Jun 04 21:19:06.304980 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2622/5141] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:05 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:07.331839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:07.333832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:07.341865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:07.342505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:07.344392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:07.345126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:07.557246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-634677768", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "403e6571-3f00-4d79-b35c-182d28b6747c"}], "security_groups": [{"name": "tempest-securitygroup--1693737532"}], "key_name": "tempest-keypair-1496873593", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:07.616395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:07.633444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:07.639217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:07.643106 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c0a8b2c-6321-4053-94c6-1dc10d8ea3c1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1406 microversion: 2.20 time: 0.317827 Jun 04 21:19:07.648092 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2520/5142] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:07 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:07.758902 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] validate_networks() for [('403e6571-3f00-4d79-b35c-182d28b6747c', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:19:07.846196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-dd63f5f4-7a50-46d5-984a-d4b226725aa0 req-e9f9ca07-cc88-45b1-84f7-66c0c1247941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:07.862991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-dd63f5f4-7a50-46d5-984a-d4b226725aa0 req-e9f9ca07-cc88-45b1-84f7-66c0c1247941 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:07.863448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-dd63f5f4-7a50-46d5-984a-d4b226725aa0 req-e9f9ca07-cc88-45b1-84f7-66c0c1247941 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:07.897863 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-dd63f5f4-7a50-46d5-984a-d4b226725aa0 req-e9f9ca07-cc88-45b1-84f7-66c0c1247941 service nova] Creating event network-vif-plugged:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch2-master-1 Jun 04 21:19:07.914132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-dd63f5f4-7a50-46d5-984a-d4b226725aa0 req-e9f9ca07-cc88-45b1-84f7-66c0c1247941 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067243 Jun 04 21:19:07.915139 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2521/5143] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:19:08.640916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:19:08.642054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:19:08.643035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:19:08.643483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:19:08.643961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:19:08.668175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:08.669702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:08.685326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:08.686038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:08.687626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:08.688452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:08.692484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:08.693662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:08.695103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:08.696243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:08.747789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:19:08.759983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:19:08.785490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:19:08.790222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:19:08.902672 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a6309ecc-9cd5-466c-a1da-a41ad83cc849 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.349786 Jun 04 21:19:08.904204 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2623/5144] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:19:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:19:08.927135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85a5aba2-ad57-48b1-84a8-409fd1f20a7d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:08.928772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85a5aba2-ad57-48b1-84a8-409fd1f20a7d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:08.989847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:09.006009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:09.008245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:09.009900 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-049a2579-a89d-4fd0-808d-e3e726eaac56 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1406 microversion: 2.20 time: 0.349202 Jun 04 21:19:09.010768 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2522/5145] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:08 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:09.136323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85a5aba2-ad57-48b1-84a8-409fd1f20a7d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:09.147262 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85a5aba2-ad57-48b1-84a8-409fd1f20a7d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1241 microversion: 2.1 time: 0.234346 Jun 04 21:19:09.157948 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2624/5146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:08 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1241 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:10.030588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:10.031405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:10.045908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:10.046434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:10.047412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:10.048059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:10.175086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:10.177429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:10.192145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:10.193566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:10.195603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:10.196204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:10.317481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:10.324732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:10.336736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:10.339052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:10.340888 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a2f8d381-0e53-447c-ab72-dbc68cff30d6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1293 microversion: 2.1 time: 0.171504 Jun 04 21:19:10.341562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2625/5147] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:10 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1293 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:10.352558 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-baf041c4-3981-4e91-987c-1941136bc18b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1598 microversion: 2.20 time: 0.326952 Jun 04 21:19:10.354117 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2523/5148] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:10 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1598 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:19:10.379823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:10.380577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:10.392990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:10.395009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:10.396480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:10.396865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:10.494335 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ba221c2-bef9-426a-ad08-aadabf0b4cfc tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119878 Jun 04 21:19:10.495109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2626/5149] 10.222.0.18 () {60 vars in 1315 bytes} [Sat Jun 4 21:19:10 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 04 21:19:11.359855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:11.361075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:11.372623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:11.373323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:11.374298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:11.374932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:11.477273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:11.486366 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aed64913-d562-429b-9057-00fcf127b602 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1299 microversion: 2.1 time: 0.131550 Jun 04 21:19:11.486703 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2524/5150] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:11 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:11.888011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2334b8c3-d2a1-4880-9ecf-c9e02edc08a9 req-85a4a9b2-9078-443b-ba31-2c899e7e0fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:11.904170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2334b8c3-d2a1-4880-9ecf-c9e02edc08a9 req-85a4a9b2-9078-443b-ba31-2c899e7e0fba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:11.904907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2334b8c3-d2a1-4880-9ecf-c9e02edc08a9 req-85a4a9b2-9078-443b-ba31-2c899e7e0fba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:11.962101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2334b8c3-d2a1-4880-9ecf-c9e02edc08a9 req-85a4a9b2-9078-443b-ba31-2c899e7e0fba service nova] Creating event network-changed:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch2-master-1 Jun 04 21:19:11.981556 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2334b8c3-d2a1-4880-9ecf-c9e02edc08a9 req-85a4a9b2-9078-443b-ba31-2c899e7e0fba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.292675 Jun 04 21:19:11.982672 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2627/5151] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:12.503650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:12.504436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:12.513138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:12.513596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:12.514391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:12.514831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:12.753892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:12.777987 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-91f45d86-85f1-470e-94c7-21823d72ecc3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1367 microversion: 2.1 time: 0.278270 Jun 04 21:19:12.781403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2525/5152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:12 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:13.365237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-31dc5ae9-7670-4646-9769-1070106b39c4 req-39926458-6bc3-462e-96af-1bdcd7050994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c", "tag": "6aae3cde-422e-4638-ab44-4b4e968a722f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:13.415153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-31dc5ae9-7670-4646-9769-1070106b39c4 req-39926458-6bc3-462e-96af-1bdcd7050994 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:13.415721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-31dc5ae9-7670-4646-9769-1070106b39c4 req-39926458-6bc3-462e-96af-1bdcd7050994 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:13.449592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-31dc5ae9-7670-4646-9769-1070106b39c4 req-39926458-6bc3-462e-96af-1bdcd7050994 service nova] Creating event network-changed:6aae3cde-422e-4638-ab44-4b4e968a722f for instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c on nch1-master-1 Jun 04 21:19:13.466830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-31dc5ae9-7670-4646-9769-1070106b39c4 req-39926458-6bc3-462e-96af-1bdcd7050994 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106526 Jun 04 21:19:13.468461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2628/5153] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:13.798285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:13.799628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:13.808955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:13.809776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:13.810561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:13.811369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:13.816548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:13.980159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:13.991998 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77b34db8-9726-4ae7-94be-a99e540024f0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1367 microversion: 2.1 time: 0.198468 Jun 04 21:19:13.992700 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2526/5154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:13 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:15.011398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:15.012297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:15.019917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:15.020494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:15.021478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:15.022110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:15.027420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:15.322105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:15.334356 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc4eb761-d898-4a58-9c28-31e94bfaf596 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1367 microversion: 2.1 time: 0.328222 Jun 04 21:19:15.345015 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2629/5155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:15 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:16.352787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:16.353587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:16.356636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:16.364757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:16.364757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:16.364757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:16.365107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:16.511612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:16.520794 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3965930-841d-45bf-9baa-2878834509af tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1367 microversion: 2.1 time: 0.171452 Jun 04 21:19:16.522311 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2527/5156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:16 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:17.426771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3b67ae57-897b-44e9-b400-631996cb04da req-5e325f34-56f4-447a-8862-7f37fcffd30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c", "name": "network-vif-plugged", "status": "completed", "tag": "6aae3cde-422e-4638-ab44-4b4e968a722f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:17.442588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b67ae57-897b-44e9-b400-631996cb04da req-5e325f34-56f4-447a-8862-7f37fcffd30c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:17.443839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b67ae57-897b-44e9-b400-631996cb04da req-5e325f34-56f4-447a-8862-7f37fcffd30c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:17.464888 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3b67ae57-897b-44e9-b400-631996cb04da req-5e325f34-56f4-447a-8862-7f37fcffd30c service nova] Creating event network-vif-plugged:6aae3cde-422e-4638-ab44-4b4e968a722f for instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c on nch1-master-1 Jun 04 21:19:17.473368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3b67ae57-897b-44e9-b400-631996cb04da req-5e325f34-56f4-447a-8862-7f37fcffd30c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052710 Jun 04 21:19:17.475526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2630/5157] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:17.541628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:17.543057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:17.552225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:17.552906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:17.553744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:17.554186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:17.690812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:17.692869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:17.702641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:17.703883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:17.705217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:17.706135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:17.714456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:17.722835 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d6190b9c-367b-45e5-b018-43214e2cbf10 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1367 microversion: 2.1 time: 0.185607 Jun 04 21:19:17.723855 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2528/5158] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:17 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:17.807527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lazy-loading 'services' on Instance uuid b5624805-3a75-403f-a25e-623132acd041 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:19:17.886353 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a23320e1-c2f2-4750-ab55-dd736cdd737a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041/os-volume_attachments/3653e205-45ec-46b3-95f9-bebd5c89c493" status: 202 len: 0 microversion: 2.1 time: 0.200711 Jun 04 21:19:17.890322 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2631/5159] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:19:17 2022] DELETE /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041/os-volume_attachments/3653e205-45ec-46b3-95f9-bebd5c89c493 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:19:18.740972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:18.741792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:18.750465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:18.750933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:18.751939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:18.752563 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:18.943481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:18.954808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b92c99c5-17db-4d4c-a880-48694423ffb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1367 microversion: 2.1 time: 0.217463 Jun 04 21:19:18.955858 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2529/5160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:18 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=20 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.018589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.088706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:20.089267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:20.092338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:20.098001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.098454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.099253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.099731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.127585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:19:20.217619 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-be914f39-c4bd-4f75-9bab-6cf5c98d6d2a tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 204 len: 0 microversion: 2.1 time: 0.133051 Jun 04 21:19:20.221407 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2530/5161] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:19:20 2022] DELETE /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:19:20.228902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:20.229800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:20.236842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.237345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.238260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.238718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.279109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:20.289837 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f722057c-0af9-4fa6-bd78-0d129d74b087 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1556 microversion: 2.1 time: 0.321087 Jun 04 21:19:20.290515 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2632/5162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:19 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1556 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:20.310014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:20.310535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:20.316832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.317939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.318750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:20.319284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:20.826973 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19592196-02b7-4fe7-be47-fbf60d54f908 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.521193 Jun 04 21:19:20.833828 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2633/5163] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:19:20 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-interface => generated 284 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:20.851798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:20.862499 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f913be84-eafe-4b9d-ab98-96db3392ff47 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1512 microversion: 2.1 time: 0.639250 Jun 04 21:19:20.874119 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2531/5164] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:20 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1512 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:19:21.763452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:21.764025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:21.770978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.771453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:21.772283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.772910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:21.805458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:19:21.882494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:21.884158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:21.895490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.896224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:21.897340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.898187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:21.912643 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-62879f52-0da7-4cc2-9d51-3c2bfa2ecb74 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 204 len: 0 microversion: 2.1 time: 0.153770 Jun 04 21:19:21.918268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2634/5165] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:19:21 2022] DELETE /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:19:21.924690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f09c9a5f-331d-4831-9508-78b912f5cee9 req-9f8627d0-cb65-4a95-859e-c3e17f5c7e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c", "tag": "6aae3cde-422e-4638-ab44-4b4e968a722f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:21.934511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f09c9a5f-331d-4831-9508-78b912f5cee9 req-9f8627d0-cb65-4a95-859e-c3e17f5c7e86 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.935040 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f09c9a5f-331d-4831-9508-78b912f5cee9 req-9f8627d0-cb65-4a95-859e-c3e17f5c7e86 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:21.952491 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f09c9a5f-331d-4831-9508-78b912f5cee9 req-9f8627d0-cb65-4a95-859e-c3e17f5c7e86 service nova] Creating event network-changed:6aae3cde-422e-4638-ab44-4b4e968a722f for instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c on nch1-master-1 Jun 04 21:19:21.958123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f09c9a5f-331d-4831-9508-78b912f5cee9 req-9f8627d0-cb65-4a95-859e-c3e17f5c7e86 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038220 Jun 04 21:19:21.958913 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2635/5166] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:21.966364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:21.967310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:21.974946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.975713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:21.976650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:21.977103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:22.179270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:22.188268 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0579375e-ac24-4318-86e0-b2cd318c2a91 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1512 microversion: 2.1 time: 0.311430 Jun 04 21:19:22.189050 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2532/5167] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:21 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:22.291026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:22.299664 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6108987-44e3-40c3-97f9-8fdf1fb25ac5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1409 microversion: 2.1 time: 0.338613 Jun 04 21:19:22.300221 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2636/5168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:21 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1409 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:23.207286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:23.208081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:23.217405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:23.217791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:23.218702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:23.219132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:23.317150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:23.317941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:23.325469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:23.325940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:23.326744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:23.327202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:23.486615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:23.495644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fee0b2c5-1430-40b8-93ff-7da2a03ccbd0 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1512 microversion: 2.1 time: 0.292953 Jun 04 21:19:23.496827 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2533/5169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:23 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:23.552006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:23.561558 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e321ae3f-0db8-4c9a-bb20-a6a09450e08e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1409 microversion: 2.1 time: 0.248300 Jun 04 21:19:23.562684 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2637/5170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:23 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:19:24.196263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d27a5922-29c1-412b-b1b8-521718d77b60 req-ba08eb5f-2d69-4d12-8127-cf45dedcc9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5624805-3a75-403f-a25e-623132acd041", "name": "network-vif-deleted", "tag": "0c5af0c2-9607-4ea6-8551-bdceea100ee4"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:24.205886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d27a5922-29c1-412b-b1b8-521718d77b60 req-ba08eb5f-2d69-4d12-8127-cf45dedcc9a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:24.206325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d27a5922-29c1-412b-b1b8-521718d77b60 req-ba08eb5f-2d69-4d12-8127-cf45dedcc9a8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:24.220354 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d27a5922-29c1-412b-b1b8-521718d77b60 req-ba08eb5f-2d69-4d12-8127-cf45dedcc9a8 service nova] Creating event network-vif-deleted:0c5af0c2-9607-4ea6-8551-bdceea100ee4 for instance b5624805-3a75-403f-a25e-623132acd041 on nch1-master-1 Jun 04 21:19:24.226391 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d27a5922-29c1-412b-b1b8-521718d77b60 req-ba08eb5f-2d69-4d12-8127-cf45dedcc9a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039815 Jun 04 21:19:24.227188 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2534/5171] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:24.514225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:24.515053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:24.523251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:24.523744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:24.524536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:24.525010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:24.562238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:24.562603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:24.563059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lazy-loading 'fault' on Instance uuid b5624805-3a75-403f-a25e-623132acd041 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:19:24.583302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:24.584081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:24.591646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:24.592101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:24.592884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:24.593318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:24.942314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:24.943642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:24.957027 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d62d0efb-14c8-42a9-9455-1eb89bb417d6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 200 len: 1367 microversion: 2.1 time: 0.378831 Jun 04 21:19:24.958677 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-415a55d2-79ce-4eb8-9cc3-63910b8bd766 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 200 len: 1309 microversion: 2.1 time: 0.449599 Jun 04 21:19:24.959339 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2638/5172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:24 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 1309 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:24.964305 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2535/5173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:24 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:19:25.005667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-64ff92c3-c5fa-4774-987c-e2112d6b7088 req-655597e4-2601-4a5d-8dc5-bc89f97f689e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e532119b-b549-43d3-8258-da2251c0b971", "name": "network-vif-deleted", "tag": "95790dff-7d4f-4e68-ae4a-ed66f11e62ad"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:25.018970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-64ff92c3-c5fa-4774-987c-e2112d6b7088 req-655597e4-2601-4a5d-8dc5-bc89f97f689e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:25.019428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-64ff92c3-c5fa-4774-987c-e2112d6b7088 req-655597e4-2601-4a5d-8dc5-bc89f97f689e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:25.041729 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-64ff92c3-c5fa-4774-987c-e2112d6b7088 req-655597e4-2601-4a5d-8dc5-bc89f97f689e service nova] Creating event network-vif-deleted:95790dff-7d4f-4e68-ae4a-ed66f11e62ad for instance e532119b-b549-43d3-8258-da2251c0b971 on nch1-master-1 Jun 04 21:19:25.048716 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-64ff92c3-c5fa-4774-987c-e2112d6b7088 req-655597e4-2601-4a5d-8dc5-bc89f97f689e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046942 Jun 04 21:19:25.049654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2639/5174] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:25.981820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:25.982663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:25.985658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:25.991580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:25.992200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: b5624805-3a75-403f-a25e-623132acd041] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:26.000232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:26.000710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:26.001505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:26.001963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:26.007118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:26.007605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:26.008396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:26.008835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:26.029332 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] HTTP exception thrown: Instance b5624805-3a75-403f-a25e-623132acd041 could not be found. Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Request method failure captured: Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 HTTP/1.1 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8uxPOOI3QKq4OXm51wyDzmw-Ul_YwJ8QSX2Awnf6-Mz94rJi8vzITbSLx1tH-m356CZnxD5z8zKZaDYIZ7yAVUVWLe5HP2uVE-iROntmfnQfWKv0x9vnmjsD6rDa3cJsh6pojHrcCnqi3GpF2Gu8FQzJiOhOqcIWoNyb-jBoemy3c4 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 82e56305a8994e3ca45920448336ba18 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1648955989 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82e56305a8994e3ca45920448336ba18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82e56305a8994e3ca45920448336ba18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82e56305a8994e3ca45920448336ba18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82e56305a8994e3ca45920448336ba18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesSnapshotTestJSON-1648955989 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 82e56305a8994e3ca45920448336ba18 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1648955989 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesSnapshotTestJSON-1648955989-project Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 59e619953f32406891051e0e029c1670 Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesSnapshotTestJSON-1648955989-project Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b5624805-3a75-403f-a25e-623132acd041 could not be found. Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b5624805-3a75-403f-a25e-623132acd041'} Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5624805-3a75-403f-a25e-623132acd041 could not be found. Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5624805-3a75-403f-a25e-623132acd041 could not be found. Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:26.031023 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5624805-3a75-403f-a25e-623132acd041 could not be found. Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Returning 404 to user: Instance b5624805-3a75-403f-a25e-623132acd041 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-27cf7bc9-57f9-46f3-af2d-37629717f51e tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041" status: 404 len: 111 microversion: 2.1 time: 0.059098 Jun 04 21:19:26.035290 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2536/5175] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:25 2022] GET /compute/v2.1/servers/b5624805-3a75-403f-a25e-623132acd041 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 HTTP/1.1 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e532119b-b549-43d3-8258-da2251c0b971'} Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:19:26.046739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f527590a-3d85-4ba8-b1f8-8180b57dfe9a tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 404 len: 111 microversion: 2.1 time: 0.062328 Jun 04 21:19:26.050330 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2640/5176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:25 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:19:27.130524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:27.131027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:27.138359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.138819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.139628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.140131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.154952 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f HTTP/1.1 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ecf890d2-6576-46f8-96ba-369ffba2495f'} Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:19:27.156692 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f27cf2e0-aec7-4df5-bb6f-a49ac1214fa4 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 404 len: 111 microversion: 2.1 time: 0.032667 Jun 04 21:19:27.160328 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2537/5177] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:19:27 2022] DELETE /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:19:27.167772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:27.168407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: ecf890d2-6576-46f8-96ba-369ffba2495f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:27.176070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.176543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.177349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.177801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.193114 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f HTTP/1.1 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'ecf890d2-6576-46f8-96ba-369ffba2495f'} Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.194771 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance ecf890d2-6576-46f8-96ba-369ffba2495f could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9eb5d407-10cd-417a-be4e-471fa8d308b6 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f" status: 404 len: 111 microversion: 2.1 time: 0.034532 Jun 04 21:19:27.198899 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2641/5178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:27 2022] GET /compute/v2.1/servers/ecf890d2-6576-46f8-96ba-369ffba2495f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:19:27.784314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:27.784950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:27.791766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.792589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.793597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.794043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.808660 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 HTTP/1.1 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e532119b-b549-43d3-8258-da2251c0b971'} Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:19:27.810261 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.813822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.814576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:19:27.815585 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c97f8834-3b6b-4d8a-8b49-f1abb1ed6767 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 404 len: 111 microversion: 2.1 time: 0.035118 Jun 04 21:19:27.816632 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2538/5179] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:19:27 2022] DELETE /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:19:27.825648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:27.826485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: e532119b-b549-43d3-8258-da2251c0b971] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:27.833113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.833585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.834386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:27.834836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:27.850680 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 HTTP/1.1 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e532119b-b549-43d3-8258-da2251c0b971'} Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:19:27.852437 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance e532119b-b549-43d3-8258-da2251c0b971 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9fbe8c90-98c6-40fd-b1c9-5a2688d3120e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971" status: 404 len: 111 microversion: 2.1 time: 0.033534 Jun 04 21:19:27.855910 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2642/5180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:27 2022] GET /compute/v2.1/servers/e532119b-b549-43d3-8258-da2251c0b971 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:19:27.929154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81507299-1c14-4d46-aff8-8616794a82a7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: .version_select at 0x7f2d0186ab80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1658442932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy9xdXUJlf2uHKR+gO0VdieNnLOrdbiUG2H1pL0bNXIdoKBWzLf2JQH0kLMurw5smsnFJ1UWp26btOEJ1/Zqma1eOxPbhF6fj7EoXVGvNXSf1cVp5xYH7TAMpwazhMtYg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:27.944015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-81507299-1c14-4d46-aff8-8616794a82a7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:19:27.949763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-81507299-1c14-4d46-aff8-8616794a82a7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:19:27.982139 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81507299-1c14-4d46-aff8-8616794a82a7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.056913 Jun 04 21:19:27.983348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2539/5181] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:19:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:32.704643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-737734820", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1658442932", "security_groups": [{"name": "tempest-secgroup-smoke-817314561"}], "block_device_mapping_v2": [{"uuid": "6121e434-b2b6-4783-9a4b-90d85dc648ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f8dc4cf-e0c9-460c-b458-27f360b796ed"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:33.101746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1571438445", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "8d4d4fdb-bf58-48a1-9c15-08a6fdd28310"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:33.104925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] validate_networks() for [('4f8dc4cf-e0c9-460c-b458-27f360b796ed', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:19:33.164305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] validate_networks() for [('8d4d4fdb-bf58-48a1-9c15-08a6fdd28310', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:19:33.938218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:19:33.938672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:19:33.939346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:19:33.939618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:19:33.940027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:19:33.952224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:33.952987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:33.953510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:33.954176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:33.973945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:19:33.974413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:19:33.974861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:19:33.975272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:19:33.975745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:19:33.978509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Getting quotas for project 82e56305a8994e3ca45920448336ba18. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:19:33.984424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Getting quotas for user 59e619953f32406891051e0e029c1670 and project 82e56305a8994e3ca45920448336ba18. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:19:33.987499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:33.988196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:33.989166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:33.989757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:33.998240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:19:34.000623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:19:34.012286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:19:34.018548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:19:34.058266 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5dfe25f-698b-4c36-98ad-b1012b2b8339 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961553 Jun 04 21:19:34.059144 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2540/5182] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:19:34.070543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-663dcfa4-6f68-4483-8a8c-b841e8ad0ed1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:34.071584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-663dcfa4-6f68-4483-8a8c-b841e8ad0ed1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:34.086508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:19:34.091019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6121e434-b2b6-4783-9a4b-90d85dc648ef',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:19:34.148488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-663dcfa4-6f68-4483-8a8c-b841e8ad0ed1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:34.158042 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-663dcfa4-6f68-4483-8a8c-b841e8ad0ed1 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1219 microversion: 2.1 time: 0.092240 Jun 04 21:19:34.160495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2541/5183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:34 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:34.257080 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e0210cf-8710-46c6-9bb7-21c140514668 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.556402 Jun 04 21:19:34.258309 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2643/5184] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:19:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:19:34.269615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f36572d-519e-41cd-bc64-b17525ba52c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:34.270238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8f36572d-519e-41cd-bc64-b17525ba52c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:34.354770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8f36572d-519e-41cd-bc64-b17525ba52c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:34.364885 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f36572d-519e-41cd-bc64-b17525ba52c8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1094 microversion: 2.1 time: 0.100730 Jun 04 21:19:34.365657 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2542/5185] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:34 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:35.177234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:35.178710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:35.186789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:35.187592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:35.188744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:35.189405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:35.280658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:35.289003 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-06db8326-f51f-4e73-9051-a475b479ca39 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1279 microversion: 2.1 time: 0.115901 Jun 04 21:19:35.289637 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2644/5186] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:35 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:35.384672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:35.385639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:35.394442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:35.394907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:35.395734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:35.396182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:35.471682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:35.481926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-10c30c52-498f-456c-8a30-0d28e446b0bf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1192 microversion: 2.1 time: 0.102009 Jun 04 21:19:35.492120 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2543/5187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:35 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:36.308003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:36.308665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:36.317885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:36.320465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:36.321767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:36.324758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:36.501354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:36.505300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:36.515463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:36.517226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:36.518978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:36.519671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:36.650202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:36.661375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87ebabeb-4b18-44cc-ba83-559ec383d590 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1210 microversion: 2.1 time: 0.165063 Jun 04 21:19:36.673808 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2544/5188] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:36 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1210 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:36.735233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:36.747811 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-550adac2-e1bf-477d-bd1f-31e1ab2020c5 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1319 microversion: 2.1 time: 0.444483 Jun 04 21:19:36.758798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2645/5189] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:36 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:37.040724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bab380d8-c786-4abc-9152-acd411aeb5ee req-b6817147-11c5-40b8-943c-2d3c10a1c0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bd436e-97b8-4daa-a414-7fa2d2b5fb0f", "tag": "b65daf4a-d96a-41ae-9667-fcccc1870a43"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:37.049333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bab380d8-c786-4abc-9152-acd411aeb5ee req-b6817147-11c5-40b8-943c-2d3c10a1c0d6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:37.050014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bab380d8-c786-4abc-9152-acd411aeb5ee req-b6817147-11c5-40b8-943c-2d3c10a1c0d6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:37.067736 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bab380d8-c786-4abc-9152-acd411aeb5ee req-b6817147-11c5-40b8-943c-2d3c10a1c0d6 service nova] Creating event network-changed:b65daf4a-d96a-41ae-9667-fcccc1870a43 for instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f on nch2-master-1 Jun 04 21:19:37.075978 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bab380d8-c786-4abc-9152-acd411aeb5ee req-b6817147-11c5-40b8-943c-2d3c10a1c0d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039169 Jun 04 21:19:37.076965 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2545/5190] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:37.682961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:37.683697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:37.694788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:37.695336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:37.696406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:37.697295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:37.765849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:37.767143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:37.775223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:37.775935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:37.776789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:37.777428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:38.038423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:38.049196 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-83c18775-3306-417d-acfc-af9c221e9f7d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.371122 Jun 04 21:19:38.059898 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2646/5191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:37 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:38.097229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:38.108599 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca3222ef-0662-42b2-926f-b8063fba4418 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1319 microversion: 2.1 time: 0.346976 Jun 04 21:19:38.109466 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2546/5192] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:37 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:38.473829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-8963b98d-8cb7-478c-b4d6-e1f3fe5d987d req-4ffca9c9-55c6-4831-9452-9cc3102a28a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207467f2-12b2-4371-9c8b-b75021bec1f9", "tag": "03b7e999-28b3-462c-8d02-95b016363550"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:38.500537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8963b98d-8cb7-478c-b4d6-e1f3fe5d987d req-4ffca9c9-55c6-4831-9452-9cc3102a28a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:38.501716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8963b98d-8cb7-478c-b4d6-e1f3fe5d987d req-4ffca9c9-55c6-4831-9452-9cc3102a28a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:38.520054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-8963b98d-8cb7-478c-b4d6-e1f3fe5d987d req-4ffca9c9-55c6-4831-9452-9cc3102a28a4 service nova] Creating event network-changed:03b7e999-28b3-462c-8d02-95b016363550 for instance 207467f2-12b2-4371-9c8b-b75021bec1f9 on nch2-master-1 Jun 04 21:19:38.526194 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-8963b98d-8cb7-478c-b4d6-e1f3fe5d987d req-4ffca9c9-55c6-4831-9452-9cc3102a28a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061224 Jun 04 21:19:38.527259 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2647/5193] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:39.067831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:39.068466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:39.076300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:39.076759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:39.077580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:39.078020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:39.127003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:39.128885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:39.136992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:39.137753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:39.139049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:39.139708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:39.274396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:39.283167 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dbee51a2-4435-4db8-8c08-35364664e072 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.219452 Jun 04 21:19:39.283797 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2547/5194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:39 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:39.320249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:39.322937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:39.330258 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a5928816-cc73-4f41-9712-a99bbd6c299f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1319 microversion: 2.1 time: 0.208364 Jun 04 21:19:39.330856 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2648/5195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:39 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:40.300578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:40.301490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:40.309244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:40.309795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:40.310672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:40.311147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:40.315820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:40.348924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:40.350241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:40.362650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:40.364187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:40.365317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:40.366335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:40.558975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:40.569909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:40.578613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-86fbd3e9-77aa-4908-a485-70bc07083b8c tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.281675 Jun 04 21:19:40.580180 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff597bb2-f0c6-4e7b-b7b3-f00591d0fb5c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1319 microversion: 2.1 time: 0.235697 Jun 04 21:19:40.580509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2548/5196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:40 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:40.580766 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2649/5197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:40 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:41.596446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:41.597038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:41.597753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:41.598603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:41.605304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:41.605743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:41.606650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:41.606767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:41.607183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:41.607402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:41.608330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:41.608871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:41.937348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:41.941248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:41.950729 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-986500b6-b9f3-406e-a50f-2609622204be tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.358336 Jun 04 21:19:41.951997 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2549/5198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:41 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:41.952154 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-136c27c2-0d77-4636-ac21-76acff4952df tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1319 microversion: 2.1 time: 0.358578 Jun 04 21:19:41.953802 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2650/5199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:41 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:19:42.076642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-24b4648e-1742-42d0-9405-e69a46f0e452 req-e867f143-02c9-4725-bed6-40713c2e3489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bd436e-97b8-4daa-a414-7fa2d2b5fb0f", "name": "network-vif-plugged", "status": "completed", "tag": "b65daf4a-d96a-41ae-9667-fcccc1870a43"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:42.086242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-24b4648e-1742-42d0-9405-e69a46f0e452 req-e867f143-02c9-4725-bed6-40713c2e3489 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:42.086985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-24b4648e-1742-42d0-9405-e69a46f0e452 req-e867f143-02c9-4725-bed6-40713c2e3489 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:42.106953 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-24b4648e-1742-42d0-9405-e69a46f0e452 req-e867f143-02c9-4725-bed6-40713c2e3489 service nova] Creating event network-vif-plugged:b65daf4a-d96a-41ae-9667-fcccc1870a43 for instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f on nch2-master-1 Jun 04 21:19:42.112485 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-24b4648e-1742-42d0-9405-e69a46f0e452 req-e867f143-02c9-4725-bed6-40713c2e3489 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043590 Jun 04 21:19:42.113211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2550/5200] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:42.969746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:42.970378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:42.971070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:42.971876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:42.977232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:42.977731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:42.978996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:42.979448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:42.981037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:42.981552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:42.982403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:42.982901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:43.228385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:43.234457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:43.237476 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-700da60f-08d5-4888-9c1e-452d64f1f6cf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.272505 Jun 04 21:19:43.238212 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2651/5201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:42 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:43.249686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-279d9614-b25d-479d-b60a-4cb780bca5bb tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1319 microversion: 2.1 time: 0.283047 Jun 04 21:19:43.250274 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2551/5202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:42 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:44.136964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e632262a-3f80-4963-8f3a-63cc4c5067e8 req-6a3d4f08-72c9-469f-8596-15b7a23b87f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207467f2-12b2-4371-9c8b-b75021bec1f9", "name": "network-vif-plugged", "status": "completed", "tag": "03b7e999-28b3-462c-8d02-95b016363550"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:44.142120 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:44.142822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:44.149739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e632262a-3f80-4963-8f3a-63cc4c5067e8 req-6a3d4f08-72c9-469f-8596-15b7a23b87f6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.150278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e632262a-3f80-4963-8f3a-63cc4c5067e8 req-6a3d4f08-72c9-469f-8596-15b7a23b87f6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.163361 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e632262a-3f80-4963-8f3a-63cc4c5067e8 req-6a3d4f08-72c9-469f-8596-15b7a23b87f6 service nova] Creating event network-vif-plugged:03b7e999-28b3-462c-8d02-95b016363550 for instance 207467f2-12b2-4371-9c8b-b75021bec1f9 on nch2-master-1 Jun 04 21:19:44.169142 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e632262a-3f80-4963-8f3a-63cc4c5067e8 req-6a3d4f08-72c9-469f-8596-15b7a23b87f6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036286 Jun 04 21:19:44.170160 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2652/5203] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:44.254409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:44.255003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:44.257060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:44.264364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.265114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.265865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.266832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.268848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:44.269697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:44.277009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.277526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.278674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.279292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.360176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:44.604160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:44.612743 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8fe5eb25-377d-44c4-a82c-f955b3d4f5f2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.362264 Jun 04 21:19:44.613533 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2552/5204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:44 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:44.625945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:44.634068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-affb041b-e48b-48ab-bc89-cfd5470d764f tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1507 microversion: 2.1 time: 0.370767 Jun 04 21:19:44.635038 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2653/5205] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:44 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:44.652837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cc49d5c-997d-437a-81e2-dc8b803becae", "device": "/dev/sdb"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:44.653958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:44.660362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.660810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.661572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:44.662003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:44.926956 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f48820f1-ab6f-49fd-a18c-537db3a83317 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "POST /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278889 Jun 04 21:19:44.927807 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2553/5206] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:19:44 2022] POST /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:45.060769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:45.061278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:45.068235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:45.068700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:45.069475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:45.070070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:45.099265 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6f4ed4e-2acb-4c3c-9cf4-7ffe233eca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/ips" status: 200 len: 151 microversion: 2.20 time: 0.042775 Jun 04 21:19:45.100072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2654/5207] 10.222.0.18 () {60 vars in 1288 bytes} [Sat Jun 4 21:19:45 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:19:45.632747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:45.634104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:45.644254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:45.644912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:45.645902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:45.646964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:45.831975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:45.843119 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ccbfce4-e7ce-4a12-ab82-218882578033 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1265 microversion: 2.1 time: 0.216204 Jun 04 21:19:45.853636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2554/5208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:45 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:46.861667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:46.862479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:46.871284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:46.871879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:46.872822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:46.873477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:46.932772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:46.933314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:46.941240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:46.941692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:46.942743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:46.943293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:46.970151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lazy-loading 'flavor' on Instance uuid 264f513d-b165-4c82-ac0c-234e590ca4c9 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:19:47.035733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:47.046341 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-07e4a1aa-3803-4a51-8b34-a74282ce5470 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1452 microversion: 2.1 time: 0.189038 Jun 04 21:19:47.047144 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2655/5209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:46 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:47.068732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:47.069719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:47.079657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:47.080272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:47.081229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:47.081960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:47.251706 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5547da1-3ef0-4ef6-99fd-459489bdba1b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/action" status: 202 len: 0 microversion: 2.20 time: 0.323090 Jun 04 21:19:47.255574 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2555/5210] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:19:46 2022] POST /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:19:47.257060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:47.261495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:47.262202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:47.268385 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4ffa60d2-7b65-4b7f-ab9d-4e995bad4213 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1452 microversion: 2.1 time: 0.208301 Jun 04 21:19:47.269097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2656/5211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:19:47 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:19:47.271671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:47.271671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:47.271671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:47.271671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:47.476304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:47.508384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:47.513548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:47.515824 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02d177c2-1753-45e2-9167-28c10659ca1f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.258382 Jun 04 21:19:47.517218 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2556/5212] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:47 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:48.535938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:48.536477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:48.543757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:48.544438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:48.545241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:48.545830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:48.755319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:48.764780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:48.766763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:48.768097 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6952d994-33b6-4399-a21a-aa67c25f2a85 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.236550 Jun 04 21:19:48.780254 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2657/5213] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:48 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:49.318963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-39c3a759-bc5e-4ac1-829d-08c348133eb4 req-cdb58111-87b3-44d2-861a-40dc92589c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207467f2-12b2-4371-9c8b-b75021bec1f9", "tag": "03b7e999-28b3-462c-8d02-95b016363550"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:49.329162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-39c3a759-bc5e-4ac1-829d-08c348133eb4 req-cdb58111-87b3-44d2-861a-40dc92589c71 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:49.329648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-39c3a759-bc5e-4ac1-829d-08c348133eb4 req-cdb58111-87b3-44d2-861a-40dc92589c71 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:49.343035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-39c3a759-bc5e-4ac1-829d-08c348133eb4 req-cdb58111-87b3-44d2-861a-40dc92589c71 service nova] Creating event network-changed:03b7e999-28b3-462c-8d02-95b016363550 for instance 207467f2-12b2-4371-9c8b-b75021bec1f9 on nch2-master-1 Jun 04 21:19:49.349126 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-39c3a759-bc5e-4ac1-829d-08c348133eb4 req-cdb58111-87b3-44d2-861a-40dc92589c71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034269 Jun 04 21:19:49.349974 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2557/5214] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:49.788767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:49.789436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:49.799417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:49.800140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:49.801333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:49.801921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:50.045795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:50.054820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:50.060718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:50.061979 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e347899-a4bb-47f4-bee4-ec621d169f08 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.277884 Jun 04 21:19:50.067245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2658/5215] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:49 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:51.085514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:51.086180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:51.088819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:51.095141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:51.095631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:51.096412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:51.096843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:51.246869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:51.256129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:51.257634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:51.258867 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e668c70b-5ecf-4432-8a05-839bb96daca8 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.178688 Jun 04 21:19:51.259637 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2558/5216] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:51 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:52.278822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:52.279355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:52.287307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:52.287996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:52.288803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:52.289250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:52.551688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:52.561027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:52.562542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:52.563773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c437e912-d994-473d-9ee3-28bad6e04006 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.289691 Jun 04 21:19:52.564349 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2659/5217] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:52 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:53.582717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:53.583281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:53.590684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:53.591150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:53.592074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:53.592439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:53.742793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:53.752829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:53.754439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:53.756015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a920aeb-5ccd-4a4f-bd32-6b35ce873c87 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.177521 Jun 04 21:19:53.757016 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2559/5218] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:53 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:54.777608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:54.778246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:54.785934 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:54.786404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:54.787195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:54.787679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:55.003880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:55.012975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:55.014851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:55.016856 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b8f021ea-5b7e-4b82-84ca-8b71c6e09b48 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.243527 Jun 04 21:19:55.017917 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2660/5219] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:54 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:56.035629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:56.036940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:56.045960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:56.046611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:56.047430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:56.048026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:56.290100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:56.298796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:56.300333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:56.301604 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d0d5986d-ac37-4a7f-b4ed-2611b25872a4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.270368 Jun 04 21:19:56.302546 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2560/5220] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:56 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:57.324622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:57.325834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:57.334496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:57.336698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:57.338597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:57.339990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:57.340746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:57.599977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:57.609964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:57.611573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:57.613138 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6313ce5a-07aa-42ce-9d1c-0f61eac30770 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.296229 Jun 04 21:19:57.613717 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2661/5221] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:57 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:57.855760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:57.857448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:57.873927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:57.874691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:57.875980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:57.876748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:57.915590 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6753c0af-e48f-48f2-b599-e09a034bf720 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/ips" status: 200 len: 148 microversion: 2.1 time: 0.067996 Jun 04 21:19:57.934350 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2561/5222] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:19:57 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/ips => generated 148 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:58.634274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:58.640300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:58.652109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:58.652572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:58.653517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:58.654155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:58.835430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:58.846330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:58.848224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:19:58.849938 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0431ea61-19d5-4f15-9b8c-d713e9d9bb92 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.222198 Jun 04 21:19:58.857887 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2662/5223] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:58 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:19:59.501224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e55940a4-eed0-4479-8bd9-00bf3d2dd587"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:19:59.502426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:59.511365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:59.512031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:59.512803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:59.513404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:59.677317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:19:59.839007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-383e9a80-c3ee-42c1-94f9-502cef254125 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341354 Jun 04 21:19:59.839848 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2562/5224] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:19:59 2022] POST /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:19:59.869954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:19:59.870656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:19:59.882748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:59.883625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:19:59.884442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:19:59.885597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:00.043734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:00.053626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:00.055391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:00.057574 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4308da25-2dc7-4ea9-a517-86aa57361f6e tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.192340 Jun 04 21:20:00.058350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2663/5225] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:19:59 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:01.079579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:01.080215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:01.086955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:01.087415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:01.088286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:01.088727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:01.301276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:01.310389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:01.312320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:01.313806 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8cf241d0-bc5d-4eea-afbd-700b06e743e4 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.239484 Jun 04 21:20:01.314624 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2563/5226] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:01 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:02.333373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:02.334005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:02.342423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:02.342892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:02.343725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:02.344179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:02.611961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:02.625640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:02.627147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:02.628649 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-227d1ee9-06eb-4f1d-97ef-e7a4349045e0 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.299330 Jun 04 21:20:02.631534 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2664/5227] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:02 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:03.191965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc582d34-4ccc-415c-8295-d791ded7dd92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: .version_select at 0x7f2d01599820>, body: {"keypair": {"name": "tempest-keypair-2075709677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkO6heW1rWWGsslpcp/RlLda+pFVMQ+3wCNczqqiSNK7x03668CkP5aRHvMHpBtI1yLd4P7TiZu64iasXThrQgGwfO7NOuB1ENPg0u71f8Xif98sicziIg74ACh0LvYxQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:03.209620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cc582d34-4ccc-415c-8295-d791ded7dd92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:20:03.217173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-cc582d34-4ccc-415c-8295-d791ded7dd92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:20:03.248642 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc582d34-4ccc-415c-8295-d791ded7dd92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061239 Jun 04 21:20:03.249272 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2564/5228] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:20:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:20:03.648264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:03.649572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:03.657098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:03.657786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:03.658781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:03.659427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:03.888459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:03.901356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:03.909332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:03.910629 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-352ff0e3-e82f-48fc-ab85-a61b3a14709c tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1743 microversion: 2.20 time: 0.266718 Jun 04 21:20:03.911587 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2665/5229] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:03 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1743 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:04.784654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984083893", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "403e6571-3f00-4d79-b35c-182d28b6747c"}], "security_groups": [{"name": "tempest-securitygroup--651049004"}], "key_name": "tempest-keypair-2075709677", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:04.928224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] validate_networks() for [('403e6571-3f00-4d79-b35c-182d28b6747c', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:20:04.930529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:04.931701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:04.939841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:04.940376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:04.941186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:04.941683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:04.957945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=100 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:05.209212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:05.221560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:05.224483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:05.225976 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c5d3a9ff-4e3f-4e38-b03c-69bff57d5ccb tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1743 microversion: 2.20 time: 0.300098 Jun 04 21:20:05.226778 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2666/5230] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:04 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1743 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:05.470298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:20:05.471325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:20:05.471325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:20:05.471991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:20:05.472485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:20:05.482858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:05.483407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:05.484331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:05.484858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:05.506145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:20:05.515660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:20:05.532591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:20:05.534921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:20:05.596535 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-985aaf32-eca4-4a1d-b2a7-42e3faaec726 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.816159 Jun 04 21:20:05.602884 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2565/5231] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:20:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:20:05.610448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8e8b4a9-7c7d-412c-b94f-bba1fef2492c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:05.611813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f8e8b4a9-7c7d-412c-b94f-bba1fef2492c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:05.740739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8e8b4a9-7c7d-412c-b94f-bba1fef2492c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:05.755960 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f8e8b4a9-7c7d-412c-b94f-bba1fef2492c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1242 microversion: 2.1 time: 0.151434 Jun 04 21:20:05.759182 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2667/5232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:05 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:20:06.194032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7378c907-f5f0-4065-a803-c6e85e05773e req-9375ba4a-675a-4685-89d0-5fa0116b1a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:06.232323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7378c907-f5f0-4065-a803-c6e85e05773e req-9375ba4a-675a-4685-89d0-5fa0116b1a04 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:06.232885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7378c907-f5f0-4065-a803-c6e85e05773e req-9375ba4a-675a-4685-89d0-5fa0116b1a04 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:06.245899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:06.247268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:06.261998 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7378c907-f5f0-4065-a803-c6e85e05773e req-9375ba4a-675a-4685-89d0-5fa0116b1a04 service nova] Creating event network-vif-plugged:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch2-master-1 Jun 04 21:20:06.267794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:06.269423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:06.271095 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7378c907-f5f0-4065-a803-c6e85e05773e req-9375ba4a-675a-4685-89d0-5fa0116b1a04 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105290 Jun 04 21:20:06.271521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:06.272101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:06.272426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2566/5233] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:06.523203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:06.535844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:06.538314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:06.539846 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-02240ba0-9ec2-4d31-b8fd-ad0ae529940b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.298323 Jun 04 21:20:06.540932 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2668/5234] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:06 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:20:06.778435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:06.779277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:06.791772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:06.792236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:06.793169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:06.793647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:06.864627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:06.876313 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-94f85fab-e5ad-4093-83cc-f1a1d494d7c2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1294 microversion: 2.1 time: 0.102983 Jun 04 21:20:06.879027 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2567/5235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:06 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:07.562607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:07.564101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:07.574354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:07.575116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:07.576119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:07.577042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:07.896001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:07.897349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:07.907911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:07.908528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:07.909487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:07.910229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:07.924357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:07.951536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:07.953878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:07.956414 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-69af63c6-a791-4b1c-8680-fc49b93e56fd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.397836 Jun 04 21:20:07.958369 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2669/5236] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:07 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:08.020530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:08.030911 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-53c009bf-de93-4c03-941c-511070965652 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1300 microversion: 2.1 time: 0.139384 Jun 04 21:20:08.035997 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2568/5237] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:07 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:08.984399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:08.986127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:09.007478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:09.014844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:09.017504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:09.018815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:09.057837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:09.058768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:09.075380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:09.075873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:09.085104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:09.087002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:09.393017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:09.412149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:09.417679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:09.419537 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-afa6bd63-e9d6-425b-94eb-993dc58463a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.445715 Jun 04 21:20:09.422462 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2670/5238] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:08 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:09.437132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:09.446594 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff50f0bb-b4a6-4730-a7c8-9d83d73964fe tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1367 microversion: 2.1 time: 0.396842 Jun 04 21:20:09.447944 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2569/5239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:09 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:09.950837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6cc90fe5-2c14-4500-b8cd-4093df14ee6d req-994540e2-9f5c-41d4-9689-0e07ae15d09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24dc3512-ad77-4fee-8873-2430da725e8e", "tag": "806145a2-376f-4a1b-bd76-056b5e693bfd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:09.992133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6cc90fe5-2c14-4500-b8cd-4093df14ee6d req-994540e2-9f5c-41d4-9689-0e07ae15d09a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:09.992938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6cc90fe5-2c14-4500-b8cd-4093df14ee6d req-994540e2-9f5c-41d4-9689-0e07ae15d09a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:10.032665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6cc90fe5-2c14-4500-b8cd-4093df14ee6d req-994540e2-9f5c-41d4-9689-0e07ae15d09a service nova] Creating event network-changed:806145a2-376f-4a1b-bd76-056b5e693bfd for instance 24dc3512-ad77-4fee-8873-2430da725e8e on nch1-master-1 Jun 04 21:20:10.039762 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6cc90fe5-2c14-4500-b8cd-4093df14ee6d req-994540e2-9f5c-41d4-9689-0e07ae15d09a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099118 Jun 04 21:20:10.040654 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2671/5240] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:10.443106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:10.444401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:10.473810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:10.474672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:10.475450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:10.477760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:10.479072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:10.481850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:10.499809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:10.544350 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:10.574130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:10.582327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:10.999767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:11.031270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:11.041471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:11.056216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:11.058822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df84b466-40c2-4df0-ab4f-3403a764523f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.621112 Jun 04 21:20:11.060147 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2570/5241] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:10 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:11.065263 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7262578c-27b1-4300-b989-d9c7ea8804ec tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1367 microversion: 2.1 time: 0.603007 Jun 04 21:20:11.076989 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2672/5242] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:10 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1367 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:12.080872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:12.081468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:12.085753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:12.086517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:12.092037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:12.097964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:12.098881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:12.099404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:12.100814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:12.101782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:12.106348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:12.108203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:12.771115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:12.779443 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3135af2a-3d31-4bd1-8610-5d4485035bfd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1367 microversion: 2.1 time: 0.698366 Jun 04 21:20:12.790041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2673/5243] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:12 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1367 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:12.814651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:12.847025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:12.849214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:12.872889 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-087c2ae6-192c-4b5e-b6bb-76b8cf6043d1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.783813 Jun 04 21:20:12.875579 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2571/5244] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:12 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:13.799788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:13.801490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:13.813032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:13.813855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:13.814876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:13.815522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:13.897395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:13.898109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:13.951947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:13.956507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:13.965540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:13.966059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:14.304343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:14.314054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a61dc018-4e1a-40a8-8aa8-2b840a0b113d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1367 microversion: 2.1 time: 0.520018 Jun 04 21:20:14.316493 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2674/5245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:13 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:14.377963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:14.393738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:14.395357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:14.396700 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c059328-10dd-4ced-94a0-42beece1dfbe tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.506424 Jun 04 21:20:14.408374 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2572/5246] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:13 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:20:15.349182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:15.352244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:15.370276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:15.429142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.059s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:15.430657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:15.430766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:15.439698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:15.441380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:15.494787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:15.495683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:15.496704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:15.497278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:15.498124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:15.535576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:15.756067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:15.910645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:15.928625 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71e8e508-8fd9-46dc-9314-1dcd5635be36 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1367 microversion: 2.1 time: 0.592833 Jun 04 21:20:15.929228 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2675/5247] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:15 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1367 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:15.933949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-69387389-fb65-4b9c-b8b7-52dc65b60de0 req-de24ca01-0da1-4f7a-b106-8683e949b153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dc3512-ad77-4fee-8873-2430da725e8e", "name": "network-vif-plugged", "status": "completed", "tag": "806145a2-376f-4a1b-bd76-056b5e693bfd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:15.956970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-69387389-fb65-4b9c-b8b7-52dc65b60de0 req-de24ca01-0da1-4f7a-b106-8683e949b153 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:15.957415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-69387389-fb65-4b9c-b8b7-52dc65b60de0 req-de24ca01-0da1-4f7a-b106-8683e949b153 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:15.969715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:15.981245 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-69387389-fb65-4b9c-b8b7-52dc65b60de0 req-de24ca01-0da1-4f7a-b106-8683e949b153 service nova] Creating event network-vif-plugged:806145a2-376f-4a1b-bd76-056b5e693bfd for instance 24dc3512-ad77-4fee-8873-2430da725e8e on nch1-master-1 Jun 04 21:20:15.983305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:15.989741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-69387389-fb65-4b9c-b8b7-52dc65b60de0 req-de24ca01-0da1-4f7a-b106-8683e949b153 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059267 Jun 04 21:20:15.990609 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2676/5248] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:15.991951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:15.998029 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-176fec68-571f-4a13-be0d-d6050b8df4e1 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.569652 Jun 04 21:20:15.999274 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2573/5249] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:15 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:16.947900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:16.948724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:16.957129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:16.957656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:16.958680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:16.959670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:17.019436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:17.021324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:17.052437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:17.053209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:17.054285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:17.054930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:17.305094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:17.320897 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a55f6c17-8369-4c99-9960-54494adff15d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1367 microversion: 2.1 time: 0.379077 Jun 04 21:20:17.321705 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2677/5250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:16 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:17.362245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:17.373409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:17.377207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:17.379244 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ad432d60-1945-43e1-a762-af8c4dc2c229 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.366516 Jun 04 21:20:17.394975 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2574/5251] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:17 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:18.339251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:18.340644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:18.350109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:18.350834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:18.351851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:18.352455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:18.398554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:18.400034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:18.410080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:18.410915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:18.412032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:18.412619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:18.686773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:18.689217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:18.698752 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-69d97223-ec50-4959-9722-81db3d04ac75 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1557 microversion: 2.1 time: 0.364056 Jun 04 21:20:18.701649 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2678/5252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:18 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1557 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:18.706426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:18.709885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:18.711795 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-86a4d3df-0dfa-4d2b-9e4e-affb7ce51289 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.317430 Jun 04 21:20:18.716921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:18.718082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:18.729133 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2575/5253] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:18 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:20:18.730482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:18.730975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:18.732622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:18.733217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:18.869658 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-90ff5b93-cc79-4c5f-8b78-763e71ac5d97 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156989 Jun 04 21:20:18.870624 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2679/5254] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:20:18 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:19.734841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:19.735488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:19.748994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:19.749457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:19.750264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:19.750715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:20.122879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:20.137727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:20.140437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:20.142738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60e1f90d-903b-421d-8f0c-5d1fbcb0b9d6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1738 microversion: 2.20 time: 0.412111 Jun 04 21:20:20.155179 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2576/5255] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:19 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1738 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:20.531984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c760a20d-46d5-4afb-a036-87eacfa6e443 req-0a215ff1-0855-4153-8bdc-74dff4812f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24dc3512-ad77-4fee-8873-2430da725e8e", "tag": "806145a2-376f-4a1b-bd76-056b5e693bfd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:20.542335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c760a20d-46d5-4afb-a036-87eacfa6e443 req-0a215ff1-0855-4153-8bdc-74dff4812f84 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:20.543148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c760a20d-46d5-4afb-a036-87eacfa6e443 req-0a215ff1-0855-4153-8bdc-74dff4812f84 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:20.568797 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c760a20d-46d5-4afb-a036-87eacfa6e443 req-0a215ff1-0855-4153-8bdc-74dff4812f84 service nova] Creating event network-changed:806145a2-376f-4a1b-bd76-056b5e693bfd for instance 24dc3512-ad77-4fee-8873-2430da725e8e on nch1-master-1 Jun 04 21:20:20.577866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c760a20d-46d5-4afb-a036-87eacfa6e443 req-0a215ff1-0855-4153-8bdc-74dff4812f84 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051062 Jun 04 21:20:20.583012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2680/5256] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:20:21.163060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:21.163878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:21.174140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:21.186408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:21.187052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:21.188705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:21.189308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:21.580797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:21.595958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:21.598530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:21.601008 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f88ff65-b6df-4a69-846f-18ee79b56312 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1720 microversion: 2.20 time: 0.443356 Jun 04 21:20:21.603085 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2577/5257] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:21 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1720 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:22.626288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:22.627227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:22.635828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:22.636303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:22.637117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:22.637828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:22.874452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:22.884885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:22.886437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:22.887955 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e38e673-39e6-436f-aad4-745e466c6932 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1720 microversion: 2.20 time: 0.270514 Jun 04 21:20:22.888557 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2681/5258] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:22 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:23.906517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:23.907773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:23.916450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:23.916912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:23.917720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:23.918163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:24.059470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-f25c925e-d6d6-4e94-80b6-4233cbce7b4b req-645065f6-d514-4ff6-93ed-c8625bc269b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "name": "network-vif-unplugged", "status": "completed", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:24.074441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f25c925e-d6d6-4e94-80b6-4233cbce7b4b req-645065f6-d514-4ff6-93ed-c8625bc269b7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:24.075084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-f25c925e-d6d6-4e94-80b6-4233cbce7b4b req-645065f6-d514-4ff6-93ed-c8625bc269b7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:24.096412 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-f25c925e-d6d6-4e94-80b6-4233cbce7b4b req-645065f6-d514-4ff6-93ed-c8625bc269b7 service nova] Creating event network-vif-unplugged:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch2-master-1 Jun 04 21:20:24.108966 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-f25c925e-d6d6-4e94-80b6-4233cbce7b4b req-645065f6-d514-4ff6-93ed-c8625bc269b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048901 Jun 04 21:20:24.110315 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2682/5259] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:24.145313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:24.160803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:24.162886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:24.164475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2b2d1250-c5a5-4afd-b375-dce0a041b89f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1720 microversion: 2.20 time: 0.261837 Jun 04 21:20:24.165560 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2578/5260] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:23 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:25.184962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:25.185814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:25.194883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:25.195287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:25.196138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:25.196807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:25.341600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:25.352900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:25.355008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:25.356439 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-00d4aa73-b7cd-4eba-9de2-5576ae463687 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1663 microversion: 2.20 time: 0.177434 Jun 04 21:20:25.367581 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2683/5261] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:25 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1663 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:25.376576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d93e0037-2eec-4568-95c2-a8f0dc49d2c9"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:25.377852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:25.385778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:25.386228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:25.387039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:25.387472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:25.591957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:25.724040 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c216cc2c-63e5-47a8-bc57-1c57b646bb64 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.352817 Jun 04 21:20:25.724809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2579/5262] 10.222.0.18 () {62 vars in 1363 bytes} [Sat Jun 4 21:20:25 2022] POST /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-volume_attachments => generated 188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:20:25.851983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:25.852501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:25.859121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:25.859626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:25.860406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:25.860852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:26.145694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:26.158972 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-63a92bc3-a41b-4368-b561-4c7014bda7a3 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-volume_attachments/d93e0037-2eec-4568-95c2-a8f0dc49d2c9" status: 202 len: 0 microversion: 2.20 time: 0.310783 Jun 04 21:20:26.159846 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2684/5263] 10.222.0.18 () {60 vars in 1456 bytes} [Sat Jun 4 21:20:25 2022] DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-volume_attachments/d93e0037-2eec-4568-95c2-a8f0dc49d2c9 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:20:26.245972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:26.246657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:26.253824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:26.254283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:26.255112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:26.255643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:26.352013 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78260f98-c3fc-49c1-9634-c81d93d9b55b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "POST /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/action" status: 202 len: 0 microversion: 2.20 time: 0.110598 Jun 04 21:20:26.352346 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2580/5264] 10.222.0.18 () {62 vars in 1318 bytes} [Sat Jun 4 21:20:26 2022] POST /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:20:26.362433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:26.363380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:26.372659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:26.373491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:26.374377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:26.374839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:26.564085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:26.573717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:26.575567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:26.576933 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4bf62f86-667a-4a47-8f05-9ca239127512 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1671 microversion: 2.20 time: 0.219692 Jun 04 21:20:26.577555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2685/5265] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:26 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1671 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:27.598633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:27.599178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:27.607038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:27.607614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:27.608407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:27.608845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:27.968344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:27.978624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:27.980282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:27.981793 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f595b549-3f10-469a-b1fb-e06383b49a14 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.388752 Jun 04 21:20:27.982833 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2581/5266] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:27 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:29.006269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:29.006816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:29.022349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=52 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:29.030323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:29.031559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:29.033539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:29.034160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:29.397504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:29.408298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:29.410507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:29.412062 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-51b7be19-cc6c-471c-a9f4-00d9eaf55f06 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.414756 Jun 04 21:20:29.412926 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2686/5267] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:28 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:29.743084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2b84b41c-3a7f-459a-8090-ba66841c85a9 req-f5bceee9-6834-492e-93de-9f90822e5d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:29.769236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2b84b41c-3a7f-459a-8090-ba66841c85a9 req-f5bceee9-6834-492e-93de-9f90822e5d0a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:29.769734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2b84b41c-3a7f-459a-8090-ba66841c85a9 req-f5bceee9-6834-492e-93de-9f90822e5d0a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:29.784910 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2b84b41c-3a7f-459a-8090-ba66841c85a9 req-f5bceee9-6834-492e-93de-9f90822e5d0a service nova] Creating event network-changed:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch1-master-1 Jun 04 21:20:29.807323 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2b84b41c-3a7f-459a-8090-ba66841c85a9 req-f5bceee9-6834-492e-93de-9f90822e5d0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068732 Jun 04 21:20:29.810036 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2582/5268] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:30.432355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:30.432991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:30.440344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:30.440802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:30.441664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:30.442104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:30.691150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:30.712110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:30.717479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:30.718957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59a0a37a-2ba1-40bd-9972-4a71f4b975a6 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.292105 Jun 04 21:20:30.719865 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2687/5269] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:30 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:20:31.742119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:31.742979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:31.756990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:31.757439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:31.758319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:31.759998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:31.991431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:32.009593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:32.011716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:32.013207 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-efdd3afb-a2f7-4e8b-9d66-1b9bc9fe3e09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.277826 Jun 04 21:20:32.015157 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2583/5270] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:31 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:33.037359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:33.038084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:33.048212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:33.053686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:33.069758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:33.070748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:33.372480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:33.390384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:33.392896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:33.394368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-75a49a71-bc86-4ffe-931d-fa9e2f7a57a7 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.361571 Jun 04 21:20:33.403440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2688/5271] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:33 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:34.415538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:34.416856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:34.428288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:34.433739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:34.434971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:34.435628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:34.686601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:34.731266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:34.734314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:34.736320 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8937da6f-bce5-4166-9936-696f9234e065 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.325619 Jun 04 21:20:34.762382 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2584/5272] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:34 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:20:35.756644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:35.756644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:35.770770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:35.771104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:35.772218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:35.772590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:36.001923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:36.012768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:36.014758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:36.016395 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70e482d8-4fbf-4ec3-afe3-2a0e042ad027 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.265379 Jun 04 21:20:36.029171 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2689/5273] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:35 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:37.039485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:37.040301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:37.059235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:37.060818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:37.063295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:37.064505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:37.298489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:37.311293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:37.318896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:37.320216 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d7d0fdc-0b97-40b7-92ce-16bfd984dd34 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.285386 Jun 04 21:20:37.334501 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2585/5274] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:37 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:38.365221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:38.366814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:38.388388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:38.388858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:38.393450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:38.394101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:38.649781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:38.676538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:38.678404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:38.681051 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-954375f9-cacf-48ad-8aac-4aeb79516382 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.335503 Jun 04 21:20:38.682883 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2690/5275] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:38 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:39.703787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:39.704605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:39.712705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:39.713547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:39.714670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:39.715322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:39.950875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:39.960621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:39.963140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:39.964999 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6dbed7c6-c048-4e90-85c8-d8dca442576f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.265622 Jun 04 21:20:39.966177 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2586/5276] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:39 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:40.984453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:40.985059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:40.992162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:40.992702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:40.993857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:40.994476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:41.233889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:41.256583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:41.258504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:41.260592 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-baf06254-752f-4b85-a85a-c9c87141f772 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.280657 Jun 04 21:20:41.262019 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2691/5277] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:40 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:42.281142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:42.281737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:42.288926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:42.289376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:42.290293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:42.290754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:42.457841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:42.466340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:42.467912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:42.469111 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a5a7c8e-cc67-45ef-918f-509d8b4809c2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.192086 Jun 04 21:20:42.469674 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2587/5278] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:42 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 04 21:20:43.487399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:43.488057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:43.495842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:43.496302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:43.497257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:43.497714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:43.638152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:43.672846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:43.674480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:43.675734 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f620f63f-eb97-4437-926f-79223a18f1dd tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.192417 Jun 04 21:20:43.688625 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2692/5279] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:43 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:44.697445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:44.698266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:44.707788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:44.708429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:44.709417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:44.710018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:44.987778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:44.999223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:45.000945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:45.002578 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79bc1808-21fc-4650-b70d-cfc3feb5df68 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.310862 Jun 04 21:20:45.003762 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2588/5280] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:44 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:45.870421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-19de91d2-a3f9-4bd7-a97b-a2959fbf718b req-718e1dbd-6e80-4040-bc79-b4a502d5bbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "name": "network-vif-plugged", "status": "completed", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:45.883856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-19de91d2-a3f9-4bd7-a97b-a2959fbf718b req-718e1dbd-6e80-4040-bc79-b4a502d5bbc4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:45.884775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-19de91d2-a3f9-4bd7-a97b-a2959fbf718b req-718e1dbd-6e80-4040-bc79-b4a502d5bbc4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:45.900382 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-19de91d2-a3f9-4bd7-a97b-a2959fbf718b req-718e1dbd-6e80-4040-bc79-b4a502d5bbc4 service nova] Creating event network-vif-plugged:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch1-master-1 Jun 04 21:20:45.909124 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-19de91d2-a3f9-4bd7-a97b-a2959fbf718b req-718e1dbd-6e80-4040-bc79-b4a502d5bbc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044804 Jun 04 21:20:45.912403 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2693/5281] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:46.022568 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:46.024045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:46.035839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:46.036660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:46.037875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:46.038484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:46.472670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:46.486034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:46.488124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:46.489658 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c8e3a68-6a39-46e8-b70d-718cbb06c1ca tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.471745 Jun 04 21:20:46.491021 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2589/5282] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:46 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:47.513679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:47.514488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:47.524420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:47.525253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:47.526330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:47.527007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:47.783575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:47.792979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:47.796871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:47.798194 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4945ddfa-88de-457a-82fb-ade2e81ef001 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1729 microversion: 2.20 time: 0.291930 Jun 04 21:20:47.798954 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2694/5283] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:47 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:48.820072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:48.822713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:48.831874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:48.832276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:48.833148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:48.833589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:49.081542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:49.096822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:49.098626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:49.100162 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7cfb510e-1f87-4a4a-84e3-4a060e449591 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1716 microversion: 2.20 time: 0.285639 Jun 04 21:20:49.101437 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2590/5284] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:20:48 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1716 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:20:56.874611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:56.875175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:56.882851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:56.883365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:56.884168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:56.884648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:56.887362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=57 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:56.911253 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2da990eb-98e5-402b-b1c2-a5d6160bdc43 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/ips" status: 200 len: 149 microversion: 2.1 time: 0.040634 Jun 04 21:20:56.912050 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2695/5285] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:20:56 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:20:56.923201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e55940a4-eed0-4479-8bd9-00bf3d2dd587"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:20:56.924340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:56.927101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=30 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:56.932271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:56.932725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:56.933511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:56.933948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:56.937137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:20:57.019538 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Invalid volume: volume e55940a4-eed0-4479-8bd9-00bf3d2dd587 is already attached to instances: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/os-volume_attachments HTTP/1.1 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 74 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: {"volumeAttachment": {"volumeId": "e55940a4-eed0-4479-8bd9-00bf3d2dd587"}} Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid volume: volume e55940a4-eed0-4479-8bd9-00bf3d2dd587 is already attached to instances: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': '24dc3512-ad77-4fee-8873-2430da725e8e', 'body': {'volumeAttachment': {'volumeId': 'e55940a4-eed0-4479-8bd9-00bf3d2dd587'}}} Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e55940a4-eed0-4479-8bd9-00bf3d2dd587 is already attached to instances: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:20:57.021444 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e55940a4-eed0-4479-8bd9-00bf3d2dd587 is already attached to instances: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e55940a4-eed0-4479-8bd9-00bf3d2dd587 is already attached to instances: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 400 to user: Invalid volume: volume e55940a4-eed0-4479-8bd9-00bf3d2dd587 is already attached to instances: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-75db6f68-8f41-4edd-9f75-5841dff6797c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105301 Jun 04 21:20:57.026809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2591/5286] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:20:56 2022] POST /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:20:57.034645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:57.035584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:57.042190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:57.042666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:57.043479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:57.044020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:57.071298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:20:57.165237 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d198ccc-b8fc-4ce3-a897-3e85403bf61a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 204 len: 0 microversion: 2.1 time: 0.134269 Jun 04 21:20:57.166212 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2696/5287] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:20:57 2022] DELETE /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:20:57.175595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:57.176491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:57.185973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:57.186459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:57.187256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:57.187753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:57.342899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:57.351280 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-353f565d-5b37-4b50-bf33-373b448a8764 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1681 microversion: 2.1 time: 0.180604 Jun 04 21:20:57.351972 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2592/5288] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:57 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:20:58.370185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:58.371007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:58.378857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:58.379321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:58.380144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:58.380589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:58.519383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:58.528095 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d3fe4fb-8794-4b9d-aee1-8be2fb2b4099 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1681 microversion: 2.1 time: 0.162696 Jun 04 21:20:58.528677 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2697/5289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:58 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:20:59.546533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:20:59.547334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:20:59.560904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:59.561465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:59.562352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:20:59.563019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:20:59.901622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:20:59.911808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-134ac3db-a665-4a5e-9d96-910c7093fb92 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 200 len: 1614 microversion: 2.1 time: 0.369527 Jun 04 21:20:59.922533 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2593/5290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:20:59 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 1614 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:00.119181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-eedfade3-e2a8-429a-9ac5-6e1b13d9a84b req-ccf5ed88-436b-4be1-8c8b-80ac6a315f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24dc3512-ad77-4fee-8873-2430da725e8e", "name": "network-vif-deleted", "tag": "806145a2-376f-4a1b-bd76-056b5e693bfd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:00.128081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:00.134657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-eedfade3-e2a8-429a-9ac5-6e1b13d9a84b req-ccf5ed88-436b-4be1-8c8b-80ac6a315f01 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:00.135344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-eedfade3-e2a8-429a-9ac5-6e1b13d9a84b req-ccf5ed88-436b-4be1-8c8b-80ac6a315f01 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:00.152727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-eedfade3-e2a8-429a-9ac5-6e1b13d9a84b req-ccf5ed88-436b-4be1-8c8b-80ac6a315f01 service nova] Creating event network-vif-deleted:806145a2-376f-4a1b-bd76-056b5e693bfd for instance 24dc3512-ad77-4fee-8873-2430da725e8e on nch1-master-1 Jun 04 21:21:00.162160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-eedfade3-e2a8-429a-9ac5-6e1b13d9a84b req-ccf5ed88-436b-4be1-8c8b-80ac6a315f01 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047849 Jun 04 21:21:00.163380 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2698/5291] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:00.929800 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:00.930606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:00.937896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:00.938556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:00.939561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:00.940443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:00.956338 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e HTTP/1.1 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '24dc3512-ad77-4fee-8873-2430da725e8e'} Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:00.958281 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:21:00.962339 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:00.965436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:00.966446 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef0d7243-8fc9-4804-9a93-25013968432a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 404 len: 111 microversion: 2.1 time: 0.041583 Jun 04 21:21:00.967463 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2594/5292] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:00 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:21:00.977973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-affcf9a3-394e-4df5-98e7-36e9515e8e8b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '.version_select at 0x7f2d00f9ea60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:01.010349 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-affcf9a3-394e-4df5-98e7-36e9515e8e8b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075709677" status: 202 len: 0 microversion: 2.1 time: 0.037291 Jun 04 21:21:01.012199 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2699/5293] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:21:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075709677 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:21:01.997139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:01.997656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:02.004718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:02.005163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:02.005941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:02.006380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:02.094783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lazy-loading 'services' on Instance uuid 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:21:02.178660 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c1a6692a-32d0-450c-b10c-6aaf7eb5db14 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments/e55940a4-eed0-4479-8bd9-00bf3d2dd587" status: 202 len: 0 microversion: 2.1 time: 0.186065 Jun 04 21:21:02.179322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2595/5294] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:21:01 2022] DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments/e55940a4-eed0-4479-8bd9-00bf3d2dd587 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:21:02.189098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:02.190211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:02.197904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:02.198448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:02.199243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:02.200373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:02.234941 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aea61fb8-0d5c-4491-b930-77af2265004a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050504 Jun 04 21:21:02.235871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2700/5295] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:21:02 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:03.248157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:03.249276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:03.255961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:03.256409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:03.257187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:03.257736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:03.290827 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecf4f98e-591b-409b-ada8-f4679dc1c365 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048051 Jun 04 21:21:03.291637 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2596/5296] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:21:03 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:21:03.350809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:03.351417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:03.359786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:03.360253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:03.361091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:03.361551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:03.393510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:21:03.485637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ce1faf5-7ea4-40d2-9239-7335a7ff606f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 204 len: 0 microversion: 2.1 time: 0.138581 Jun 04 21:21:03.486739 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2701/5297] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:21:03 2022] DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:21:03.495971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:03.496842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:03.503426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:03.503925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:03.504690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:03.505127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:03.731647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:03.740111 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8c2111a-ed04-4c77-b875-85e42911c196 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1680 microversion: 2.1 time: 0.248825 Jun 04 21:21:03.741192 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2597/5298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:03 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:04.759251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:04.760130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:04.767496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:04.767982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:04.768771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:04.769216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:04.930567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:04.938640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85716141-4f57-47eb-ba46-c5bff4a2180a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1680 microversion: 2.1 time: 0.184309 Jun 04 21:21:04.939207 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2702/5299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:04 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:05.960502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:05.961468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:05.971026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:05.971593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:05.972614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:05.973004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:06.270283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:06.279253 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b7c90d4-507d-404d-8a87-e2259b9e2922 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1680 microversion: 2.1 time: 0.325778 Jun 04 21:21:06.280234 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2598/5300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:05 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1680 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:07.137108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3d7381cb-8976-45d4-bdd3-d09231991954 req-2e3e9b0a-b2db-4572-862f-c2fc880cc108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c", "name": "network-vif-deleted", "tag": "6aae3cde-422e-4638-ab44-4b4e968a722f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:07.151140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3d7381cb-8976-45d4-bdd3-d09231991954 req-2e3e9b0a-b2db-4572-862f-c2fc880cc108 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:07.151804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3d7381cb-8976-45d4-bdd3-d09231991954 req-2e3e9b0a-b2db-4572-862f-c2fc880cc108 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:07.164384 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3d7381cb-8976-45d4-bdd3-d09231991954 req-2e3e9b0a-b2db-4572-862f-c2fc880cc108 service nova] Creating event network-vif-deleted:6aae3cde-422e-4638-ab44-4b4e968a722f for instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c on nch1-master-1 Jun 04 21:21:07.170607 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3d7381cb-8976-45d4-bdd3-d09231991954 req-2e3e9b0a-b2db-4572-862f-c2fc880cc108 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Jun 04 21:21:07.171987 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2703/5301] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:07.306579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:07.310394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:07.325084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:07.326070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:07.327079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:07.327763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:07.363972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:07.364698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:07.365363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lazy-loading 'fault' on Instance uuid 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:21:07.410109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:07.418406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2e7adb2b-9bb2-4365-b7da-5a8d30ca7ce5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 200 len: 1331 microversion: 2.1 time: 0.123723 Jun 04 21:21:07.418991 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2599/5302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:07 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:08.437615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:08.438991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:08.446974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:08.447440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:08.448722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:08.449174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:08.463787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c HTTP/1.1 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c'} Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:08.465545 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a68b9065-2161-4dd2-b338-c5adb87435d5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 404 len: 111 microversion: 2.1 time: 0.034584 Jun 04 21:21:08.469806 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2704/5303] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:08 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:21:08.480415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09f6c047-fb40-4bcf-a7ba-05073d66c6f4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '.version_select at 0x7f2d021f6670>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:08.510285 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09f6c047-fb40-4bcf-a7ba-05073d66c6f4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496873593" status: 202 len: 0 microversion: 2.1 time: 0.037538 Jun 04 21:21:08.511282 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2600/5304] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496873593 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:21:09.214160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a79578df-1b23-47db-8d68-e76dba6b3276 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: .version_select at 0x7f2d00ec5790>, body: {"keypair": {"name": "tempest-keypair-1892920326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3Ds2HySTKR/dEz2zFzjzF2ej4eXn3zTlZkCLlKZhxDU3kho9BWIOqwU1XMtheiawdI5uFwLotU8CZ+4pX2Qup9fARwo64MEyeQk13K4KbV8v5jts9xejtJQjNf7wqWTA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:09.230016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a79578df-1b23-47db-8d68-e76dba6b3276 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:21:09.235362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a79578df-1b23-47db-8d68-e76dba6b3276 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:21:09.260698 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a79578df-1b23-47db-8d68-e76dba6b3276 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051940 Jun 04 21:21:09.261314 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2705/5305] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:21:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:11.071409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1541433983", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "403e6571-3f00-4d79-b35c-182d28b6747c"}], "security_groups": [{"name": "tempest-securitygroup--470741217"}], "key_name": "tempest-keypair-1892920326", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:11.252016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] validate_networks() for [('403e6571-3f00-4d79-b35c-182d28b6747c', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:21:11.818646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:21:11.819151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:21:11.819645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:21:11.820681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:21:11.821371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:21:11.832965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:11.833408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:11.834421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:11.835028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:11.853274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:21:11.859142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:21:11.873022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:21:11.876373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:21:11.928089 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9510c15d-e183-4e3e-aac2-7d52ae262f4c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.862793 Jun 04 21:21:11.928984 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2601/5306] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:21:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:21:11.939899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e77d1ca2-417d-4b3f-a4b5-ae3c4706c44f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:11.947704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e77d1ca2-417d-4b3f-a4b5-ae3c4706c44f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:12.062005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e77d1ca2-417d-4b3f-a4b5-ae3c4706c44f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:12.097285 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e77d1ca2-417d-4b3f-a4b5-ae3c4706c44f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1242 microversion: 2.1 time: 0.160364 Jun 04 21:21:12.099446 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2706/5307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:11 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:13.121098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:13.121883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:13.133557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:13.134122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:13.135225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:13.135770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:13.232005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:13.242340 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c2a8b94-138c-4078-aa67-a8883d241e24 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1302 microversion: 2.1 time: 0.130832 Jun 04 21:21:13.243402 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2602/5308] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:13 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:14.264393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:14.268379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:14.278331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:14.279254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:14.280424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:14.281315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:14.781098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:14.790277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b610075-f989-47f8-8f44-b77974f03caa tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.533421 Jun 04 21:21:14.790899 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2707/5309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:14 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:15.234871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e825895c-8d0e-487d-a0a3-50a809ed1d9a req-5cd08866-92ff-4157-b953-7608d16448d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b2eec7-5489-4539-bbf2-2383265135e1", "tag": "4c676620-9de1-44b0-a77e-8c006c419ad5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:15.246056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e825895c-8d0e-487d-a0a3-50a809ed1d9a req-5cd08866-92ff-4157-b953-7608d16448d5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:15.246504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e825895c-8d0e-487d-a0a3-50a809ed1d9a req-5cd08866-92ff-4157-b953-7608d16448d5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:15.267405 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e825895c-8d0e-487d-a0a3-50a809ed1d9a req-5cd08866-92ff-4157-b953-7608d16448d5 service nova] Creating event network-changed:4c676620-9de1-44b0-a77e-8c006c419ad5 for instance 82b2eec7-5489-4539-bbf2-2383265135e1 on nch1-master-1 Jun 04 21:21:15.279671 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e825895c-8d0e-487d-a0a3-50a809ed1d9a req-5cd08866-92ff-4157-b953-7608d16448d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048522 Jun 04 21:21:15.280899 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2603/5310] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:15.808877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:15.809508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:15.819008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:15.819543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:15.820813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:15.821391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:15.975898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:15.984257 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45b8a507-cef1-45e7-ba83-5723e7f42de8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.180231 Jun 04 21:21:15.984993 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2708/5311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:15 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:17.003753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:17.004512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:17.011682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:17.012512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:17.013291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:17.013728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:17.239113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:17.251841 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-044fa6cd-3c9d-47b7-9cda-383193ba3a02 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.253967 Jun 04 21:21:17.261420 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2604/5312] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:16 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:18.270084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:18.270702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:18.279915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:18.280363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:18.281348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:18.281799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:18.430213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:18.446685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61afe2a0-8588-4fb0-a60f-1bcdad2ceec2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.181025 Jun 04 21:21:18.447316 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2709/5313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:18 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:19.467952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:19.468597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:19.478489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:19.478940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:19.479913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:19.480346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:19.642348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:19.651469 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c028b686-0d10-4ca6-acd4-d99445440b1c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.191212 Jun 04 21:21:19.652215 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2605/5314] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:19 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:20.670938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:20.671836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:20.679326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:20.679831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:20.680721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:20.681155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:20.835150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:20.843355 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2272d7cf-a94a-40b2-b97e-6de597e19d3c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.177542 Jun 04 21:21:20.843968 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2710/5315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:20 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:21.870827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:21.872299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:21.875585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:21.876902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:21.883301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:21.883792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:21.884629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:21.889096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:21.994342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3b2a3692-5490-4b5a-ae7a-8d3dbfe319ba req-b77743a9-2600-487a-99b3-fe9cf03b122a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2eec7-5489-4539-bbf2-2383265135e1", "name": "network-vif-plugged", "status": "completed", "tag": "4c676620-9de1-44b0-a77e-8c006c419ad5"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:22.011556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b2a3692-5490-4b5a-ae7a-8d3dbfe319ba req-b77743a9-2600-487a-99b3-fe9cf03b122a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.012550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b2a3692-5490-4b5a-ae7a-8d3dbfe319ba req-b77743a9-2600-487a-99b3-fe9cf03b122a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.033500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3b2a3692-5490-4b5a-ae7a-8d3dbfe319ba req-b77743a9-2600-487a-99b3-fe9cf03b122a service nova] Creating event network-vif-plugged:4c676620-9de1-44b0-a77e-8c006c419ad5 for instance 82b2eec7-5489-4539-bbf2-2383265135e1 on nch1-master-1 Jun 04 21:21:22.042880 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3b2a3692-5490-4b5a-ae7a-8d3dbfe319ba req-b77743a9-2600-487a-99b3-fe9cf03b122a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052613 Jun 04 21:21:22.045149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2711/5316] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:22.079404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:22.095493 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6bf8f5fb-46fb-4320-b19c-f884c749d03e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.237271 Jun 04 21:21:22.097307 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2606/5317] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:21 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:22.450489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:22.457041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:22.458153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:22.465613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.466071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.466857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.467300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.499101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5220286b-0784-4f2e-9397-eb5365b2de46 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051139 Jun 04 21:21:22.500042 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2712/5318] 10.222.0.18 () {60 vars in 1342 bytes} [Sat Jun 4 21:21:22 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:22.563220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:22.563779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:22.570764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.571419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.572281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.572718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.601321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:21:22.707353 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b591f93-82e5-4434-a354-38715d2a7321 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 204 len: 0 microversion: 2.20 time: 0.148550 Jun 04 21:21:22.708012 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2607/5319] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:21:22 2022] DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:21:22.716446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:22.717079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:22.725362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.726155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.726992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:22.727426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:22.970860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:22.982791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:22.984709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:22.986028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-958b8b0e-113b-4ca1-a065-846f8ddcf420 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.273577 Jun 04 21:21:22.986606 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2713/5320] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:21:22 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:21:23.113596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:23.114298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:23.122259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:23.122714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:23.123543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:23.123983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:23.129519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:23.265788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:23.273928 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-273bf957-6578-4750-893b-94d90b93bed5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.164759 Jun 04 21:21:23.274530 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2608/5321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:23 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:24.005149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:24.006571 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:24.014173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:24.014683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:24.015802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:24.016472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:24.032456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:24.248080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:24.262662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:24.264308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:24.266115 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6c22dcfb-8625-400b-947d-936e20a92a0d tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1722 microversion: 2.20 time: 0.264752 Jun 04 21:21:24.266684 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2714/5322] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:21:23 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:21:24.292216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:24.295198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:24.305546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:24.306336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:24.307559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:24.308321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:24.476265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:24.484385 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c500271f-0248-491d-b59f-fdc0d8b0dce4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1367 microversion: 2.1 time: 0.197835 Jun 04 21:21:24.484975 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2609/5323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:24 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:25.285583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:25.286325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:25.295914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:25.296390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:25.297920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:25.298560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:25.401075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:25.409647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:25.411196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bff665dac5de4530ab70f20ba2da386d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7752a37a5984bc99d2acfcc327fc14e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:25.412429 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6bba9759-e9f5-4fe4-81a7-698c24978cec tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 200 len: 1654 microversion: 2.20 time: 0.131165 Jun 04 21:21:25.413192 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2715/5324] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:21:25 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 1654 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 04 21:21:25.457209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:25.458347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:25.466732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:25.467567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:25.468607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:25.469222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:25.501348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:25.502020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:25.510726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:25.511742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:25.521511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:25.522179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:25.581833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lazy-loading 'services' on Instance uuid 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:21:25.676559 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e97b8642-cdea-4429-b23d-486cca876b84 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "DELETE /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f/os-volume_attachments/1cc49d5c-997d-437a-81e2-dc8b803becae" status: 202 len: 0 microversion: 2.1 time: 0.222686 Jun 04 21:21:25.677184 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2610/5325] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:21:25 2022] DELETE /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f/os-volume_attachments/1cc49d5c-997d-437a-81e2-dc8b803becae => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:21:26.034766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:26.051313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e9d513ca-1a2b-4b12-9870-3a1d2f5eedd4 req-cecc6280-cbd0-41ee-b205-0508d0ce9e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264f513d-b165-4c82-ac0c-234e590ca4c9", "name": "network-vif-deleted", "tag": "38f406cd-1186-4487-99c1-50d9601556db"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:26.072532 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-84cd8407-4d8f-463d-93b5-35252597d018 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1556 microversion: 2.1 time: 0.574959 Jun 04 21:21:26.074558 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2716/5326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:25 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1556 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:21:26.091961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:26.092755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:26.096588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e9d513ca-1a2b-4b12-9870-3a1d2f5eedd4 req-cecc6280-cbd0-41ee-b205-0508d0ce9e60 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.097174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e9d513ca-1a2b-4b12-9870-3a1d2f5eedd4 req-cecc6280-cbd0-41ee-b205-0508d0ce9e60 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.100698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.101719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.103121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.103766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.159095 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e9d513ca-1a2b-4b12-9870-3a1d2f5eedd4 req-cecc6280-cbd0-41ee-b205-0508d0ce9e60 service nova] Creating event network-vif-deleted:38f406cd-1186-4487-99c1-50d9601556db for instance 264f513d-b165-4c82-ac0c-234e590ca4c9 on nch1-master-1 Jun 04 21:21:26.175476 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e9d513ca-1a2b-4b12-9870-3a1d2f5eedd4 req-cecc6280-cbd0-41ee-b205-0508d0ce9e60 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133225 Jun 04 21:21:26.176906 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2611/5327] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:26.237850 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4c83e50-006e-4abe-bbd7-093c84335fb3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149892 Jun 04 21:21:26.238611 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2717/5328] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:21:26 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:21:26.434139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:26.439020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:26.462281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.463938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.465496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.465949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.492676 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] HTTP exception thrown: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Request method failure captured: Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 HTTP/1.1 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8uGShlDS5_xAk8RwsSd-_2Ekpju4vKFRjiCh7Xe5WBGZ9H8qBoVD6kmP1SVwqhE1CTwse-1llKA1Jt5kpatYwuim3OHx4OJBTG2-bUBv2HP6Wuysb_SdO6z_6Yqdx2Cl3LOzb9hQ1bOpSkxrSD6hftLFFI9svFRg5fASrlFI-XjFlM Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: bff665dac5de4530ab70f20ba2da386d Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '264f513d-b165-4c82-ac0c-234e590ca4c9'} Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:26.494693 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:26.499049 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:26.500256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Returning 404 to user: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:26.501251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f86db2d-31f3-4b8c-ad6f-24c8694a0e18 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 404 len: 111 microversion: 2.20 time: 0.072683 Jun 04 21:21:26.502014 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2612/5329] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:21:26 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:21:26.513105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87f666a2-a966-4be5-ab61-9058a34523d2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '.version_select at 0x7f2d00ec5820>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:26.552009 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87f666a2-a966-4be5-ab61-9058a34523d2 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-266260891" status: 204 len: 0 microversion: 2.20 time: 0.045114 Jun 04 21:21:26.553097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2718/5330] 10.222.0.18 () {60 vars in 1258 bytes} [Sat Jun 4 21:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-266260891 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 04 21:21:26.841280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:26.842626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:26.852700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.853167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.853922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:26.855394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:26.892248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:21:27.005251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:21:27.047280 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-58a0bd5a-5af5-4dd9-956f-c7d0b597c60c tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "DELETE /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 204 len: 0 microversion: 2.1 time: 0.211002 Jun 04 21:21:27.048585 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2613/5331] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:21:26 2022] DELETE /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:21:27.057174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:27.057819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:27.067369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:27.068098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:27.069082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:27.069937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:27.397229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:27.417954 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e2e6d24e-3d35-4f61-bbd4-885424b060bf tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1513 microversion: 2.1 time: 0.364465 Jun 04 21:21:27.420130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2719/5332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:27 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1513 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:27.619585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a40b9734-1d17-4c59-b154-f58017150442 req-7dc51503-4eb1-448f-bed9-9f2b1da31809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b2eec7-5489-4539-bbf2-2383265135e1", "tag": "4c676620-9de1-44b0-a77e-8c006c419ad5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:27.649259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a40b9734-1d17-4c59-b154-f58017150442 req-7dc51503-4eb1-448f-bed9-9f2b1da31809 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:27.650405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a40b9734-1d17-4c59-b154-f58017150442 req-7dc51503-4eb1-448f-bed9-9f2b1da31809 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:27.682249 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a40b9734-1d17-4c59-b154-f58017150442 req-7dc51503-4eb1-448f-bed9-9f2b1da31809 service nova] Creating event network-changed:4c676620-9de1-44b0-a77e-8c006c419ad5 for instance 82b2eec7-5489-4539-bbf2-2383265135e1 on nch1-master-1 Jun 04 21:21:27.690622 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a40b9734-1d17-4c59-b154-f58017150442 req-7dc51503-4eb1-448f-bed9-9f2b1da31809 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077147 Jun 04 21:21:27.693301 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2614/5333] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:21:28.437022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:28.437624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:28.453249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:28.453714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:28.454523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:28.455012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:28.954487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:28.965125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-487f5c76-7c6f-47af-89cc-e69519e6d4a8 tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1513 microversion: 2.1 time: 0.531976 Jun 04 21:21:28.966187 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2720/5334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:28 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:29.203358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:29.204691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:29.213532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:29.214675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:29.215773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:29.216729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:29.239321 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] HTTP exception thrown: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Request method failure captured: Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 HTTP/1.1 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8uGShlDS5_xAk8RwsSd-_2Ekpju4vKFRjiCh7Xe5WBGZ9H8qBoVD6kmP1SVwqhE1CTwse-1llKA1Jt5kpatYwuim3OHx4OJBTG2-bUBv2HP6Wuysb_SdO6z_6Yqdx2Cl3LOzb9hQ1bOpSkxrSD6hftLFFI9svFRg5fASrlFI-XjFlM Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: bff665dac5de4530ab70f20ba2da386d Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '264f513d-b165-4c82-ac0c-234e590ca4c9'} Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:29.242317 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.245804 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.248083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Returning 404 to user: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:29.249159 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f46c656f-594c-4fa2-ba5d-23e7500f0f4b tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 404 len: 111 microversion: 2.20 time: 0.050311 Jun 04 21:21:29.259658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:29.260765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: 264f513d-b165-4c82-ac0c-234e590ca4c9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:29.266526 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2615/5335] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:21:29 2022] DELETE /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:21:29.268643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:29.269119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:29.269937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:29.270393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:29.291597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] HTTP exception thrown: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Request method failure captured: Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 HTTP/1.1 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8uGShlDS5_xAk8RwsSd-_2Ekpju4vKFRjiCh7Xe5WBGZ9H8qBoVD6kmP1SVwqhE1CTwse-1llKA1Jt5kpatYwuim3OHx4OJBTG2-bUBv2HP6Wuysb_SdO6z_6Yqdx2Cl3LOzb9hQ1bOpSkxrSD6hftLFFI9svFRg5fASrlFI-XjFlM Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: bff665dac5de4530ab70f20ba2da386d Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '264f513d-b165-4c82-ac0c-234e590ca4c9'} Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.296647 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Returning 404 to user: Instance 264f513d-b165-4c82-ac0c-234e590ca4c9 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fb3ee5b7-75a8-4ef9-9982-19c8ca8d0b61 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9" status: 404 len: 111 microversion: 2.20 time: 0.042832 Jun 04 21:21:29.301061 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2721/5336] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:21:29 2022] GET /compute/v2.1/servers/264f513d-b165-4c82-ac0c-234e590ca4c9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:21:29.463393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d51b21ed-e9f6-4cb1-9306-95668af073e0 req-78a46a01-30af-4098-a060-19488eed1e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bd436e-97b8-4daa-a414-7fa2d2b5fb0f", "name": "network-vif-deleted", "tag": "b65daf4a-d96a-41ae-9667-fcccc1870a43"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:21:29.480054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d51b21ed-e9f6-4cb1-9306-95668af073e0 req-78a46a01-30af-4098-a060-19488eed1e33 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:29.480512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d51b21ed-e9f6-4cb1-9306-95668af073e0 req-78a46a01-30af-4098-a060-19488eed1e33 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:29.506951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d51b21ed-e9f6-4cb1-9306-95668af073e0 req-78a46a01-30af-4098-a060-19488eed1e33 service nova] Creating event network-vif-deleted:b65daf4a-d96a-41ae-9667-fcccc1870a43 for instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f on nch2-master-1 Jun 04 21:21:29.524155 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d51b21ed-e9f6-4cb1-9306-95668af073e0 req-78a46a01-30af-4098-a060-19488eed1e33 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069988 Jun 04 21:21:29.529240 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2616/5337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:21:29.985134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:30.003271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:30.019639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.028297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.029686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.030291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.109965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.123987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.127695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lazy-loading 'fault' on Instance uuid 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:21:30.225131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59e619953f32406891051e0e029c1670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82e56305a8994e3ca45920448336ba18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:21:30.243726 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a9a2ada4-b55a-4065-916c-076ed0580c0b tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 200 len: 1309 microversion: 2.1 time: 0.262932 Jun 04 21:21:30.244369 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2722/5338] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:29 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 1309 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:21:30.533260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:30.534913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:30.544708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.545161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.546024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.546502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.565434 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] HTTP exception thrown: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Request method failure captured: Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 HTTP/1.1 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8uGShlDS5_xAk8RwsSd-_2Ekpju4vKFRjiCh7Xe5WBGZ9H8qBoVD6kmP1SVwqhE1CTwse-1llKA1Jt5kpatYwuim3OHx4OJBTG2-bUBv2HP6Wuysb_SdO6z_6Yqdx2Cl3LOzb9hQ1bOpSkxrSD6hftLFFI9svFRg5fASrlFI-XjFlM Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: bff665dac5de4530ab70f20ba2da386d Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'c61574d2-73e7-4234-a592-ee9c151ebf69'} Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:30.567878 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.573334 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.575106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Returning 404 to user: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:30.576185 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d522c02f-b637-4b11-9d62-77dd8e2df83f tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 404 len: 111 microversion: 2.20 time: 0.049791 Jun 04 21:21:30.576904 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2617/5339] 10.222.0.18 () {60 vars in 1279 bytes} [Sat Jun 4 21:21:30 2022] DELETE /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:21:30.588450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:30.589226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] [instance: c61574d2-73e7-4234-a592-ee9c151ebf69] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:30.597935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.598623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.600121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:30.600738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:30.618048 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] HTTP exception thrown: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Request method failure captured: Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 HTTP/1.1 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8uGShlDS5_xAk8RwsSd-_2Ekpju4vKFRjiCh7Xe5WBGZ9H8qBoVD6kmP1SVwqhE1CTwse-1llKA1Jt5kpatYwuim3OHx4OJBTG2-bUBv2HP6Wuysb_SdO6z_6Yqdx2Cl3LOzb9hQ1bOpSkxrSD6hftLFFI9svFRg5fASrlFI-XjFlM Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Openstack-Nova-Api-Version: 2.20 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7752a37a5984bc99d2acfcc327fc14e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: d7752a37a5984bc99d2acfcc327fc14e Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1155730873 Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: bff665dac5de4530ab70f20ba2da386d Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1155730873-project Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c61574d2-73e7-4234-a592-ee9c151ebf69'} Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.620006 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:21:30.624167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] Returning 404 to user: Instance c61574d2-73e7-4234-a592-ee9c151ebf69 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:30.625626 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b97f8e9-96b5-4c00-92ea-b50c29234a09 tempest-AttachVolumeShelveTestJSON-1155730873 tempest-AttachVolumeShelveTestJSON-1155730873-project] 10.222.0.18 "GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69" status: 404 len: 111 microversion: 2.20 time: 0.043832 Jun 04 21:21:30.626276 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2723/5340] 10.222.0.18 () {60 vars in 1276 bytes} [Sat Jun 4 21:21:30 2022] GET /compute/v2.1/servers/c61574d2-73e7-4234-a592-ee9c151ebf69 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:21:31.262496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:21:31.263394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] [instance: 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:21:31.272763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:31.273374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:31.274199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:21:31.274808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:21:31.298732 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] HTTP exception thrown: Instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f could not be found. Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Request method failure captured: Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f HTTP/1.1 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8uxPOOI3QKq4OXm51wyDzmw-Ul_YwJ8QSX2Awnf6-Mz94rJi8vzITbSLx1tH-m356CZnxD5z8zKZaDYIZ7yAVUVWLe5HP2uVE-iROntmfnQfWKv0x9vnmjsD6rDa3cJsh6pojHrcCnqi3GpF2Gu8FQzJiOhOqcIWoNyb-jBoemy3c4 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 82e56305a8994e3ca45920448336ba18 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1648955989 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_82e56305a8994e3ca45920448336ba18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82e56305a8994e3ca45920448336ba18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/82e56305a8994e3ca45920448336ba18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/82e56305a8994e3ca45920448336ba18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-VolumesSnapshotTestJSON-1648955989 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 82e56305a8994e3ca45920448336ba18 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1648955989 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-VolumesSnapshotTestJSON-1648955989-project Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 59e619953f32406891051e0e029c1670 Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-VolumesSnapshotTestJSON-1648955989-project Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f could not be found. Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '81bd436e-97b8-4daa-a414-7fa2d2b5fb0f'} Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f could not be found. Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f could not be found. Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:21:31.301162 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f could not be found. Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:21:31.306221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] Returning 404 to user: Instance 81bd436e-97b8-4daa-a414-7fa2d2b5fb0f could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:21:31.306761 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74fa38ab-94b9-452d-8762-22c3b48b9dfc tempest-VolumesSnapshotTestJSON-1648955989 tempest-VolumesSnapshotTestJSON-1648955989-project] 10.222.0.18 "GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f" status: 404 len: 111 microversion: 2.1 time: 0.049201 Jun 04 21:21:31.307437 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2618/5341] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:21:31 2022] GET /compute/v2.1/servers/81bd436e-97b8-4daa-a414-7fa2d2b5fb0f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:22:04.180939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:04.182457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:04.199109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:04.203561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=43 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:04.209681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:04.210592 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:04.212364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:04.213213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:04.252000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9797ca8b-3326-4284-a508-57acd636dafd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/ips" status: 200 len: 148 microversion: 2.1 time: 0.076724 Jun 04 21:22:04.253126 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2724/5342] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:22:04 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/ips => generated 148 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:06.159926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98470abe-f55c-4c36-8d51-fc050f6a1e34"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:06.161842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:06.175248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:06.178580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:06.196621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:06.200019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:06.202307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:06.203436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:06.814944 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3755363c-1c9b-4621-a86f-d05f4f92cf9f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660225 Jun 04 21:22:06.817426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2619/5343] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:22:06 2022] POST /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:12.592735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98470abe-f55c-4c36-8d51-fc050f6a1e34"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:12.594484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:12.603887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:12.604987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:12.606386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:12.607250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:12.778597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Invalid volume: volume 98470abe-f55c-4c36-8d51-fc050f6a1e34 is already attached to instances: 82b2eec7-5489-4539-bbf2-2383265135e1 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments HTTP/1.1 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 74 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: {"volumeAttachment": {"volumeId": "98470abe-f55c-4c36-8d51-fc050f6a1e34"}} Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: exception: Invalid volume: volume 98470abe-f55c-4c36-8d51-fc050f6a1e34 is already attached to instances: 82b2eec7-5489-4539-bbf2-2383265135e1 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '82b2eec7-5489-4539-bbf2-2383265135e1', 'body': {'volumeAttachment': {'volumeId': '98470abe-f55c-4c36-8d51-fc050f6a1e34'}}} Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 98470abe-f55c-4c36-8d51-fc050f6a1e34 is already attached to instances: 82b2eec7-5489-4539-bbf2-2383265135e1 Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:22:12.780618 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 98470abe-f55c-4c36-8d51-fc050f6a1e34 is already attached to instances: 82b2eec7-5489-4539-bbf2-2383265135e1 Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 98470abe-f55c-4c36-8d51-fc050f6a1e34 is already attached to instances: 82b2eec7-5489-4539-bbf2-2383265135e1 Jun 04 21:22:12.786274 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:22:12.801061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 400 to user: Invalid volume: volume 98470abe-f55c-4c36-8d51-fc050f6a1e34 is already attached to instances: 82b2eec7-5489-4539-bbf2-2383265135e1 {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:22:12.804830 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7d5e0de2-1528-4229-a2e6-81b0bc5ce83b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.216650 Jun 04 21:22:12.805749 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2725/5344] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:22:12 2022] POST /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments => generated 174 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:22:12.948291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:12.950161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:12.970302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:12.971313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:12.975334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:12.975857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:13.125983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lazy-loading 'services' on Instance uuid 82b2eec7-5489-4539-bbf2-2383265135e1 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:22:13.244980 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68726f4a-cb80-4ec1-a418-10e1d6278e8a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments/98470abe-f55c-4c36-8d51-fc050f6a1e34" status: 202 len: 0 microversion: 2.1 time: 0.307753 Jun 04 21:22:13.255375 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2620/5345] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:22:12 2022] DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments/98470abe-f55c-4c36-8d51-fc050f6a1e34 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:22:13.258653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:13.259907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:13.271848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:13.272328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:13.276461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:13.276990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:13.349093 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53a4a449-6e7d-431f-88e3-00489f0b84de tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095013 Jun 04 21:22:13.350376 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2726/5346] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:22:13 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:22:13.493334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a5a5ddd-82ec-4d5b-a880-54d552462782 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-287160916", "availability_zone": "foo_zone"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:13.494922 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:13.494922 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:13.496255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.aggregate [None req-9a5a5ddd-82ec-4d5b-a880-54d552462782 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Generated uuid fea63c48-95ee-48c6-9762-5a9a46e25c04 for aggregate {{(pid=137229) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 04 21:22:13.553113 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a5a5ddd-82ec-4d5b-a880-54d552462782 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.251786 Jun 04 21:22:13.556626 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2621/5347] 10.222.0.18 () {60 vars in 1163 bytes} [Sat Jun 4 21:22:13 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:13.566715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-73ffad89-2454-424b-8ffa-7f32ff553e62 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:13.568311 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:13.568311 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:22:13.612035 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-73ffad89-2454-424b-8ffa-7f32ff553e62 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.050505 Jun 04 21:22:13.613287 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2727/5348] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 21:22:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:22:13.628062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-727f5503-ed51-40aa-b481-a7a9737093d0 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:13.630817 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:13.630817 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:13.633545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-727f5503-ed51-40aa-b481-a7a9737093d0 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:13.634243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-727f5503-ed51-40aa-b481-a7a9737093d0 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:13.635737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-727f5503-ed51-40aa-b481-a7a9737093d0 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:13.636442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-727f5503-ed51-40aa-b481-a7a9737093d0 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:13.685310 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-727f5503-ed51-40aa-b481-a7a9737093d0 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065238 Jun 04 21:22:13.687626 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2622/5349] 10.222.0.18 () {58 vars in 1175 bytes} [Sat Jun 4 21:22:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:22:13.702164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e821730-09e2-4deb-9a22-0b0f689b9560 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:13.703274 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:13.703274 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:22:13.730958 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e821730-09e2-4deb-9a22-0b0f689b9560 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.036090 Jun 04 21:22:13.733146 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2728/5350] 10.222.0.18 () {58 vars in 1142 bytes} [Sat Jun 4 21:22:13 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:13.757227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-491150f5-23d0-4973-a043-8e768ea35c6c tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:13.759825 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:13.759825 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:13.771866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491150f5-23d0-4973-a043-8e768ea35c6c tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:13.772634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-491150f5-23d0-4973-a043-8e768ea35c6c tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.229417 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-491150f5-23d0-4973-a043-8e768ea35c6c tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.488675 Jun 04 21:22:14.231072 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2623/5351] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 21:22:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:22:14.241646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a7012e6-d642-46d3-93cb-aac92bfd470b tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:14.242700 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:14.242700 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:22:14.283857 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a7012e6-d642-46d3-93cb-aac92bfd470b tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.046349 Jun 04 21:22:14.286107 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2729/5352] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:22:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:14.305100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9953c3c5-3c70-4f16-852f-5f582b69e63e tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1099405882", "availability_zone": "foo_zone"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:14.307018 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:14.307018 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:14.362939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:14.363938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:14.375145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.375648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.376449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.376900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.478044 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9953c3c5-3c70-4f16-852f-5f582b69e63e tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.178665 Jun 04 21:22:14.479485 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2624/5353] 10.222.0.18 () {60 vars in 1172 bytes} [Sat Jun 4 21:22:14 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:14.498612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0922846-e841-47a5-9e29-9c9632e5242c tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:14.518231 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:14.518231 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:14.540906 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ee29a6d-83ec-4d3f-9b36-ba1716120b22 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.178830 Jun 04 21:22:14.543290 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2730/5354] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:22:14 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1/os-volume_attachments => generated 25 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 04 21:22:14.584421 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0922846-e841-47a5-9e29-9c9632e5242c tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.088813 Jun 04 21:22:14.586314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2625/5355] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 21:22:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:14.604210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-31b07c2c-90a3-454a-b16c-79a0a90866e9 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:14.605203 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:14.605203 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:22:14.616001 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-31b07c2c-90a3-454a-b16c-79a0a90866e9 tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.022687 Jun 04 21:22:14.617919 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2731/5356] 10.222.0.18 () {58 vars in 1151 bytes} [Sat Jun 4 21:22:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:14.629273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a577b917-1c2d-49e7-ba5d-e4963171413a tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:14.630783 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:14.630783 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:14.642675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:14.643206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:14.647905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a577b917-1c2d-49e7-ba5d-e4963171413a tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.650061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a577b917-1c2d-49e7-ba5d-e4963171413a tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.662677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.664810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.667081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.667574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.732974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:22:14.879554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a577b917-1c2d-49e7-ba5d-e4963171413a tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.254462 Jun 04 21:22:14.881599 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2626/5357] 10.222.0.18 () {60 vars in 1193 bytes} [Sat Jun 4 21:22:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:14.916621 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6d29cbc-0161-4a55-bc7e-37fb80ddeb8f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 204 len: 0 microversion: 2.1 time: 0.277942 Jun 04 21:22:14.917835 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2732/5358] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:22:14 2022] DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:22:14.920271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe02e933-77bc-4570-99d5-6c57514560ea tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:14.920835 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:22:14.920835 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:22:14.931911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:14.932733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:14.945557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.949156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.950031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:14.950500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:14.982348 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe02e933-77bc-4570-99d5-6c57514560ea tempest-TestAggregatesBasicOps-865169415 tempest-TestAggregatesBasicOps-865169415-project-admin] 10.222.0.18 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.081072 Jun 04 21:22:15.018367 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2627/5359] 10.222.0.18 () {58 vars in 1154 bytes} [Sat Jun 4 21:22:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 04 21:22:15.515732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:15.527872 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-295e15f3-3faf-4a8b-a5f6-2a423980395e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1680 microversion: 2.1 time: 0.603919 Jun 04 21:22:15.528498 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2733/5360] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:14 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1680 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:15.909182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:15.915608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:15.927076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:15.928121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:15.930358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:15.932564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:16.028478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:22:16.238796 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-afce08c0-f6c4-4d91-9471-95e31bfa0905 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 204 len: 0 microversion: 2.1 time: 0.333802 Jun 04 21:22:16.246025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2628/5361] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:22:15 2022] DELETE /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:22:16.254282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:16.255711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:16.275833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:16.277613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:16.280553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:16.282562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:16.547955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:16.548767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:16.565591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:16.568372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:16.570973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:16.572207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:16.999469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:17.012739 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-34a289f9-ef33-4070-8937-36132391b94f tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1577 microversion: 2.1 time: 0.764603 Jun 04 21:22:17.014594 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2734/5362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:16 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1577 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:17.141471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:17.154509 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da85d979-6353-44d3-83a4-ac7c0c0ae8e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1680 microversion: 2.1 time: 0.611848 Jun 04 21:22:17.164405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2629/5363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:16 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1680 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:22:18.035113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:18.035724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:18.044190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:18.044959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:18.045964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:18.046424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:18.172200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:18.172814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:18.187410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:18.188790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:18.189769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:18.196087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:18.761058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:18.770053 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-63236df9-b95e-4abb-ba4f-f483fdcc57b2 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1577 microversion: 2.1 time: 0.739870 Jun 04 21:22:18.770638 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2735/5364] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:18 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1577 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:19.080155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:19.099790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a365440-8fda-4bf2-b34c-85cd560b49f8 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1680 microversion: 2.1 time: 0.930954 Jun 04 21:22:19.102322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2630/5365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:18 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1680 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:19.792080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:19.793593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:19.801404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:19.802314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:19.804842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:19.805427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:19.972638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-dc84c6d0-5565-4756-a59f-79606c895128 req-54e56d2d-0f52-40b1-baa2-961416b845b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2eec7-5489-4539-bbf2-2383265135e1", "name": "network-vif-deleted", "tag": "4c676620-9de1-44b0-a77e-8c006c419ad5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:19.999714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-dc84c6d0-5565-4756-a59f-79606c895128 req-54e56d2d-0f52-40b1-baa2-961416b845b9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:20.000876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-dc84c6d0-5565-4756-a59f-79606c895128 req-54e56d2d-0f52-40b1-baa2-961416b845b9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:20.030852 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-dc84c6d0-5565-4756-a59f-79606c895128 req-54e56d2d-0f52-40b1-baa2-961416b845b9 service nova] Creating event network-vif-deleted:4c676620-9de1-44b0-a77e-8c006c419ad5 for instance 82b2eec7-5489-4539-bbf2-2383265135e1 on nch1-master-1 Jun 04 21:22:20.049042 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-dc84c6d0-5565-4756-a59f-79606c895128 req-54e56d2d-0f52-40b1-baa2-961416b845b9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080445 Jun 04 21:22:20.052675 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2631/5366] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:20.122253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:20.123225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:20.140457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:20.142385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:20.145846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:20.146591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:20.201178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:20.215924 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-103a90b2-ff6d-4f15-abb6-08a332f41c01 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1577 microversion: 2.1 time: 0.429505 Jun 04 21:22:20.217359 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2736/5367] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:19 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1577 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:20.232132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:20.232760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:20.234849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lazy-loading 'fault' on Instance uuid 82b2eec7-5489-4539-bbf2-2383265135e1 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:22:20.319741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:20.328217 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-620becc6-aefa-4279-a9bd-1c5363deabde tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 200 len: 1332 microversion: 2.1 time: 0.212924 Jun 04 21:22:20.333516 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2632/5368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:20 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 1332 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:21.234273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:21.235674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:21.246122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:21.249512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:21.253564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:21.254035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:21.348878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:21.350745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:21.367252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:21.380448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:21.381487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:21.384057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:21.416291 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 HTTP/1.1 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '82b2eec7-5489-4539-bbf2-2383265135e1'} Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:22:21.417950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:22:21.424749 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0e14828-cb35-403d-896c-b46500e6840b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 404 len: 111 microversion: 2.1 time: 0.074541 Jun 04 21:22:21.429461 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2633/5369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:21 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:22:21.434928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e382428c-f8cf-4dc5-9dac-ed61199c28ae tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '.version_select at 0x7f2d02292f70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:21.435095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:21.450181 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1806e778-35a9-4ac1-bcd3-3c9417344027 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 200 len: 1225 microversion: 2.1 time: 0.218194 Jun 04 21:22:21.454925 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2737/5370] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:21 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 1225 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:21.486413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e382428c-f8cf-4dc5-9dac-ed61199c28ae tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892920326" status: 202 len: 0 microversion: 2.1 time: 0.055027 Jun 04 21:22:21.490610 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2634/5371] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:22:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1892920326 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:22:22.097920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5bc874d0-483d-4635-803b-ebfc0a55a2df req-9bbd6dfd-f93a-47e2-aa60-1669bc2ee0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207467f2-12b2-4371-9c8b-b75021bec1f9", "name": "network-vif-deleted", "tag": "03b7e999-28b3-462c-8d02-95b016363550"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:22.129179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5bc874d0-483d-4635-803b-ebfc0a55a2df req-9bbd6dfd-f93a-47e2-aa60-1669bc2ee0c3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:22.129667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5bc874d0-483d-4635-803b-ebfc0a55a2df req-9bbd6dfd-f93a-47e2-aa60-1669bc2ee0c3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:22.167473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5bc874d0-483d-4635-803b-ebfc0a55a2df req-9bbd6dfd-f93a-47e2-aa60-1669bc2ee0c3 service nova] Creating event network-vif-deleted:03b7e999-28b3-462c-8d02-95b016363550 for instance 207467f2-12b2-4371-9c8b-b75021bec1f9 on nch2-master-1 Jun 04 21:22:22.182781 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5bc874d0-483d-4635-803b-ebfc0a55a2df req-9bbd6dfd-f93a-47e2-aa60-1669bc2ee0c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088509 Jun 04 21:22:22.183417 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2738/5372] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:22.472225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:22.472882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:22.493061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:22.493531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:22.494327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:22.494773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:22.514291 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 HTTP/1.1 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '207467f2-12b2-4371-9c8b-b75021bec1f9'} Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:22:22.516263 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:22:22.522273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:22:22.528131 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2d55906f-5d2b-4280-a882-6bc765cc67cb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 404 len: 111 microversion: 2.1 time: 0.056007 Jun 04 21:22:22.532576 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2635/5373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:22 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:22:22.689976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2019043281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1658442932", "security_groups": [{"name": "tempest-secgroup-smoke-817314561"}], "block_device_mapping_v2": [{"uuid": "6121e434-b2b6-4783-9a4b-90d85dc648ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f8dc4cf-e0c9-460c-b458-27f360b796ed"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:23.175079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-47255d6e-7dd3-4863-b5aa-8b1427a21b8d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: .version_select at 0x7f2d02292550>, body: {"keypair": {"name": "tempest-keypair-1647309054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq6UYOylUQsrcpQrqUuEbtsPpkq0FH0uC4pOf4v04/BhiThVhI9xML3woBnFWP66BGlcDX6Zg79ZRaX4UOc7T3gQeWqfkgXW7qP8ThcUwK/3xjIdLzwVwVMMGS/gvp4Zg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:23.223042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-47255d6e-7dd3-4863-b5aa-8b1427a21b8d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:22:23.240509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-47255d6e-7dd3-4863-b5aa-8b1427a21b8d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:22:23.296317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] validate_networks() for [('4f8dc4cf-e0c9-460c-b458-27f360b796ed', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:22:23.311645 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-47255d6e-7dd3-4863-b5aa-8b1427a21b8d tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144626 Jun 04 21:22:23.320215 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2636/5374] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:22:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:24.054723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:22:24.055308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:22:24.055707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:22:24.056137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:22:24.056765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:22:24.086891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:24.088361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:24.089236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:24.089693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:24.110803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:22:24.121337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:22:24.243389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:22:24.250780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6121e434-b2b6-4783-9a4b-90d85dc648ef',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:22:24.629777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35aeecff-ac94-4434-98aa-a0618acf0fa0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.947213 Jun 04 21:22:24.636503 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2739/5375] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:22:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:22:24.645894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:24.652063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7a4d3cf-3226-4f0f-a34d-3c6201af01bc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:24.652754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7a4d3cf-3226-4f0f-a34d-3c6201af01bc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:25.152897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7a4d3cf-3226-4f0f-a34d-3c6201af01bc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:25.163299 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7a4d3cf-3226-4f0f-a34d-3c6201af01bc tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1095 microversion: 2.1 time: 0.519963 Jun 04 21:22:25.173081 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2637/5376] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:24 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1095 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:22:26.187845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:26.192382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:26.208035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:26.210363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:26.219600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:26.220373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:26.433335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1927780740", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "403e6571-3f00-4d79-b35c-182d28b6747c"}], "security_groups": [{"name": "tempest-securitygroup--2076936722"}], "key_name": "tempest-keypair-1647309054", "user_data": "}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:26.496663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:26.692863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:26.709677 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39bb88db-bb5e-40ae-834a-711536e64574 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1193 microversion: 2.1 time: 0.526204 Jun 04 21:22:26.715214 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2740/5377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:26 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1193 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:26.929769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] validate_networks() for [('403e6571-3f00-4d79-b35c-182d28b6747c', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:22:27.740260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:27.741031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:27.752094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:27.755208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:27.756251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:27.756867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:28.010989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:28.022782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eaf594b6-54f3-4a42-96dd-b6f15ec0a41e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1211 microversion: 2.1 time: 0.286418 Jun 04 21:22:28.035145 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2741/5378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:27 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1211 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:28.987158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:22:28.987837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:22:28.988565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:22:28.989429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:22:28.990014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:22:29.009132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:29.009729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:29.010542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:29.010981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:29.030308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:22:29.036008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Getting quotas for user 6343f086d9584796aba71988b14570f0 and project ed013dca03534a42a3a99593e56d0162. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:22:29.041254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:29.041908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:29.049189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:29.049658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:29.050630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:29.051087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:29.051296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:22:29.053807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:22:29.105989 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-65ce6dfc-24f2-4000-adf9-eda0efe4fa5a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.679480 Jun 04 21:22:29.106852 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2638/5379] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:22:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 2681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:22:29.116739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf0396f3-4349-4ef0-b9e9-f63907672d3e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:29.117462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf0396f3-4349-4ef0-b9e9-f63907672d3e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:29.163991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:29.173721 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e552ba4-aeec-488e-b04f-e2d58cfef894 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1199 microversion: 2.1 time: 0.136911 Jun 04 21:22:29.181808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2742/5380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:29 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1199 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:22:29.210987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf0396f3-4349-4ef0-b9e9-f63907672d3e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:29.222300 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf0396f3-4349-4ef0-b9e9-f63907672d3e tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1242 microversion: 2.1 time: 0.109462 Jun 04 21:22:29.228255 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2639/5381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:29 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:30.190753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:30.191682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:30.209813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:30.213970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:30.217544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:30.222205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:30.238765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:30.239414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:30.254794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:30.256265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:30.260472 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:30.261808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:30.466145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:30.476442 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5edb336f-cde8-41de-9652-b2df2505e17a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1294 microversion: 2.1 time: 0.241653 Jun 04 21:22:30.480859 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2640/5382] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:30 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1294 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:31.127001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5a94945d-d773-4199-8fc3-dc61a8bdef7b req-893cf011-6571-4630-8c44-80707f180ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24219cc5-692b-4ec6-a48b-20e534801889", "tag": "c34e2209-6ec0-4f30-a331-b61451055a72"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:31.140181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5a94945d-d773-4199-8fc3-dc61a8bdef7b req-893cf011-6571-4630-8c44-80707f180ffe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:31.140619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5a94945d-d773-4199-8fc3-dc61a8bdef7b req-893cf011-6571-4630-8c44-80707f180ffe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:31.182049 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5a94945d-d773-4199-8fc3-dc61a8bdef7b req-893cf011-6571-4630-8c44-80707f180ffe service nova] Creating event network-changed:c34e2209-6ec0-4f30-a331-b61451055a72 for instance 24219cc5-692b-4ec6-a48b-20e534801889 on nch2-master-1 Jun 04 21:22:31.222879 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5a94945d-d773-4199-8fc3-dc61a8bdef7b req-893cf011-6571-4630-8c44-80707f180ffe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092350 Jun 04 21:22:31.224198 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2641/5383] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:22:31.405825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:31.422932 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-42441555-2312-4e11-ab48-52f83c4cc596 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1266 microversion: 2.1 time: 1.236368 Jun 04 21:22:31.432930 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2743/5384] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:30 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1266 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:31.503206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:31.504623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:31.528452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:31.533745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:31.534999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:31.535666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:31.685097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:31.696620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-315da9d5-1a50-42f3-8f1d-e9b23e0e3f93 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1300 microversion: 2.1 time: 0.203313 Jun 04 21:22:31.697549 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2642/5385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:31 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1300 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:32.452047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:32.452693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:32.466630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:32.467488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:32.469957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:32.472575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:32.517146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:32.715283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:32.716781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:32.731111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:32.733586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:32.734619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:32.741025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:33.329186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:33.339340 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5f251559-a09e-4f84-bded-33c93df76ac3 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1266 microversion: 2.1 time: 0.894009 Jun 04 21:22:33.340526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2744/5386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:32 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1266 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:33.392758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:33.403992 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e70ed04f-4a79-4267-a87f-0faa9e231f1a tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.692957 Jun 04 21:22:33.414392 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2643/5387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:32 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:34.357576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:34.358888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:34.362839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:34.363911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:34.368929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:34.369664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:34.370857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:34.371455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:34.420961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:34.421748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:34.436335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:34.436806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:34.437663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:34.438053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:34.446966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:35.324775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:35.338855 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-121c5e13-aad0-4906-9dd9-a36c897088bd tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.920831 Jun 04 21:22:35.340563 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2644/5388] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:34 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:35.345917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3df251d7-b2f1-4ded-b564-4e759d921207 req-0f15b7ec-f60d-4292-9704-131d4ea54f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c22bf4-18e0-4d41-8523-5692d220901b", "tag": "a89156a7-f16d-4228-a896-3149fce20fb3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:35.361463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3df251d7-b2f1-4ded-b564-4e759d921207 req-0f15b7ec-f60d-4292-9704-131d4ea54f35 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:35.362865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3df251d7-b2f1-4ded-b564-4e759d921207 req-0f15b7ec-f60d-4292-9704-131d4ea54f35 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:35.381260 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3df251d7-b2f1-4ded-b564-4e759d921207 req-0f15b7ec-f60d-4292-9704-131d4ea54f35 service nova] Creating event network-changed:a89156a7-f16d-4228-a896-3149fce20fb3 for instance 43c22bf4-18e0-4d41-8523-5692d220901b on nch1-master-1 Jun 04 21:22:35.389037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3df251d7-b2f1-4ded-b564-4e759d921207 req-0f15b7ec-f60d-4292-9704-131d4ea54f35 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047118 Jun 04 21:22:35.392523 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2645/5389] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:35.416609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:35.429930 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b82b7d00-3098-475a-97d6-44155dd8e4f7 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1266 microversion: 2.1 time: 1.076540 Jun 04 21:22:35.430699 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2745/5390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:34 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1266 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:36.363076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:36.363076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:36.365727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:36.376433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:36.379806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:36.380679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:36.447034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:36.447714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:36.466558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:36.467036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:36.467892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:36.468352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:36.698093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:36.709691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:36.710598 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5885f5e-1fa6-4e0d-ae39-0b92a807941b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.358034 Jun 04 21:22:36.712823 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2646/5391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:36 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:36.718160 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4264363-ed49-484f-a7df-2ea5d7e8a60e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1266 microversion: 2.1 time: 0.275495 Jun 04 21:22:36.718750 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2746/5392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:36 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:22:37.137523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d1173de9-839d-4458-8ef8-be81c9857e3f req-ba3e9186-fe52-4320-9db3-e6d0fa27a885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24219cc5-692b-4ec6-a48b-20e534801889", "name": "network-vif-plugged", "status": "completed", "tag": "c34e2209-6ec0-4f30-a331-b61451055a72"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:37.160810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d1173de9-839d-4458-8ef8-be81c9857e3f req-ba3e9186-fe52-4320-9db3-e6d0fa27a885 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:37.164606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d1173de9-839d-4458-8ef8-be81c9857e3f req-ba3e9186-fe52-4320-9db3-e6d0fa27a885 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:37.197708 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d1173de9-839d-4458-8ef8-be81c9857e3f req-ba3e9186-fe52-4320-9db3-e6d0fa27a885 service nova] Creating event network-vif-plugged:c34e2209-6ec0-4f30-a331-b61451055a72 for instance 24219cc5-692b-4ec6-a48b-20e534801889 on nch2-master-1 Jun 04 21:22:37.211565 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d1173de9-839d-4458-8ef8-be81c9857e3f req-ba3e9186-fe52-4320-9db3-e6d0fa27a885 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078257 Jun 04 21:22:37.212204 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2647/5393] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:22:37.732376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:37.733852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:37.736923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:37.737595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:37.749334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:37.749789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:37.751281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:37.751905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:37.752712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:37.753608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:37.754845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:37.756352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:38.003190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:38.015311 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-626ae32f-99db-4a86-be72-77bc626ccebf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1266 microversion: 2.1 time: 0.282956 Jun 04 21:22:38.028581 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2648/5394] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:37 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:38.036242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:38.044343 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0e26adc6-0db3-4c7c-947f-084778877fe9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.318646 Jun 04 21:22:38.045646 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2747/5395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:37 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:39.033974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:39.035188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:39.046079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:39.050575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:39.051032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:39.051930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:39.052715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:39.065110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:39.066566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:39.076959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:39.078205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:39.080372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:39.080944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:39.218298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:39.293122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:39.301495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:39.303361 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0d8153e5-93b0-4025-b984-0c28ec616832 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1454 microversion: 2.1 time: 0.274017 Jun 04 21:22:39.314112 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2649/5396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:39 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1454 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:39.314366 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4a4c47d-8835-4254-90e8-646c02f84a01 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.252257 Jun 04 21:22:39.314366 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2748/5397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:39 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:39.328430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:39.329201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:39.336166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:39.336655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:39.337543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:39.338078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:39.504586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:39.514693 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a4b70e8-bab4-42f1-b4d9-1b1b70d16552 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1454 microversion: 2.1 time: 0.190047 Jun 04 21:22:39.515748 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2650/5398] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:39 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:40.331251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:40.332525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:40.339160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:40.339649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:40.340588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:40.341189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:40.660838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:40.675643 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98d16375-f4bd-4c5b-a6fa-dbb7166d4045 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.347991 Jun 04 21:22:40.676645 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2749/5399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:40 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:41.696545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:41.697927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:41.710470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:41.711619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:41.712557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:41.713706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:41.952752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:41.984138 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-88d8c412-a9eb-4709-9f06-bbdfc7252143 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.294658 Jun 04 21:22:41.994895 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2651/5400] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:41 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:41.999693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a947006f-23d1-4c6d-91b4-7b3750d69292 req-8feece10-268c-46fa-ad08-d2282ebdb917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24219cc5-692b-4ec6-a48b-20e534801889", "tag": "c34e2209-6ec0-4f30-a331-b61451055a72"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:42.019292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a947006f-23d1-4c6d-91b4-7b3750d69292 req-8feece10-268c-46fa-ad08-d2282ebdb917 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:42.019784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a947006f-23d1-4c6d-91b4-7b3750d69292 req-8feece10-268c-46fa-ad08-d2282ebdb917 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:42.047320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a947006f-23d1-4c6d-91b4-7b3750d69292 req-8feece10-268c-46fa-ad08-d2282ebdb917 service nova] Creating event network-changed:c34e2209-6ec0-4f30-a331-b61451055a72 for instance 24219cc5-692b-4ec6-a48b-20e534801889 on nch2-master-1 Jun 04 21:22:42.068467 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a947006f-23d1-4c6d-91b4-7b3750d69292 req-8feece10-268c-46fa-ad08-d2282ebdb917 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072706 Jun 04 21:22:42.069102 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2750/5401] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:42.579668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b73929a7-688e-49e6-ade0-1db25c404aa4 req-869059d8-9c20-4ff8-a91d-b193ed0215e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c22bf4-18e0-4d41-8523-5692d220901b", "name": "network-vif-plugged", "status": "completed", "tag": "a89156a7-f16d-4228-a896-3149fce20fb3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:42.602880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b73929a7-688e-49e6-ade0-1db25c404aa4 req-869059d8-9c20-4ff8-a91d-b193ed0215e7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:42.605537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b73929a7-688e-49e6-ade0-1db25c404aa4 req-869059d8-9c20-4ff8-a91d-b193ed0215e7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:42.633148 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b73929a7-688e-49e6-ade0-1db25c404aa4 req-869059d8-9c20-4ff8-a91d-b193ed0215e7 service nova] Creating event network-vif-plugged:a89156a7-f16d-4228-a896-3149fce20fb3 for instance 43c22bf4-18e0-4d41-8523-5692d220901b on nch1-master-1 Jun 04 21:22:42.644395 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b73929a7-688e-49e6-ade0-1db25c404aa4 req-869059d8-9c20-4ff8-a91d-b193ed0215e7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068370 Jun 04 21:22:42.646809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2652/5402] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:43.003060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:43.004875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:43.008112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:22:43.030465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:43.031333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:43.032180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:43.032627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:43.206357 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:43.215829 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78e6ec06-5997-4f2f-a811-d5a8799b4ca5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1368 microversion: 2.1 time: 0.217620 Jun 04 21:22:43.216427 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2751/5403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:42 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:44.235007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:44.236371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:44.253158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:44.253617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:44.255564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:44.256373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:44.526098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:22:44.536261 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fbe174af-e606-41bb-9046-8641f198d30f tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1558 microversion: 2.1 time: 0.307349 Jun 04 21:22:44.548539 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2653/5404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:22:44 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1558 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:22:44.555971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:22:44.556537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:22:44.564515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:44.564974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:44.566270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:44.566870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:44.683895 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-27a8aa50-a747-4709-9422-bd9ae5fa8fe3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133138 Jun 04 21:22:44.685075 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2752/5405] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:22:44 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:22:46.386777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b15a17f4-25d5-4637-bf28-7922fcefdb9e req-edf9b619-ea21-4286-aa77-25b96ea48981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43c22bf4-18e0-4d41-8523-5692d220901b", "tag": "a89156a7-f16d-4228-a896-3149fce20fb3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:22:46.398422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b15a17f4-25d5-4637-bf28-7922fcefdb9e req-edf9b619-ea21-4286-aa77-25b96ea48981 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:22:46.398870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b15a17f4-25d5-4637-bf28-7922fcefdb9e req-edf9b619-ea21-4286-aa77-25b96ea48981 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:22:46.412540 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b15a17f4-25d5-4637-bf28-7922fcefdb9e req-edf9b619-ea21-4286-aa77-25b96ea48981 service nova] Creating event network-changed:a89156a7-f16d-4228-a896-3149fce20fb3 for instance 43c22bf4-18e0-4d41-8523-5692d220901b on nch1-master-1 Jun 04 21:22:46.418230 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b15a17f4-25d5-4637-bf28-7922fcefdb9e req-edf9b619-ea21-4286-aa77-25b96ea48981 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041798 Jun 04 21:22:46.423195 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2654/5406] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:23:21.649798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:21.650826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=44 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:21.655864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:21.656855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:21.667472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:21.667967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:21.669289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:21.669749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:21.699935 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-940ac8d5-dc29-4b52-824c-3528abace2e2 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/ips" status: 200 len: 148 microversion: 2.1 time: 0.052982 Jun 04 21:23:21.700544 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2753/5407] 10.222.0.18 () {58 vars in 1247 bytes} [Sat Jun 4 21:23:21 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/ips => generated 148 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:23:23.225769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:23.227646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=48 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:23:23.233121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdb6ada6-677b-4f08-acc2-cd8fe9b67249"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:23:23.235163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:23.242783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:23.243232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:23.244169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:23.245000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:23.677848 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e44d9404-93ed-43fd-8a8a-d8db09e6dfd6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "POST /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454476 Jun 04 21:23:23.682260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2655/5408] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:23:23 2022] POST /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:23:27.169537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:27.170697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:27.177871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:27.178430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:27.180171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:27.180714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:27.266250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lazy-loading 'services' on Instance uuid 43c22bf4-18e0-4d41-8523-5692d220901b {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:23:27.343264 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7f6a6148-5c36-467a-a278-a3942195d809 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments/fdb6ada6-677b-4f08-acc2-cd8fe9b67249" status: 202 len: 0 microversion: 2.1 time: 0.178555 Jun 04 21:23:27.344382 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2754/5409] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:23:27 2022] DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments/fdb6ada6-677b-4f08-acc2-cd8fe9b67249 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:23:27.356735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:27.364595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:27.379110 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:27.379358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:27.380193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:27.380671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:27.414309 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a52634a5-a9e6-4cb2-8bf4-d034d85b58a5 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065026 Jun 04 21:23:27.415022 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2656/5410] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:23:27 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:23:28.432409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:28.433539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:28.443154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:28.443885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:28.445038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:28.446805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:28.509039 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-86052278-d3d1-4490-8bd0-78737a60fc7c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085642 Jun 04 21:23:28.509561 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2755/5411] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:23:28 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:23:28.587040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:28.587685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:28.595821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:28.596279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:28.597255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:28.597899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:28.636444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:23:28.729701 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ac226df-3ba8-4e7f-b61e-c75721ac529c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 204 len: 0 microversion: 2.1 time: 0.148511 Jun 04 21:23:28.730267 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2657/5412] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:23:28 2022] DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:23:28.740552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:28.741441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:28.748363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:28.749063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:28.750247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:28.751029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:29.347259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:23:29.358132 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5a0a2d5d-534e-44ea-99a8-a9b8bb861526 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1681 microversion: 2.1 time: 0.623061 Jun 04 21:23:29.360077 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2756/5413] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:28 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1681 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:23:30.378597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:30.379497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:30.388523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:30.389084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:30.390237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:30.390972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:30.590581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:23:30.601451 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdf4656b-4502-4179-8a0d-a24baee020a9 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1681 microversion: 2.1 time: 0.227670 Jun 04 21:23:30.602824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2658/5414] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:30 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:23:31.619390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:31.620273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:31.628777 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:31.629626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:31.630584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:31.631289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:31.749549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6343f086d9584796aba71988b14570f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed013dca03534a42a3a99593e56d0162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:23:31.761037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-62e36c16-e64c-414b-b9de-0466447a04e1 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 200 len: 1613 microversion: 2.1 time: 0.145589 Jun 04 21:23:31.772248 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2757/5415] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:31 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 1613 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:23:31.854133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-89f832c9-2faf-4d26-8a14-f15322474865 req-778b80a8-e287-41ca-8c54-8fa4e522a738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43c22bf4-18e0-4d41-8523-5692d220901b", "name": "network-vif-deleted", "tag": "a89156a7-f16d-4228-a896-3149fce20fb3"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:23:31.868755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-89f832c9-2faf-4d26-8a14-f15322474865 req-778b80a8-e287-41ca-8c54-8fa4e522a738 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:31.871530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-89f832c9-2faf-4d26-8a14-f15322474865 req-778b80a8-e287-41ca-8c54-8fa4e522a738 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:31.895499 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-89f832c9-2faf-4d26-8a14-f15322474865 req-778b80a8-e287-41ca-8c54-8fa4e522a738 service nova] Creating event network-vif-deleted:a89156a7-f16d-4228-a896-3149fce20fb3 for instance 43c22bf4-18e0-4d41-8523-5692d220901b on nch1-master-1 Jun 04 21:23:31.905227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-89f832c9-2faf-4d26-8a14-f15322474865 req-778b80a8-e287-41ca-8c54-8fa4e522a738 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056771 Jun 04 21:23:31.908489 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2659/5416] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:23:32.778520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:32.779826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:32.787426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:32.787923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:32.788731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:32.789189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:32.811568 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b HTTP/1.1 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '43c22bf4-18e0-4d41-8523-5692d220901b'} Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:32.813314 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7c585f97-9d68-4b58-a155-da24450de6d4 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 404 len: 111 microversion: 2.1 time: 0.040388 Jun 04 21:23:32.818465 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2758/5417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:32 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:32.825961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db2ec222-48d6-4e3e-9756-f4dc23191d9b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '.version_select at 0x7f2d0bf78ca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:32.852647 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db2ec222-48d6-4e3e-9756-f4dc23191d9b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647309054" status: 202 len: 0 microversion: 2.1 time: 0.030556 Jun 04 21:23:32.869307 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2660/5418] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647309054 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:23:34.912004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:34.912569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:34.920476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:34.921036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:34.921975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:34.922537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:34.938706 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b HTTP/1.1 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '43c22bf4-18e0-4d41-8523-5692d220901b'} Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:34.940461 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d15787f7-c3c1-471b-b375-28bca8934a5b tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 404 len: 111 microversion: 2.1 time: 0.034558 Jun 04 21:23:34.945038 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2759/5419] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:23:34 2022] DELETE /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:34.953067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:34.953882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 43c22bf4-18e0-4d41-8523-5692d220901b] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:34.961885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:34.962733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:34.963752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:34.964135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:34.980368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b HTTP/1.1 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '43c22bf4-18e0-4d41-8523-5692d220901b'} Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:34.982248 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 43c22bf4-18e0-4d41-8523-5692d220901b could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c7bb721-b32d-4d7b-a5c2-bbb9b7d3b3a0 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b" status: 404 len: 111 microversion: 2.1 time: 0.037021 Jun 04 21:23:34.986899 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2661/5420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:34 2022] GET /compute/v2.1/servers/43c22bf4-18e0-4d41-8523-5692d220901b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:36.154531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:36.155125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:36.166914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.167328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.168219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.168675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.185262 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 HTTP/1.1 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '82b2eec7-5489-4539-bbf2-2383265135e1'} Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:36.186890 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.190678 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.192405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:36.193511 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd631022-e62d-4e07-a8e5-f3613fe5cda3 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 404 len: 111 microversion: 2.1 time: 0.043179 Jun 04 21:23:36.194081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2760/5421] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:23:36 2022] DELETE /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:36.203117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:36.203887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 82b2eec7-5489-4539-bbf2-2383265135e1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:36.212484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.212929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.213717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.214236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.232664 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 HTTP/1.1 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '82b2eec7-5489-4539-bbf2-2383265135e1'} Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.234809 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 82b2eec7-5489-4539-bbf2-2383265135e1 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:36.238938 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f9e9900f-ff39-4a96-aefa-201cc4f4035c tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1" status: 404 len: 111 microversion: 2.1 time: 0.037488 Jun 04 21:23:36.240314 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2662/5422] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:36 2022] GET /compute/v2.1/servers/82b2eec7-5489-4539-bbf2-2383265135e1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:23:36.245668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:36.246188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:36.253741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.254245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.255139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.255859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.272426 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e HTTP/1.1 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '24dc3512-ad77-4fee-8873-2430da725e8e'} Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:36.274002 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0ca3dc6-7846-472f-a24c-15d98d907cb6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 404 len: 111 microversion: 2.1 time: 0.033818 Jun 04 21:23:36.278308 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2761/5423] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:23:36 2022] DELETE /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:36.285876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:36.286611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 24dc3512-ad77-4fee-8873-2430da725e8e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:36.294294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.294758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.295687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:36.296263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:36.313103 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e HTTP/1.1 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '24dc3512-ad77-4fee-8873-2430da725e8e'} Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:36.314836 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 24dc3512-ad77-4fee-8873-2430da725e8e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-057ca824-6866-4fae-8d01-74a633397ce6 tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e" status: 404 len: 111 microversion: 2.1 time: 0.035498 Jun 04 21:23:36.319205 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2663/5424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:36 2022] GET /compute/v2.1/servers/24dc3512-ad77-4fee-8873-2430da725e8e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:37.485612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:37.486595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:37.495553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:37.496570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:37.497469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:37.497949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:37.515724 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c HTTP/1.1 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c'} Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:37.517786 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2fad1a78-86b7-400d-ac15-2888298e29da tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 404 len: 111 microversion: 2.1 time: 0.038233 Jun 04 21:23:37.526921 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2762/5425] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:23:37 2022] DELETE /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:23:37.529759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:23:37.530707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] [instance: 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:23:37.539722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:37.540152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:37.541157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:23:37.541755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:23:37.560120 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] HTTP exception thrown: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Request method failure captured: Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c HTTP/1.1 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8xJAxMo-czQw-yoGB0ADjbnBek8ODcB96F5yLqo64JQcjlgvHhxgpm7JCMatBCUz7feXOJY1sGVkA58ETvtl4lRh4h9LaijI41HNT_2cTJ4-HKh77A2CAQ2fUhFmzTQvLRxPx872oCe_kYSrUQQzKUwgNTTzTktDEZtwvS5MdUznMQ Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed013dca03534a42a3a99593e56d0162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed013dca03534a42a3a99593e56d0162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: ed013dca03534a42a3a99593e56d0162 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-475698259 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 6343f086d9584796aba71988b14570f0 Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-AttachVolumeNegativeTest-475698259-project Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c'} Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:23:37.562452 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] Returning 404 to user: Instance 340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-74e09e6a-05b4-4554-a1be-6f7c87355aba tempest-AttachVolumeNegativeTest-475698259 tempest-AttachVolumeNegativeTest-475698259-project] 10.222.0.18 "GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c" status: 404 len: 111 microversion: 2.1 time: 0.038968 Jun 04 21:23:37.570119 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2664/5426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:23:37 2022] GET /compute/v2.1/servers/340a7d6f-3ad3-4b4e-b93e-01ec6b101d1c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:24:32.464906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2022428699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1658442932", "security_groups": [{"name": "tempest-secgroup-smoke-817314561"}], "block_device_mapping_v2": [{"uuid": "cf8fbba4-3ff5-451e-9e8c-477486db525d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f8dc4cf-e0c9-460c-b458-27f360b796ed"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:32.480758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=20 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.482225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.671756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] validate_networks() for [('4f8dc4cf-e0c9-460c-b458-27f360b796ed', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:24:32.953669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:32.954918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:33.170196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:24:33.170711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:24:33.171258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:24:33.172486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:24:33.172922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:24:33.182393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:33.182852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:33.183699 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:33.184145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:33.205354 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:24:33.211472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Getting quotas for user 2356361a22724a45a9213f5b1b4b71fb and project fc6af5f33fb64a17906872b7edb1e049. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:24:33.273119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-335d2146-bcb1-4c06-83d4-c40d0228f77d tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Action: 'create', calling method: .version_select at 0x7f2d0186af70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-699868517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcUs7LS0NGk5tLCd48vpGzoDsBxkL069pVF3kMQgARQ0mMK8OgJHjPcwGqD+6qiuyyVp7zOsFon4AsaREhvSPHWKh/42e67q2hvW5+RXWj3d/gSXqesa5SFkWflvMM58w=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:33.277668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:24:33.279904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf8fbba4-3ff5-451e-9e8c-477486db525d',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:24:33.290675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-335d2146-bcb1-4c06-83d4-c40d0228f77d tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Getting quotas for project 93bbbe3f781e4813951d03770dea2606. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:24:33.296599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-335d2146-bcb1-4c06-83d4-c40d0228f77d tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Getting quotas for user 084f5ad7fb594747bb54d90dad0c3057 and project 93bbbe3f781e4813951d03770dea2606. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:24:33.325781 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-335d2146-bcb1-4c06-83d4-c40d0228f77d tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.377309 Jun 04 21:24:33.327198 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2665/5427] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:24:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:24:33.438665 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2499d773-ec6c-45ea-a4e8-279328a73a45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.978060 Jun 04 21:24:33.439331 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2763/5428] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:24:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:24:33.449619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0e755b14-0c76-4fe0-babc-961e35902fcb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:33.450246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0e755b14-0c76-4fe0-babc-961e35902fcb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:33.756878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0e755b14-0c76-4fe0-babc-961e35902fcb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:33.766638 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0e755b14-0c76-4fe0-babc-961e35902fcb tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1095 microversion: 2.1 time: 0.320992 Jun 04 21:24:33.767226 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2666/5429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:33 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1095 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:34.785535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:34.786300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:34.794331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:34.795207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:34.796413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:34.797138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:34.875142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:34.886219 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89f883f2-a0f2-4132-b516-62b35a1689db tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1201 microversion: 2.1 time: 0.105658 Jun 04 21:24:34.888036 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2764/5430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:34 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:35.905131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:35.905747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:35.915638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:35.916090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:35.916883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:35.917320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:36.178586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:36.187016 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0d1accdd-2e2a-46c6-8720-60fed1d24924 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1278 microversion: 2.1 time: 0.285782 Jun 04 21:24:36.197967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2667/5431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:35 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:37.216440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:37.217167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:37.235363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:37.237431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:37.239114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:37.241156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:37.429257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-40ee2f9a-b35b-402f-83d4-341ff5e9464e req-b60213a9-0e82-49d1-826a-20b1c413b0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5f156c-2bb2-4545-8f32-045cf71ccba3", "tag": "56691486-5807-4d01-b517-89810f46372d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:37.450768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-40ee2f9a-b35b-402f-83d4-341ff5e9464e req-b60213a9-0e82-49d1-826a-20b1c413b0e8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:37.451256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-40ee2f9a-b35b-402f-83d4-341ff5e9464e req-b60213a9-0e82-49d1-826a-20b1c413b0e8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:37.481483 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-40ee2f9a-b35b-402f-83d4-341ff5e9464e req-b60213a9-0e82-49d1-826a-20b1c413b0e8 service nova] Creating event network-changed:56691486-5807-4d01-b517-89810f46372d for instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 on nch1-master-1 Jun 04 21:24:37.498574 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-40ee2f9a-b35b-402f-83d4-341ff5e9464e req-b60213a9-0e82-49d1-826a-20b1c413b0e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516762 Jun 04 21:24:37.499952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2765/5432] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:24:37.605729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:37.615445 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-505fa0aa-cf50-4880-b029-8e0c6058cde5 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.404767 Jun 04 21:24:37.616424 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2668/5433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:37 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:38.636532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:38.637177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:38.645678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:38.647241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:38.648435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:38.649576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:39.004462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:39.013565 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-847cd640-c7ea-4ff4-9961-5bab8120cb45 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.383862 Jun 04 21:24:39.019205 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2766/5434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:38 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:40.038876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:40.040060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:40.048064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:40.048509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:40.049342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:40.050163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:40.254790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:40.272353 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9885519b-9e78-4c03-a227-d82dcb440674 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.239799 Jun 04 21:24:40.273025 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2669/5435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:40 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:41.295197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:41.295868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:41.314771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:41.315310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:41.316182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:41.320261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:41.963998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1069873540-access_point-621093425", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "81ccda79-50d6-4514-861d-808082ec9fe5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-699868517", "security_groups": [{"name": "tempest-secgroup_access--317487169"}, {"name": "tempest-secgroup_general--1565309731"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:41.966329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:41.975342 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-78c5665b-7952-43f1-bc1b-0d13f73b0260 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.686197 Jun 04 21:24:41.983010 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2767/5436] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:41 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:42.233569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] validate_networks() for [('81ccda79-50d6-4514-861d-808082ec9fe5', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:24:42.992522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:42.993166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:43.000749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:43.001480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:43.002477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:43.003150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:43.194877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:43.219688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:43.415942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:43.430653 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79eec662-3344-44b0-8624-0f7bae13d210 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.441997 Jun 04 21:24:43.435769 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2768/5437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:42 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:24:43.595997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:24:43.596483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:24:43.596889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:24:43.597300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:24:43.597718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:24:43.609291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:43.610158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:43.611145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:43.611792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:43.638209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Getting quotas for project 93bbbe3f781e4813951d03770dea2606. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:24:43.653508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Getting quotas for user 084f5ad7fb594747bb54d90dad0c3057 and project 93bbbe3f781e4813951d03770dea2606. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:24:43.676587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:24:43.679088 ncdv-master-1 devstack@n-api.service[137229]: WARNING nova.utils [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1069873540-access_point-621093425 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1069873540-ac Jun 04 21:24:43.680308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:24:43.738490 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-46c2e2be-cf4e-49c7-b077-e1a7068e0c14 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.780521 Jun 04 21:24:43.739758 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2670/5438] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:24:41 2022] POST /compute/v2.1/servers => generated 457 bytes in 1784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:24:43.750413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4cfa3764-1d48-4dfd-b889-ccc9fe9a7604 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:43.751431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4cfa3764-1d48-4dfd-b889-ccc9fe9a7604 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:43.827858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4cfa3764-1d48-4dfd-b889-ccc9fe9a7604 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:43.837678 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4cfa3764-1d48-4dfd-b889-ccc9fe9a7604 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1293 microversion: 2.1 time: 0.091149 Jun 04 21:24:43.839132 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2769/5439] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:43 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:44.454065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:44.456272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:44.471947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:44.472833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:44.473830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:44.474598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:44.663993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:44.674500 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7433f006-3d8c-4811-b9be-7915bd1be955 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.227583 Jun 04 21:24:44.676473 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2671/5440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:44 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:44.857279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:44.858029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:44.872464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:44.873149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:44.874527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:44.874900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:45.077549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3d975099-35b7-4f9b-a442-851dc7490c85 req-de33e833-f080-4d25-9d1f-e9f05f30a14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5f156c-2bb2-4545-8f32-045cf71ccba3", "name": "network-vif-plugged", "status": "completed", "tag": "56691486-5807-4d01-b517-89810f46372d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:45.095230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3d975099-35b7-4f9b-a442-851dc7490c85 req-de33e833-f080-4d25-9d1f-e9f05f30a14b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:45.096062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3d975099-35b7-4f9b-a442-851dc7490c85 req-de33e833-f080-4d25-9d1f-e9f05f30a14b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:45.098666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:45.118312 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3d975099-35b7-4f9b-a442-851dc7490c85 req-de33e833-f080-4d25-9d1f-e9f05f30a14b service nova] Creating event network-vif-plugged:56691486-5807-4d01-b517-89810f46372d for instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 on nch1-master-1 Jun 04 21:24:45.119093 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78d968e9-c7be-426d-b42f-99a20887f0e2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1353 microversion: 2.1 time: 0.267231 Jun 04 21:24:45.120839 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2672/5441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:44 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1353 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:24:45.132482 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3d975099-35b7-4f9b-a442-851dc7490c85 req-de33e833-f080-4d25-9d1f-e9f05f30a14b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.323442 Jun 04 21:24:45.133171 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2770/5442] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:24:45.693086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:45.693678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:45.700817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:45.701274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:45.702095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:45.702540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:45.911238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:45.921474 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c311db0c-68d0-469e-b308-50a6a11c00a9 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1266 microversion: 2.1 time: 0.232380 Jun 04 21:24:45.923432 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2673/5443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:45 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:46.148670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:46.152402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:46.169191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:46.170106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:46.171089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:46.171739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:46.638162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:46.646834 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9db12db-77b3-44ed-b540-7bde8dcd3771 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.512819 Jun 04 21:24:46.647526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2771/5444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:46 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:46.941839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:46.943367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:46.951729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:46.952647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:46.953701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:46.954377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:47.161037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-8956c4d3-72c6-4ba3-80f2-cd534979a091 req-a3b26246-8bca-46f5-8589-bec15da76cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c1a650-ab88-4d0e-8398-4164b3bdf530", "tag": "02dc3808-c4a0-4963-9fa0-eb62932cc987"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:47.198322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8956c4d3-72c6-4ba3-80f2-cd534979a091 req-a3b26246-8bca-46f5-8589-bec15da76cac service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:47.199177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8956c4d3-72c6-4ba3-80f2-cd534979a091 req-a3b26246-8bca-46f5-8589-bec15da76cac service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:47.205081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:47.218448 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-8956c4d3-72c6-4ba3-80f2-cd534979a091 req-a3b26246-8bca-46f5-8589-bec15da76cac service nova] Creating event network-changed:02dc3808-c4a0-4963-9fa0-eb62932cc987 for instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 on nch2-master-1 Jun 04 21:24:47.222277 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-49eabb9a-dd30-49a9-9b38-65ac2f3910c0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1454 microversion: 2.1 time: 0.284954 Jun 04 21:24:47.223228 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2674/5445] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:46 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1454 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:47.229023 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-8956c4d3-72c6-4ba3-80f2-cd534979a091 req-a3b26246-8bca-46f5-8589-bec15da76cac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079159 Jun 04 21:24:47.229893 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2772/5446] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:24:47.240050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:47.241049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:47.253719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:47.255390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:47.258599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:47.259739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:47.544902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:47.554353 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a373b6f5-bdc0-4ca5-a01a-c8d918f487e0 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1454 microversion: 2.1 time: 0.319051 Jun 04 21:24:47.555578 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2675/5447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:47 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1454 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:47.667819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:47.668506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:47.675645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:47.676607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:47.677586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:47.679093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:47.841349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:47.849336 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c03a6f91-4193-498b-9883-db115002d08e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.188319 Jun 04 21:24:47.850081 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2773/5448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:47 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:48.866925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:48.868388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:48.876602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:48.877448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:48.878388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:48.878925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:49.250980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:49.267057 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6616ee77-2dc1-4378-870d-54ebb8326a60 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.403254 Jun 04 21:24:49.268086 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2676/5449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:48 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:50.267039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cf43e9ad-d717-4daa-826f-31ec7ae0498a req-814e3a0d-b614-4af4-a087-1d8b5df3028c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5f156c-2bb2-4545-8f32-045cf71ccba3", "tag": "56691486-5807-4d01-b517-89810f46372d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:50.278205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cf43e9ad-d717-4daa-826f-31ec7ae0498a req-814e3a0d-b614-4af4-a087-1d8b5df3028c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:50.278676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cf43e9ad-d717-4daa-826f-31ec7ae0498a req-814e3a0d-b614-4af4-a087-1d8b5df3028c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:50.285319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:50.286626 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:50.291159 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cf43e9ad-d717-4daa-826f-31ec7ae0498a req-814e3a0d-b614-4af4-a087-1d8b5df3028c service nova] Creating event network-changed:56691486-5807-4d01-b517-89810f46372d for instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 on nch1-master-1 Jun 04 21:24:50.296321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:50.296721 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cf43e9ad-d717-4daa-826f-31ec7ae0498a req-814e3a0d-b614-4af4-a087-1d8b5df3028c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036653 Jun 04 21:24:50.297222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:50.297732 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2774/5450] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:24:50.298586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:50.299124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:50.558459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:50.571331 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-910fb791-f500-4324-9302-f0c218171044 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.290305 Jun 04 21:24:50.573126 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2677/5451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:50 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:51.591318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:51.592151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:51.599257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:51.600013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:51.600812 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:51.602640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:51.756690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:51.765249 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb5bf208-6777-422c-94c3-4d21fbe9bb3e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.180736 Jun 04 21:24:51.765843 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2775/5452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:51 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:52.783306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:52.784113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:52.791744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:52.792467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:52.793410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:52.794045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:52.973547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:52.987270 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-504799f9-8317-4737-923e-8fc7d518198c tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.208187 Jun 04 21:24:52.988188 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2678/5453] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:52 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:53.367244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d7acfb0f-64cf-4d5a-b999-1c8a71602e86 req-9a3e45a4-7dae-49e3-99ec-ca7eae262669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c1a650-ab88-4d0e-8398-4164b3bdf530", "name": "network-vif-plugged", "status": "completed", "tag": "02dc3808-c4a0-4963-9fa0-eb62932cc987"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:53.381779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d7acfb0f-64cf-4d5a-b999-1c8a71602e86 req-9a3e45a4-7dae-49e3-99ec-ca7eae262669 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:53.386460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d7acfb0f-64cf-4d5a-b999-1c8a71602e86 req-9a3e45a4-7dae-49e3-99ec-ca7eae262669 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:53.401018 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d7acfb0f-64cf-4d5a-b999-1c8a71602e86 req-9a3e45a4-7dae-49e3-99ec-ca7eae262669 service nova] Creating event network-vif-plugged:02dc3808-c4a0-4963-9fa0-eb62932cc987 for instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 on nch2-master-1 Jun 04 21:24:53.408219 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d7acfb0f-64cf-4d5a-b999-1c8a71602e86 req-9a3e45a4-7dae-49e3-99ec-ca7eae262669 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044621 Jun 04 21:24:53.409162 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2776/5454] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:24:54.003934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:54.004779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:54.011743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:54.012618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:54.021967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:54.023151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:54.024676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:54.025130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:54.210340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:54.225440 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c280c29-e1ca-4fd8-862f-c863826531bb tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1470 microversion: 2.1 time: 0.221991 Jun 04 21:24:54.228358 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2679/5455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:54 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:55.245507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:55.246593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:55.252626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:24:55.256988 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:55.257732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:55.259369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:55.259953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:55.545704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:55.560518 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-93ef8e56-49e7-4835-9540-4f4fce265f78 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1641 microversion: 2.1 time: 0.319880 Jun 04 21:24:55.572617 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2777/5456] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:55 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1641 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:55.580538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:55.581693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:55.590029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:55.590749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:55.591826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:55.592493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:55.833734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:24:55.843853 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e4063fe9-f7d2-4fb0-99ef-6c0e96e83a82 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1641 microversion: 2.1 time: 0.269924 Jun 04 21:24:55.844597 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2680/5457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:55 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1641 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:24:55.862122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:24:55.863263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:24:55.871255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:55.871987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:55.872941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:55.873585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:56.403685 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-12c97c51-53e0-48e0-86cc-ca6502fd95e3 tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1792 microversion: 2.1 time: 0.545733 Jun 04 21:24:56.408988 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2778/5458] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:24:55 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1792 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:24:59.421611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-31811eef-2932-465a-b75d-62c0a0aa5007 req-9cec42bb-f5fa-44be-afb0-4380aa181f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c1a650-ab88-4d0e-8398-4164b3bdf530", "tag": "02dc3808-c4a0-4963-9fa0-eb62932cc987"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:24:59.434485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-31811eef-2932-465a-b75d-62c0a0aa5007 req-9cec42bb-f5fa-44be-afb0-4380aa181f06 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:24:59.434942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-31811eef-2932-465a-b75d-62c0a0aa5007 req-9cec42bb-f5fa-44be-afb0-4380aa181f06 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:24:59.451325 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-31811eef-2932-465a-b75d-62c0a0aa5007 req-9cec42bb-f5fa-44be-afb0-4380aa181f06 service nova] Creating event network-changed:02dc3808-c4a0-4963-9fa0-eb62932cc987 for instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 on nch2-master-1 Jun 04 21:24:59.457686 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-31811eef-2932-465a-b75d-62c0a0aa5007 req-9cec42bb-f5fa-44be-afb0-4380aa181f06 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039809 Jun 04 21:24:59.458563 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2681/5459] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:25:34.047230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1086215070", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "fc8abb8e-77f9-44af-83f1-2ec70b855279"}], "key_name": "tempest-TestSecurityGroupsBasicOps-699868517", "security_groups": []}, "os:scheduler_hints": {"different_host": ["36c1a650-ab88-4d0e-8398-4164b3bdf530"]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:25:34.056662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:34.058657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=66 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:34.133151 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] validate_networks() for [('fc8abb8e-77f9-44af-83f1-2ec70b855279', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:25:34.732765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:25:34.733211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:25:34.733781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:25:34.734280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:25:34.734769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:25:34.746053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:34.746593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:34.747503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:34.748068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:34.767694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Getting quotas for project 93bbbe3f781e4813951d03770dea2606. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:25:34.773923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Getting quotas for user 084f5ad7fb594747bb54d90dad0c3057 and project 93bbbe3f781e4813951d03770dea2606. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:25:34.788246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:25:34.790851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:25:34.842654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-131ed7b4-a1a6-44ba-a16e-7d599ab35fc4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.800461 Jun 04 21:25:34.843881 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2779/5460] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:25:34 2022] POST /compute/v2.1/servers => generated 361 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:25:34.852287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:34.853268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=82 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:34.857394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f22dd9e2-1272-4c0c-8443-ca46f37d7b7e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:34.858303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f22dd9e2-1272-4c0c-8443-ca46f37d7b7e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:34.944731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f22dd9e2-1272-4c0c-8443-ca46f37d7b7e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:34.952549 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f22dd9e2-1272-4c0c-8443-ca46f37d7b7e tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1241 microversion: 2.1 time: 0.102268 Jun 04 21:25:34.953192 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2682/5461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:34 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:25:35.970548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:35.971232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:35.979538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:35.980039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:35.980816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:35.981264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:36.114776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:36.131007 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b452404-e5da-43ed-b0ee-a83b526fde49 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1293 microversion: 2.1 time: 0.165835 Jun 04 21:25:36.131823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2780/5462] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:35 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:37.150549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:37.153332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:37.165272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:37.165998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:37.167009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:37.167891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:37.346192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:37.369787 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-39cf8fee-5f31-402d-9107-d8612bd4d1fa tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.224681 Jun 04 21:25:37.382190 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2683/5463] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:37 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:38.035947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-67bd090b-b1cc-4927-936f-5dd21e6aa164 req-3474ad78-1e00-4309-8398-4865b7c8765c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a80475a-b96b-4954-b7ca-bf8fd1fa8940", "tag": "9a63e115-d0f7-45fc-9e05-99c82b18ac43"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:25:38.046435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-67bd090b-b1cc-4927-936f-5dd21e6aa164 req-3474ad78-1e00-4309-8398-4865b7c8765c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:38.046866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-67bd090b-b1cc-4927-936f-5dd21e6aa164 req-3474ad78-1e00-4309-8398-4865b7c8765c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:38.067825 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-67bd090b-b1cc-4927-936f-5dd21e6aa164 req-3474ad78-1e00-4309-8398-4865b7c8765c service nova] Creating event network-changed:9a63e115-d0f7-45fc-9e05-99c82b18ac43 for instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 on nch1-master-1 Jun 04 21:25:38.075594 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-67bd090b-b1cc-4927-936f-5dd21e6aa164 req-3474ad78-1e00-4309-8398-4865b7c8765c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042629 Jun 04 21:25:38.077442 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2781/5464] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:25:38.388115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:38.390364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:38.398268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:38.398829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:38.400325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:38.401133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:38.555759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:38.569591 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b44d2dc-ce1d-42f9-8e17-10b84a4dec12 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.185838 Jun 04 21:25:38.570221 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2684/5465] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:38 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:39.589420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:39.590166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:39.597380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:39.597848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:39.598890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:39.599450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:39.729491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:39.738113 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04bdd719-3fa0-4796-8659-2edb10b9fb8a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.154696 Jun 04 21:25:39.738773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2782/5466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:39 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:40.758029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:40.758762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:40.769252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:40.770365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:40.771436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:40.771890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:40.944059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:40.957183 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9546d93f-f896-49e4-8740-8d31b198c3b2 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.203888 Jun 04 21:25:40.958033 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2685/5467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:40 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:41.974809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:41.975559 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:41.984095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:41.984444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:41.985337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:41.985848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:42.084418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:42.094177 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9919ad63-b289-4a03-a34a-99497e6f1221 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.123436 Jun 04 21:25:42.094773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2783/5468] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:41 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:25:42.834228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c40900af-89ab-47f9-8a96-e24e90713a9a req-fc2f55ea-224a-4b9c-a2cc-90322cad2f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a80475a-b96b-4954-b7ca-bf8fd1fa8940", "name": "network-vif-plugged", "status": "completed", "tag": "9a63e115-d0f7-45fc-9e05-99c82b18ac43"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:25:42.847655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c40900af-89ab-47f9-8a96-e24e90713a9a req-fc2f55ea-224a-4b9c-a2cc-90322cad2f47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:42.848600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c40900af-89ab-47f9-8a96-e24e90713a9a req-fc2f55ea-224a-4b9c-a2cc-90322cad2f47 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:42.864224 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c40900af-89ab-47f9-8a96-e24e90713a9a req-fc2f55ea-224a-4b9c-a2cc-90322cad2f47 service nova] Creating event network-vif-plugged:9a63e115-d0f7-45fc-9e05-99c82b18ac43 for instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 on nch1-master-1 Jun 04 21:25:42.871080 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c40900af-89ab-47f9-8a96-e24e90713a9a req-fc2f55ea-224a-4b9c-a2cc-90322cad2f47 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041229 Jun 04 21:25:42.872288 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2686/5469] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:25:43.113164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:43.113974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:43.121528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:43.122033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:43.122871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:43.123471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:43.213859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:43.222767 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9035a558-e6e9-4749-b6d8-6b3512565859 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.114341 Jun 04 21:25:43.223772 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2784/5470] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:43 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:44.243648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:44.244391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:44.252044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:44.252600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:44.253539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:44.254015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:44.349953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:44.358394 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-509efcb7-03a8-46f7-928e-7418559a2eb7 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1299 microversion: 2.1 time: 0.120819 Jun 04 21:25:44.360724 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2687/5471] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:44 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:45.379438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:45.380128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:45.383332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:45.384102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:45.401468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.402309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.404344 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.404928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.501131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:45.509803 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-12c5a949-b9da-4806-922b-66d3dfca99c4 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1472 microversion: 2.1 time: 0.134819 Jun 04 21:25:45.510361 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2785/5472] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:45 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1472 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:45.527143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:45.527789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:45.529856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:25:45.536489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.536941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.537722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.538325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.623986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:45.632549 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da0fb6a8-1cdf-4a5a-ab69-1a7021526c81 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1472 microversion: 2.1 time: 0.109715 Jun 04 21:25:45.633185 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2688/5473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:45 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:45.649447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:45.650079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:45.656696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.657208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.657965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.658413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.747043 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-042fdbc0-9b43-46ca-92f1-6b7fe1d5fadb tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1623 microversion: 2.1 time: 0.101331 Jun 04 21:25:45.747772 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2786/5474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:45 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1623 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:45.765481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:45.766130 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:45.773085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.773634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.774513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:45.774959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:45.922133 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c3841009-4454-4c2d-ad5d-ee7dfe429d5c tempest-TestSecurityGroupsBasicOps-2053290211 tempest-TestSecurityGroupsBasicOps-2053290211-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1911 microversion: 2.1 time: 0.161237 Jun 04 21:25:45.922737 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2689/5475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:45 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1911 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:45.997196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:45.997714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:46.004666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:46.005118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:46.005906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:46.006362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:46.035763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:25:46.131580 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e859d59-1000-4284-94dc-741b9aa565e0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 204 len: 0 microversion: 2.1 time: 0.137988 Jun 04 21:25:46.132217 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2787/5476] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:25:45 2022] DELETE /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:25:46.142627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:46.143335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:46.152581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:46.153058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:46.153877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:46.154680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:46.248337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:46.258323 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-18e455b7-79d9-4eef-a2d4-99d79781beaf tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1478 microversion: 2.1 time: 0.121079 Jun 04 21:25:46.259355 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2690/5477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:46 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1478 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:47.279665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:47.281241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:47.289459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:47.290046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:47.290926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:47.291384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:47.401301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:47.409883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8eaefbfc-b7ca-4125-97d4-50bf7745ff44 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1478 microversion: 2.1 time: 0.136300 Jun 04 21:25:47.410584 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2788/5478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:47 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1478 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:48.244580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bfec12d6-6ed2-4637-a0ed-742adee85872 req-59ab02ba-f052-4079-95f4-df88b12beb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a80475a-b96b-4954-b7ca-bf8fd1fa8940", "name": "network-vif-deleted", "tag": "9a63e115-d0f7-45fc-9e05-99c82b18ac43"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:25:48.253967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bfec12d6-6ed2-4637-a0ed-742adee85872 req-59ab02ba-f052-4079-95f4-df88b12beb49 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:48.254402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bfec12d6-6ed2-4637-a0ed-742adee85872 req-59ab02ba-f052-4079-95f4-df88b12beb49 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:48.276911 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bfec12d6-6ed2-4637-a0ed-742adee85872 req-59ab02ba-f052-4079-95f4-df88b12beb49 service nova] Creating event network-vif-deleted:9a63e115-d0f7-45fc-9e05-99c82b18ac43 for instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 on nch1-master-1 Jun 04 21:25:48.286468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bfec12d6-6ed2-4637-a0ed-742adee85872 req-59ab02ba-f052-4079-95f4-df88b12beb49 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045610 Jun 04 21:25:48.287349 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2691/5479] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:25:48.427531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:48.428685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:48.441375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:48.441811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:48.442623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:48.443114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:48.496246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:48.496861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:48.497346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lazy-loading 'fault' on Instance uuid 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:25:48.546313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:48.556640 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-396124e1-cb78-4fa7-b6ee-2384e19b47d0 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 200 len: 1331 microversion: 2.1 time: 0.133164 Jun 04 21:25:48.563579 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2789/5480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:48 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:49.575536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:49.576267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 9a80475a-b96b-4954-b7ca-bf8fd1fa8940] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:49.588380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:49.588815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:49.589657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:49.590095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:49.608945 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] HTTP exception thrown: Instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 could not be found. Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Request method failure captured: Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 HTTP/1.1 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim82P2QDJL0QndeEv7UCjn3zutVWTGms0PYAO_NfFg7hzdc5o39z3Owhy2qXP54DGtLI_d_TsdrOp2a3L0X3R-YMw749g7iKu5-Ss55vgepu8ijrvNSQCwYU_hZBiYMCBvZ-Ek-O5lsnQu2z50q7VBarAx3SzmldeHhxtP8G-wCilo-I Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 93bbbe3f781e4813951d03770dea2606 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1069873540 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_93bbbe3f781e4813951d03770dea2606"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93bbbe3f781e4813951d03770dea2606"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/93bbbe3f781e4813951d03770dea2606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93bbbe3f781e4813951d03770dea2606"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1069873540 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 93bbbe3f781e4813951d03770dea2606 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1069873540 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestSecurityGroupsBasicOps-1069873540-project Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 084f5ad7fb594747bb54d90dad0c3057 Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1069873540-project Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 could not be found. Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '9a80475a-b96b-4954-b7ca-bf8fd1fa8940'} Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 could not be found. Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 could not be found. Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:25:49.610685 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 could not be found. Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Returning 404 to user: Instance 9a80475a-b96b-4954-b7ca-bf8fd1fa8940 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8c5e67a5-c391-49fa-a6b2-3320ab50c204 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940" status: 404 len: 111 microversion: 2.1 time: 0.041253 Jun 04 21:25:49.616080 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2692/5481] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:49 2022] GET /compute/v2.1/servers/9a80475a-b96b-4954-b7ca-bf8fd1fa8940 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:25:54.101904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:54.102550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:54.112268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:54.113213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:54.114075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:54.114526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:54.155135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:25:54.262615 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6829f3f7-e88c-4939-ab4f-57b9d58414e9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "DELETE /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 204 len: 0 microversion: 2.1 time: 0.164609 Jun 04 21:25:54.264212 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2790/5482] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:25:54 2022] DELETE /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:25:54.279593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:54.279593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:54.285415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:54.285979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:54.286866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:54.287407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:54.344246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ea24da9c-8a9c-4e46-bc52-6eb945115d8e req-a7e6b2e4-a85d-4bf3-8ce3-f7d346616471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c1a650-ab88-4d0e-8398-4164b3bdf530", "tag": "02dc3808-c4a0-4963-9fa0-eb62932cc987"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:25:54.353825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ea24da9c-8a9c-4e46-bc52-6eb945115d8e req-a7e6b2e4-a85d-4bf3-8ce3-f7d346616471 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:54.354270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ea24da9c-8a9c-4e46-bc52-6eb945115d8e req-a7e6b2e4-a85d-4bf3-8ce3-f7d346616471 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:54.367545 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ea24da9c-8a9c-4e46-bc52-6eb945115d8e req-a7e6b2e4-a85d-4bf3-8ce3-f7d346616471 service nova] Creating event network-changed:02dc3808-c4a0-4963-9fa0-eb62932cc987 for instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 on nch2-master-1 Jun 04 21:25:54.374435 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ea24da9c-8a9c-4e46-bc52-6eb945115d8e req-a7e6b2e4-a85d-4bf3-8ce3-f7d346616471 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275155 Jun 04 21:25:54.379351 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2693/5483] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:25:54.471377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:54.480696 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b225c1cf-2b0f-4f81-a7fc-0785a7e18bff tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1766 microversion: 2.1 time: 0.211575 Jun 04 21:25:54.481367 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2791/5484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:54 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1766 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:55.500581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:55.502124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:55.509343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:55.509906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:55.510743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:55.511389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:55.852064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '084f5ad7fb594747bb54d90dad0c3057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93bbbe3f781e4813951d03770dea2606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:25:55.861583 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a671dbc7-d335-41d6-ae76-73d88e5b3533 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 200 len: 1766 microversion: 2.1 time: 0.366517 Jun 04 21:25:55.862260 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2694/5485] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:55 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 1766 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:25:56.395950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-57b8c97b-bc4d-4f78-bef3-6563c01608f0 req-e00e70b2-23d8-453a-a09f-bfa12504d05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c1a650-ab88-4d0e-8398-4164b3bdf530", "name": "network-vif-deleted", "tag": "02dc3808-c4a0-4963-9fa0-eb62932cc987"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:25:56.405941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-57b8c97b-bc4d-4f78-bef3-6563c01608f0 req-e00e70b2-23d8-453a-a09f-bfa12504d05a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:56.406764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-57b8c97b-bc4d-4f78-bef3-6563c01608f0 req-e00e70b2-23d8-453a-a09f-bfa12504d05a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:56.418773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-57b8c97b-bc4d-4f78-bef3-6563c01608f0 req-e00e70b2-23d8-453a-a09f-bfa12504d05a service nova] Creating event network-vif-deleted:02dc3808-c4a0-4963-9fa0-eb62932cc987 for instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 on nch2-master-1 Jun 04 21:25:56.424149 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-57b8c97b-bc4d-4f78-bef3-6563c01608f0 req-e00e70b2-23d8-453a-a09f-bfa12504d05a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Jun 04 21:25:56.427995 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2792/5486] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:25:56.880000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:25:56.881901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] [instance: 36c1a650-ab88-4d0e-8398-4164b3bdf530] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:25:56.890571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:56.891428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:56.892284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:25:56.892761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:25:56.908206 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] HTTP exception thrown: Instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 could not be found. Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Request method failure captured: Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 HTTP/1.1 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim82P2QDJL0QndeEv7UCjn3zutVWTGms0PYAO_NfFg7hzdc5o39z3Owhy2qXP54DGtLI_d_TsdrOp2a3L0X3R-YMw749g7iKu5-Ss55vgepu8ijrvNSQCwYU_hZBiYMCBvZ-Ek-O5lsnQu2z50q7VBarAx3SzmldeHhxtP8G-wCilo-I Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 93bbbe3f781e4813951d03770dea2606 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1069873540 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_93bbbe3f781e4813951d03770dea2606"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93bbbe3f781e4813951d03770dea2606"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/93bbbe3f781e4813951d03770dea2606"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/93bbbe3f781e4813951d03770dea2606"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1069873540 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 93bbbe3f781e4813951d03770dea2606 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1069873540 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestSecurityGroupsBasicOps-1069873540-project Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 084f5ad7fb594747bb54d90dad0c3057 Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1069873540-project Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 could not be found. Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '36c1a650-ab88-4d0e-8398-4164b3bdf530'} Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 could not be found. Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 could not be found. Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:25:56.910458 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 could not be found. Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Returning 404 to user: Instance 36c1a650-ab88-4d0e-8398-4164b3bdf530 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e2ecae85-0ff5-445d-8d8a-3d53e645ed9a tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530" status: 404 len: 111 microversion: 2.1 time: 0.036658 Jun 04 21:25:56.915008 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2695/5487] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:25:56 2022] GET /compute/v2.1/servers/36c1a650-ab88-4d0e-8398-4164b3bdf530 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:26:01.699164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-151f4c94-acc2-4814-a7d6-1e217723acc9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] Calling method '.version_select at 0x7f2d00cbaee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:01.728486 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-151f4c94-acc2-4814-a7d6-1e217723acc9 tempest-TestSecurityGroupsBasicOps-1069873540 tempest-TestSecurityGroupsBasicOps-1069873540-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-699868517" status: 202 len: 0 microversion: 2.1 time: 0.034779 Jun 04 21:26:01.729088 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2793/5488] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:26:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-699868517 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:26:15.444378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=30 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:15.446440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=58 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:15.618679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7dbef268-56c4-40ca-a93b-b472b17b6ed0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Action: 'create', calling method: .version_select at 0x7f2d01a35670>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1783708974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgyrZ3h3zc4+gfUO3dH2I5T0BSNXHd0PVnAY15gJ2MAmnAsQLei243rJUVyXriw+sucwVBwkR3eiTr+n+oMHAA2XWvkUv40yu/9yl5ePSweVycDmYoXz+Sxz57JR12ToA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:15.636465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7dbef268-56c4-40ca-a93b-b472b17b6ed0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Getting quotas for project 8209f333d47d4a9e8a0f5e8754927807. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:26:15.641975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7dbef268-56c4-40ca-a93b-b472b17b6ed0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Getting quotas for user 013cb638ecc6411e943c2056b813059d and project 8209f333d47d4a9e8a0f5e8754927807. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:26:15.669974 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7dbef268-56c4-40ca-a93b-b472b17b6ed0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.232273 Jun 04 21:26:15.670587 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2696/5489] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:26:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:17.074763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:17.075629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:17.082155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-269277796", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1783708974", "security_groups": [{"name": "tempest-secgroup-smoke-230702289"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "6e76d609-c438-46a1-b917-6c033d3ac7f4"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:17.222088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] validate_networks() for [('6e76d609-c438-46a1-b917-6c033d3ac7f4', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:26:17.674802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Getting quotas for project 8209f333d47d4a9e8a0f5e8754927807. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:26:17.680450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Getting quotas for user 013cb638ecc6411e943c2056b813059d and project 8209f333d47d4a9e8a0f5e8754927807. Resources: dict_keys(['metadata_items']) {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:26:17.693603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:26:17.694044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:26:17.694538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:26:17.694964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:26:17.695398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:26:17.703955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:17.704416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:17.705234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:17.705960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:17.731150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Getting quotas for project 8209f333d47d4a9e8a0f5e8754927807. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:26:17.737427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Getting quotas for user 013cb638ecc6411e943c2056b813059d and project 8209f333d47d4a9e8a0f5e8754927807. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:26:17.752970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:26:17.756255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:26:17.816229 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05f3d91b-bc6a-464f-bb06-1db7e3c4735e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.742308 Jun 04 21:26:17.819268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2794/5490] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:26:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:26:17.827887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0d2b567b-5d44-4689-8ab4-4b3eeaa2e770 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:17.829036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0d2b567b-5d44-4689-8ab4-4b3eeaa2e770 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:17.942447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0d2b567b-5d44-4689-8ab4-4b3eeaa2e770 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:17.958504 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0d2b567b-5d44-4689-8ab4-4b3eeaa2e770 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1302 microversion: 2.1 time: 0.130850 Jun 04 21:26:17.959077 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2697/5491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:17 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:18.977206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:18.978731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:18.990103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:18.990606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:18.991397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:18.991882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:19.152224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:19.162210 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3421580f-c69a-4add-96a7-d659f68e1f1b tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1354 microversion: 2.1 time: 0.190092 Jun 04 21:26:19.162849 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2795/5492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:18 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:20.182590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:20.184621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:20.195202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:20.196314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:20.197277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:20.197903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:20.396637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:20.405915 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7816ee83-ecba-4d8b-b5c7-b8ce77b5cf03 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.229339 Jun 04 21:26:20.406920 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2698/5493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:20 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:21.106229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-701b13da-4578-4b33-803c-e4b0e296d0e4 req-6ac2783d-de28-4eb2-8aa5-bf4fe7abcb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f118d316-cff3-4c7d-bc11-fe5edd86b5cc", "tag": "bfec44d6-64be-48d7-9d6b-743e8d4cea4c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:21.121941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-701b13da-4578-4b33-803c-e4b0e296d0e4 req-6ac2783d-de28-4eb2-8aa5-bf4fe7abcb0b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:21.122411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-701b13da-4578-4b33-803c-e4b0e296d0e4 req-6ac2783d-de28-4eb2-8aa5-bf4fe7abcb0b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:21.141911 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-701b13da-4578-4b33-803c-e4b0e296d0e4 req-6ac2783d-de28-4eb2-8aa5-bf4fe7abcb0b service nova] Creating event network-changed:bfec44d6-64be-48d7-9d6b-743e8d4cea4c for instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc on nch2-master-1 Jun 04 21:26:21.147435 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-701b13da-4578-4b33-803c-e4b0e296d0e4 req-6ac2783d-de28-4eb2-8aa5-bf4fe7abcb0b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047734 Jun 04 21:26:21.148670 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2796/5494] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:21.424407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:21.425178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:21.432636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:21.433161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:21.433877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:21.434390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:21.573614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:21.581544 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81e45d7e-65f4-4e2c-bcdd-6b58538bc157 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.161230 Jun 04 21:26:21.582131 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2699/5495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:21 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:22.599004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:22.599884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:22.607716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:22.608195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:22.608977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:22.609422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:22.750013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:22.758488 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cdb811a2-46de-4557-aa0b-cd0b220dcec6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.163735 Jun 04 21:26:22.759047 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2797/5496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:22 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:23.776330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:23.776953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:23.784509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:23.784962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:23.785734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:23.786159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:23.934313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:23.942454 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd3a6a42-3cb3-47a4-b06a-0ad0be2aa2f4 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.170194 Jun 04 21:26:23.943040 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2700/5497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:23 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:24.962622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:24.963221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:24.970770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:24.971233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:24.972046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:24.972494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:25.125097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:25.133955 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb500f11-6ddc-4328-ad79-082f1266436a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.176097 Jun 04 21:26:25.134603 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2798/5498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:24 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:26.155892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:26.156434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:26.163519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:26.163993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:26.164849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:26.165254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:26.307700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:26.315813 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-15edeead-1358-47f8-9980-9c71ed8d9f22 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.164006 Jun 04 21:26:26.316568 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2701/5499] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:26 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:27.333146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:27.333781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:27.341452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:27.342024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:27.342710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:27.343148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:27.488827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:27.498958 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-14acd709-a99e-40b8-9f5b-1c54f9dee8e1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.169692 Jun 04 21:26:27.500384 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2799/5500] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:27 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:27.621324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-13465d3e-fd6c-4156-b71a-a920ab9e758e req-02dfe90b-7aea-46f1-8071-c8dec8f6cb73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f118d316-cff3-4c7d-bc11-fe5edd86b5cc", "name": "network-vif-plugged", "status": "completed", "tag": "bfec44d6-64be-48d7-9d6b-743e8d4cea4c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:27.631683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-13465d3e-fd6c-4156-b71a-a920ab9e758e req-02dfe90b-7aea-46f1-8071-c8dec8f6cb73 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:27.632190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-13465d3e-fd6c-4156-b71a-a920ab9e758e req-02dfe90b-7aea-46f1-8071-c8dec8f6cb73 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:27.646668 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-13465d3e-fd6c-4156-b71a-a920ab9e758e req-02dfe90b-7aea-46f1-8071-c8dec8f6cb73 service nova] Creating event network-vif-plugged:bfec44d6-64be-48d7-9d6b-743e8d4cea4c for instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc on nch2-master-1 Jun 04 21:26:27.652406 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-13465d3e-fd6c-4156-b71a-a920ab9e758e req-02dfe90b-7aea-46f1-8071-c8dec8f6cb73 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035047 Jun 04 21:26:27.653101 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2702/5501] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:28.148173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:28.149077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:28.326898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b2d63206-8451-4e33-9811-5d5044cea628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: .version_select at 0x7f2d00cb2700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-4821336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERrg8+oWuDHEnBPjPPPTO2U32cUCbjq2TCrs2zVNQUYaNcJuKq5ZYYtzoel6ceuGamKYyp00vjkKhD40CeV+4iHny1XV1etGQN2zJwQuLhCORZLiGQ5j763s2MMfKX89Q=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:28.343276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b2d63206-8451-4e33-9811-5d5044cea628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:26:28.355903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b2d63206-8451-4e33-9811-5d5044cea628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:26:28.388501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b2d63206-8451-4e33-9811-5d5044cea628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.247314 Jun 04 21:26:28.389123 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2800/5502] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:26:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:28.513529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:28.518691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:28.519666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:28.527569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:28.528028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:28.528812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:28.529250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:28.734523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:28.745965 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3054209a-14b9-4082-89fe-db9e10ff1de0 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1427 microversion: 2.1 time: 0.233643 Jun 04 21:26:28.746834 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2703/5503] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:28 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1427 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:29.764676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:29.765327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:29.772203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:29.772684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:29.773487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:29.773914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:30.032408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:30.040624 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae9c21ad-3f21-4ca4-bd39-e13f7d12db8c tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1607 microversion: 2.1 time: 0.281145 Jun 04 21:26:30.041258 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2801/5504] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:29 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1607 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:30.057698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:30.058333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:30.065141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:30.065582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:30.066364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:30.066796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:30.324989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:30.333168 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c268685-b272-4d5c-b696-62a1accebb25 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1607 microversion: 2.1 time: 0.279694 Jun 04 21:26:30.333765 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2704/5505] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:30 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1607 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:30.350512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:30.351221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:30.363654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:30.363654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:30.363654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:30.363654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:30.568905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:30.576914 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4f1e210-95e9-4e41-8722-545e565bb54e tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1607 microversion: 2.1 time: 0.230387 Jun 04 21:26:30.577571 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2802/5506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:30 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1607 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:34.072823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-4e67b409-e24e-491c-8b71-bb41bb173241 req-fd5e8847-f468-494f-8f53-fcca14bb99e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f118d316-cff3-4c7d-bc11-fe5edd86b5cc", "tag": "bfec44d6-64be-48d7-9d6b-743e8d4cea4c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:34.082877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e67b409-e24e-491c-8b71-bb41bb173241 req-fd5e8847-f468-494f-8f53-fcca14bb99e8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:34.083653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-4e67b409-e24e-491c-8b71-bb41bb173241 req-fd5e8847-f468-494f-8f53-fcca14bb99e8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:34.098251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-4e67b409-e24e-491c-8b71-bb41bb173241 req-fd5e8847-f468-494f-8f53-fcca14bb99e8 service nova] Creating event network-changed:bfec44d6-64be-48d7-9d6b-743e8d4cea4c for instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc on nch2-master-1 Jun 04 21:26:34.104893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-4e67b409-e24e-491c-8b71-bb41bb173241 req-fd5e8847-f468-494f-8f53-fcca14bb99e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035705 Jun 04 21:26:34.106218 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2705/5507] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:36.405654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1078645958", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "5dd1b21a-0f43-431f-b602-db15a688b642"}], "key_name": "tempest-TestNetworkAdvancedServerOps-4821336", "security_groups": [{"name": "tempest-secgroup-smoke-845893464"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:36.523978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] validate_networks() for [('5dd1b21a-0f43-431f-b602-db15a688b642', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:26:37.001715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:26:37.002152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:26:37.002637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:26:37.003326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:26:37.004103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:26:37.015182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:37.015692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:37.016542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:37.016987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:37.036439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:26:37.042784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:26:37.057171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:26:37.059857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:26:37.112120 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e6d6992a-877c-43e6-8bec-7cd0e4f8c2fb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711171 Jun 04 21:26:37.113138 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2803/5508] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:26:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:26:37.124452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b55871a8-e43f-48bb-a6e0-4f6f6a65e9b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:37.125169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b55871a8-e43f-48bb-a6e0-4f6f6a65e9b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:37.185033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b55871a8-e43f-48bb-a6e0-4f6f6a65e9b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:37.193604 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b55871a8-e43f-48bb-a6e0-4f6f6a65e9b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1264 microversion: 2.1 time: 0.074200 Jun 04 21:26:37.194225 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2706/5509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:37 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1264 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:38.212135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:38.213420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:38.221294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:38.222014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:38.223166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:38.223867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:38.353134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:38.372227 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-04edd4b5-6264-41af-b9de-b3c5ac51a439 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1324 microversion: 2.1 time: 0.159917 Jun 04 21:26:38.376640 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2804/5510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:38 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:39.389613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:39.390244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:39.401208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:39.401928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:39.402894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:39.403497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:39.672600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:39.681084 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-026dad6b-bb5e-4c24-9503-1fb4e5c9fa24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.295718 Jun 04 21:26:39.681692 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2707/5511] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:39 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:40.101367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-aa6a649a-4a8b-429e-a960-629e2c3564ef req-b522c667-c3ee-4ada-a179-03f33d590dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:40.134147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aa6a649a-4a8b-429e-a960-629e2c3564ef req-b522c667-c3ee-4ada-a179-03f33d590dae service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:40.136148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-aa6a649a-4a8b-429e-a960-629e2c3564ef req-b522c667-c3ee-4ada-a179-03f33d590dae service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:40.150890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-aa6a649a-4a8b-429e-a960-629e2c3564ef req-b522c667-c3ee-4ada-a179-03f33d590dae service nova] Creating event network-changed:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch1-master-1 Jun 04 21:26:40.156623 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-aa6a649a-4a8b-429e-a960-629e2c3564ef req-b522c667-c3ee-4ada-a179-03f33d590dae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059768 Jun 04 21:26:40.157247 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2805/5512] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:40.699281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:40.700042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:40.707648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:40.708096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:40.708877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:40.709337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:40.852506 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:40.863150 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-807e140c-5b2c-4b1c-acd4-0b532c86ef61 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.167937 Jun 04 21:26:40.865951 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2708/5513] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:40 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:40.880717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:40.881341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:40.890511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-cadd1f3d-ac8e-47c7-8633-888d6dc055b4 req-197b1088-ee9e-4265-bceb-497bf7144f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5f156c-2bb2-4545-8f32-045cf71ccba3", "tag": "56691486-5807-4d01-b517-89810f46372d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:40.890795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:40.891530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:40.892946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:40.893622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:40.902266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cadd1f3d-ac8e-47c7-8633-888d6dc055b4 req-197b1088-ee9e-4265-bceb-497bf7144f38 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:40.902849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-cadd1f3d-ac8e-47c7-8633-888d6dc055b4 req-197b1088-ee9e-4265-bceb-497bf7144f38 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:40.920480 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-cadd1f3d-ac8e-47c7-8633-888d6dc055b4 req-197b1088-ee9e-4265-bceb-497bf7144f38 service nova] Creating event network-changed:56691486-5807-4d01-b517-89810f46372d for instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 on nch1-master-1 Jun 04 21:26:40.922958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:26:40.929304 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-cadd1f3d-ac8e-47c7-8633-888d6dc055b4 req-197b1088-ee9e-4265-bceb-497bf7144f38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043667 Jun 04 21:26:40.930402 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2709/5514] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:41.009059 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b593b14-2a79-491f-97b8-bec4ebd90771 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 204 len: 0 microversion: 2.1 time: 0.134417 Jun 04 21:26:41.009703 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2806/5515] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:26:40 2022] DELETE /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:26:41.019125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:41.019942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:41.026493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:41.027050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:41.027931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:41.028436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:41.170292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:41.178942 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d24d1403-e0ad-4e0f-8aa7-914777010be8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1579 microversion: 2.1 time: 0.164237 Jun 04 21:26:41.179672 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2710/5516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:41 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:26:41.882576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:41.883549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:41.891490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:41.891970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:41.892913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:41.893342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:42.031996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:42.042168 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1aa3753a-986b-4d7c-a82f-acb114f09b22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.163839 Jun 04 21:26:42.042689 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2807/5517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:41 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:42.197475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:42.198188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:42.205653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:42.206104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:42.206880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:42.207311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:42.352836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:42.361368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d5fb4953-9280-4ffd-91b0-1bf66f7ef4a1 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1579 microversion: 2.1 time: 0.168407 Jun 04 21:26:42.361962 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2711/5518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:42 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:43.059733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:43.060349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:43.067841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:43.068619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:43.069417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:43.069868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:43.301624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:43.311950 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c203fa3c-96c6-4ee1-b75c-e40d5661c0a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.256198 Jun 04 21:26:43.312839 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2808/5519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:43 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:43.381930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:43.382552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:43.391025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:43.391700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:43.392441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:43.392751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:43.616780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:43.628791 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-37eca083-387c-4b3c-b0cc-8e89d434c2a8 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1579 microversion: 2.1 time: 0.250437 Jun 04 21:26:43.629820 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2712/5520] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:43 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1579 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:44.192348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-67aeff09-e80a-4b4d-8436-a455c4bf005f req-e7d50a3d-b9be-4e69-a3f3-fa619cb9a148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5f156c-2bb2-4545-8f32-045cf71ccba3", "name": "network-vif-deleted", "tag": "56691486-5807-4d01-b517-89810f46372d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:44.203496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-67aeff09-e80a-4b4d-8436-a455c4bf005f req-e7d50a3d-b9be-4e69-a3f3-fa619cb9a148 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:44.203983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-67aeff09-e80a-4b4d-8436-a455c4bf005f req-e7d50a3d-b9be-4e69-a3f3-fa619cb9a148 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:44.216133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-67aeff09-e80a-4b4d-8436-a455c4bf005f req-e7d50a3d-b9be-4e69-a3f3-fa619cb9a148 service nova] Creating event network-vif-deleted:56691486-5807-4d01-b517-89810f46372d for instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 on nch1-master-1 Jun 04 21:26:44.221268 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-67aeff09-e80a-4b4d-8436-a455c4bf005f req-e7d50a3d-b9be-4e69-a3f3-fa619cb9a148 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033050 Jun 04 21:26:44.221873 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2809/5521] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:44.329392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:44.330005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:44.336562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:44.337400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:44.338188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:44.338631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:44.504099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:44.513779 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-29f84ac5-f2b5-446b-8cfb-e690733b50ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.187820 Jun 04 21:26:44.514359 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2713/5522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:44 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:44.647824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:44.648522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:44.656311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:44.656782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:44.657577 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:44.658036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:44.692468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:44.692952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:44.693427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lazy-loading 'fault' on Instance uuid 5b5f156c-2bb2-4545-8f32-045cf71ccba3 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:26:44.739550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:44.748438 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3879b34f-a588-44ac-9c32-3390cda46451 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 200 len: 1231 microversion: 2.1 time: 0.105162 Jun 04 21:26:44.749006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2810/5523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:44 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:45.122345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-f2b42120-d8c1-48ed-9d66-98b47b2977c2 req-a3a0bee4-b1e4-4658-a24f-dc563efcd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "name": "network-vif-plugged", "status": "completed", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:45.131256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f2b42120-d8c1-48ed-9d66-98b47b2977c2 req-a3a0bee4-b1e4-4658-a24f-dc563efcd5a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:45.132098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-f2b42120-d8c1-48ed-9d66-98b47b2977c2 req-a3a0bee4-b1e4-4658-a24f-dc563efcd5a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:45.145566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-f2b42120-d8c1-48ed-9d66-98b47b2977c2 req-a3a0bee4-b1e4-4658-a24f-dc563efcd5a4 service nova] Creating event network-vif-plugged:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch1-master-1 Jun 04 21:26:45.151210 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-f2b42120-d8c1-48ed-9d66-98b47b2977c2 req-a3a0bee4-b1e4-4658-a24f-dc563efcd5a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033210 Jun 04 21:26:45.152379 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2714/5524] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:26:45.530957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:45.531818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:45.539650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:45.540161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:45.541047 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:45.541642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:45.674426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:45.682307 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f407f257-d9ef-4799-a8b8-f15a627ea598 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.155594 Jun 04 21:26:45.682896 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2811/5525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:45 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:45.767995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:45.768706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 5b5f156c-2bb2-4545-8f32-045cf71ccba3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:45.770771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:45.776859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:45.777328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:45.778100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:45.778541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:45.782015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=81 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:45.794344 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 could not be found. Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 HTTP/1.1 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 could not be found. Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '5b5f156c-2bb2-4545-8f32-045cf71ccba3'} Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 could not be found. Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 could not be found. Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:26:45.796069 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 could not be found. Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance 5b5f156c-2bb2-4545-8f32-045cf71ccba3 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4ff69996-7670-4d45-9435-418caeab4458 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3" status: 404 len: 111 microversion: 2.1 time: 0.035217 Jun 04 21:26:45.800464 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2715/5526] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:45 2022] GET /compute/v2.1/servers/5b5f156c-2bb2-4545-8f32-045cf71ccba3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:26:46.700071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:46.700696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:46.708193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:46.708692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:46.709498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:46.710155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:46.851312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:46.855015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:46.860006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df04bad0-e320-4d54-a4f3-cdb656214250 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1389 microversion: 2.1 time: 0.164082 Jun 04 21:26:46.860586 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2812/5527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:46 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:47.881903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:47.882940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:47.886581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:47.896344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:47.897098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:47.898386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:47.899113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:48.038954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:48.047480 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b55197ca-2c04-442d-9a96-94c4c78c84a8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1561 microversion: 2.1 time: 0.172793 Jun 04 21:26:48.048086 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2716/5528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:47 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:48.063900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:48.064659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:48.067045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:48.067847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:48.069551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:26:48.076273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:48.076752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:48.077527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:48.078157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:48.223769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:48.232272 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-754f0e99-b2b2-4054-bc81-9724365d8c8e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1561 microversion: 2.1 time: 0.172421 Jun 04 21:26:48.232859 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2813/5529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:48 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:26:50.238229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:26:50.238827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1f725f3c-6a5f-44f9-8f09-a814b2a867b0 req-f0e5d0c4-c8e3-4710-98a9-74f32650422e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:26:50.240258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:26:50.247911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1f725f3c-6a5f-44f9-8f09-a814b2a867b0 req-f0e5d0c4-c8e3-4710-98a9-74f32650422e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:50.248375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1f725f3c-6a5f-44f9-8f09-a814b2a867b0 req-f0e5d0c4-c8e3-4710-98a9-74f32650422e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:50.249920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:50.250591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:50.251937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:26:50.252642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:26:50.260627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1f725f3c-6a5f-44f9-8f09-a814b2a867b0 req-f0e5d0c4-c8e3-4710-98a9-74f32650422e service nova] Creating event network-changed:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch1-master-1 Jun 04 21:26:50.266466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1f725f3c-6a5f-44f9-8f09-a814b2a867b0 req-f0e5d0c4-c8e3-4710-98a9-74f32650422e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031706 Jun 04 21:26:50.267703 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2814/5530] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:26:50.403867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:26:50.412130 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-081fb78c-d206-4929-b4f0-354a59769920 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1561 microversion: 2.1 time: 0.179487 Jun 04 21:26:50.412721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2717/5531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:26:50 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:04.708790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:04.709839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=8 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:04.713887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:04.714516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:04.721778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:04.722249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:04.723034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:04.723486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:04.750449 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1794f29f-a5f6-468b-a772-d7fc9326dce7 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.043920 Jun 04 21:27:04.751025 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2815/5532] 10.222.0.18 () {58 vars in 1292 bytes} [Sat Jun 4 21:27:04 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc/os-server-password => generated 116 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:27:13.691385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:13.692421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:13.695002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:13.695795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=13 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:13.701574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:13.702028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:13.702807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:13.703249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:13.774275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e203eb0e-7094-4f9c-b83f-7fa20f11d6c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action" status: 200 len: 24575 microversion: 2.1 time: 0.086910 Jun 04 21:27:13.774960 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2718/5533] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:27:13 2022] POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action => generated 24575 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:27:19.216883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:19.218026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:19.220673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-77f2846a-3d78-46e3-9a55-4919cc60ac11 req-e7bc45ff-bbcc-4010-9fc2-c854e730c3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24219cc5-692b-4ec6-a48b-20e534801889", "tag": "c34e2209-6ec0-4f30-a331-b61451055a72"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:19.221109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:19.222059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:19.228446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:19.229038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:19.229894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:19.230183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-77f2846a-3d78-46e3-9a55-4919cc60ac11 req-e7bc45ff-bbcc-4010-9fc2-c854e730c3b5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:19.230493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:19.230635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-77f2846a-3d78-46e3-9a55-4919cc60ac11 req-e7bc45ff-bbcc-4010-9fc2-c854e730c3b5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:19.242280 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-77f2846a-3d78-46e3-9a55-4919cc60ac11 req-e7bc45ff-bbcc-4010-9fc2-c854e730c3b5 service nova] Creating event network-changed:c34e2209-6ec0-4f30-a331-b61451055a72 for instance 24219cc5-692b-4ec6-a48b-20e534801889 on nch2-master-1 Jun 04 21:27:19.247499 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-77f2846a-3d78-46e3-9a55-4919cc60ac11 req-e7bc45ff-bbcc-4010-9fc2-c854e730c3b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Jun 04 21:27:19.248400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2719/5534] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:27:19.259801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:27:19.343975 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f16dcb3-9c5f-4593-8fd2-1456c9731aae tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 204 len: 0 microversion: 2.1 time: 0.130900 Jun 04 21:27:19.344597 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2816/5535] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:27:19 2022] DELETE /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:27:19.354120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:19.355117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:19.367578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:19.368008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:19.369062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:19.369503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:19.520470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:19.529516 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-defedda7-3ba9-40fc-83c7-b80d612e9b8d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1579 microversion: 2.1 time: 0.180103 Jun 04 21:27:19.530109 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2720/5536] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:19 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1579 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:20.549825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:20.550681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:20.558593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:20.559078 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:20.559919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:20.560378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:20.701678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:20.710046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ff658ffd-6dc6-41ff-82cf-498c85329fbf tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1579 microversion: 2.1 time: 0.165172 Jun 04 21:27:20.710649 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2817/5537] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:20 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:21.343894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-af6a27cd-6b7e-4b1e-ab95-ba52af12ee3d req-c3f8a54a-10c9-4302-ab71-3c55e076b268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24219cc5-692b-4ec6-a48b-20e534801889", "name": "network-vif-deleted", "tag": "c34e2209-6ec0-4f30-a331-b61451055a72"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:21.353696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-af6a27cd-6b7e-4b1e-ab95-ba52af12ee3d req-c3f8a54a-10c9-4302-ab71-3c55e076b268 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:21.354139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-af6a27cd-6b7e-4b1e-ab95-ba52af12ee3d req-c3f8a54a-10c9-4302-ab71-3c55e076b268 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:21.366702 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-af6a27cd-6b7e-4b1e-ab95-ba52af12ee3d req-c3f8a54a-10c9-4302-ab71-3c55e076b268 service nova] Creating event network-vif-deleted:c34e2209-6ec0-4f30-a331-b61451055a72 for instance 24219cc5-692b-4ec6-a48b-20e534801889 on nch2-master-1 Jun 04 21:27:21.372139 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-af6a27cd-6b7e-4b1e-ab95-ba52af12ee3d req-c3f8a54a-10c9-4302-ab71-3c55e076b268 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032140 Jun 04 21:27:21.372754 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2721/5538] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:27:21.727196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:21.728606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:21.736541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:21.736999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:21.738062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:21.738526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:21.772346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:21.773205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:21.773952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lazy-loading 'fault' on Instance uuid 24219cc5-692b-4ec6-a48b-20e534801889 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:27:21.817112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2356361a22724a45a9213f5b1b4b71fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc6af5f33fb64a17906872b7edb1e049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:21.825207 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d13c8a51-27a2-4bf3-b2d8-3bba7b251a3e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 200 len: 1231 microversion: 2.1 time: 0.102035 Jun 04 21:27:21.825773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2818/5539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:21 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:22.848545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:22.849691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 24219cc5-692b-4ec6-a48b-20e534801889] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:22.857400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:22.857851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:22.858623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:22.859025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:22.872822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance 24219cc5-692b-4ec6-a48b-20e534801889 could not be found. Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 HTTP/1.1 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 24219cc5-692b-4ec6-a48b-20e534801889 could not be found. Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '24219cc5-692b-4ec6-a48b-20e534801889'} Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24219cc5-692b-4ec6-a48b-20e534801889 could not be found. Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24219cc5-692b-4ec6-a48b-20e534801889 could not be found. Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:27:22.874436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24219cc5-692b-4ec6-a48b-20e534801889 could not be found. Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance 24219cc5-692b-4ec6-a48b-20e534801889 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ab3b705f-d549-4397-a8fb-1a46fc89283d tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889" status: 404 len: 111 microversion: 2.1 time: 0.035874 Jun 04 21:27:22.878585 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2722/5540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:22 2022] GET /compute/v2.1/servers/24219cc5-692b-4ec6-a48b-20e534801889 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:27:23.356542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:23.357186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:23.364465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:23.364932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:23.365862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:23.366317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:23.381176 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: request: DELETE /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 HTTP/1.1 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '207467f2-12b2-4371-9c8b-b75021bec1f9'} Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:27:23.383106 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17c69157-0373-4818-8100-f0e26b7cd83e tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 404 len: 111 microversion: 2.1 time: 0.033097 Jun 04 21:27:23.387351 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2819/5541] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:27:23 2022] DELETE /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:27:23.393940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:23.394560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] [instance: 207467f2-12b2-4371-9c8b-b75021bec1f9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:23.402147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:23.402597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:23.403377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:23.403869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:23.418002 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] HTTP exception thrown: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Request method failure captured: Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 HTTP/1.1 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8vc3t9M_21tEzGL9UF1p62chlw-QedqtpTcxvzEPzV6TEYgvjvq68AyD8KNOvEZMJIdtLk0lK2h4e6EddpKDN1Up_NpX2uPyOtsgdi9d20EUeb6cQvJ5Cq3ItsmHuLOonupvKYGurfeJHznfrNwcqoIfAq_vIIEdNluagdpedHcgP0 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fc6af5f33fb64a17906872b7edb1e049"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: fc6af5f33fb64a17906872b7edb1e049 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestVolumeBootPattern-524389578 Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2356361a22724a45a9213f5b1b4b71fb Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestVolumeBootPattern-524389578-project Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '207467f2-12b2-4371-9c8b-b75021bec1f9'} Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:27:23.419605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Returning 404 to user: Instance 207467f2-12b2-4371-9c8b-b75021bec1f9 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf6bee82-bb06-4303-ac36-3e956ba93344 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9" status: 404 len: 111 microversion: 2.1 time: 0.031112 Jun 04 21:27:23.423536 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2723/5542] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:23 2022] GET /compute/v2.1/servers/207467f2-12b2-4371-9c8b-b75021bec1f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:27:24.891756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:24.892391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:24.900139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:24.900599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:24.901393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:24.901860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.139431 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd7c5b62-d266-4d0b-ae22-5a607ed4746d tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1831 microversion: 2.1 time: 0.252029 Jun 04 21:27:25.140027 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2820/5543] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:24 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1831 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:25.156696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:25.157213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:25.164650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:25.165104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.165883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:25.166324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.307940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:25.315870 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cbed227a-f31f-4323-801b-0f879ad0c6e3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1680 microversion: 2.1 time: 0.163288 Jun 04 21:27:25.316436 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2724/5544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:25 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:25.412034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:25.412926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:25.419332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:25.419849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.420640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:25.421098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.492785 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6995809-2340-4ff5-8fb0-54d4c7b7ccd5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action" status: 200 len: 32639 microversion: 2.1 time: 0.084750 Jun 04 21:27:25.493431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2821/5545] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:27:25 2022] POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action => generated 32639 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:27:25.650778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:25.651376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:25.657773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:25.658228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.659043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:25.659480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:25.754897 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '22b3579138134855aaa83a5c8de93c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629b5e4cfba945fc8761667732bd0b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:25.755543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] flavor_id is None. Assuming migration. {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 04 21:27:25.756017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:27:25.813969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-856360bb-4260-4a25-942c-62c480f85a09 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] Calling method '.version_select at 0x7f2d0185ff70>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:25.839071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-856360bb-4260-4a25-942c-62c480f85a09 tempest-TestVolumeBootPattern-524389578 tempest-TestVolumeBootPattern-524389578-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1658442932" status: 202 len: 0 microversion: 2.1 time: 0.029289 Jun 04 21:27:25.839897 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2822/5546] 10.222.0.18 () {58 vars in 1262 bytes} [Sat Jun 4 21:27:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1658442932 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 04 21:27:26.014829 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5779d5f3-773c-437c-8c2c-aff87e2096a3 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.368432 Jun 04 21:27:26.015556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2725/5547] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:27:25 2022] POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:27:26.030800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:26.032189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:26.040853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:26.041701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:26.042667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:26.043224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:26.298865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:26.308601 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a8f2526a-e976-4e8d-b72a-229ce1b7c229 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1689 microversion: 2.1 time: 0.288123 Jun 04 21:27:26.309431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2823/5548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:26 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1689 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:27.327932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:27.329404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:27.340566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:27.341376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:27.342637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:27.343129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:27.568777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:27.577354 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ccd15216-0304-4275-9420-89bb7e434f65 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1689 microversion: 2.1 time: 0.253902 Jun 04 21:27:27.579189 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2726/5549] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:27 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:28.594484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:28.595106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:28.603952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:28.604409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:28.605203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:28.605701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:28.782132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:28.790104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1be28992-f4e7-4bce-804b-5693d7bc5dab tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.199528 Jun 04 21:27:28.791059 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2824/5550] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:28 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:29.808884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:29.809704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:29.817578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:29.818035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:29.818823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:29.819262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:30.202925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:30.211527 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5da26059-fc3d-4c3e-9d06-1dc87b27ccb2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.407663 Jun 04 21:27:30.212142 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2727/5551] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:29 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:31.229517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:31.230383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:31.241275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:31.241929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:31.243788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:31.244996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:31.482729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:31.492145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-482552da-8d00-4745-a9f3-04ef4813364e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.266422 Jun 04 21:27:31.492707 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2825/5552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:31 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:32.510645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:32.521806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:32.534060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:32.534556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:32.535383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:32.535962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:32.890123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:32.899664 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e5da8b81-31c1-48be-a5d9-cb7dbbcc9685 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.393373 Jun 04 21:27:32.900688 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2728/5553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:32 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:33.916877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:33.917525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:33.925029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:33.925498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:33.926314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:33.926780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:34.340235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:34.354402 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b6b5da5c-af97-410b-adcc-941fecba7dc4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.441592 Jun 04 21:27:34.355297 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2826/5554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:33 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:35.374432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:35.375106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:35.383827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:35.384342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:35.385217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:35.385709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:35.537724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:35.550094 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8aa37164-25e6-4404-bde8-9df010da2262 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.179858 Jun 04 21:27:35.550908 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2729/5555] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:35 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:36.572077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:36.572710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:36.580398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:36.580877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:36.581712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:36.582166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:36.731581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:36.739457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b287d4fb-7e8b-4799-9604-d43b65704244 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.173533 Jun 04 21:27:36.740063 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2827/5556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:36 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:37.758098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:37.758769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:37.766631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:37.767087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:37.767905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:37.768347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:37.904893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:37.913456 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1e8f91d1-0eaf-4a1b-ba8c-22336571f5ad tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.159492 Jun 04 21:27:37.914467 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2730/5557] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:37 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:38.931666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:38.932278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:38.939818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:38.940278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:38.941059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:38.941504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:39.088087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:39.096202 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-740fc1a8-89b4-45b8-8bbc-c4cb4701f1e7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.168928 Jun 04 21:27:39.096778 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2828/5558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:38 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:40.115909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:40.116553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:40.125633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:40.126197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:40.127150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:40.127723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:40.282675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:40.291302 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-119be126-0305-4674-8297-5dd06c75aff5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.180507 Jun 04 21:27:40.291921 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2731/5559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:40 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:41.312168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:41.312995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:41.323355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:41.324081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:41.325234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:41.325893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:41.471878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:41.482122 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8d98f910-d5cb-46dd-9ccc-444ebbf29d91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.175509 Jun 04 21:27:41.482710 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2829/5560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:41 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:42.499104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:42.499700 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:42.507222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:42.507708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:42.508477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:42.508994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:42.655360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:42.663176 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9a2bf648-18b7-4408-99b9-f69cd2cfe0dd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.168094 Jun 04 21:27:42.663791 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2732/5561] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:42 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:43.683060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:43.683703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:43.691361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:43.691878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:43.692643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:43.693132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:43.829768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:43.842010 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ba52ee7-ca4a-4dc4-a3c5-dc16d7f58a58 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.163888 Jun 04 21:27:43.842731 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2830/5562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:43 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:44.867328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:44.868275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:44.873386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=33 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:44.879529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:44.879939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:44.880709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:44.881141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:44.883929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:45.025261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:45.033545 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7e05afec-5155-49cd-9cf7-723786496149 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1694 microversion: 2.1 time: 0.173054 Jun 04 21:27:45.034124 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2733/5563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:44 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:46.050847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:46.051466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:46.058713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:46.059177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:46.060072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:46.060522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:46.218727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:46.227024 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-577bd6e9-bca5-49af-a6ee-32029d69b063 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1693 microversion: 2.1 time: 0.180114 Jun 04 21:27:46.227646 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2831/5564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:46 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1693 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:46.616908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-20e3eec4-623e-464a-814d-320e2a7de220 req-baf2d41d-4eee-4393-b7dd-de7912aff474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "name": "network-vif-unplugged", "status": "completed", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:46.627909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-20e3eec4-623e-464a-814d-320e2a7de220 req-baf2d41d-4eee-4393-b7dd-de7912aff474 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:46.628899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-20e3eec4-623e-464a-814d-320e2a7de220 req-baf2d41d-4eee-4393-b7dd-de7912aff474 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:46.641165 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-20e3eec4-623e-464a-814d-320e2a7de220 req-baf2d41d-4eee-4393-b7dd-de7912aff474 service nova] Creating event network-vif-unplugged:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch2-master-1 Jun 04 21:27:46.646874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-20e3eec4-623e-464a-814d-320e2a7de220 req-baf2d41d-4eee-4393-b7dd-de7912aff474 service nova] Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:27:46.658105 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-20e3eec4-623e-464a-814d-320e2a7de220 req-baf2d41d-4eee-4393-b7dd-de7912aff474 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044976 Jun 04 21:27:46.658764 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2734/5565] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:27:47.245489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:47.246148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:47.253994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:47.254420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:47.255527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:47.256312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:47.277594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:47.411123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:47.419065 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c415a551-3bc3-4e35-b878-cea796c73a18 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1693 microversion: 2.1 time: 0.177736 Jun 04 21:27:47.419882 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2832/5566] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:47 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:48.444724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:48.446166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:48.455640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:48.456091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:48.456861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:48.457292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:48.597798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:48.609950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bde6a300-4774-4cfc-adda-bd5b3b6594f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1691 microversion: 2.1 time: 0.175397 Jun 04 21:27:48.610749 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2735/5567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:48 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:48.676299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ade7f2ff-bb24-4b3d-875f-f6fa5ff21632 req-2b4e79bf-9fa2-45d4-aaad-35b6daa197cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:48.685922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ade7f2ff-bb24-4b3d-875f-f6fa5ff21632 req-2b4e79bf-9fa2-45d4-aaad-35b6daa197cc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:48.686331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ade7f2ff-bb24-4b3d-875f-f6fa5ff21632 req-2b4e79bf-9fa2-45d4-aaad-35b6daa197cc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:48.698405 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ade7f2ff-bb24-4b3d-875f-f6fa5ff21632 req-2b4e79bf-9fa2-45d4-aaad-35b6daa197cc service nova] Creating event network-changed:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch2-master-1 Jun 04 21:27:48.704848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-ade7f2ff-bb24-4b3d-875f-f6fa5ff21632 req-2b4e79bf-9fa2-45d4-aaad-35b6daa197cc service nova] Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:27:48.716085 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ade7f2ff-bb24-4b3d-875f-f6fa5ff21632 req-2b4e79bf-9fa2-45d4-aaad-35b6daa197cc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043430 Jun 04 21:27:48.716793 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2833/5568] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:27:49.628486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:49.629093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:49.636305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:49.636755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:49.637882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:49.638316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:49.779917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:49.788069 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce37ff6e-552b-418d-a7ef-7a5b1ee7d25f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1688 microversion: 2.1 time: 0.163558 Jun 04 21:27:49.788660 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2736/5569] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:49 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:49.806259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:49.807233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:49.809011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:27:49.814947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:49.815725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:49.816500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:49.816951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:49.879926 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2bb4bca8-7397-4e32-b986-1faf38ce1f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action" status: 204 len: 0 microversion: 2.1 time: 0.078657 Jun 04 21:27:49.880562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2834/5570] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:27:49 2022] POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:27:49.889156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:49.889781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:49.896490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:49.896954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:49.897745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:49.898192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:50.040199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:50.048317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d3fa7124-db6d-48f7-8855-cadd0a9884b3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1688 microversion: 2.1 time: 0.163458 Jun 04 21:27:50.048885 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2737/5571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:49 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:51.067833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:51.068550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:51.075168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:51.075639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:51.076421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:51.077214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:51.233018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:51.241182 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3f59bd35-910f-4151-945b-4f8b1f569f5a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1688 microversion: 2.1 time: 0.178625 Jun 04 21:27:51.241771 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2835/5572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:51 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:52.260488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:27:52.261327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:27:52.270734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:52.271240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:52.272141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:52.272628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:52.415935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:27:52.424206 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e11667a0-0236-486e-9292-0edaa2fd976c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1680 microversion: 2.1 time: 0.168225 Jun 04 21:27:52.424804 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2738/5573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:27:52 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:27:54.023249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-45c5a146-f658-4036-aae2-f800b6ca7456 req-15fab0cb-c5c6-4ebd-bd24-1f900aece1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "name": "network-vif-plugged", "status": "completed", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:27:54.033095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-45c5a146-f658-4036-aae2-f800b6ca7456 req-15fab0cb-c5c6-4ebd-bd24-1f900aece1b5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:27:54.033572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-45c5a146-f658-4036-aae2-f800b6ca7456 req-15fab0cb-c5c6-4ebd-bd24-1f900aece1b5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:27:54.045294 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-45c5a146-f658-4036-aae2-f800b6ca7456 req-15fab0cb-c5c6-4ebd-bd24-1f900aece1b5 service nova] Creating event network-vif-plugged:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch2-master-1 Jun 04 21:27:54.050207 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-45c5a146-f658-4036-aae2-f800b6ca7456 req-15fab0cb-c5c6-4ebd-bd24-1f900aece1b5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Jun 04 21:27:54.050978 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2836/5574] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:28:14.654643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:14.656510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:14.660119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=11 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:14.660796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=33 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:14.666350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:14.666798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:14.667598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:14.668048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:14.720773 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f989ec4e-18fb-49d4-b10f-c16a129af471 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action" status: 200 len: 24557 microversion: 2.1 time: 0.073034 Jun 04 21:28:14.721408 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2739/5575] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:28:14 2022] POST /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc/action => generated 24557 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:28:21.069990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=5 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:21.070763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:21.074760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:21.075478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:21.083014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:21.083481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:21.084291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:21.084750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:21.228485 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-764836f9-7b72-4116-a6b4-f31c1c3bd1c6 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1831 microversion: 2.1 time: 0.160648 Jun 04 21:28:21.229051 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2837/5576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:21 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1831 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:28:22.088438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:22.088989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:22.090147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a150bc29-8c4d-499f-adbf-4cee67e976d2 req-ae90af90-0bd4-4af0-9781-c3eaaf204815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:22.097880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:22.098338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:22.099531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:22.100000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:22.101472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a150bc29-8c4d-499f-adbf-4cee67e976d2 req-ae90af90-0bd4-4af0-9781-c3eaaf204815 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:22.102226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a150bc29-8c4d-499f-adbf-4cee67e976d2 req-ae90af90-0bd4-4af0-9781-c3eaaf204815 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:22.115364 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a150bc29-8c4d-499f-adbf-4cee67e976d2 req-ae90af90-0bd4-4af0-9781-c3eaaf204815 service nova] Creating event network-changed:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch2-master-1 Jun 04 21:28:22.120581 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a150bc29-8c4d-499f-adbf-4cee67e976d2 req-ae90af90-0bd4-4af0-9781-c3eaaf204815 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034436 Jun 04 21:28:22.121397 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2838/5577] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:28:22.131108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:28:22.226436 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0fb4a884-422f-47fd-b886-05f5d6faed03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 204 len: 0 microversion: 2.1 time: 0.142316 Jun 04 21:28:22.227392 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2740/5578] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:28:22 2022] DELETE /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:28:22.236296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:22.237244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:22.244475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:22.244945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:22.245748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:22.246418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:22.391594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:22.400036 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-187e5021-64ae-48ab-a651-a3b1e969e957 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1686 microversion: 2.1 time: 0.168159 Jun 04 21:28:22.400612 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2839/5579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:22 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:23.418159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:23.419011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:23.427529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:23.427995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:23.428789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:23.429227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:23.638293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:23.646475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-135b9072-810a-44ed-a144-e37788dc907c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 200 len: 1686 microversion: 2.1 time: 0.232700 Jun 04 21:28:23.647190 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2741/5580] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:23 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 1686 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:24.044049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6ecc0e86-dbe2-489a-9532-b5749ea39f48 req-84b8c6a7-35a0-4d55-92a5-0c63769e40be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dec2069-7976-436f-a1ed-e7f4fe214cdc", "name": "network-vif-deleted", "tag": "da171306-eae0-4655-8250-01a1eaea9d5c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:24.055026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6ecc0e86-dbe2-489a-9532-b5749ea39f48 req-84b8c6a7-35a0-4d55-92a5-0c63769e40be service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:24.056222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6ecc0e86-dbe2-489a-9532-b5749ea39f48 req-84b8c6a7-35a0-4d55-92a5-0c63769e40be service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:24.069510 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6ecc0e86-dbe2-489a-9532-b5749ea39f48 req-84b8c6a7-35a0-4d55-92a5-0c63769e40be service nova] Creating event network-vif-deleted:da171306-eae0-4655-8250-01a1eaea9d5c for instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc on nch2-master-1 Jun 04 21:28:24.074681 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6ecc0e86-dbe2-489a-9532-b5749ea39f48 req-84b8c6a7-35a0-4d55-92a5-0c63769e40be service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Jun 04 21:28:24.075543 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2840/5581] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:28:24.668783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:24.669760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 5dec2069-7976-436f-a1ed-e7f4fe214cdc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:24.678884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:24.679338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:24.680162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:24.680606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:24.694903 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] HTTP exception thrown: Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc could not be found. Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Request method failure captured: Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc HTTP/1.1 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim84Dn58ValFXUTebBMP7dcTKQ5Z2qG55qf9hXJgpxeBNi_yB1fQpt6BxbtWMu1ypgYh2LZC0eZK8IUrsu5ORb3viJNMHp9Jx88-hELo8A1mK7TFaFy5TbVOmkrUAzVb1xeavrzcslCOP4-AazfRrLsJiGIWnnyb0rzWGktycVnsVHaw Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_487d2d29adde413baa30ed91635c0591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/487d2d29adde413baa30ed91635c0591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e9add19ab3754964b66d1d5a7facc5e8 Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc could not be found. Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '5dec2069-7976-436f-a1ed-e7f4fe214cdc'} Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc could not be found. Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc could not be found. Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:28:24.696602 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc could not be found. Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Returning 404 to user: Instance 5dec2069-7976-436f-a1ed-e7f4fe214cdc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7586a602-d2b8-4954-88ef-82468a7ceda9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc" status: 404 len: 111 microversion: 2.1 time: 0.036271 Jun 04 21:28:24.701007 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2742/5582] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:24 2022] GET /compute/v2.1/servers/5dec2069-7976-436f-a1ed-e7f4fe214cdc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:28:28.104226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-083cfb1d-638d-49e0-8217-7d982e51d7d4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '.version_select at 0x7f2d00ebcc10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:28.124782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-083cfb1d-638d-49e0-8217-7d982e51d7d4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-4821336" status: 202 len: 0 microversion: 2.1 time: 0.026156 Jun 04 21:28:28.125446 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2841/5583] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-4821336 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:28:28.154849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aebad20e-783f-4154-8aa0-716fdb94fb66 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: .version_select at 0x7f2d00f02790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1651378465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/WZjvfAqYnNzg5VcDC8WCoHN3mi8IHzDkI1IV13ECmSpsNQf2qTEzk+ft3AqVShTvk5C8+I2T2WiplgcXARnPjlJROiUY63HzHldUscCd+VLU8o2vlyiyfXiq1rNzhow=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:28.171340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-aebad20e-783f-4154-8aa0-716fdb94fb66 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:28:28.177502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-aebad20e-783f-4154-8aa0-716fdb94fb66 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:28:28.202182 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aebad20e-783f-4154-8aa0-716fdb94fb66 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051751 Jun 04 21:28:28.202785 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2743/5584] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:28:28 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:28:34.296639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=16 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:34.301605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-392067192", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "8d7ff9af-012c-4f65-90dd-66ac8f2bed19"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1651378465", "security_groups": [{"name": "tempest-secgroup-smoke-1288932590"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:34.430458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] validate_networks() for [('8d7ff9af-012c-4f65-90dd-66ac8f2bed19', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:28:34.894341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:28:34.894953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:28:34.895543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:28:34.896077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:28:34.896505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:28:34.908698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:34.908698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:34.909070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:34.909529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:34.930443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:28:34.944916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:28:34.966851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:28:34.969491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:28:35.029000 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb9b1de6-fafd-44ed-8aba-fc384b84225b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733186 Jun 04 21:28:35.030402 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2842/5585] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:28:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:28:35.046175 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b51c3d55-f772-4347-8cbe-b2ff2f81a121 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:35.060055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b51c3d55-f772-4347-8cbe-b2ff2f81a121 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:35.073976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:35.159755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b51c3d55-f772-4347-8cbe-b2ff2f81a121 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:35.170492 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b51c3d55-f772-4347-8cbe-b2ff2f81a121 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1266 microversion: 2.1 time: 0.130553 Jun 04 21:28:35.174458 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2744/5586] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:35 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:36.191652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:36.192155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:36.205760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:36.206247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:36.207707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:36.208185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:36.301235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:36.311237 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5b42c53d-306c-440c-963b-597ef0ebc348 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1318 microversion: 2.1 time: 0.124761 Jun 04 21:28:36.312638 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2843/5587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:36 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1318 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:37.329925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:37.331135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:37.339029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:37.339479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:37.340283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:37.340743 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:37.506550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:37.514937 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-26e83989-6f06-4a50-bb2b-f6b3bb897e55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1392 microversion: 2.1 time: 0.189429 Jun 04 21:28:37.515545 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2745/5588] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:37 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:38.017654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3b4f930e-76d6-4e12-8aa4-d95b808209c3 req-b120078d-42df-4db1-99c6-106939cbdfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:38.030900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b4f930e-76d6-4e12-8aa4-d95b808209c3 req-b120078d-42df-4db1-99c6-106939cbdfa9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:38.031869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3b4f930e-76d6-4e12-8aa4-d95b808209c3 req-b120078d-42df-4db1-99c6-106939cbdfa9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:38.050164 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3b4f930e-76d6-4e12-8aa4-d95b808209c3 req-b120078d-42df-4db1-99c6-106939cbdfa9 service nova] Creating event network-changed:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:28:38.057330 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3b4f930e-76d6-4e12-8aa4-d95b808209c3 req-b120078d-42df-4db1-99c6-106939cbdfa9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043331 Jun 04 21:28:38.058497 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2844/5589] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:28:38.532078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:38.532647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:38.540171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:38.540665 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:38.541462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:38.541895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:38.693082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:38.700951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8402c0f-166a-4fbb-a5bd-e0bd06dc3f72 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1392 microversion: 2.1 time: 0.172998 Jun 04 21:28:38.701517 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2746/5590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:38 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:39.718668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:39.720379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:39.728852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:39.729416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:39.730365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:39.730814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:39.876662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:39.884865 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a3b4dd97-c575-4ce6-b5c1-63fabc2e1c1e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1392 microversion: 2.1 time: 0.170380 Jun 04 21:28:39.885467 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2845/5591] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:39 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:40.906375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:40.907398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:40.919770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:40.920496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:40.921775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:40.922495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:41.073106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:41.084231 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b6ddef7e-8c61-432d-b80a-519e6b723d03 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1392 microversion: 2.1 time: 0.184486 Jun 04 21:28:41.084814 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2747/5592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:40 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:41.798642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-00400179-d815-40b6-ab79-e04ded1b8c6e req-cac037e4-5ac1-48fb-8c20-4e0ed5c88019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "name": "network-vif-plugged", "status": "completed", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:41.808714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-00400179-d815-40b6-ab79-e04ded1b8c6e req-cac037e4-5ac1-48fb-8c20-4e0ed5c88019 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:41.809264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-00400179-d815-40b6-ab79-e04ded1b8c6e req-cac037e4-5ac1-48fb-8c20-4e0ed5c88019 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:41.822745 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-00400179-d815-40b6-ab79-e04ded1b8c6e req-cac037e4-5ac1-48fb-8c20-4e0ed5c88019 service nova] Creating event network-vif-plugged:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:28:41.828037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-00400179-d815-40b6-ab79-e04ded1b8c6e req-cac037e4-5ac1-48fb-8c20-4e0ed5c88019 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033181 Jun 04 21:28:41.828624 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2846/5593] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:28:42.102070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:42.102667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:42.110444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:42.110896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:42.111703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:42.112139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:42.252774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:42.260750 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c9ecc98-e771-4321-952a-3af7663ab0ef tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1392 microversion: 2.1 time: 0.163629 Jun 04 21:28:42.261345 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2748/5594] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:42 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:43.280090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:43.281024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:43.288807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:43.289269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:43.290238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:43.290852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:43.432491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:43.444674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d339fdcf-32f7-4316-9535-a6cfaf4174de tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1392 microversion: 2.1 time: 0.168998 Jun 04 21:28:43.445404 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2847/5595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:43 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:44.469446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:44.470370 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:44.478822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:44.479300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:44.480157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:44.480598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:44.628558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:44.637121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3cf32b25-f721-47f6-b306-889fd524d818 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1565 microversion: 2.1 time: 0.172914 Jun 04 21:28:44.637724 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2749/5596] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:44 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:44.656619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:44.657349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:44.666484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:44.667142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:44.668361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:44.669292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:44.815570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:44.823715 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79494268-6978-4565-889f-636da1b2c5bb tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1565 microversion: 2.1 time: 0.173315 Jun 04 21:28:44.824196 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2848/5597] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:44 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:28:46.869711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:28:46.870297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:28:46.872328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:46.873819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:46.877566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-644f7501-0b51-4c63-8086-8dae067b792c req-89f2dd58-76cb-4570-b124-379a50220262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:28:46.880944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:46.881517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:46.882512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:46.882951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:46.884784 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:46.885643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:28:46.892205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-644f7501-0b51-4c63-8086-8dae067b792c req-89f2dd58-76cb-4570-b124-379a50220262 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:28:46.892740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-644f7501-0b51-4c63-8086-8dae067b792c req-89f2dd58-76cb-4570-b124-379a50220262 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:28:46.906727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-644f7501-0b51-4c63-8086-8dae067b792c req-89f2dd58-76cb-4570-b124-379a50220262 service nova] Creating event network-changed:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:28:46.912501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-644f7501-0b51-4c63-8086-8dae067b792c req-89f2dd58-76cb-4570-b124-379a50220262 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039320 Jun 04 21:28:46.913179 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2849/5598] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:28:47.025235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:28:47.034506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9200cd38-b692-45d0-ad95-e58447f64e16 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1565 microversion: 2.1 time: 0.168804 Jun 04 21:28:47.035373 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2750/5599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:28:46 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:10.321609 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:10.322806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=32 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:10.327568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:10.328610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:10.336717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:10.337182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:10.337963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:10.338410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:10.413175 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5caa4359-cb75-43b6-818a-ddaa68dae65f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action" status: 200 len: 24563 microversion: 2.1 time: 0.094699 Jun 04 21:29:10.413860 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2850/5600] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:29:10 2022] POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action => generated 24563 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:29:21.508382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:21.509014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:21.511400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:21.512526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=36 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:21.519562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:21.520048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:21.520866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:21.521306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:21.672627 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95be8648-a300-4401-9598-98c287581b06 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1834 microversion: 2.1 time: 0.168108 Jun 04 21:29:21.673253 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2751/5601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:21 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1834 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:21.690118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:21.690864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:21.693852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:21.694522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:21.702395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:21.702884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:21.703694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:21.704140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:21.850055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:21.862786 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd681b9c-8f79-4555-967f-7dc3db5ee1a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1683 microversion: 2.1 time: 0.176683 Jun 04 21:29:21.863605 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2851/5602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:21 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:21.956265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:21.957211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:21.963610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:21.964068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:21.965440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:21.965888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:22.033806 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bdef56bb-c927-44ca-8e44-19c0d9677ddd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action" status: 200 len: 32636 microversion: 2.1 time: 0.081303 Jun 04 21:29:22.034445 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2752/5603] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:29:21 2022] POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action => generated 32636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:29:22.188334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:22.189243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:22.199267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:22.199770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:22.200557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:22.201007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:22.244421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '22b3579138134855aaa83a5c8de93c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629b5e4cfba945fc8761667732bd0b05', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:22.245161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] flavor_id is None. Assuming migration. {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 04 21:29:22.245614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:29:22.627910 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ad3bc4d-f7d9-42a9-9977-e11aeb1ecdec tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action" status: 202 len: 0 microversion: 2.1 time: 0.443945 Jun 04 21:29:22.628565 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2852/5604] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:29:22 2022] POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:29:22.638079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:22.638877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:22.646629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:22.647079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:22.647918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:22.648435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:22.801213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:22.811664 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fedad862-84ff-48ec-9ef0-26f979db6fe2 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1692 microversion: 2.1 time: 0.178303 Jun 04 21:29:22.812272 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2753/5605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:22 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:23.832723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:23.833643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:23.841872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:23.842109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:23.842857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:23.843282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:23.987809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:23.996292 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f1d3184-12f0-495b-a7da-7df522b0b956 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1692 microversion: 2.1 time: 0.170285 Jun 04 21:29:24.006156 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2853/5606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:23 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:25.016816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:25.017399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:25.024832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:25.025295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:25.026075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:25.026522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:25.168089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:25.178613 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-67bf7ad0-1156-49ba-8ff7-e316f9a88dd1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.166699 Jun 04 21:29:25.179450 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2754/5607] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:25 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:26.202642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:26.203267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:26.210762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:26.211223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:26.212034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:26.212478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:26.353392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:26.362942 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9f826592-2217-4615-8f4a-f3e014486d39 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.164174 Jun 04 21:29:26.363553 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2854/5608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:26 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:27.385904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:27.386891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:27.395312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:27.395801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:27.396578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:27.397017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:27.544113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:27.556629 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b585dd7f-4e9a-4698-a600-714d079e33bc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.176772 Jun 04 21:29:27.557399 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2755/5609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:27 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:28.580525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:28.581608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:28.593111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:28.593579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:28.594368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:28.594823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:28.742281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:28.750466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5aad5668-73fd-4e00-bd80-81e6e0765401 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.177273 Jun 04 21:29:28.751033 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2855/5610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:28 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:29.769271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:29.769879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:29.777548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:29.778005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:29.778879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:29.779963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:29.926115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:29.934356 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-039b508d-7c78-428a-95e0-d3eb231e42a3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.169098 Jun 04 21:29:29.934921 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2756/5611] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:29 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:30.953002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:30.953569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:30.961122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:30.961582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:30.962361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:30.962804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:31.101476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:31.109811 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0eb21001-f9d2-4de8-a594-f168f7ae5f95 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.161340 Jun 04 21:29:31.110388 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2856/5612] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:30 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:32.128327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:32.128970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:32.136894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:32.137714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:32.138758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:32.139348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:32.283025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:32.295383 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-38868793-3210-4b93-aa47-4ecfe6566649 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.171265 Jun 04 21:29:32.296250 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2757/5613] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:32 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:29:33.320417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:33.321215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:33.329309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:33.329773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:33.330553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:33.331001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:33.469802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:33.478762 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d09463f-8536-49f6-a083-369e4f73d686 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.164011 Jun 04 21:29:33.479331 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2857/5614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:33 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:34.496352 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:34.496929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:34.504569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:34.505038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:34.505812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:34.506246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:34.648391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:34.657036 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09a99e61-379e-4092-b167-6782cb811276 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.164655 Jun 04 21:29:34.657584 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2758/5615] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:34 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:35.678735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:35.679669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:35.691821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:35.692656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:35.694291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:35.695028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:35.842897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:35.851260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ac24defa-8b57-41e1-b530-85aec4b90ee6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.179413 Jun 04 21:29:35.851874 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2858/5616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:35 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:36.869408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:36.870037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:36.877644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:36.878102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:36.878888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:36.879329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:37.030874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:37.043932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-984bbced-abad-4511-847f-5839804d20dc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.178192 Jun 04 21:29:37.044941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2759/5617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:36 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:38.065372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:38.066272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:38.077325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:38.077946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:38.079691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:38.080262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:38.226239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:38.238093 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9cd812ee-f991-4301-9fe5-1a191a1af963 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.178575 Jun 04 21:29:38.238884 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2859/5618] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:38 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:39.255447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:39.256068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:39.264019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:39.264745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:39.265529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:39.265993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:39.412241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:39.420735 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a143cb1e-ad2a-4e5b-8c11-517f5824be3d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.169159 Jun 04 21:29:39.421328 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2760/5619] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:39 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:40.439802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:40.440437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:40.448436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:40.448901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:40.449703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:40.450150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:40.596898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:40.605415 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-475f976f-842b-4fe3-9dc3-32c9aeb1d621 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.170170 Jun 04 21:29:40.606001 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2860/5620] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:40 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:41.622560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:41.623172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:41.631114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:41.631494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:41.632411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:41.632845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:41.774036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:41.782621 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ba98b147-4865-4d4b-b002-d40a2d45474e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1697 microversion: 2.1 time: 0.164051 Jun 04 21:29:41.783441 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2761/5621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:41 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:42.539235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d396ecc3-91c3-477c-9a9d-3d480ceb157b req-4dfc9470-8eac-4da3-a575-4017f30ac8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "name": "network-vif-unplugged", "status": "completed", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:42.547831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d396ecc3-91c3-477c-9a9d-3d480ceb157b req-4dfc9470-8eac-4da3-a575-4017f30ac8c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:42.548657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d396ecc3-91c3-477c-9a9d-3d480ceb157b req-4dfc9470-8eac-4da3-a575-4017f30ac8c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:42.571607 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d396ecc3-91c3-477c-9a9d-3d480ceb157b req-4dfc9470-8eac-4da3-a575-4017f30ac8c6 service nova] Creating event network-vif-unplugged:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch2-master-1 Jun 04 21:29:42.579967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-d396ecc3-91c3-477c-9a9d-3d480ceb157b req-4dfc9470-8eac-4da3-a575-4017f30ac8c6 service nova] Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:29:42.592682 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d396ecc3-91c3-477c-9a9d-3d480ceb157b req-4dfc9470-8eac-4da3-a575-4017f30ac8c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140441 Jun 04 21:29:42.593424 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2861/5622] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:29:42.800997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:42.801675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:42.809189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:42.809730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:42.810589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:42.811080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:43.044971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:43.054115 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5fdf0a1-6df0-48c7-b06c-234e5e40487e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1696 microversion: 2.1 time: 0.257315 Jun 04 21:29:43.055060 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2762/5623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:42 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1696 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:44.076413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:44.078198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:44.090736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:44.091866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:44.093580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:44.094461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:44.252480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:44.260474 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4074b448-d83c-4dfb-a703-4e839980d551 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1694 microversion: 2.1 time: 0.190723 Jun 04 21:29:44.261069 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2862/5624] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:44 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:44.624913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-a7f50f62-0ad3-415e-bfa6-690cbae4c843 req-1e19b0c2-b65d-4c7a-8323-303867e98dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:44.637374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a7f50f62-0ad3-415e-bfa6-690cbae4c843 req-1e19b0c2-b65d-4c7a-8323-303867e98dc5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:44.638315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-a7f50f62-0ad3-415e-bfa6-690cbae4c843 req-1e19b0c2-b65d-4c7a-8323-303867e98dc5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:44.651790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-a7f50f62-0ad3-415e-bfa6-690cbae4c843 req-1e19b0c2-b65d-4c7a-8323-303867e98dc5 service nova] Creating event network-changed:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch2-master-1 Jun 04 21:29:44.657985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-a7f50f62-0ad3-415e-bfa6-690cbae4c843 req-1e19b0c2-b65d-4c7a-8323-303867e98dc5 service nova] Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:29:44.668947 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-a7f50f62-0ad3-415e-bfa6-690cbae4c843 req-1e19b0c2-b65d-4c7a-8323-303867e98dc5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049157 Jun 04 21:29:44.669533 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2763/5625] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:29:45.279801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:45.281221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:45.289042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:45.289518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:45.290297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:45.290953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:45.508089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:45.518776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de3b0661-4075-4de4-b7ed-267871ccc783 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1691 microversion: 2.1 time: 0.243033 Jun 04 21:29:45.524510 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2863/5626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:45 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1691 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:45.536375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:45.537034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:45.543638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:45.544104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:45.544888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:45.545328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:45.666226 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5d9146d5-aefb-4afa-9070-85aa19657172 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action" status: 202 len: 0 microversion: 2.1 time: 0.134218 Jun 04 21:29:45.666924 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2764/5627] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:29:45 2022] POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:29:45.675119 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:45.675738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:45.681990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:45.682431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:45.683253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:45.683748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:45.832366 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:45.840912 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-13526264-ecd8-46d2-9a6f-4b3b68470487 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1690 microversion: 2.1 time: 0.169777 Jun 04 21:29:45.851293 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2864/5628] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:45 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:46.859878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:46.861398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:46.871541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:46.872016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:46.872791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:46.873197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:47.024379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:47.031956 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fb7fe061-f828-4aa6-ab84-d5b9bbc361a7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1690 microversion: 2.1 time: 0.177240 Jun 04 21:29:47.032681 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2765/5629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:46 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:48.053692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:48.054900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:48.065514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:48.065985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:48.066774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:48.067226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:48.217759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:48.229926 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c837d9d3-6681-44de-8fac-58be83160274 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1690 microversion: 2.1 time: 0.182832 Jun 04 21:29:48.230676 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2865/5630] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:48 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:48.528613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-6d6494ab-eb27-48d1-a1e0-df41d497f8e4 req-c0f07458-5127-4fc4-bd8a-aa156617b500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "name": "network-vif-plugged", "status": "completed", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:48.537285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6d6494ab-eb27-48d1-a1e0-df41d497f8e4 req-c0f07458-5127-4fc4-bd8a-aa156617b500 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:48.537723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6d6494ab-eb27-48d1-a1e0-df41d497f8e4 req-c0f07458-5127-4fc4-bd8a-aa156617b500 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:48.550011 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-6d6494ab-eb27-48d1-a1e0-df41d497f8e4 req-c0f07458-5127-4fc4-bd8a-aa156617b500 service nova] Creating event network-vif-plugged:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch2-master-1 Jun 04 21:29:48.551724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:48.558473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-6d6494ab-eb27-48d1-a1e0-df41d497f8e4 req-c0f07458-5127-4fc4-bd8a-aa156617b500 service nova] Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:29:48.571120 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-6d6494ab-eb27-48d1-a1e0-df41d497f8e4 req-c0f07458-5127-4fc4-bd8a-aa156617b500 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121598 Jun 04 21:29:48.571809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2766/5631] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:29:49.249492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:49.250064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:49.257590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:49.258049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:49.258844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:49.259296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:49.263942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:49.410926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:49.418824 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e2ce62b-07ca-45d2-bb29-0b539bd8cada tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1690 microversion: 2.1 time: 0.173452 Jun 04 21:29:49.419523 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2866/5632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:49 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:49.449415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ab085093-a26b-4f38-8b39-fab33004f9cc req-1b003ad7-4d69-484e-a1dd-f308287f306e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "name": "network-vif-unplugged", "status": "completed", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:49.460432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ab085093-a26b-4f38-8b39-fab33004f9cc req-1b003ad7-4d69-484e-a1dd-f308287f306e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:49.460943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ab085093-a26b-4f38-8b39-fab33004f9cc req-1b003ad7-4d69-484e-a1dd-f308287f306e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:49.473240 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ab085093-a26b-4f38-8b39-fab33004f9cc req-1b003ad7-4d69-484e-a1dd-f308287f306e service nova] Creating event network-vif-unplugged:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:29:49.479275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-ab085093-a26b-4f38-8b39-fab33004f9cc req-1b003ad7-4d69-484e-a1dd-f308287f306e service nova] Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:29:49.493656 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ab085093-a26b-4f38-8b39-fab33004f9cc req-1b003ad7-4d69-484e-a1dd-f308287f306e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048070 Jun 04 21:29:49.493911 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2767/5633] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:29:50.438804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:50.439474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:50.447161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:50.447648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:50.448435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:50.449016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:50.587144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:50.595192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aaf527c4-7406-4edb-ad24-a396fda722c4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1690 microversion: 2.1 time: 0.161149 Jun 04 21:29:50.595824 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2867/5634] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:50 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:51.510889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3ae03371-7ce6-4fd6-817a-7ba93610c870 req-d82ef864-c2e6-4c1f-a5bc-512310b37c71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:51.520573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3ae03371-7ce6-4fd6-817a-7ba93610c870 req-d82ef864-c2e6-4c1f-a5bc-512310b37c71 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:51.521019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3ae03371-7ce6-4fd6-817a-7ba93610c870 req-d82ef864-c2e6-4c1f-a5bc-512310b37c71 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:51.533478 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3ae03371-7ce6-4fd6-817a-7ba93610c870 req-d82ef864-c2e6-4c1f-a5bc-512310b37c71 service nova] Creating event network-changed:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:29:51.539254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-3ae03371-7ce6-4fd6-817a-7ba93610c870 req-d82ef864-c2e6-4c1f-a5bc-512310b37c71 service nova] Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:29:51.551475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3ae03371-7ce6-4fd6-817a-7ba93610c870 req-d82ef864-c2e6-4c1f-a5bc-512310b37c71 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045252 Jun 04 21:29:51.552566 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2768/5635] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:29:51.613298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:51.613918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:51.623307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:51.623800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:51.624581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:51.625025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:51.772029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:51.780239 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e2d8fa8-6fde-4dae-b430-f374e37fb88d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1690 microversion: 2.1 time: 0.171197 Jun 04 21:29:51.780978 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2868/5636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:51 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:52.806759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:29:52.807596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:29:52.809748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=41 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:52.816002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:52.817301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:52.818208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:52.818724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:52.965936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:29:52.974085 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b807c55c-2b09-4fa8-9cc6-f721d42d28cc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1683 microversion: 2.1 time: 0.174669 Jun 04 21:29:52.974719 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2769/5637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:29:52 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:29:56.171671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-92368dc8-e223-499e-904d-de2d41980a4f req-2a9d6b55-e6e8-48c7-9338-8a10b86b26de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "name": "network-vif-plugged", "status": "completed", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:29:56.176232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=39 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:29:56.182655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-92368dc8-e223-499e-904d-de2d41980a4f req-2a9d6b55-e6e8-48c7-9338-8a10b86b26de service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:29:56.183124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-92368dc8-e223-499e-904d-de2d41980a4f req-2a9d6b55-e6e8-48c7-9338-8a10b86b26de service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:29:56.197460 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-92368dc8-e223-499e-904d-de2d41980a4f req-2a9d6b55-e6e8-48c7-9338-8a10b86b26de service nova] Creating event network-vif-plugged:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:29:56.202829 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-92368dc8-e223-499e-904d-de2d41980a4f req-2a9d6b55-e6e8-48c7-9338-8a10b86b26de service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041869 Jun 04 21:29:56.203568 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2869/5638] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:30:19.225452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:19.226980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:19.230420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:19.231283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=15 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:19.236907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:19.237360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:19.238121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:19.238558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:19.313483 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4eba800c-cf16-4e80-ada4-2c2be3a1add3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action" status: 200 len: 63029 microversion: 2.1 time: 0.094545 Jun 04 21:30:19.314232 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2770/5639] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:30:19 2022] POST /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96/action => generated 63029 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:30:25.745331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:25.746493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=18 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:25.753686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:25.754858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:25.765682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:25.766140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:25.766920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:25.767364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:25.917382 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-97d701c0-6bb4-49cd-9707-245d8d4b36d5 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1834 microversion: 2.1 time: 0.175673 Jun 04 21:30:25.918231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2870/5640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:25 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1834 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:26.804953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:26.805555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:26.813953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-8d4d6195-6dfc-4ea7-af1a-44bf504c250d req-0aa9f7f2-862d-4098-8bef-0154ee34068a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:26.814496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:26.814642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:26.815727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:26.816176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:26.823863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8d4d6195-6dfc-4ea7-af1a-44bf504c250d req-0aa9f7f2-862d-4098-8bef-0154ee34068a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:26.824618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-8d4d6195-6dfc-4ea7-af1a-44bf504c250d req-0aa9f7f2-862d-4098-8bef-0154ee34068a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:26.836552 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-8d4d6195-6dfc-4ea7-af1a-44bf504c250d req-0aa9f7f2-862d-4098-8bef-0154ee34068a service nova] Creating event network-changed:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:30:26.845208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:30:26.845463 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-8d4d6195-6dfc-4ea7-af1a-44bf504c250d req-0aa9f7f2-862d-4098-8bef-0154ee34068a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034894 Jun 04 21:30:26.846220 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2871/5641] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:30:26.937790 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9b87cef4-95ac-4ae3-8aa7-8e8401aad252 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 204 len: 0 microversion: 2.1 time: 0.137084 Jun 04 21:30:26.938680 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2771/5642] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:30:26 2022] DELETE /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:30:26.947673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:26.948514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:26.955325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:26.956185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:26.957218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:26.957921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:27.098615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:27.106630 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-082f4644-80e8-4c8b-96b5-9c0441929a32 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1689 microversion: 2.1 time: 0.163244 Jun 04 21:30:27.107302 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2872/5643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:26 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:28.128292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:28.129052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:28.137733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:28.138191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:28.139306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:28.139782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:28.296319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:28.304199 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8880004-b07d-4997-9019-219ba4682b99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1689 microversion: 2.1 time: 0.182348 Jun 04 21:30:28.304817 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2772/5644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:28 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:29.192701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-99d6a3b0-04e8-441d-95c2-5a657a8681b5 req-07f5e03c-dca3-41ac-a393-1d1dda66402b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f17e4a-8657-4ec6-ba70-6ca67b6a6e96", "name": "network-vif-deleted", "tag": "c7795f53-24dc-4ec8-9086-9aca081c3dda"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:29.203009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-99d6a3b0-04e8-441d-95c2-5a657a8681b5 req-07f5e03c-dca3-41ac-a393-1d1dda66402b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:29.203539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-99d6a3b0-04e8-441d-95c2-5a657a8681b5 req-07f5e03c-dca3-41ac-a393-1d1dda66402b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:29.214938 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-99d6a3b0-04e8-441d-95c2-5a657a8681b5 req-07f5e03c-dca3-41ac-a393-1d1dda66402b service nova] Creating event network-vif-deleted:c7795f53-24dc-4ec8-9086-9aca081c3dda for instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 on nch1-master-1 Jun 04 21:30:29.220612 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-99d6a3b0-04e8-441d-95c2-5a657a8681b5 req-07f5e03c-dca3-41ac-a393-1d1dda66402b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Jun 04 21:30:29.221415 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2873/5645] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:30:29.324167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:29.324875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:29.332829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:29.333555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:29.334636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:29.335234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:29.372502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:29.373470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:29.373944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lazy-loading 'fault' on Instance uuid 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:30:29.420915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:29.428823 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3f41d5a9-2cd4-47a3-81b9-15a88cb6b204 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 200 len: 1356 microversion: 2.1 time: 0.109810 Jun 04 21:30:29.429421 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2773/5646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:29 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:30.452781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:30.453500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:30.460521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:30.461033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:30.461866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:30.462408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:30.477523 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] HTTP exception thrown: Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 could not be found. Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Request method failure captured: Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 HTTP/1.1 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim84Dn58ValFXUTebBMP7dcTKQ5Z2qG55qf9hXJgpxeBNi_yB1fQpt6BxbtWMu1ypgYh2LZC0eZK8IUrsu5ORb3viJNMHp9Jx88-hELo8A1mK7TFaFy5TbVOmkrUAzVb1xeavrzcslCOP4-AazfRrLsJiGIWnnyb0rzWGktycVnsVHaw Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_487d2d29adde413baa30ed91635c0591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/487d2d29adde413baa30ed91635c0591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: e9add19ab3754964b66d1d5a7facc5e8 Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 could not be found. Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '95f17e4a-8657-4ec6-ba70-6ca67b6a6e96'} Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 could not be found. Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 could not be found. Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:30:30.479179 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 could not be found. Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Returning 404 to user: Instance 95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-619ffd9f-5896-4786-a415-716bf90542d1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96" status: 404 len: 111 microversion: 2.1 time: 0.035751 Jun 04 21:30:30.483895 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2874/5647] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:30 2022] GET /compute/v2.1/servers/95f17e4a-8657-4ec6-ba70-6ca67b6a6e96 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:30:33.873551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-afcac6fd-777d-4bdc-b025-7f460a4e0b24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '.version_select at 0x7f2d0be6fca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:33.905536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-afcac6fd-777d-4bdc-b025-7f460a4e0b24 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1651378465" status: 202 len: 0 microversion: 2.1 time: 0.036502 Jun 04 21:30:33.906509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2774/5648] 10.222.0.18 () {58 vars in 1283 bytes} [Sat Jun 4 21:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1651378465 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:30:33.940996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-af1682ee-adde-4061-bd74-7f79e5cdff97 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: .version_select at 0x7f2d003fbe50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-511903055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFEO8yUCADkL0jSK3LM+Shlt8Tr1/7gvgA5hQ7+M/uVDLl6ux0MHJbdym3/XVTZ0JdMn5YREBFrO9XDcvzP90Yl52kU0it3n9oLrJl8xUf3bCUl0bMf9KJDSSRWkZWlbw=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:33.957689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-af1682ee-adde-4061-bd74-7f79e5cdff97 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:30:33.963712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-af1682ee-adde-4061-bd74-7f79e5cdff97 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:30:33.989989 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-af1682ee-adde-4061-bd74-7f79e5cdff97 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053115 Jun 04 21:30:33.990922 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2875/5649] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:30:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:30:39.912707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:39.917526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1091720134", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "b18c9b1b-59a1-4dd1-a3f0-9f5f5899879b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-511903055", "security_groups": [{"name": "tempest-secgroup-smoke-1445121435"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:40.034146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] validate_networks() for [('b18c9b1b-59a1-4dd1-a3f0-9f5f5899879b', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:30:40.468056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:30:40.468828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:30:40.469419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:30:40.469864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:30:40.470295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:30:40.480858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:40.481313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:40.482122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:40.482605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:40.500227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:30:40.505875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:30:40.519593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:30:40.524754 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:30:40.575126 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7b941380-7bdf-4ec3-854a-61a2f1e03125 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.664209 Jun 04 21:30:40.581102 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2775/5650] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:30:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:30:40.586478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46c2ff33-d5f0-4179-9796-12abc532d7d8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:40.587087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46c2ff33-d5f0-4179-9796-12abc532d7d8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:40.589758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=18 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:40.649513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-46c2ff33-d5f0-4179-9796-12abc532d7d8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:40.657967 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46c2ff33-d5f0-4179-9796-12abc532d7d8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1266 microversion: 2.1 time: 0.075723 Jun 04 21:30:40.658721 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2876/5651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:40 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:30:41.676511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:41.677228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:41.689839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:41.690664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:41.691767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:41.692277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:41.762656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:41.771163 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6c106b3-e65e-40ac-98e7-814c5cf2cde1 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1318 microversion: 2.1 time: 0.100085 Jun 04 21:30:41.771775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2776/5652] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:41 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:42.788822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:42.790309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:42.814143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:42.815255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:42.816279 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:42.816884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:43.058032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:43.068119 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dad44045-22e2-4a3a-89ea-5dffc7c36302 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.283036 Jun 04 21:30:43.073161 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2877/5653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:42 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:43.679803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-6e091452-48df-4da9-a7dd-6f81968730d1 req-de4a1f9c-d50c-4643-b65e-3f68b7bc5836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:43.700020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6e091452-48df-4da9-a7dd-6f81968730d1 req-de4a1f9c-d50c-4643-b65e-3f68b7bc5836 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:43.700978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-6e091452-48df-4da9-a7dd-6f81968730d1 req-de4a1f9c-d50c-4643-b65e-3f68b7bc5836 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:43.717265 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-6e091452-48df-4da9-a7dd-6f81968730d1 req-de4a1f9c-d50c-4643-b65e-3f68b7bc5836 service nova] Creating event network-changed:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch1-master-1 Jun 04 21:30:43.723317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-6e091452-48df-4da9-a7dd-6f81968730d1 req-de4a1f9c-d50c-4643-b65e-3f68b7bc5836 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048393 Jun 04 21:30:43.724124 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2777/5654] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:30:44.086416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:44.087017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:44.094914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:44.095383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:44.096341 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:44.096792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:44.237200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:44.245357 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79454fa8-388f-4dd0-a1d9-d21437187c55 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.162934 Jun 04 21:30:44.245935 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2878/5655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:44 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:45.262805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:45.263537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:45.271848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:45.272302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:45.273087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:45.273530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:45.413330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:45.421687 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-abc2d6da-3477-4992-83c5-b21bef2265f3 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.163242 Jun 04 21:30:45.422236 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2778/5656] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:45 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:46.438906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:46.439716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:46.447108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:46.447603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:46.448398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:46.448826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:46.593734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:46.602095 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2494110-1f06-4222-8197-6944c8320dbc tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.167344 Jun 04 21:30:46.602679 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2879/5657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:46 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:47.619579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:47.619963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:47.627479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:47.627977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:47.628828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:47.629211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:47.782132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:47.790162 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-703a418e-ea5b-4ee2-a4f0-3cf9135d55c6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.175101 Jun 04 21:30:47.790750 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2779/5658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:47 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:48.807296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:48.807941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:48.815477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:48.815980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:48.816780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:48.817238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:48.954826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:48.962598 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc842fac-5a8f-49ec-b118-983a17ade325 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.159326 Jun 04 21:30:48.963169 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2880/5659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:48 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:49.980073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:49.980703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:49.983701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:49.989641 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:49.990096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:49.990881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:49.991325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:50.144259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:50.155576 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cc7855a2-0634-4d57-8f6b-9aa231f00e26 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.179396 Jun 04 21:30:50.156429 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2780/5660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:49 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:50.371807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fb252072-5432-4b0d-8540-246b5f832fb6 req-cceb7f08-c6d3-4871-8214-0bc2c90cfc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "name": "network-vif-plugged", "status": "completed", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:50.381602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fb252072-5432-4b0d-8540-246b5f832fb6 req-cceb7f08-c6d3-4871-8214-0bc2c90cfc27 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:50.382126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fb252072-5432-4b0d-8540-246b5f832fb6 req-cceb7f08-c6d3-4871-8214-0bc2c90cfc27 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:50.394828 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fb252072-5432-4b0d-8540-246b5f832fb6 req-cceb7f08-c6d3-4871-8214-0bc2c90cfc27 service nova] Creating event network-vif-plugged:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch1-master-1 Jun 04 21:30:50.400037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fb252072-5432-4b0d-8540-246b5f832fb6 req-cceb7f08-c6d3-4871-8214-0bc2c90cfc27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Jun 04 21:30:50.400837 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2881/5661] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:30:51.173592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:51.174184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:51.176154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:51.176820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:51.183477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:51.183948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:51.184741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:51.185172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:51.330499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:51.338430 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf706e83-a4dc-4da5-9897-0da8bee94ccf tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1392 microversion: 2.1 time: 0.168960 Jun 04 21:30:51.339014 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2781/5662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:51 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:52.355009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:30:52.361424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:52.362626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:52.370024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:52.370588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:52.371456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:52.371987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:52.516144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:52.527613 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65be9201-e714-4aba-82df-083611b306ea tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1564 microversion: 2.1 time: 0.173519 Jun 04 21:30:52.528397 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2882/5663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:52 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:30:52.545906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:52.546520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:52.554028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:52.554462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:52.555243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:52.555716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:52.704286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:52.713231 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-13ab2aa5-0bda-4d33-9c93-eaae6ab10f06 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1564 microversion: 2.1 time: 0.170854 Jun 04 21:30:52.713864 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2782/5664] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:52 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:30:54.748620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:30:54.749239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:30:54.758071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:54.758573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:54.759348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:54.760037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:54.831692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0de630c5-5313-43da-8fe9-0e3f62f2756d req-5aaef00e-83e3-4430-a3a6-9056aa3216f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:30:54.841022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0de630c5-5313-43da-8fe9-0e3f62f2756d req-5aaef00e-83e3-4430-a3a6-9056aa3216f9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:30:54.841891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0de630c5-5313-43da-8fe9-0e3f62f2756d req-5aaef00e-83e3-4430-a3a6-9056aa3216f9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:30:54.854606 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0de630c5-5313-43da-8fe9-0e3f62f2756d req-5aaef00e-83e3-4430-a3a6-9056aa3216f9 service nova] Creating event network-changed:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch1-master-1 Jun 04 21:30:54.859916 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0de630c5-5313-43da-8fe9-0e3f62f2756d req-5aaef00e-83e3-4430-a3a6-9056aa3216f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108640 Jun 04 21:30:54.860941 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2783/5665] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:30:54.917522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:30:54.925727 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-94aac254-7a36-404e-b97a-c7826cb53628 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1564 microversion: 2.1 time: 0.180969 Jun 04 21:30:54.926543 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2883/5666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:30:54 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:08.367642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:08.368263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:08.371224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=7 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:08.371900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=42 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:08.378490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:08.378490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:08.378995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:08.379427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:08.407056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:31:08.509411 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-51b17504-7544-4ed1-af09-f0b696eb77d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 204 len: 0 microversion: 2.1 time: 0.145639 Jun 04 21:31:08.510076 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2784/5667] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:31:08 2022] DELETE /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:31:08.520352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:08.520982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:08.523227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:08.523930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=38 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:08.530298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:08.530762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:08.531581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:08.532036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:08.678756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:08.690550 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-10111406-a648-414a-9706-c4c1ab89e8d2 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1732 microversion: 2.1 time: 0.175609 Jun 04 21:31:08.691261 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2884/5668] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:08 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:09.712717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:09.714773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:09.724434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:09.724880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:09.725651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:09.726080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:09.872982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:09.881380 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7592c5a-5bb0-4af8-b82e-df38eec627c6 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1732 microversion: 2.1 time: 0.175713 Jun 04 21:31:09.882056 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2785/5669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:09 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:10.710261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-7ebc4e5e-a3f1-49a1-a444-a328a2697026 req-c4f52fe3-e25a-4dba-b1be-08fa50689b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f118d316-cff3-4c7d-bc11-fe5edd86b5cc", "name": "network-vif-deleted", "tag": "bfec44d6-64be-48d7-9d6b-743e8d4cea4c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:10.722743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7ebc4e5e-a3f1-49a1-a444-a328a2697026 req-c4f52fe3-e25a-4dba-b1be-08fa50689b11 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:10.723202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7ebc4e5e-a3f1-49a1-a444-a328a2697026 req-c4f52fe3-e25a-4dba-b1be-08fa50689b11 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:10.737486 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-7ebc4e5e-a3f1-49a1-a444-a328a2697026 req-c4f52fe3-e25a-4dba-b1be-08fa50689b11 service nova] Creating event network-vif-deleted:bfec44d6-64be-48d7-9d6b-743e8d4cea4c for instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc on nch2-master-1 Jun 04 21:31:10.743028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-7ebc4e5e-a3f1-49a1-a444-a328a2697026 req-c4f52fe3-e25a-4dba-b1be-08fa50689b11 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038073 Jun 04 21:31:10.743890 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2885/5670] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:31:10.899777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:10.900489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:10.908054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:10.908716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:10.909942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:10.910384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:10.950601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:10.951056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:10.951525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lazy-loading 'fault' on Instance uuid f118d316-cff3-4c7d-bc11-fe5edd86b5cc {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:31:10.994439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013cb638ecc6411e943c2056b813059d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8209f333d47d4a9e8a0f5e8754927807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:11.002528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-acb42522-e72c-4824-abe0-ac5872dc90ea tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 200 len: 1388 microversion: 2.1 time: 0.107516 Jun 04 21:31:11.003616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2786/5671] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:10 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 1388 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:12.024649 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:12.025804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:12.036860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:12.037327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:12.038118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:12.038578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:12.052907 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] HTTP exception thrown: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Request method failure captured: Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc HTTP/1.1 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim83xl7G4WdAeZrv7jtCZddVvvuk1IFeFklUi7gYHQcxbgZznumTRFjDZUPPay0Xl6sZymRE9yGTJByLHJNJcSt0osJP73l_RcqTtWXz89ItBiGuRhPd30UZvFdDBuYte29NXdLV0FSjSxqdLaKTQ0mjp8u4b4YG5sMFyH6qng8CWaYs Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 8209f333d47d4a9e8a0f5e8754927807 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 8209f333d47d4a9e8a0f5e8754927807 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestServerBasicOps-357207767-project Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 013cb638ecc6411e943c2056b813059d Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestServerBasicOps-357207767-project Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f118d316-cff3-4c7d-bc11-fe5edd86b5cc'} Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:12.054546 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Returning 404 to user: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-624b0cdc-e62c-43a8-9cf3-546bd40accd1 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 404 len: 111 microversion: 2.1 time: 0.038225 Jun 04 21:31:12.059416 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2886/5672] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:12 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:31:12.523443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:12.524379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:12.535612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:12.536060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:12.536828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:12.537259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:12.552009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] HTTP exception thrown: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Request method failure captured: Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc HTTP/1.1 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim83xl7G4WdAeZrv7jtCZddVvvuk1IFeFklUi7gYHQcxbgZznumTRFjDZUPPay0Xl6sZymRE9yGTJByLHJNJcSt0osJP73l_RcqTtWXz89ItBiGuRhPd30UZvFdDBuYte29NXdLV0FSjSxqdLaKTQ0mjp8u4b4YG5sMFyH6qng8CWaYs Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 8209f333d47d4a9e8a0f5e8754927807 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 8209f333d47d4a9e8a0f5e8754927807 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestServerBasicOps-357207767-project Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 013cb638ecc6411e943c2056b813059d Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestServerBasicOps-357207767-project Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'f118d316-cff3-4c7d-bc11-fe5edd86b5cc'} Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:31:12.553684 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Returning 404 to user: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-392e96e7-5743-4d2e-8a95-5d784ca34873 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 404 len: 111 microversion: 2.1 time: 0.038116 Jun 04 21:31:12.558348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2787/5673] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:31:12 2022] DELETE /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:31:12.564155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:12.564820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] [instance: f118d316-cff3-4c7d-bc11-fe5edd86b5cc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:12.571654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:12.572115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:12.572887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:12.573409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:12.587861 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] HTTP exception thrown: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Request method failure captured: Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc HTTP/1.1 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim83xl7G4WdAeZrv7jtCZddVvvuk1IFeFklUi7gYHQcxbgZznumTRFjDZUPPay0Xl6sZymRE9yGTJByLHJNJcSt0osJP73l_RcqTtWXz89ItBiGuRhPd30UZvFdDBuYte29NXdLV0FSjSxqdLaKTQ0mjp8u4b4YG5sMFyH6qng8CWaYs Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 8209f333d47d4a9e8a0f5e8754927807 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/8209f333d47d4a9e8a0f5e8754927807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 8209f333d47d4a9e8a0f5e8754927807 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestServerBasicOps-357207767 Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestServerBasicOps-357207767-project Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 013cb638ecc6411e943c2056b813059d Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestServerBasicOps-357207767-project Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'f118d316-cff3-4c7d-bc11-fe5edd86b5cc'} Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:12.589402 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Returning 404 to user: Instance f118d316-cff3-4c7d-bc11-fe5edd86b5cc could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a100ca5b-8ebb-4936-9fc3-c974d1057664 tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc" status: 404 len: 111 microversion: 2.1 time: 0.030692 Jun 04 21:31:12.593659 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2887/5674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:12 2022] GET /compute/v2.1/servers/f118d316-cff3-4c7d-bc11-fe5edd86b5cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:31:12.759946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14632205-17a2-410c-bc31-bfc2c463574a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] Calling method '.version_select at 0x7f2d0bf5b9d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:12.782715 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14632205-17a2-410c-bc31-bfc2c463574a tempest-TestServerBasicOps-357207767 tempest-TestServerBasicOps-357207767-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1783708974" status: 202 len: 0 microversion: 2.1 time: 0.026834 Jun 04 21:31:12.784561 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2788/5675] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:31:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1783708974 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:31:18.229349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:18.231005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:18.238301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:18.238769 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:18.239836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:18.240293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:18.308742 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ddc80c1-7cf2-4618-9a5d-eaab61dd4f7f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action" status: 200 len: 24572 microversion: 2.1 time: 0.083995 Jun 04 21:31:18.309814 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2888/5676] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:31:18 2022] POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action => generated 24572 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:31:29.242426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:29.243172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:29.489138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:29.489759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:29.497135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:29.497527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:29.498303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:29.498735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:29.639673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:29.648166 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-13599be0-3e4d-4a94-a180-7959c7bc05da tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1682 microversion: 2.1 time: 0.410983 Jun 04 21:31:29.648740 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2789/5677] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:29 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1682 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:29.749587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:29.750627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:29.753828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:29.754536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=16 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:31:29.761526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:29.761995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:29.762809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:29.763250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:29.844191 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c39b310-74bd-469c-bf18-77f917046afd tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action" status: 200 len: 32645 microversion: 2.1 time: 0.099284 Jun 04 21:31:29.844848 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2889/5678] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:31:29 2022] POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action => generated 32645 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:31:30.054592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:30.055091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:30.062097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:30.062535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:30.063340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:30.063826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:30.203247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68ad86dd-c6d7-4102-9da4-6decacc3e5ae tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1833 microversion: 2.1 time: 0.152685 Jun 04 21:31:30.203894 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2790/5679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:30 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1833 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:30.227498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:30.228764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:30.236629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:30.237102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:30.237864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:30.238307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:30.269869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lazy-loading 'flavor' on Instance uuid 45da0d54-7387-4d38-8fe5-b9e5b496ef2e {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:31:30.284033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Going to try to live migrate instance to another host {{(pid=137228) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 04 21:31:30.354430 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [6858fe18-fc51-477a-8254-b11d68c2e1d2] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 21:31:31.364051 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [6858fe18-fc51-477a-8254-b11d68c2e1d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 46844. Jun 04 21:31:34.758918 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc8dc182-ef43-4db3-8f5a-bfc70f6d4bbb tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action" status: 202 len: 0 microversion: 2.1 time: 4.535551 Jun 04 21:31:34.759668 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2890/5680] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:31:30 2022] POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action => generated 0 bytes in 4537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:31:34.769185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:34.769964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:34.778415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:34.778873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:34.779727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:34.780170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:34.920842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:34.928786 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7317e753-9c40-453b-885b-427d998b5318 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.163933 Jun 04 21:31:34.929428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2791/5681] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:34 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:35.946993 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:35.947594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:35.958105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:35.958563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:35.959333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:35.959803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:36.068476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-18ad0d23-e833-4be6-aa14-4e679702396d req-80120d9d-da8a-41a1-805f-a3593dd469b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "name": "network-vif-unplugged", "status": "completed", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:36.081117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-18ad0d23-e833-4be6-aa14-4e679702396d req-80120d9d-da8a-41a1-805f-a3593dd469b4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:36.081546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-18ad0d23-e833-4be6-aa14-4e679702396d req-80120d9d-da8a-41a1-805f-a3593dd469b4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:36.094330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-18ad0d23-e833-4be6-aa14-4e679702396d req-80120d9d-da8a-41a1-805f-a3593dd469b4 service nova] Creating event network-vif-unplugged:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch1-master-1 Jun 04 21:31:36.103309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:36.107924 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-18ad0d23-e833-4be6-aa14-4e679702396d req-80120d9d-da8a-41a1-805f-a3593dd469b4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036617 Jun 04 21:31:36.113501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-981db2c5-c44d-4356-89af-f9d382afa8f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.170129 Jun 04 21:31:36.114009 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2792/5682] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:31:36.114566 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2891/5683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:35 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:37.137468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:37.138151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:37.145437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:37.145895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:37.146662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:37.147100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:37.296870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:37.308617 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f1e24714-6571-48ec-ba87-67f3cf68c792 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.179330 Jun 04 21:31:37.309369 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2793/5684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:37 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:38.126297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d917f216-71ba-47b1-b56d-f2db1523eedb req-08fb8d86-dad6-4fd8-9898-89868c62f1ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:38.136688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d917f216-71ba-47b1-b56d-f2db1523eedb req-08fb8d86-dad6-4fd8-9898-89868c62f1ce service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:38.137191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d917f216-71ba-47b1-b56d-f2db1523eedb req-08fb8d86-dad6-4fd8-9898-89868c62f1ce service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:38.148535 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d917f216-71ba-47b1-b56d-f2db1523eedb req-08fb8d86-dad6-4fd8-9898-89868c62f1ce service nova] Creating event network-changed:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch1-master-1 Jun 04 21:31:38.153834 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d917f216-71ba-47b1-b56d-f2db1523eedb req-08fb8d86-dad6-4fd8-9898-89868c62f1ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031276 Jun 04 21:31:38.154422 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2892/5685] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:31:38.331097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:38.331737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:38.339469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:38.340378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:38.341475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:38.341955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:38.489773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:38.498106 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7f5f7cb8-a3f0-4103-b669-80f5cb7c5eac tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.170964 Jun 04 21:31:38.498783 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2794/5686] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:38 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:39.517823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:39.518538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:39.525566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:39.526026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:39.526813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:39.527265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:39.678312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:39.690717 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ced7c0d2-c23f-4381-b907-60d191d8585d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.178277 Jun 04 21:31:39.691620 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2893/5687] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:39 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:40.709840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:40.710459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:40.720621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:40.721266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:40.722411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:40.723056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:40.865645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:40.875850 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f8272327-2433-4763-bb63-bf2c8c4ec79f tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.171447 Jun 04 21:31:40.876422 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2795/5688] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:40 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:41.893980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:41.894730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:41.902470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:41.902941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:41.903778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:41.904233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:42.043607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c4345546-7ab7-4928-8449-db84424d157e req-647ff0b5-db92-4902-a1c2-df350a230ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "name": "network-vif-unplugged", "status": "completed", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:42.052608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c4345546-7ab7-4928-8449-db84424d157e req-647ff0b5-db92-4902-a1c2-df350a230ec0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:42.053037 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c4345546-7ab7-4928-8449-db84424d157e req-647ff0b5-db92-4902-a1c2-df350a230ec0 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:42.058760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:42.066860 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-641f08ef-0790-4262-9e01-7bb0759c90f6 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.177401 Jun 04 21:31:42.067682 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2894/5689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:41 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:42.071892 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c4345546-7ab7-4928-8449-db84424d157e req-647ff0b5-db92-4902-a1c2-df350a230ec0 service nova] Creating event network-vif-unplugged:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch1-master-1 Jun 04 21:31:42.078208 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c4345546-7ab7-4928-8449-db84424d157e req-647ff0b5-db92-4902-a1c2-df350a230ec0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038261 Jun 04 21:31:42.078770 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2796/5690] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:31:43.085654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:43.086294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:43.093920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:43.094395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:43.095555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:43.095682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:43.231319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:43.241265 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc66910e-9952-458a-bcb8-ac36d3338d01 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1692 microversion: 2.1 time: 0.159622 Jun 04 21:31:43.242131 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2895/5691] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:43 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:44.262509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:44.263292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:44.271108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.271596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.272521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.272987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.422954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:44.430886 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f6565f27-7f31-46c1-8890-6c73c130f989 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1682 microversion: 2.1 time: 0.175815 Jun 04 21:31:44.431483 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2797/5692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:44 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:44.447441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:44.448101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:44.455451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.455983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.456772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.457227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.593789 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c66e0586-5ba1-4ee7-9c5a-7a1329a423a9 tempest-TestNetworkAdvancedServerOps-31379573 tempest-TestNetworkAdvancedServerOps-31379573-project-admin] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1833 microversion: 2.1 time: 0.150129 Jun 04 21:31:44.594351 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2896/5693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:44 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1833 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:44.611067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:44.611720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:44.618000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.618479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.619239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.619701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.758833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:44.767647 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-675085eb-bd5b-4741-9cce-19e617da5b47 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1682 microversion: 2.1 time: 0.160464 Jun 04 21:31:44.771549 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2798/5694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:44 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:44.869836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:44.870805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:44.877492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.877961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.878751 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:44.879202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:44.929320 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-96e33b1d-063b-416c-b4c4-c7021c880a02 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action" status: 200 len: 38609 microversion: 2.1 time: 0.063328 Jun 04 21:31:44.929963 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2897/5695] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:31:44 2022] POST /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e/action => generated 38609 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:31:46.216498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:46.217059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:46.218893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-baf3fe13-a788-4dfd-b907-572c05a32e16 req-c201118a-07c4-45e9-bd21-e964d8ece340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:46.224702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:46.225256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:46.226053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:46.226492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:46.230145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-baf3fe13-a788-4dfd-b907-572c05a32e16 req-c201118a-07c4-45e9-bd21-e964d8ece340 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:46.230767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-baf3fe13-a788-4dfd-b907-572c05a32e16 req-c201118a-07c4-45e9-bd21-e964d8ece340 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:46.245937 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-baf3fe13-a788-4dfd-b907-572c05a32e16 req-c201118a-07c4-45e9-bd21-e964d8ece340 service nova] Creating event network-changed:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch2-master-1 Jun 04 21:31:46.251326 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-baf3fe13-a788-4dfd-b907-572c05a32e16 req-c201118a-07c4-45e9-bd21-e964d8ece340 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037317 Jun 04 21:31:46.252026 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2898/5696] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:31:46.257255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:31:46.351214 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a203a22-d0c1-46d5-bd6b-217275f7de7a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 204 len: 0 microversion: 2.1 time: 0.139122 Jun 04 21:31:46.352322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2799/5697] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:31:46 2022] DELETE /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:31:46.362798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:46.364068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:46.374165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:46.375218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:46.376291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:46.376966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:46.862641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:46.873149 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-162b645a-f5a0-4a71-97d0-755d39d8246b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 200 len: 1688 microversion: 2.1 time: 0.516014 Jun 04 21:31:46.874273 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2899/5698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:46 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 1688 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:47.894862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:47.895584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 45da0d54-7387-4d38-8fe5-b9e5b496ef2e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:47.902958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:47.903460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:47.904416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:47.904900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:47.921541 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] HTTP exception thrown: Instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e could not be found. Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Request method failure captured: Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e HTTP/1.1 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim84Dn58ValFXUTebBMP7dcTKQ5Z2qG55qf9hXJgpxeBNi_yB1fQpt6BxbtWMu1ypgYh2LZC0eZK8IUrsu5ORb3viJNMHp9Jx88-hELo8A1mK7TFaFy5TbVOmkrUAzVb1xeavrzcslCOP4-AazfRrLsJiGIWnnyb0rzWGktycVnsVHaw Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_487d2d29adde413baa30ed91635c0591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/487d2d29adde413baa30ed91635c0591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e9add19ab3754964b66d1d5a7facc5e8 Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e could not be found. Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '45da0d54-7387-4d38-8fe5-b9e5b496ef2e'} Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e could not be found. Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e could not be found. Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:47.923182 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e could not be found. Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Returning 404 to user: Instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b234ed8-2952-47fa-806d-281e92ac33ba tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e" status: 404 len: 111 microversion: 2.1 time: 0.036269 Jun 04 21:31:47.928505 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2800/5699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:47 2022] GET /compute/v2.1/servers/45da0d54-7387-4d38-8fe5-b9e5b496ef2e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:31:48.266608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ba7ee066-9d70-458e-acf2-fe235ae22b33 req-d4d6c1df-80c5-4dc4-b9b5-525bf8da6df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45da0d54-7387-4d38-8fe5-b9e5b496ef2e", "name": "network-vif-deleted", "tag": "f118e91c-f2ca-4dc8-888b-d0e27cd33e1d"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:48.276647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ba7ee066-9d70-458e-acf2-fe235ae22b33 req-d4d6c1df-80c5-4dc4-b9b5-525bf8da6df5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:48.276647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ba7ee066-9d70-458e-acf2-fe235ae22b33 req-d4d6c1df-80c5-4dc4-b9b5-525bf8da6df5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:48.288343 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ba7ee066-9d70-458e-acf2-fe235ae22b33 req-d4d6c1df-80c5-4dc4-b9b5-525bf8da6df5 service nova] Creating event network-vif-deleted:f118e91c-f2ca-4dc8-888b-d0e27cd33e1d for instance 45da0d54-7387-4d38-8fe5-b9e5b496ef2e on nch2-master-1 Jun 04 21:31:48.293572 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ba7ee066-9d70-458e-acf2-fe235ae22b33 req-d4d6c1df-80c5-4dc4-b9b5-525bf8da6df5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031215 Jun 04 21:31:48.294343 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2900/5700] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:31:50.982007 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73d3552e-3a42-4c5d-82b6-5656780e5f31 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '.version_select at 0x7f2d018a6790>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:51.004398 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73d3552e-3a42-4c5d-82b6-5656780e5f31 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-511903055" status: 202 len: 0 microversion: 2.1 time: 0.026339 Jun 04 21:31:51.004994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2801/5701] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 21:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-511903055 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:31:51.035450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9e4b1eee-333a-4379-90ad-dbfd44502e22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: .version_select at 0x7f2d003b5ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-310270396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKKfYsa77yKZwjeTULZH+Vo3CZ826900kVm6zLso1uOmSSWZ6smvKnlkT1OJsGN66Wbuw54t0WhlJr9H0KffAYj8S8AeUdRq77hE931GLjkrsVu945u1uK0FautizJI2Q=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:51.052353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-9e4b1eee-333a-4379-90ad-dbfd44502e22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:31:51.058320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-9e4b1eee-333a-4379-90ad-dbfd44502e22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:31:51.085965 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9e4b1eee-333a-4379-90ad-dbfd44502e22 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054899 Jun 04 21:31:51.086631 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2901/5702] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:31:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:31:57.131211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-608371926", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "11ef0ac9-977c-4c61-b821-b6dacbb582a9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-310270396", "security_groups": [{"name": "tempest-secgroup-smoke-1345459862"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:31:57.250673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] validate_networks() for [('11ef0ac9-977c-4c61-b821-b6dacbb582a9', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:31:57.760677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:31:57.761207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:31:57.762109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:31:57.762615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:31:57.763236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:31:57.774943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:57.775732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:57.777066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:57.777757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:57.799826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:31:57.808106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Getting quotas for user e9add19ab3754964b66d1d5a7facc5e8 and project 487d2d29adde413baa30ed91635c0591. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:31:57.823308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:31:57.825962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:31:57.891631 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d5671f3-a3ac-4f5d-8700-1058a15bc942 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765117 Jun 04 21:31:57.893484 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2802/5703] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:31:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:31:57.903953 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46fdbc9a-9205-41ae-b89e-32f8719e12b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:57.908037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46fdbc9a-9205-41ae-b89e-32f8719e12b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:57.985548 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-46fdbc9a-9205-41ae-b89e-32f8719e12b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:57.994817 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46fdbc9a-9205-41ae-b89e-32f8719e12b7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1265 microversion: 2.1 time: 0.095122 Jun 04 21:31:57.996908 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2902/5704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:57 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:31:59.015222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:31:59.016799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:31:59.028017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:59.029085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:59.030142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:31:59.042238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:31:59.183334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:31:59.193118 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5f7af9e3-03a1-42ab-afde-3ade306c7599 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1325 microversion: 2.1 time: 0.183457 Jun 04 21:31:59.198212 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2803/5705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:31:59 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:00.215116 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:00.216506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:00.218766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:00.221263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:00.227754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:00.228211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:00.229186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:00.229686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:00.438573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:00.447558 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9965b335-8659-4866-8214-8f6d5b51f40c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1391 microversion: 2.1 time: 0.236872 Jun 04 21:32:00.448800 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2903/5706] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:00 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:00.719823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-147f3bc7-22de-47ad-84dc-3d18f31ac2cd req-95a30120-54ef-4fc9-98eb-53e8e6f827b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b19a2f-9d73-46a1-b840-e999a1f66b91", "tag": "486420f3-fcc4-42ef-95f9-10eb7c575dd1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:32:00.726489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:00.737957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-147f3bc7-22de-47ad-84dc-3d18f31ac2cd req-95a30120-54ef-4fc9-98eb-53e8e6f827b2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:00.738403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-147f3bc7-22de-47ad-84dc-3d18f31ac2cd req-95a30120-54ef-4fc9-98eb-53e8e6f827b2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:00.741615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:00.758789 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-147f3bc7-22de-47ad-84dc-3d18f31ac2cd req-95a30120-54ef-4fc9-98eb-53e8e6f827b2 service nova] Creating event network-changed:486420f3-fcc4-42ef-95f9-10eb7c575dd1 for instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 on nch2-master-1 Jun 04 21:32:00.767121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-147f3bc7-22de-47ad-84dc-3d18f31ac2cd req-95a30120-54ef-4fc9-98eb-53e8e6f827b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051930 Jun 04 21:32:00.767968 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2804/5707] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:32:01.470267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:01.471654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:01.483087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:01.484090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:01.484916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:01.485374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:01.629936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:01.637767 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-366265d4-1b52-4350-af35-5f136a6a512c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1391 microversion: 2.1 time: 0.174384 Jun 04 21:32:01.638280 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2904/5708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:01 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:02.661414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:02.662151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:02.669867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:02.670328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:02.671094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:02.671725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:02.808655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:02.817230 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-681ab611-7a21-40df-bc0f-87a747df8e08 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1391 microversion: 2.1 time: 0.165013 Jun 04 21:32:02.817823 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2805/5709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:02 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:03.834725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:03.835382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:03.843109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:03.843374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:03.844211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:03.844682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:03.999916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:04.007884 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6275fcd6-c79d-43bd-9fd1-d280ab210c9a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1391 microversion: 2.1 time: 0.177314 Jun 04 21:32:04.008453 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2905/5710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:03 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:05.025856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:05.026517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:05.034202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:05.034667 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:05.035463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:05.035978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:05.043307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d930572a-dc25-4e40-b40e-396712cf8160 req-64e44979-ca79-48d7-a8ce-a36ba9f7cd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b19a2f-9d73-46a1-b840-e999a1f66b91", "name": "network-vif-plugged", "status": "completed", "tag": "486420f3-fcc4-42ef-95f9-10eb7c575dd1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:32:05.052841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d930572a-dc25-4e40-b40e-396712cf8160 req-64e44979-ca79-48d7-a8ce-a36ba9f7cd53 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:05.053295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d930572a-dc25-4e40-b40e-396712cf8160 req-64e44979-ca79-48d7-a8ce-a36ba9f7cd53 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:05.068692 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d930572a-dc25-4e40-b40e-396712cf8160 req-64e44979-ca79-48d7-a8ce-a36ba9f7cd53 service nova] Creating event network-vif-plugged:486420f3-fcc4-42ef-95f9-10eb7c575dd1 for instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 on nch2-master-1 Jun 04 21:32:05.084787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d930572a-dc25-4e40-b40e-396712cf8160 req-64e44979-ca79-48d7-a8ce-a36ba9f7cd53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045182 Jun 04 21:32:05.085756 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2906/5711] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:32:05.209933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:05.218135 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-380ed145-89be-48d4-91d0-1b0ef8c3dde7 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1391 microversion: 2.1 time: 0.196415 Jun 04 21:32:05.218730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2806/5712] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:05 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:06.237276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:06.238022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:06.244826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:06.245290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:06.246072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:06.246531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:06.401175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:06.409083 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fa23f3e5-b6a7-4021-8cc5-22b36c1e7797 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1391 microversion: 2.1 time: 0.177285 Jun 04 21:32:06.409659 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2907/5713] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:06 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:07.427294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:07.427938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:07.435395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:07.435874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:07.436645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:07.437082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:07.583234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:07.591275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8a0e115-e9aa-4884-a603-f068f23cdf0e tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1563 microversion: 2.1 time: 0.168165 Jun 04 21:32:07.591900 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2807/5714] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:07 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:07.609889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:07.610515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:07.617915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:07.618380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:07.619170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:07.619671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:07.990999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:08.029364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:08.037792 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8de70952-e45b-4e02-b6a3-cb5cf8459848 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1563 microversion: 2.1 time: 0.431814 Jun 04 21:32:08.038396 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2908/5715] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:07 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1563 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:10.025738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:10.027017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:10.028924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d3777b7d-31b9-49c0-90db-1a5fb3527ea9 req-80cc97a8-ae3b-442c-be8f-a64b347a8f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b19a2f-9d73-46a1-b840-e999a1f66b91", "tag": "486420f3-fcc4-42ef-95f9-10eb7c575dd1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:32:10.029344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:10.029875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:10.037664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:10.038117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:10.038552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d3777b7d-31b9-49c0-90db-1a5fb3527ea9 req-80cc97a8-ae3b-442c-be8f-a64b347a8f6a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:10.038906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:10.039148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d3777b7d-31b9-49c0-90db-1a5fb3527ea9 req-80cc97a8-ae3b-442c-be8f-a64b347a8f6a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:10.039355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:10.052820 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d3777b7d-31b9-49c0-90db-1a5fb3527ea9 req-80cc97a8-ae3b-442c-be8f-a64b347a8f6a service nova] Creating event network-changed:486420f3-fcc4-42ef-95f9-10eb7c575dd1 for instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 on nch2-master-1 Jun 04 21:32:10.058828 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d3777b7d-31b9-49c0-90db-1a5fb3527ea9 req-80cc97a8-ae3b-442c-be8f-a64b347a8f6a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035534 Jun 04 21:32:10.059552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2909/5716] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:32:10.265305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:10.274716 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-014d860a-412f-48dc-9841-829ba1fcc4ae tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1563 microversion: 2.1 time: 0.253565 Jun 04 21:32:10.275580 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2808/5717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:10 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:31.564212 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=13 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:31.564997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=34 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:31.569334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:32:31.570379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:31.577982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:31.578471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:31.579262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:31.579759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:31.632475 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4404c461-936d-4190-ba03-bc0807dcd8a4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91/action" status: 200 len: 24564 microversion: 2.1 time: 0.069990 Jun 04 21:32:31.633014 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2910/5718] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:32:31 2022] POST /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91/action => generated 24564 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:32:38.030316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:32:38.032753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:38.035870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=9 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:38.037161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=25 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:32:38.046485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:38.046936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:38.047819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:38.048265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:38.319193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:32:38.319678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:32:38.320143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:32:38.320561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:32:38.320981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:32:38.384868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:38.391957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:38.392442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:38.393235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:38.393692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:38.425258 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b92df5fb-75fb-4843-aea9-fb929e34bb91 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91/action" status: 202 len: 1136 microversion: 2.1 time: 0.402148 Jun 04 21:32:38.426278 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2809/5719] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:32:38 2022] POST /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91/action => generated 1136 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 04 21:32:38.441723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:38.442450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:38.450353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:38.450858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:38.451936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:38.452417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:38.683746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:38.691739 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c94d5e88-bb63-45a4-9856-aed7822954e5 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.254404 Jun 04 21:32:38.692177 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2911/5720] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:38 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:32:39.711762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:39.712514 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:39.721606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:39.722055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:39.722823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:39.723256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:39.866948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:39.875006 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-db5e356b-08ab-479f-8814-d43cd8670b75 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.168604 Jun 04 21:32:39.875589 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2810/5721] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:39 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:40.895992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:40.896821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:40.907836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:40.908472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:40.909514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:40.910126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:41.054217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:41.064876 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-77095698-31e8-488f-95f9-010a6f5d66e4 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.174839 Jun 04 21:32:41.065461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2912/5722] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:40 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:42.086956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:42.087974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:42.097633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:42.098092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:42.098869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:42.099305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:42.252574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:42.262466 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ba3b8ccf-9c2b-45f5-a829-cce555fc5a99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.182089 Jun 04 21:32:42.263065 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2811/5723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:42 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:43.284768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:43.285850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:43.297162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:43.297626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:43.298419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:43.298878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:43.448683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:43.461614 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c43663f2-5ec0-4893-b438-882495eeecce tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.183237 Jun 04 21:32:43.462426 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2913/5724] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:43 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:44.483956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:44.485498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:44.492225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:44.492713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:44.493505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:44.494000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:44.637123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:44.645615 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a98653b6-259a-4e3f-9725-db6ffc061774 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.168691 Jun 04 21:32:44.646196 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2812/5725] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:44 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:45.665070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:45.665795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:45.676678 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:45.677361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:45.678467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:45.679132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:45.827643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:45.836397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2f4a8ea4-b506-4f70-a6ab-8e06273260c8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.177164 Jun 04 21:32:45.836974 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2914/5726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:45 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:46.856122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:46.856688 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:46.864159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:46.864609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:46.865353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:46.865815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:47.003028 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:47.017493 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd58c5a5-6b47-4198-afdc-6d54f4a8180c tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.165398 Jun 04 21:32:47.018052 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2813/5727] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:46 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:48.036880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:48.037605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:48.044984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:48.045538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:48.046446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:48.046982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:48.188123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:48.199612 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3d094ab9-59ed-40da-ba07-24b812e9fb99 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.168117 Jun 04 21:32:48.200408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2915/5728] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:48 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:49.218269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:49.218846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:49.226511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:49.226971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:49.227791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:49.228233 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:49.378420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:49.386365 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-be9a85f5-a9d1-421a-9eb4-c0ceb3376435 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1690 microversion: 2.1 time: 0.172166 Jun 04 21:32:49.389994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2814/5729] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:49 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:50.403562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:50.404084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:50.411771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:50.412233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:50.413009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:50.413490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:50.557616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:50.570273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-090be798-532e-49ad-8a3f-dd38bf9a5f7d tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1696 microversion: 2.1 time: 0.170690 Jun 04 21:32:50.571090 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2916/5730] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:50 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:51.595713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:51.596825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:51.604371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:51.604819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:51.605580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:51.606141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:51.752647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:51.760862 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c21168c2-c179-4f57-b408-6ef93c44e739 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1696 microversion: 2.1 time: 0.171885 Jun 04 21:32:51.761447 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2815/5731] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:51 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:52.783293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:32:52.784484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:32:52.796283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:52.797079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:52.798399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:52.799123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:52.943718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:32:52.951878 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e87139c-1efa-4cc4-a666-48f4c16166e8 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1681 microversion: 2.1 time: 0.175175 Jun 04 21:32:52.952461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2917/5732] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:32:52 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:32:55.217207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-29f4d486-0cac-4f48-963c-5421db34729d req-3c3d73b2-2c7f-4dfc-a680-33684730caa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b19a2f-9d73-46a1-b840-e999a1f66b91", "name": "network-vif-plugged", "status": "completed", "tag": "486420f3-fcc4-42ef-95f9-10eb7c575dd1"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:32:55.227418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-29f4d486-0cac-4f48-963c-5421db34729d req-3c3d73b2-2c7f-4dfc-a680-33684730caa4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:32:55.227884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-29f4d486-0cac-4f48-963c-5421db34729d req-3c3d73b2-2c7f-4dfc-a680-33684730caa4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:32:55.241037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-29f4d486-0cac-4f48-963c-5421db34729d req-3c3d73b2-2c7f-4dfc-a680-33684730caa4 service nova] Creating event network-vif-plugged:486420f3-fcc4-42ef-95f9-10eb7c575dd1 for instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 on nch2-master-1 Jun 04 21:32:55.246238 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-29f4d486-0cac-4f48-963c-5421db34729d req-3c3d73b2-2c7f-4dfc-a680-33684730caa4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Jun 04 21:32:55.247013 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2816/5733] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:33:17.192893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:17.193877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:17.196516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=16 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:17.197208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=46 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:17.203216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:17.203726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:17.204523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:17.204985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:17.256029 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e007aa3a-fdb5-49ba-800f-b11fcc420611 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "POST /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91/action" status: 200 len: 24579 microversion: 2.1 time: 0.066958 Jun 04 21:33:17.256677 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2918/5734] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:33:17 2022] POST /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91/action => generated 24579 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:33:24.606520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:24.607838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:24.608979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-7d36bb13-40eb-4ec9-b7ab-7f9056ed24a7 req-f0f1466e-eeb1-4a0e-a39e-f4ce470e5211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70b19a2f-9d73-46a1-b840-e999a1f66b91", "tag": "486420f3-fcc4-42ef-95f9-10eb7c575dd1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:24.611873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=20 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:24.612494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:24.617670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:24.618176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:24.619362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:24.619486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7d36bb13-40eb-4ec9-b7ab-7f9056ed24a7 req-f0f1466e-eeb1-4a0e-a39e-f4ce470e5211 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:24.619841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:24.620123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7d36bb13-40eb-4ec9-b7ab-7f9056ed24a7 req-f0f1466e-eeb1-4a0e-a39e-f4ce470e5211 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:24.633371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-7d36bb13-40eb-4ec9-b7ab-7f9056ed24a7 req-f0f1466e-eeb1-4a0e-a39e-f4ce470e5211 service nova] Creating event network-changed:486420f3-fcc4-42ef-95f9-10eb7c575dd1 for instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 on nch2-master-1 Jun 04 21:33:24.638848 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-7d36bb13-40eb-4ec9-b7ab-7f9056ed24a7 req-f0f1466e-eeb1-4a0e-a39e-f4ce470e5211 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034334 Jun 04 21:33:24.643555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2919/5735] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:33:24.652266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:33:24.742630 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83a834fd-f562-402c-9c3f-befeebd698e9 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 204 len: 0 microversion: 2.1 time: 0.140175 Jun 04 21:33:24.747302 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2817/5736] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:33:24 2022] DELETE /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:33:24.753740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:24.754463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:24.761449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:24.761913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:24.762910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:24.763365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:24.918798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:24.926708 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d2794574-06b4-4c16-9ed1-d3daa1c3660b tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1687 microversion: 2.1 time: 0.177927 Jun 04 21:33:24.927530 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2920/5737] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:24 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:33:25.950027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:25.951205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:25.959655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:25.960104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:25.960887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:25.961330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:26.174074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9add19ab3754964b66d1d5a7facc5e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487d2d29adde413baa30ed91635c0591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:26.182370 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ecaca1a6-baaa-4967-b942-f420bee28a3a tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 200 len: 1687 microversion: 2.1 time: 0.240362 Jun 04 21:33:26.183193 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2818/5738] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:25 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 1687 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:26.587781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-97484f00-d355-4b7f-b874-69a924606f43 req-8f721c04-8c9a-4d93-a718-ea9fb79cbd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70b19a2f-9d73-46a1-b840-e999a1f66b91", "name": "network-vif-deleted", "tag": "486420f3-fcc4-42ef-95f9-10eb7c575dd1"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:26.597466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-97484f00-d355-4b7f-b874-69a924606f43 req-8f721c04-8c9a-4d93-a718-ea9fb79cbd55 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:26.597923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-97484f00-d355-4b7f-b874-69a924606f43 req-8f721c04-8c9a-4d93-a718-ea9fb79cbd55 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:26.610197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-97484f00-d355-4b7f-b874-69a924606f43 req-8f721c04-8c9a-4d93-a718-ea9fb79cbd55 service nova] Creating event network-vif-deleted:486420f3-fcc4-42ef-95f9-10eb7c575dd1 for instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 on nch2-master-1 Jun 04 21:33:26.616707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-97484f00-d355-4b7f-b874-69a924606f43 req-8f721c04-8c9a-4d93-a718-ea9fb79cbd55 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Jun 04 21:33:26.617649 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2921/5739] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:33:27.202400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:27.203275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] [instance: 70b19a2f-9d73-46a1-b840-e999a1f66b91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:27.211836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:27.212289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:27.213062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:27.213497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:27.227941 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] HTTP exception thrown: Instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 could not be found. Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Request method failure captured: Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 HTTP/1.1 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim84Dn58ValFXUTebBMP7dcTKQ5Z2qG55qf9hXJgpxeBNi_yB1fQpt6BxbtWMu1ypgYh2LZC0eZK8IUrsu5ORb3viJNMHp9Jx88-hELo8A1mK7TFaFy5TbVOmkrUAzVb1xeavrzcslCOP4-AazfRrLsJiGIWnnyb0rzWGktycVnsVHaw Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_487d2d29adde413baa30ed91635c0591"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/487d2d29adde413baa30ed91635c0591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/487d2d29adde413baa30ed91635c0591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 487d2d29adde413baa30ed91635c0591 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1712033491 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e9add19ab3754964b66d1d5a7facc5e8 Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1712033491-project Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 could not be found. Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '70b19a2f-9d73-46a1-b840-e999a1f66b91'} Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 could not be found. Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 could not be found. Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:33:27.229637 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 could not be found. Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Returning 404 to user: Instance 70b19a2f-9d73-46a1-b840-e999a1f66b91 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a573ade-5e82-45b0-be15-7e5749223593 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91" status: 404 len: 111 microversion: 2.1 time: 0.034027 Jun 04 21:33:27.234513 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2819/5740] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:27 2022] GET /compute/v2.1/servers/70b19a2f-9d73-46a1-b840-e999a1f66b91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:33:30.545775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-79eca8e7-094f-4b4c-8604-3ea735ecac40 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] Calling method '.version_select at 0x7f2d00cad4c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:30.576337 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-79eca8e7-094f-4b4c-8604-3ea735ecac40 tempest-TestNetworkAdvancedServerOps-1712033491 tempest-TestNetworkAdvancedServerOps-1712033491-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-310270396" status: 202 len: 0 microversion: 2.1 time: 0.036031 Jun 04 21:33:30.577260 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2922/5741] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 21:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-310270396 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:33:38.823740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-405f0125-f864-440a-9bce-8b8f30d0a1f6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'create', calling method: .version_select at 0x7f2d00d4a670>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-924979011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/RTyB5ivAtIGenaXr7GVu9SQH1DocT738ODpcqhuorUb+xDYZAH4vrM+yQqxTP87A/iFUt5o4LFpQvLzYWGh1HrVl02OfcJF1eoZxQh9A91KLYt4ZfdX9bldjvWggNLA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:38.828971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:38.829731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:38.850168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-405f0125-f864-440a-9bce-8b8f30d0a1f6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for project 35e9e2025977459bafb89c97180bc199. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:33:38.855849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-405f0125-f864-440a-9bce-8b8f30d0a1f6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for user efa3530b7b2b4dcfac5a43d1d1750067 and project 35e9e2025977459bafb89c97180bc199. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:33:38.893504 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-405f0125-f864-440a-9bce-8b8f30d0a1f6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.073509 Jun 04 21:33:38.894294 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2820/5742] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:33:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:33:39.988850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1174684608", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "4e68fcf8-126c-4af3-9ada-e9ed2916940e"}], "key_name": "tempest-TestNetworkBasicOps-924979011", "security_groups": [{"name": "tempest-secgroup-smoke-450082552"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:39.997893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:40.109443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] validate_networks() for [('4e68fcf8-126c-4af3-9ada-e9ed2916940e', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:33:40.589983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:33:40.590419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:33:40.590903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:33:40.591321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:33:40.591823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:33:40.601661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:40.602121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:40.602926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:40.603374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:40.621582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for project 35e9e2025977459bafb89c97180bc199. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:33:40.628266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for user efa3530b7b2b4dcfac5a43d1d1750067 and project 35e9e2025977459bafb89c97180bc199. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:33:40.643211 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:33:40.645747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:33:40.695080 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e49999b-7f78-486d-85de-0b80ccb90bb6 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710566 Jun 04 21:33:40.695795 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2923/5743] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:33:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:33:40.707566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ff932ed-6f21-430b-9c4f-771d204a4e90 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:40.708878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ff932ed-6f21-430b-9c4f-771d204a4e90 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:40.771680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ff932ed-6f21-430b-9c4f-771d204a4e90 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:40.780002 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ff932ed-6f21-430b-9c4f-771d204a4e90 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1248 microversion: 2.1 time: 0.077823 Jun 04 21:33:40.780592 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2821/5744] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:40 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:41.797797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:41.798546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:41.806868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:41.807332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:41.808224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:41.809104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:41.880155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:41.888210 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8d5e77e2-e576-4511-ae7d-f908571e2b8d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1318 microversion: 2.1 time: 0.095266 Jun 04 21:33:41.888790 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2924/5745] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:41 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:42.905854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:42.906435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:42.914851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:42.915331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:42.916146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:42.916585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:43.059317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:43.067783 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bd312686-47bb-4b96-8196-5dcf88f877cd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1373 microversion: 2.1 time: 0.165814 Jun 04 21:33:43.068702 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2822/5746] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:42 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:43.244429 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d763e92e-aac6-4385-8eef-43aaca101aa3 req-e3ee2047-b920-4be4-bea8-ab330f62d29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16369a0e-5ca7-461f-ae6e-093f56821ca9", "tag": "13b967d2-5804-4520-8583-8a4c5242f97c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:43.254176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d763e92e-aac6-4385-8eef-43aaca101aa3 req-e3ee2047-b920-4be4-bea8-ab330f62d29e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:43.254622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d763e92e-aac6-4385-8eef-43aaca101aa3 req-e3ee2047-b920-4be4-bea8-ab330f62d29e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:43.267778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d763e92e-aac6-4385-8eef-43aaca101aa3 req-e3ee2047-b920-4be4-bea8-ab330f62d29e service nova] Creating event network-changed:13b967d2-5804-4520-8583-8a4c5242f97c for instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 on nch2-master-1 Jun 04 21:33:43.273903 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d763e92e-aac6-4385-8eef-43aaca101aa3 req-e3ee2047-b920-4be4-bea8-ab330f62d29e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033111 Jun 04 21:33:43.274562 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2925/5747] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:33:44.091047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:44.091983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:44.101283 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:44.101736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:44.102513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:44.102950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:44.236406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:44.244227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44654884-8242-46e5-a031-7f558e9ba48f tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1373 microversion: 2.1 time: 0.160013 Jun 04 21:33:44.244806 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2823/5748] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:44 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:45.268478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:45.269476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:45.277081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:45.277617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:45.278396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:45.278842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:45.425062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:45.433036 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-42084ddf-0988-4e46-b8b1-3618e53ba2bd tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1373 microversion: 2.1 time: 0.173701 Jun 04 21:33:45.433603 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2926/5749] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:45 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:46.452396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:46.452989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:46.462756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:46.463213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:46.464103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:46.464635 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:46.605698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:46.613927 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6bc12b12-3be1-4ac9-a1fe-6f7bea94c0bb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1373 microversion: 2.1 time: 0.166218 Jun 04 21:33:46.614520 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2824/5750] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:46 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:47.462888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5d19f90f-5dee-41d1-97ef-614bf6877134 req-1daab3c5-a253-4bf7-bc6a-d918902fb83b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16369a0e-5ca7-461f-ae6e-093f56821ca9", "name": "network-vif-plugged", "status": "completed", "tag": "13b967d2-5804-4520-8583-8a4c5242f97c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:47.467358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:47.476259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5d19f90f-5dee-41d1-97ef-614bf6877134 req-1daab3c5-a253-4bf7-bc6a-d918902fb83b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:47.476717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5d19f90f-5dee-41d1-97ef-614bf6877134 req-1daab3c5-a253-4bf7-bc6a-d918902fb83b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:47.490698 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5d19f90f-5dee-41d1-97ef-614bf6877134 req-1daab3c5-a253-4bf7-bc6a-d918902fb83b service nova] Creating event network-vif-plugged:13b967d2-5804-4520-8583-8a4c5242f97c for instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 on nch2-master-1 Jun 04 21:33:47.495945 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5d19f90f-5dee-41d1-97ef-614bf6877134 req-1daab3c5-a253-4bf7-bc6a-d918902fb83b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036860 Jun 04 21:33:47.496554 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2927/5751] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:33:47.631747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:47.632360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:47.639339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:47.639825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:47.640600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:47.641041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:47.780423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:47.789191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52e536b4-0d1f-4333-9ec9-858b47a2a34d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1373 microversion: 2.1 time: 0.161313 Jun 04 21:33:47.795432 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2825/5752] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:47 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:48.812944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:48.814107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:48.821734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:48.822196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:48.822984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:48.823433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:48.962921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:48.970741 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66d85fc0-8db7-420d-935a-c85b6e53f80a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1373 microversion: 2.1 time: 0.166387 Jun 04 21:33:48.971298 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2928/5753] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:48 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:49.988439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:49.989016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:49.996698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:49.997447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:49.997927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:49.998364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:50.137356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:50.146700 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c504dba-1416-4d1b-971e-1ee7557a3e3a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1545 microversion: 2.1 time: 0.162392 Jun 04 21:33:50.147304 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2826/5754] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:49 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1545 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:50.163832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:33:50.164521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:33:50.171863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:50.172172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:50.172979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:50.173435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:50.324518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:33:50.333059 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8d9b850f-9b68-4016-823e-e3104994729d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1545 microversion: 2.1 time: 0.173815 Jun 04 21:33:50.333626 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2929/5755] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:33:50 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1545 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:33:52.270519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-707c549d-9258-49ba-81fd-ca3399ca5440 req-c6fa88f3-e5c8-45c4-bdc8-870b1d464d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16369a0e-5ca7-461f-ae6e-093f56821ca9", "tag": "13b967d2-5804-4520-8583-8a4c5242f97c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:33:52.277617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:33:52.285833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-707c549d-9258-49ba-81fd-ca3399ca5440 req-c6fa88f3-e5c8-45c4-bdc8-870b1d464d2c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:33:52.286288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-707c549d-9258-49ba-81fd-ca3399ca5440 req-c6fa88f3-e5c8-45c4-bdc8-870b1d464d2c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:33:52.298290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-707c549d-9258-49ba-81fd-ca3399ca5440 req-c6fa88f3-e5c8-45c4-bdc8-870b1d464d2c service nova] Creating event network-changed:13b967d2-5804-4520-8583-8a4c5242f97c for instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 on nch2-master-1 Jun 04 21:33:52.303739 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-707c549d-9258-49ba-81fd-ca3399ca5440 req-c6fa88f3-e5c8-45c4-bdc8-870b1d464d2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037249 Jun 04 21:33:52.304401 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2827/5756] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:34:12.585233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:34:12.586133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:12.588493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:12.589187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:12.589906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=5 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:12.590790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=30 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:12.597441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:12.597906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:12.598692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:12.599147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:12.649442 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2685ca30-de17-4c33-90a1-c01258073043 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9/action" status: 200 len: 24574 microversion: 2.1 time: 0.068091 Jun 04 21:34:12.649984 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2930/5757] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:34:12 2022] POST /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:34:27.234471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:27.235295 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=32 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:27.239919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-daa99c30-ede7-461c-a52b-ec8eb6876d6c tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'create', calling method: .version_select at 0x7f2d0be784c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1254722199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmkHd8MK0CpR5ZKlfi7nTjG49ky2hUjmV9F1uzlafgeqrfQxVGfhzA3dV3v4UTJP0q+ltbv+V/2eNtjyQcfZ/BZIAmveJ0JZ2XK/fNticAAd+oqaIaL4SVqIw2XUp0jdQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:34:27.255957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-daa99c30-ede7-461c-a52b-ec8eb6876d6c tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for project 35e9e2025977459bafb89c97180bc199. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:34:27.262017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-daa99c30-ede7-461c-a52b-ec8eb6876d6c tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for user efa3530b7b2b4dcfac5a43d1d1750067 and project 35e9e2025977459bafb89c97180bc199. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:34:27.290690 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-daa99c30-ede7-461c-a52b-ec8eb6876d6c tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.058236 Jun 04 21:34:27.291313 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2828/5758] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:34:27 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:34:28.387007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1362339851", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "15af80a3-0936-4b27-a0d3-e376fe52305b"}], "key_name": "tempest-TestNetworkBasicOps-1254722199", "security_groups": [{"name": "tempest-secgroup-smoke-1870291235"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:34:28.395900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:28.396578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:28.498703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] validate_networks() for [('15af80a3-0936-4b27-a0d3-e376fe52305b', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:34:28.897257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:34:28.898275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:34:28.898972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:34:28.899634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:34:28.900105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:34:28.915737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:28.916346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:28.917421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:28.918100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:28.942159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for project 35e9e2025977459bafb89c97180bc199. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:34:28.948502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for user efa3530b7b2b4dcfac5a43d1d1750067 and project 35e9e2025977459bafb89c97180bc199. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:34:28.963097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:34:28.965841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:34:29.024495 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d64aaec4-8607-47c3-85f2-1bcaebb31b9d tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641923 Jun 04 21:34:29.025259 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2931/5759] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:34:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:34:29.036454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6f45e8f-6f01-43f7-afeb-257eed4f7710 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:29.037305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6f45e8f-6f01-43f7-afeb-257eed4f7710 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:29.108194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c6f45e8f-6f01-43f7-afeb-257eed4f7710 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:29.117375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6f45e8f-6f01-43f7-afeb-257eed4f7710 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1249 microversion: 2.1 time: 0.085892 Jun 04 21:34:29.119041 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2829/5760] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:29 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:30.136948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:30.137560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:30.147107 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:30.147584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:30.148371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:30.148822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:30.216892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:30.226156 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7775f4f5-ce69-43ff-af29-de01dcf3f244 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1309 microversion: 2.1 time: 0.093322 Jun 04 21:34:30.226799 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2932/5761] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:30 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:31.243065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:31.243739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:31.252571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:31.253019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:31.253793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:31.254224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:31.402807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:31.413596 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a0a7d6a0-0344-40a1-9805-9688aa44e909 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.174390 Jun 04 21:34:31.414207 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2830/5762] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:31 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:31.750732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0c859a7b-df01-48ac-b263-ac72b9b35a15 req-570bcff1-b26b-4d5d-978d-157a69302cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b2012c-93ce-482e-8ed7-4523936684bc", "tag": "39d60569-8e8a-4a9f-bd6f-c0d138eb0258"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:34:31.764924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c859a7b-df01-48ac-b263-ac72b9b35a15 req-570bcff1-b26b-4d5d-978d-157a69302cae service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:31.765961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c859a7b-df01-48ac-b263-ac72b9b35a15 req-570bcff1-b26b-4d5d-978d-157a69302cae service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:31.782449 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0c859a7b-df01-48ac-b263-ac72b9b35a15 req-570bcff1-b26b-4d5d-978d-157a69302cae service nova] Creating event network-changed:39d60569-8e8a-4a9f-bd6f-c0d138eb0258 for instance 86b2012c-93ce-482e-8ed7-4523936684bc on nch1-master-1 Jun 04 21:34:31.788037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0c859a7b-df01-48ac-b263-ac72b9b35a15 req-570bcff1-b26b-4d5d-978d-157a69302cae service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041943 Jun 04 21:34:31.788730 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2933/5763] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:34:32.433773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:32.434550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:32.444379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:32.444965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:32.445979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:32.446556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:32.587067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:32.595184 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9b92a66a-440b-4392-bd3a-3066096431d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.167481 Jun 04 21:34:32.595774 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2831/5764] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:32 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:33.614297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:33.615413 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:33.623045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:33.623501 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:33.624579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:33.625025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:33.764767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:33.773368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f6ab70c2-ea69-4f10-9ee1-59c63ba5c4fb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.163373 Jun 04 21:34:33.773952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2934/5765] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:33 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:34.790772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:34.791396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:34.799027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:34.799476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:34.800280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:34.800716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:34.939722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:34.948393 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-938dfd53-8d44-4a23-8d9b-17a7beba2ba5 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.161622 Jun 04 21:34:34.948948 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2832/5766] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:34 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:35.965723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:35.966346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:35.973750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:35.974220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:35.975726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:35.976187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:36.123164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:36.134647 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-49c8124c-0be4-4387-8f27-9417f145dafc tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.172648 Jun 04 21:34:36.135411 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2935/5767] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:35 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:37.157057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:37.157937 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:37.167553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:37.168019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:37.168796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:37.169240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:37.310627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:37.318793 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d81c28af-ba05-4345-8d0c-0ecd290c9eeb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.168443 Jun 04 21:34:37.319726 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2833/5768] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:37 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:37.419958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e7ffb9d6-d5cd-4255-a36e-4563dd756ccf req-2fea831d-d79b-4796-b321-c660033f28a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2012c-93ce-482e-8ed7-4523936684bc", "name": "network-vif-plugged", "status": "completed", "tag": "39d60569-8e8a-4a9f-bd6f-c0d138eb0258"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:34:37.433117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e7ffb9d6-d5cd-4255-a36e-4563dd756ccf req-2fea831d-d79b-4796-b321-c660033f28a1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:37.433833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e7ffb9d6-d5cd-4255-a36e-4563dd756ccf req-2fea831d-d79b-4796-b321-c660033f28a1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:37.450559 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e7ffb9d6-d5cd-4255-a36e-4563dd756ccf req-2fea831d-d79b-4796-b321-c660033f28a1 service nova] Creating event network-vif-plugged:39d60569-8e8a-4a9f-bd6f-c0d138eb0258 for instance 86b2012c-93ce-482e-8ed7-4523936684bc on nch1-master-1 Jun 04 21:34:37.455730 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e7ffb9d6-d5cd-4255-a36e-4563dd756ccf req-2fea831d-d79b-4796-b321-c660033f28a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039535 Jun 04 21:34:37.456408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2936/5769] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:34:38.339239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:38.339857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:38.347306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:38.347795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:38.348580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:38.349018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:38.484764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:38.493622 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44f59619-56b9-4802-95e9-f8b3cee97317 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1375 microversion: 2.1 time: 0.159897 Jun 04 21:34:38.494203 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2834/5770] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:38 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:39.509824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:39.510716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:39.515776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:39.516542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:39.524362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:39.524849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:39.525646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:39.526100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:39.668083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:39.676163 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-62e1f170-1554-4349-a9c0-39894a2dc24b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1547 microversion: 2.1 time: 0.168590 Jun 04 21:34:39.676732 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2937/5771] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:39 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:34:39.692533 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:34:39.693119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:34:39.695001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:34:39.701768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:39.702155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:39.702955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:34:39.703382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:34:39.842502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:34:39.850536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d5f286a8-ef65-4516-8a66-0c467136c625 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1547 microversion: 2.1 time: 0.161896 Jun 04 21:34:39.851146 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2835/5772] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:34:39 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:08.089856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:08.090349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:08.092818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:08.093686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=30 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:08.100026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:08.100488 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:08.101275 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:08.101717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:08.128178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:35:08.217628 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e701cac1-913b-494f-96e4-58245b09a007 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "DELETE /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 204 len: 0 microversion: 2.1 time: 0.131294 Jun 04 21:35:08.218230 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2938/5773] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:35:08 2022] DELETE /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:35:08.226802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:08.227462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:08.229931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:08.230808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=36 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:08.238343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:08.238809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:08.239623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:08.240069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:08.388534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:08.397114 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-907d4a5e-eabb-4d7e-84bb-6abb0523583a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1553 microversion: 2.1 time: 0.174375 Jun 04 21:35:08.397739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2836/5774] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:08 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:09.415229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:09.416108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:09.424072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:09.424562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:09.425461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:09.425911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:09.569687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:09.578020 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d8214cc-ca81-41f2-9bf6-6fa91f55b7a2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1553 microversion: 2.1 time: 0.167151 Jun 04 21:35:09.578598 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2939/5775] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:09 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:10.321803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c8aaeb15-65bd-4393-9d56-e334be33785d req-42c9f765-dd11-44f3-856d-bd3d812d02e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b2012c-93ce-482e-8ed7-4523936684bc", "name": "network-vif-deleted", "tag": "39d60569-8e8a-4a9f-bd6f-c0d138eb0258"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:10.331560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c8aaeb15-65bd-4393-9d56-e334be33785d req-42c9f765-dd11-44f3-856d-bd3d812d02e4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:10.332014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c8aaeb15-65bd-4393-9d56-e334be33785d req-42c9f765-dd11-44f3-856d-bd3d812d02e4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:10.343482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c8aaeb15-65bd-4393-9d56-e334be33785d req-42c9f765-dd11-44f3-856d-bd3d812d02e4 service nova] Creating event network-vif-deleted:39d60569-8e8a-4a9f-bd6f-c0d138eb0258 for instance 86b2012c-93ce-482e-8ed7-4523936684bc on nch1-master-1 Jun 04 21:35:10.348619 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c8aaeb15-65bd-4393-9d56-e334be33785d req-42c9f765-dd11-44f3-856d-bd3d812d02e4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030706 Jun 04 21:35:10.349592 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2837/5776] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:10.595166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:10.595775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:10.603738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:10.604205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:10.605057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:10.605731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:10.640077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:10.640827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:10.641316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lazy-loading 'fault' on Instance uuid 86b2012c-93ce-482e-8ed7-4523936684bc {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:35:10.684234 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:10.692862 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-312a9c86-a58d-4427-b6ba-6eea6ebf169a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 200 len: 1339 microversion: 2.1 time: 0.101812 Jun 04 21:35:10.693773 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2940/5777] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:10 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:11.717035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:11.718211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 86b2012c-93ce-482e-8ed7-4523936684bc] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:11.725399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:11.725879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:11.726640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:11.727080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:11.741050 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] HTTP exception thrown: Instance 86b2012c-93ce-482e-8ed7-4523936684bc could not be found. Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Request method failure captured: Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc HTTP/1.1 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim8-sJTBfvv6LgoYhZABqX0ftUI3IjASUF-Dihei89xYP0CL6d5qf7qoVjkRlCqRixp6OR4k479A3Ox-7gBPcb7kGpuz82d7U4jUQDyA3W69nrWDNA9hos5jOvtDwyuLb6Pe1SE8UiQGE0y3Um2VBDIpf6E5QQpH1-IdX0QQp0UGlcqM Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 35e9e2025977459bafb89c97180bc199 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35e9e2025977459bafb89c97180bc199"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35e9e2025977459bafb89c97180bc199"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35e9e2025977459bafb89c97180bc199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35e9e2025977459bafb89c97180bc199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 35e9e2025977459bafb89c97180bc199 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestNetworkBasicOps-1361576571-project Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: efa3530b7b2b4dcfac5a43d1d1750067 Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestNetworkBasicOps-1361576571-project Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 86b2012c-93ce-482e-8ed7-4523936684bc could not be found. Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '86b2012c-93ce-482e-8ed7-4523936684bc'} Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b2012c-93ce-482e-8ed7-4523936684bc could not be found. Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b2012c-93ce-482e-8ed7-4523936684bc could not be found. Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:35:11.742703 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b2012c-93ce-482e-8ed7-4523936684bc could not be found. Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Returning 404 to user: Instance 86b2012c-93ce-482e-8ed7-4523936684bc could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9378c567-b65e-4a3a-8ca3-40c8fe876e87 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc" status: 404 len: 111 microversion: 2.1 time: 0.035727 Jun 04 21:35:11.748293 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2838/5778] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:11 2022] GET /compute/v2.1/servers/86b2012c-93ce-482e-8ed7-4523936684bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:35:11.930236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4d94c69-bfff-461c-aedf-cf95930356e1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '.version_select at 0x7f2d003fb4c0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:11.952451 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4d94c69-bfff-461c-aedf-cf95930356e1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1254722199" status: 202 len: 0 microversion: 2.1 time: 0.026099 Jun 04 21:35:11.953032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2941/5779] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 21:35:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1254722199 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:35:13.991594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:13.992374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:14.000055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:14.000741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:14.001368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:14.001809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:14.031932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:35:14.124551 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1411be96-f422-4c9e-92c2-8f365cba5ec1 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "DELETE /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 204 len: 0 microversion: 2.1 time: 0.136585 Jun 04 21:35:14.125538 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2839/5780] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:35:13 2022] DELETE /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:35:14.134523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:14.135237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:14.142304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:14.142762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:14.143914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:14.144357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:14.204874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b4f50630-4c71-46b4-ba87-351abf6348a2 req-fbe7a87d-75d6-47ef-9d64-b46a91a65e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16369a0e-5ca7-461f-ae6e-093f56821ca9", "tag": "13b967d2-5804-4520-8583-8a4c5242f97c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:14.214308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b4f50630-4c71-46b4-ba87-351abf6348a2 req-fbe7a87d-75d6-47ef-9d64-b46a91a65e02 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:14.215044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b4f50630-4c71-46b4-ba87-351abf6348a2 req-fbe7a87d-75d6-47ef-9d64-b46a91a65e02 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:14.226737 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b4f50630-4c71-46b4-ba87-351abf6348a2 req-fbe7a87d-75d6-47ef-9d64-b46a91a65e02 service nova] Creating event network-changed:13b967d2-5804-4520-8583-8a4c5242f97c for instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 on nch2-master-1 Jun 04 21:35:14.232438 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b4f50630-4c71-46b4-ba87-351abf6348a2 req-fbe7a87d-75d6-47ef-9d64-b46a91a65e02 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242515 Jun 04 21:35:14.233252 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2942/5781] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:14.287381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:14.295292 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-62088e90-dc1c-4392-89e7-5fbfe8a1a648 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1670 microversion: 2.1 time: 0.165310 Jun 04 21:35:14.295914 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2840/5782] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:14 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:15.315500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:15.316343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:15.324110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:15.324573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:15.325361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:15.325810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:15.544064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:15.552484 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2df1ca02-7188-4d15-8183-ba9a3709b352 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 200 len: 1670 microversion: 2.1 time: 0.241617 Jun 04 21:35:15.553382 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2943/5783] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:15 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 1670 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:16.250476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0a1c7f99-948d-4028-bc23-6c0b512b8808 req-e4b79fec-32bf-4a23-becb-fbf671e2dc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16369a0e-5ca7-461f-ae6e-093f56821ca9", "name": "network-vif-deleted", "tag": "13b967d2-5804-4520-8583-8a4c5242f97c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:16.262677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0a1c7f99-948d-4028-bc23-6c0b512b8808 req-e4b79fec-32bf-4a23-becb-fbf671e2dc9c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:16.263124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0a1c7f99-948d-4028-bc23-6c0b512b8808 req-e4b79fec-32bf-4a23-becb-fbf671e2dc9c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:16.276170 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0a1c7f99-948d-4028-bc23-6c0b512b8808 req-e4b79fec-32bf-4a23-becb-fbf671e2dc9c service nova] Creating event network-vif-deleted:13b967d2-5804-4520-8583-8a4c5242f97c for instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 on nch2-master-1 Jun 04 21:35:16.283812 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0a1c7f99-948d-4028-bc23-6c0b512b8808 req-e4b79fec-32bf-4a23-becb-fbf671e2dc9c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036760 Jun 04 21:35:16.284796 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2841/5784] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:16.570879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:16.571458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 16369a0e-5ca7-461f-ae6e-093f56821ca9] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:16.579059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:16.579537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:16.580378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:16.580807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:16.598174 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] HTTP exception thrown: Instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 could not be found. Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Request method failure captured: Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 HTTP/1.1 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8-sJTBfvv6LgoYhZABqX0ftUI3IjASUF-Dihei89xYP0CL6d5qf7qoVjkRlCqRixp6OR4k479A3Ox-7gBPcb7kGpuz82d7U4jUQDyA3W69nrWDNA9hos5jOvtDwyuLb6Pe1SE8UiQGE0y3Um2VBDIpf6E5QQpH1-IdX0QQp0UGlcqM Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 35e9e2025977459bafb89c97180bc199 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35e9e2025977459bafb89c97180bc199"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35e9e2025977459bafb89c97180bc199"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35e9e2025977459bafb89c97180bc199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35e9e2025977459bafb89c97180bc199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 35e9e2025977459bafb89c97180bc199 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestNetworkBasicOps-1361576571-project Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: efa3530b7b2b4dcfac5a43d1d1750067 Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestNetworkBasicOps-1361576571-project Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 could not be found. Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '16369a0e-5ca7-461f-ae6e-093f56821ca9'} Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 could not be found. Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 could not be found. Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:35:16.599892 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 could not be found. Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Returning 404 to user: Instance 16369a0e-5ca7-461f-ae6e-093f56821ca9 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cdccd37e-588a-4210-b479-c133e6b01d22 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9" status: 404 len: 111 microversion: 2.1 time: 0.034719 Jun 04 21:35:16.605409 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2944/5785] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:16 2022] GET /compute/v2.1/servers/16369a0e-5ca7-461f-ae6e-093f56821ca9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:35:16.792791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4bfc200-435c-4934-84cb-00d2ad43bbcb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '.version_select at 0x7f2d0be784c0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:16.814581 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4bfc200-435c-4934-84cb-00d2ad43bbcb tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-924979011" status: 202 len: 0 microversion: 2.1 time: 0.025963 Jun 04 21:35:16.815472 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2842/5786] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 21:35:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-924979011 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:35:25.113603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-612b026e-bcfa-481a-ba11-9db56ff98d7b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'create', calling method: .version_select at 0x7f2d019bf310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2143043211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHm8DxK+25kwKZCz5AqZgh4Bx3x9H8ikYKoTctbikD1/ja2OxKTtQ7UlJRjzcjRnFnvnNvI3LzYyXOWT34utV6c5fJ686mPpAGz5RMsxKs3R1L8DVQdm+rPNKMYMqt1IyA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:25.134845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-612b026e-bcfa-481a-ba11-9db56ff98d7b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for project 35e9e2025977459bafb89c97180bc199. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:35:25.140713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-612b026e-bcfa-481a-ba11-9db56ff98d7b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for user efa3530b7b2b4dcfac5a43d1d1750067 and project 35e9e2025977459bafb89c97180bc199. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:35:25.170101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-612b026e-bcfa-481a-ba11-9db56ff98d7b tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.063303 Jun 04 21:35:25.176041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2945/5787] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:35:25 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:26.276866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:26.282138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1623595515", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "96a0ff65-9cda-4f7e-ae3e-3545c54176c6"}], "key_name": "tempest-TestNetworkBasicOps-2143043211", "security_groups": [{"name": "tempest-secgroup-smoke-1901865628"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:26.411078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] validate_networks() for [('96a0ff65-9cda-4f7e-ae3e-3545c54176c6', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:35:26.911399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:35:26.911892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:35:26.912567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:35:26.912986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:35:26.913405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:35:26.925774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:26.926348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:26.927554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:26.927987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:26.946621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for project 35e9e2025977459bafb89c97180bc199. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:35:26.957200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Getting quotas for user efa3530b7b2b4dcfac5a43d1d1750067 and project 35e9e2025977459bafb89c97180bc199. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:35:26.992685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:35:26.995244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:35:27.060121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73adb7b1-80aa-410c-8b79-06e48034336a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785148 Jun 04 21:35:27.061058 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2843/5788] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:35:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:35:27.069062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:27.074065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c0eec07f-064b-44fc-85b5-67cf7224b503 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:27.075030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c0eec07f-064b-44fc-85b5-67cf7224b503 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:27.176086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c0eec07f-064b-44fc-85b5-67cf7224b503 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:27.186192 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c0eec07f-064b-44fc-85b5-67cf7224b503 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1249 microversion: 2.1 time: 0.118796 Jun 04 21:35:27.190901 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2946/5789] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:27 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1249 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:28.210545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:28.211163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:28.218917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:28.219469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:28.220467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:28.221050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:28.299960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:28.314128 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e101cfef-59fb-4ef5-8d53-7536370fd812 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1319 microversion: 2.1 time: 0.110525 Jun 04 21:35:28.314726 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2844/5790] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:28 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1319 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:29.331689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:29.332362 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:29.339456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:29.339947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:29.340754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:29.341194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:29.564031 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:29.574940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55d0812f-cc74-41d6-bcfa-d90c55f0d4d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1375 microversion: 2.1 time: 0.247923 Jun 04 21:35:29.575552 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2947/5791] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:29 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:29.804300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9380d26c-4d09-4bfd-9391-b361f6445e50 req-390cdc12-dbef-497b-829f-184d22b4b4b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41127d97-fd42-48be-8c47-99670eb3581a", "tag": "022d2c80-8d5b-43a7-a16e-d4617b2b8663"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:29.816917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9380d26c-4d09-4bfd-9391-b361f6445e50 req-390cdc12-dbef-497b-829f-184d22b4b4b7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:29.817369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9380d26c-4d09-4bfd-9391-b361f6445e50 req-390cdc12-dbef-497b-829f-184d22b4b4b7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:29.833830 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9380d26c-4d09-4bfd-9391-b361f6445e50 req-390cdc12-dbef-497b-829f-184d22b4b4b7 service nova] Creating event network-changed:022d2c80-8d5b-43a7-a16e-d4617b2b8663 for instance 41127d97-fd42-48be-8c47-99670eb3581a on nch2-master-1 Jun 04 21:35:29.839121 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9380d26c-4d09-4bfd-9391-b361f6445e50 req-390cdc12-dbef-497b-829f-184d22b4b4b7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038935 Jun 04 21:35:29.840148 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2845/5792] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:30.593361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:30.594055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:30.602922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:30.603388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:30.604235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:30.604683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:30.748466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:30.756381 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c16bce9c-153c-4260-ac3b-e75506e62cd9 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1375 microversion: 2.1 time: 0.167125 Jun 04 21:35:30.756946 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2948/5793] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:30 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:31.773956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:31.774663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:31.782782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:31.782994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:31.783855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:31.784293 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:31.928165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:31.936007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-314d5043-0b4c-4c83-8e76-e84989eae8d2 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1375 microversion: 2.1 time: 0.166228 Jun 04 21:35:31.936582 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2846/5794] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:31 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:32.953508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:32.954340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:32.962074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:32.962582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:32.963348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:32.963826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:33.110172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:33.118383 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb2c4426-b06c-48e5-b561-f4327650bce4 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1375 microversion: 2.1 time: 0.169521 Jun 04 21:35:33.118939 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2949/5795] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:32 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:33.953575 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0a43709b-0048-4bdc-ba82-92281a4e2079 req-572aa7c0-f89d-4f8f-a97f-bf6f41837400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41127d97-fd42-48be-8c47-99670eb3581a", "name": "network-vif-plugged", "status": "completed", "tag": "022d2c80-8d5b-43a7-a16e-d4617b2b8663"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:33.962450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0a43709b-0048-4bdc-ba82-92281a4e2079 req-572aa7c0-f89d-4f8f-a97f-bf6f41837400 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:33.962885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0a43709b-0048-4bdc-ba82-92281a4e2079 req-572aa7c0-f89d-4f8f-a97f-bf6f41837400 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:33.978212 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0a43709b-0048-4bdc-ba82-92281a4e2079 req-572aa7c0-f89d-4f8f-a97f-bf6f41837400 service nova] Creating event network-vif-plugged:022d2c80-8d5b-43a7-a16e-d4617b2b8663 for instance 41127d97-fd42-48be-8c47-99670eb3581a on nch2-master-1 Jun 04 21:35:33.983291 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0a43709b-0048-4bdc-ba82-92281a4e2079 req-572aa7c0-f89d-4f8f-a97f-bf6f41837400 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105784 Jun 04 21:35:33.983944 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2847/5796] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:34.135535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:34.136204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:34.143195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:34.144028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:34.144819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:34.145268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:34.280994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:34.289633 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53170d56-c6b5-4483-87cb-adfc38c8021a tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1375 microversion: 2.1 time: 0.158262 Jun 04 21:35:34.290240 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2950/5797] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:34 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:35.308063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:35.308780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:35.315328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:35.315838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:35.316627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:35.317218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:35.468501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:35.476975 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6103422f-9425-4cf3-b22e-d3ae301a8b27 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1547 microversion: 2.1 time: 0.174152 Jun 04 21:35:35.477558 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2848/5798] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:35 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:35.497372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:35:35.498011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:35.504928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:35.505400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:35.506228 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:35.506685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:35.648026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:35:35.668801 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f7543fdd-ada5-46a6-ad2e-95cefaee3d55 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1547 microversion: 2.1 time: 0.175091 Jun 04 21:35:35.669697 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2951/5799] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:35:35 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:35:37.662489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c9ee9cab-63ba-4644-b567-0440f0f2f274 req-b79259c7-8d4e-49d3-bf10-5e7af4809c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41127d97-fd42-48be-8c47-99670eb3581a", "tag": "022d2c80-8d5b-43a7-a16e-d4617b2b8663"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:37.668240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:37.669596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:37.677339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c9ee9cab-63ba-4644-b567-0440f0f2f274 req-b79259c7-8d4e-49d3-bf10-5e7af4809c24 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:37.678064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c9ee9cab-63ba-4644-b567-0440f0f2f274 req-b79259c7-8d4e-49d3-bf10-5e7af4809c24 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:37.690943 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c9ee9cab-63ba-4644-b567-0440f0f2f274 req-b79259c7-8d4e-49d3-bf10-5e7af4809c24 service nova] Creating event network-changed:022d2c80-8d5b-43a7-a16e-d4617b2b8663 for instance 41127d97-fd42-48be-8c47-99670eb3581a on nch2-master-1 Jun 04 21:35:37.697105 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c9ee9cab-63ba-4644-b567-0440f0f2f274 req-b79259c7-8d4e-49d3-bf10-5e7af4809c24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038721 Jun 04 21:35:37.698006 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2849/5800] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:35:58.935817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:35:58.937198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:35:58.940393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:58.941421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:58.942310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=30 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:35:58.953808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:58.954388 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:58.955207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:35:58.955677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:35:59.010349 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a275bb71-02ba-49f1-822e-d7d60df96b78 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a/action" status: 200 len: 24565 microversion: 2.1 time: 0.079664 Jun 04 21:35:59.011057 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2952/5801] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:35:58 2022] POST /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a/action => generated 24565 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:36:10.147032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:10.148002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=26 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:10.152529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:10.153542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:10.161397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:10.161869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:10.162659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:10.163092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:10.214904 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e117494-94d1-4c98-bf2c-0f08cce19b39 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "POST /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a/action" status: 200 len: 32628 microversion: 2.1 time: 0.069589 Jun 04 21:36:10.215539 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2850/5802] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:36:10 2022] POST /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a/action => generated 32628 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:36:11.236062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:11.237494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:11.238214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-1466e6ae-73e1-4f2a-8e00-353670ca9466 req-3423de0d-afa7-4ee4-bf5b-f459b3ded92a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41127d97-fd42-48be-8c47-99670eb3581a", "tag": "022d2c80-8d5b-43a7-a16e-d4617b2b8663"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:11.241550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:11.242598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:11.248581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:11.248581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:11.248891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1466e6ae-73e1-4f2a-8e00-353670ca9466 req-3423de0d-afa7-4ee4-bf5b-f459b3ded92a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:11.249208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-1466e6ae-73e1-4f2a-8e00-353670ca9466 req-3423de0d-afa7-4ee4-bf5b-f459b3ded92a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:11.249340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:11.249822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:11.261046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-1466e6ae-73e1-4f2a-8e00-353670ca9466 req-3423de0d-afa7-4ee4-bf5b-f459b3ded92a service nova] Creating event network-changed:022d2c80-8d5b-43a7-a16e-d4617b2b8663 for instance 41127d97-fd42-48be-8c47-99670eb3581a on nch2-master-1 Jun 04 21:36:11.266112 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-1466e6ae-73e1-4f2a-8e00-353670ca9466 req-3423de0d-afa7-4ee4-bf5b-f459b3ded92a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031947 Jun 04 21:36:11.267180 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2851/5803] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:36:11.279941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:36:11.389484 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f942b594-1da3-48c2-9704-8388f8fd2f62 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "DELETE /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 204 len: 0 microversion: 2.1 time: 0.157590 Jun 04 21:36:11.394130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2953/5804] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:36:11 2022] DELETE /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:36:11.399881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:11.400584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:11.407971 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:11.408433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:11.409223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:11.409654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:11.560017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:11.568104 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3c3634d4-683f-400d-9805-347f582b2512 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1671 microversion: 2.1 time: 0.172458 Jun 04 21:36:11.568721 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2852/5805] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:11 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:12.586944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:12.587642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:12.596430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:12.596899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:12.597700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:12.598146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:12.808673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efa3530b7b2b4dcfac5a43d1d1750067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e9e2025977459bafb89c97180bc199', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:12.817140 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-47741907-b4a7-4959-b586-7c0b4b81fa45 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 200 len: 1671 microversion: 2.1 time: 0.234696 Jun 04 21:36:12.817848 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2954/5806] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:12 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 1671 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:13.199734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-75166c83-d336-48d0-a539-3f02bfcb836e req-78f5c136-8d41-4a68-95cf-a369e11b28d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41127d97-fd42-48be-8c47-99670eb3581a", "name": "network-vif-deleted", "tag": "022d2c80-8d5b-43a7-a16e-d4617b2b8663"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:13.212269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-75166c83-d336-48d0-a539-3f02bfcb836e req-78f5c136-8d41-4a68-95cf-a369e11b28d4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:13.212708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-75166c83-d336-48d0-a539-3f02bfcb836e req-78f5c136-8d41-4a68-95cf-a369e11b28d4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:13.225194 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-75166c83-d336-48d0-a539-3f02bfcb836e req-78f5c136-8d41-4a68-95cf-a369e11b28d4 service nova] Creating event network-vif-deleted:022d2c80-8d5b-43a7-a16e-d4617b2b8663 for instance 41127d97-fd42-48be-8c47-99670eb3581a on nch2-master-1 Jun 04 21:36:13.230251 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-75166c83-d336-48d0-a539-3f02bfcb836e req-78f5c136-8d41-4a68-95cf-a369e11b28d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103962 Jun 04 21:36:13.230879 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2853/5807] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:13.839380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:13.840499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] [instance: 41127d97-fd42-48be-8c47-99670eb3581a] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:13.853103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:13.853866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:13.855162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:13.856052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:13.871990 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] HTTP exception thrown: Instance 41127d97-fd42-48be-8c47-99670eb3581a could not be found. Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Request method failure captured: Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a HTTP/1.1 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim8-sJTBfvv6LgoYhZABqX0ftUI3IjASUF-Dihei89xYP0CL6d5qf7qoVjkRlCqRixp6OR4k479A3Ox-7gBPcb7kGpuz82d7U4jUQDyA3W69nrWDNA9hos5jOvtDwyuLb6Pe1SE8UiQGE0y3Um2VBDIpf6E5QQpH1-IdX0QQp0UGlcqM Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 35e9e2025977459bafb89c97180bc199 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_35e9e2025977459bafb89c97180bc199"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35e9e2025977459bafb89c97180bc199"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/35e9e2025977459bafb89c97180bc199"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/35e9e2025977459bafb89c97180bc199"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 35e9e2025977459bafb89c97180bc199 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestNetworkBasicOps-1361576571 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestNetworkBasicOps-1361576571-project Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: efa3530b7b2b4dcfac5a43d1d1750067 Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestNetworkBasicOps-1361576571-project Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 41127d97-fd42-48be-8c47-99670eb3581a could not be found. Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '41127d97-fd42-48be-8c47-99670eb3581a'} Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41127d97-fd42-48be-8c47-99670eb3581a could not be found. Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41127d97-fd42-48be-8c47-99670eb3581a could not be found. Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:13.873675 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41127d97-fd42-48be-8c47-99670eb3581a could not be found. Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Returning 404 to user: Instance 41127d97-fd42-48be-8c47-99670eb3581a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8b58abad-423d-4480-b62d-bbfd9f2fea74 tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a" status: 404 len: 111 microversion: 2.1 time: 0.042376 Jun 04 21:36:13.878900 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2955/5808] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:13 2022] GET /compute/v2.1/servers/41127d97-fd42-48be-8c47-99670eb3581a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:36:14.050195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-324577eb-2c91-455a-bb87-8194501fdcda tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] Calling method '.version_select at 0x7f2d00d30940>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:14.072363 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-324577eb-2c91-455a-bb87-8194501fdcda tempest-TestNetworkBasicOps-1361576571 tempest-TestNetworkBasicOps-1361576571-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2143043211" status: 202 len: 0 microversion: 2.1 time: 0.026916 Jun 04 21:36:14.073166 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2854/5809] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 21:36:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2143043211 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:36:30.487143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:30.487921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:30.605867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1818457107", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:30.661051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] validate_networks() for None {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:36:30.965995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:36:30.966437 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:36:30.966928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:36:30.967384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:36:30.967836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:36:30.977832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:30.978304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:30.979126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:30.979618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:30.997640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Getting quotas for project 0e6b163300524060964aa4a02f874d3b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:36:31.003101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Getting quotas for user 1dd3f612bd90491183b03cf3e19c4607 and project 0e6b163300524060964aa4a02f874d3b. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:36:31.016549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:36:31.019432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:36:31.063272 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-194d6b7c-129d-46c2-8a96-bcc78ffb820c tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581680 Jun 04 21:36:31.063948 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2956/5810] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:36:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:36:31.072491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:31.073245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:31.077507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-41d75e1a-9873-4a22-84a2-b7449d99d76e tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:31.078432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-41d75e1a-9873-4a22-84a2-b7449d99d76e tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:31.135659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-41d75e1a-9873-4a22-84a2-b7449d99d76e tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:31.142757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-41d75e1a-9873-4a22-84a2-b7449d99d76e tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1222 microversion: 2.1 time: 0.072282 Jun 04 21:36:31.143321 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2855/5811] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:31 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:32.162086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:32.162697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:32.170118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:32.170593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:32.171393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:32.171897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:32.258681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:32.267104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-542a9ee5-6b69-41f1-a9cd-d0c20f44a61f tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1282 microversion: 2.1 time: 0.110106 Jun 04 21:36:32.267916 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2957/5812] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:32 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:33.285479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:33.286102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:33.294019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:33.294478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:33.295264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:33.295735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:33.445961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:33.453662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8e5828b-5c43-4a82-a4d6-760198f0f265 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1322 microversion: 2.1 time: 0.172363 Jun 04 21:36:33.454234 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2856/5813] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:33 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:33.801863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-82584e02-23eb-4510-8be8-3670c4cff38b req-1192d1d2-49a4-4e11-a44a-7556eda5d783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb8dff55-e8f4-42c1-955b-4f19c8579b83", "tag": "9bf98d71-cc36-4606-84db-cdd29479a9c5"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:33.811823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-82584e02-23eb-4510-8be8-3670c4cff38b req-1192d1d2-49a4-4e11-a44a-7556eda5d783 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:33.812281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-82584e02-23eb-4510-8be8-3670c4cff38b req-1192d1d2-49a4-4e11-a44a-7556eda5d783 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:33.824543 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-82584e02-23eb-4510-8be8-3670c4cff38b req-1192d1d2-49a4-4e11-a44a-7556eda5d783 service nova] Creating event network-changed:9bf98d71-cc36-4606-84db-cdd29479a9c5 for instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 on nch2-master-1 Jun 04 21:36:33.829752 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-82584e02-23eb-4510-8be8-3670c4cff38b req-1192d1d2-49a4-4e11-a44a-7556eda5d783 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033272 Jun 04 21:36:33.830721 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2958/5814] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:34.471529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:34.472858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:34.480578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:34.481136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:34.481931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:34.482392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:34.620630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:34.632374 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-669b24dd-1876-47f3-9c59-87d5e0bb4719 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1322 microversion: 2.1 time: 0.165127 Jun 04 21:36:34.633128 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2857/5815] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:34 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:35.660867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:35.662048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:35.669349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:35.669818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:35.670610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:35.671090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:35.814313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:35.822571 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-558daab8-b27f-4c02-8d68-325fac41dbe8 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1322 microversion: 2.1 time: 0.170628 Jun 04 21:36:35.823173 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2959/5816] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:35 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:36.844048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:36.844785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:36.854072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:36.854638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:36.855633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:36.856185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:37.001497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:37.013838 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19cd67ec-f21e-4efe-aee1-aec48859edfe tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1322 microversion: 2.1 time: 0.174425 Jun 04 21:36:37.014579 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2858/5817] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:36 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:36:38.034153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:38.034888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:38.043318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:38.044490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:38.045497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:38.045969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:38.182683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:38.190563 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ccfb612a-ca4a-4778-8340-c8ca9f94c48d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1322 microversion: 2.1 time: 0.160860 Jun 04 21:36:38.191149 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2960/5818] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:38 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:38.210868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-7dd59670-009b-4810-b507-eaa279607290 req-d2ba105a-7f39-4238-bc90-ec28303bd632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8dff55-e8f4-42c1-955b-4f19c8579b83", "name": "network-vif-plugged", "status": "completed", "tag": "9bf98d71-cc36-4606-84db-cdd29479a9c5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:38.220741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7dd59670-009b-4810-b507-eaa279607290 req-d2ba105a-7f39-4238-bc90-ec28303bd632 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:38.221223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-7dd59670-009b-4810-b507-eaa279607290 req-d2ba105a-7f39-4238-bc90-ec28303bd632 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:38.233334 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-7dd59670-009b-4810-b507-eaa279607290 req-d2ba105a-7f39-4238-bc90-ec28303bd632 service nova] Creating event network-vif-plugged:9bf98d71-cc36-4606-84db-cdd29479a9c5 for instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 on nch2-master-1 Jun 04 21:36:38.238330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-7dd59670-009b-4810-b507-eaa279607290 req-d2ba105a-7f39-4238-bc90-ec28303bd632 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031470 Jun 04 21:36:38.238909 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2859/5819] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:39.211444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:39.212036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:39.219543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:39.220153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:39.220955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:39.221405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:39.357071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:39.365801 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2c0a5985-d5ce-4a5f-829b-841eb6c6706a tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1322 microversion: 2.1 time: 0.159864 Jun 04 21:36:39.366499 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2961/5820] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:39 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:40.388886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:40.389726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:40.400005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:40.400590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:40.401757 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:40.402301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:40.543307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:40.551324 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5dd6bed-57c3-4a71-99c7-14326a69052b tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1472 microversion: 2.1 time: 0.170031 Jun 04 21:36:40.551943 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2860/5821] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:40 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:40.622131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bfab6e37-8668-41be-b47e-9bd9f97a9b20 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Calling method '.version_select at 0x7f2d00ef8700>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:40.693687 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bfab6e37-8668-41be-b47e-9bd9f97a9b20 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/97e8a75585fc432a9fb7ae1a035923ac" status: 200 len: 371 microversion: 2.1 time: 0.127586 Jun 04 21:36:40.694323 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2962/5822] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:36:40 2022] GET /compute/v2.1/os-quota-sets/97e8a75585fc432a9fb7ae1a035923ac => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:40.706704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-923977a4-1c15-4b37-ab2a-c61c7640d7f2 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2018441358", "id": 729942257, "os-flavor-access:is_public": "True"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:40.708668 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:36:40.708668 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:36:40.725543 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-923977a4-1c15-4b37-ab2a-c61c7640d7f2 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023684 Jun 04 21:36:40.726293 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2861/5823] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:36:40 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:40.737695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "729942257"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:40.738847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:40.745561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:40.746013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:40.746802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:40.747304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:40.840154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '47f426d736504f198aedc66a514d24a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e8a75585fc432a9fb7ae1a035923ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:40.848681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2018441358 {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:36:40.858418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:40.858872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:40.859719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:40.860176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:40.881654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Getting quotas for project 0e6b163300524060964aa4a02f874d3b. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:36:40.887345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Getting quotas for user 1dd3f612bd90491183b03cf3e19c4607 and project 0e6b163300524060964aa4a02f874d3b. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:36:40.900610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.compute.api [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] ram quota exceeded for 97e8a75585fc432a9fb7ae1a035923ac, tried to resize instance. Jun 04 21:36:40.901167 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Request method failure captured: Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83/action HTTP/1.1 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 38 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9BeeJd2ADE-TASrFmRctHJUxB94Yk9bHDZGExPxSkin78n0Vy6cX0bUCDL1Q6K34o0gqbqoHKMYGWr8p6TWytbv6uRKmFDidzQPgjGII7Jqj6d2D-e11aq-pIlno6eM3CpbizMtVF_abieXrIF-nsh8nJYEai1_f9YvtZl4hep3LU0 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 97e8a75585fc432a9fb7ae1a035923ac Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1899466816 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,admin,reader Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,admin,reader Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1899466816 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 97e8a75585fc432a9fb7ae1a035923ac Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1899466816 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-1899466816-project-admin Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 47f426d736504f198aedc66a514d24a2 Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1899466816-project-admin Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: {"resize": {"flavorRef": "729942257"}} Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'bb8dff55-e8f4-42c1-955b-4f19c8579b83', 'body': {'resize': {'flavorRef': '729942257'}}} Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:36:40.903262 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a869355a-1f03-4fa9-ac77-05545ae787d9 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83/action" status: 403 len: 118 microversion: 2.1 time: 0.171254 Jun 04 21:36:40.909748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2963/5824] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:36:40 2022] POST /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83/action => generated 118 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:36:40.915537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-66550e7f-3dd7-40fa-918a-93bfd8971c02 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:40.916346 ncdv-master-1 devstack@n-api.service[137229]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:36:40.916346 ncdv-master-1 devstack@n-api.service[137229]: warnings.warn(msg) Jun 04 21:36:40.934706 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-66550e7f-3dd7-40fa-918a-93bfd8971c02 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/729942257" status: 202 len: 0 microversion: 2.1 time: 0.022895 Jun 04 21:36:40.935342 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2862/5825] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 21:36:40 2022] DELETE /compute/v2.1/flavors/729942257 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:36:40.943582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e344703e-927c-405b-a422-acb40ad52a84 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:40.963652 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e344703e-927c-405b-a422-acb40ad52a84 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023828 Jun 04 21:36:40.964220 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2964/5826] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:36:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:40.980817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-883e15cd-ee0a-457e-a9ab-eddb5e08fa64 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Calling method '.version_select at 0x7f2d00cc0f70>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:41.065322 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-883e15cd-ee0a-457e-a9ab-eddb5e08fa64 tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "GET /compute/v2.1/os-quota-sets/97e8a75585fc432a9fb7ae1a035923ac" status: 200 len: 371 microversion: 2.1 time: 0.088131 Jun 04 21:36:41.065911 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2863/5827] 10.222.0.18 () {58 vars in 1241 bytes} [Sat Jun 4 21:36:40 2022] GET /compute/v2.1/os-quota-sets/97e8a75585fc432a9fb7ae1a035923ac => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:41.079108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d08e7d55-7ebe-4bc4-bcbf-3f5c371e5e1d tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-808220306", "id": 663244028, "os-flavor-access:is_public": "True"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:41.080777 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:36:41.080777 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:36:41.099129 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d08e7d55-7ebe-4bc4-bcbf-3f5c371e5e1d tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023854 Jun 04 21:36:41.099764 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2965/5828] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:36:41 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:41.110499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "663244028"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:41.111489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:41.118045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.118492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.119255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.119727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.207893 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '47f426d736504f198aedc66a514d24a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e8a75585fc432a9fb7ae1a035923ac', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:41.214913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-808220306 {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:36:41.221649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.222088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.222868 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.223300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.246008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Getting quotas for project 0e6b163300524060964aa4a02f874d3b. Resources: {'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:36:41.251148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Getting quotas for user 1dd3f612bd90491183b03cf3e19c4607 and project 0e6b163300524060964aa4a02f874d3b. Resources: {'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:36:41.264856 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] cores quota exceeded for 97e8a75585fc432a9fb7ae1a035923ac, tried to resize instance. Jun 04 21:36:41.265400 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Request method failure captured: Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83/action HTTP/1.1 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 38 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9BeeJd2ADE-TASrFmRctHJUxB94Yk9bHDZGExPxSkin78n0Vy6cX0bUCDL1Q6K34o0gqbqoHKMYGWr8p6TWytbv6uRKmFDidzQPgjGII7Jqj6d2D-e11aq-pIlno6eM3CpbizMtVF_abieXrIF-nsh8nJYEai1_f9YvtZl4hep3LU0 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 97e8a75585fc432a9fb7ae1a035923ac Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1899466816 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,admin,reader Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,admin,reader Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/97e8a75585fc432a9fb7ae1a035923ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1899466816 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 97e8a75585fc432a9fb7ae1a035923ac Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1899466816 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersAdminNegativeTestJSON-1899466816-project-admin Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 47f426d736504f198aedc66a514d24a2 Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1899466816-project-admin Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: {"resize": {"flavorRef": "663244028"}} Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'bb8dff55-e8f4-42c1-955b-4f19c8579b83', 'body': {'resize': {'flavorRef': '663244028'}}} Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:36:41.267492 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f4de7d83-5d20-4257-88af-1fa45a433abb tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "POST /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83/action" status: 403 len: 113 microversion: 2.1 time: 0.162447 Jun 04 21:36:41.272298 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2864/5829] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:36:41 2022] POST /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83/action => generated 113 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:36:41.279573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-743d8dde-3af3-4882-8aee-0d041ef21def tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:41.280582 ncdv-master-1 devstack@n-api.service[137228]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 21:36:41.280582 ncdv-master-1 devstack@n-api.service[137228]: warnings.warn(msg) Jun 04 21:36:41.306528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-743d8dde-3af3-4882-8aee-0d041ef21def tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "DELETE /compute/v2.1/flavors/663244028" status: 202 len: 0 microversion: 2.1 time: 0.031853 Jun 04 21:36:41.307055 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2966/5830] 10.222.0.18 () {58 vars in 1157 bytes} [Sat Jun 4 21:36:41 2022] DELETE /compute/v2.1/flavors/663244028 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:36:41.316543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-531e8798-718d-4478-a326-8ffb3a3351fa tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:41.336971 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-531e8798-718d-4478-a326-8ffb3a3351fa tempest-ServersAdminNegativeTestJSON-1899466816 tempest-ServersAdminNegativeTestJSON-1899466816-project-admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024154 Jun 04 21:36:41.337541 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2865/5831] 10.222.0.18 () {58 vars in 1145 bytes} [Sat Jun 4 21:36:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:36:41.355112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:41.355759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:41.362251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.362723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.363543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.364000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.393564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:36:41.481338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0ecf23df-d616-48ff-8f7c-16e9ec2bbe94 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 204 len: 0 microversion: 2.1 time: 0.129908 Jun 04 21:36:41.482087 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2967/5832] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:36:41 2022] DELETE /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:36:41.492998 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:41.493615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:41.501181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.501638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.502414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:41.502854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:41.640325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:41.648825 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d26b50d1-f378-43f6-8429-eba3ce21776d tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1478 microversion: 2.1 time: 0.162064 Jun 04 21:36:41.649400 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2866/5833] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:41 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:42.670807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:42.671610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:42.681209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:42.681821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:42.682903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:42.683491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:42.823820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dd3f612bd90491183b03cf3e19c4607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6b163300524060964aa4a02f874d3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:42.832478 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1242eb93-7c3b-475b-bfd4-ac8c3ef8fb28 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 200 len: 1478 microversion: 2.1 time: 0.168127 Jun 04 21:36:42.833130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2968/5834] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:42 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 1478 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:43.209764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fa318955-abda-485e-901a-7c700b0ec480 req-a6e1d9cc-eb53-4be1-9326-d8d9657dfe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb8dff55-e8f4-42c1-955b-4f19c8579b83", "name": "network-vif-deleted", "tag": "9bf98d71-cc36-4606-84db-cdd29479a9c5"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:43.228093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fa318955-abda-485e-901a-7c700b0ec480 req-a6e1d9cc-eb53-4be1-9326-d8d9657dfe80 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:43.228924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fa318955-abda-485e-901a-7c700b0ec480 req-a6e1d9cc-eb53-4be1-9326-d8d9657dfe80 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:43.241845 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fa318955-abda-485e-901a-7c700b0ec480 req-a6e1d9cc-eb53-4be1-9326-d8d9657dfe80 service nova] Creating event network-vif-deleted:9bf98d71-cc36-4606-84db-cdd29479a9c5 for instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 on nch2-master-1 Jun 04 21:36:43.249355 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fa318955-abda-485e-901a-7c700b0ec480 req-a6e1d9cc-eb53-4be1-9326-d8d9657dfe80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042970 Jun 04 21:36:43.249967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2867/5835] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:43.853677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:43.854297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] [instance: bb8dff55-e8f4-42c1-955b-4f19c8579b83] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:43.861793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:43.862252 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:43.863010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:43.863481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:43.878213 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] HTTP exception thrown: Instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 could not be found. Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Request method failure captured: Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 HTTP/1.1 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9BdY9f6SGPcIFYm76iX3rXEUQ_doQirSyUGLmfF7Cwo3msgGnKKHf37bDK5shcMCyS-XhTkAup4_EEX4UyMeiYdwjJaGCAmdjmhstNS9dBAo5PuTSEdkJc1AIhRoWMMMSi_pa_gx8QaKvf034Tode3DVA1pHh8VyAK9jEmhlhwzEoY Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0e6b163300524060964aa4a02f874d3b Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-651199397 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0e6b163300524060964aa4a02f874d3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e6b163300524060964aa4a02f874d3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0e6b163300524060964aa4a02f874d3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0e6b163300524060964aa4a02f874d3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersAdminNegativeTestJSON-651199397 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0e6b163300524060964aa4a02f874d3b Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-651199397 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersAdminNegativeTestJSON-651199397-project Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 1dd3f612bd90491183b03cf3e19c4607 Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersAdminNegativeTestJSON-651199397-project Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 could not be found. Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'bb8dff55-e8f4-42c1-955b-4f19c8579b83'} Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 could not be found. Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 could not be found. Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:36:43.880845 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 could not be found. Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] Returning 404 to user: Instance bb8dff55-e8f4-42c1-955b-4f19c8579b83 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c93e6902-9fc4-4c87-b26d-3ce147f67878 tempest-ServersAdminNegativeTestJSON-651199397 tempest-ServersAdminNegativeTestJSON-651199397-project] 10.222.0.18 "GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83" status: 404 len: 111 microversion: 2.1 time: 0.035183 Jun 04 21:36:43.886294 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2969/5836] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:43 2022] GET /compute/v2.1/servers/bb8dff55-e8f4-42c1-955b-4f19c8579b83 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:36:47.088076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-204503455", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "4b1dd203-abbd-4e14-834d-cb063751534f"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:47.148501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] validate_networks() for [('4b1dd203-abbd-4e14-834d-cb063751534f', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:36:47.515299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:36:47.515756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:36:47.516235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:36:47.516647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:36:47.517061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:36:47.527152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:47.527596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:47.528395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:47.528830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:47.545801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Getting quotas for project 0c9da76d6d254fe0995e9642e330bad7. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:36:47.551035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Getting quotas for user ca6ec0768b414f93861ebb3da7615753 and project 0c9da76d6d254fe0995e9642e330bad7. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:36:47.563170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:36:47.565613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:36:47.613878 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e5abecbf-53d9-469a-ad78-af28c5f28256 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658277 Jun 04 21:36:47.614451 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2868/5837] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:36:47.625195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7ad410f4-f256-4e74-a45c-34bd8cf9e4bb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:47.625862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7ad410f4-f256-4e74-a45c-34bd8cf9e4bb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:47.681959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7ad410f4-f256-4e74-a45c-34bd8cf9e4bb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:47.689692 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7ad410f4-f256-4e74-a45c-34bd8cf9e4bb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1214 microversion: 2.1 time: 0.068506 Jun 04 21:36:47.690242 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2970/5838] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:47 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:48.708122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:48.708725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:48.716385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:48.716861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:48.717654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:48.718075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:48.785063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:48.793554 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb8a8c87-b4f6-4220-9ab4-4826f0b09c6d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1272 microversion: 2.1 time: 0.090568 Jun 04 21:36:48.803532 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2869/5839] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:48 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:49.811704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:49.812336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:49.820617 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:49.821114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:49.821916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:49.822511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:49.964776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:49.972790 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a30c98e6-6fa0-4eba-b1b1-b4de70d3e48d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1314 microversion: 2.1 time: 0.165122 Jun 04 21:36:49.973353 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2971/5840] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:49 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:50.216096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-53729822-9c05-45de-b7fa-9d1d77f25192 req-599aa64c-c3e4-4175-ab08-e77b4b1758fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52b3172-8315-4160-92f2-02539d4e45cb", "tag": "49785bbb-59e1-4338-a48e-8643d2aeb626"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:50.225546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-53729822-9c05-45de-b7fa-9d1d77f25192 req-599aa64c-c3e4-4175-ab08-e77b4b1758fb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:50.225982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-53729822-9c05-45de-b7fa-9d1d77f25192 req-599aa64c-c3e4-4175-ab08-e77b4b1758fb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:50.241077 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-53729822-9c05-45de-b7fa-9d1d77f25192 req-599aa64c-c3e4-4175-ab08-e77b4b1758fb service nova] Creating event network-changed:49785bbb-59e1-4338-a48e-8643d2aeb626 for instance e52b3172-8315-4160-92f2-02539d4e45cb on nch2-master-1 Jun 04 21:36:50.247738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-53729822-9c05-45de-b7fa-9d1d77f25192 req-599aa64c-c3e4-4175-ab08-e77b4b1758fb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035375 Jun 04 21:36:50.248369 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2870/5841] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:36:50.993063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:50.993735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:50.996806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=5 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:51.002557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:51.003027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:51.003848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:51.004307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:51.144654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:51.154002 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-34f95f8d-bbbf-42fe-8c8b-62de77d3b86d tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1314 microversion: 2.1 time: 0.167375 Jun 04 21:36:51.154578 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2972/5842] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:50 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:52.172183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:52.172768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:52.180780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:52.181314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:52.182142 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:52.183383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:52.328967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:52.337541 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1391b00b-e791-47ca-98c0-3b5fc88625df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1314 microversion: 2.1 time: 0.170814 Jun 04 21:36:52.338137 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2871/5843] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:52 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:53.359605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:53.360391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:53.371587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:53.372342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:53.373289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:53.373747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:53.516259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:53.527952 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cc4cf58b-6022-439f-bbe1-3ef821e79b5b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1314 microversion: 2.1 time: 0.175926 Jun 04 21:36:53.528538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2973/5844] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:53 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:54.307268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5a46b113-ee2d-4dd1-96fb-2047635fc062 req-d1778037-cccb-471b-b3fb-43ac56ada1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b3172-8315-4160-92f2-02539d4e45cb", "name": "network-vif-plugged", "status": "completed", "tag": "49785bbb-59e1-4338-a48e-8643d2aeb626"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:54.316844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5a46b113-ee2d-4dd1-96fb-2047635fc062 req-d1778037-cccb-471b-b3fb-43ac56ada1fc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:54.317721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5a46b113-ee2d-4dd1-96fb-2047635fc062 req-d1778037-cccb-471b-b3fb-43ac56ada1fc service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:54.329885 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5a46b113-ee2d-4dd1-96fb-2047635fc062 req-d1778037-cccb-471b-b3fb-43ac56ada1fc service nova] Creating event network-vif-plugged:49785bbb-59e1-4338-a48e-8643d2aeb626 for instance e52b3172-8315-4160-92f2-02539d4e45cb on nch2-master-1 Jun 04 21:36:54.334776 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5a46b113-ee2d-4dd1-96fb-2047635fc062 req-d1778037-cccb-471b-b3fb-43ac56ada1fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Jun 04 21:36:54.335377 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2872/5845] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:36:54.546624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:54.547250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:54.554679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:54.555121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:54.555948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:54.556405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:54.694742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:54.703197 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-274b8a2c-b0ba-4b8d-bcf6-713453b6c6ec tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1314 microversion: 2.1 time: 0.160600 Jun 04 21:36:54.703845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2974/5846] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:54 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:55.723483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:55.724206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:55.733003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:55.733524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:55.734458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:55.734979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:55.872765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:55.881402 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cdf0b2ed-f8ee-4ed0-946a-92dfd65510c8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1501 microversion: 2.1 time: 0.164128 Jun 04 21:36:55.881982 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2873/5847] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:55 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:55.898619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:36:55.899730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:55.907113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:55.907711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:55.908512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:55.908975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:55.937884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:55.944226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Old instance type m1.heat2, new instance type m1.heat {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:36:55.951016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:36:55.951490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:36:55.952024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:36:55.952484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:36:55.952917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:36:55.990985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:56.024043 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef02f6a8-ec64-481b-a029-07af6320b509 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "POST /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb/action" status: 202 len: 0 microversion: 2.1 time: 0.129771 Jun 04 21:36:56.024901 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2975/5848] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:36:55 2022] POST /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:36:56.033326 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:56.034364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:56.041022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:56.041549 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:56.042367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:56.042799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:56.185518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:56.194318 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-476a01fa-453d-49ff-9b28-8967f0bd1cb1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1510 microversion: 2.1 time: 0.164937 Jun 04 21:36:56.194932 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2874/5849] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:56 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:57.214220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:57.214956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:57.221726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:57.222288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:57.223182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:57.223747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:57.366754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:57.375187 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-443cc979-f9ba-450d-9e8b-aba7f0420457 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1510 microversion: 2.1 time: 0.166963 Jun 04 21:36:57.376024 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2976/5850] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:57 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:58.392774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:58.393403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:58.396622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:58.397850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=10 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:58.403836 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:58.404275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:58.405088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:58.405530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:58.542349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:58.551110 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fb1dd840-1062-465f-b24c-4d866d63fd6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1510 microversion: 2.1 time: 0.162282 Jun 04 21:36:58.551725 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2875/5851] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:58 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:36:59.572194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:36:59.573088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:36:59.575724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:36:59.582566 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:59.583036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:59.583868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:36:59.584327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:36:59.730586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:36:59.739472 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7bd6433-1a0a-4b4d-bef8-49d34966f677 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.173152 Jun 04 21:36:59.740109 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2977/5852] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:36:59 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:00.757959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:00.758666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:00.766234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:00.766681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:00.767445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:00.767936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:00.912442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:00.923808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-785567e4-a2be-4ac6-a590-aeb2ef1dcb6e tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.169666 Jun 04 21:37:00.924421 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2876/5853] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:00 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:01.946261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:01.947368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:01.952023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:01.958090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:01.958563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:01.959359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:01.959843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:02.103442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:02.118732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd6c2f66-1b01-468d-b390-48441aac28e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.178573 Jun 04 21:37:02.119584 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2978/5854] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:01 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:03.142220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:03.142894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:03.145917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:03.151993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:03.152438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:03.153202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:03.153632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:03.157460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=90 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:03.309974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:03.320289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d0d2637d-00c9-434c-aa26-eb3f35708956 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.182300 Jun 04 21:37:03.320909 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2877/5855] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:03 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:04.341872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:04.343127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:04.350229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:04.350705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:04.351499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:04.351990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:04.493154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:04.501413 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6389a040-fbbd-428c-b0e0-adfadbbebd01 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.166275 Jun 04 21:37:04.502010 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2979/5856] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:04 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:05.518860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:05.519886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:05.529587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:05.530144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:05.531264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:05.531831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:05.686725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:05.698927 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5181cd8d-f2f3-42e0-9d06-eded4383bcbb tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.183973 Jun 04 21:37:05.699792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2878/5857] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:05 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:06.720082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:06.720770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:06.729006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:06.729534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:06.730411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:06.730925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:06.867139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:06.875437 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e9414d4-1cd8-4339-9abc-ef2bd694956f tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.161458 Jun 04 21:37:06.876019 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2980/5858] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:06 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:07.896601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:07.897382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:07.907927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:07.908659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:07.909561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:07.910144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:08.061185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:08.069207 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ea98a262-e551-4e96-b034-0025c7dff1ed tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.179567 Jun 04 21:37:08.069809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2879/5859] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:07 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:09.089744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:09.091949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:09.100060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:09.100546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:09.101385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:09.101797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:09.237753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:09.245967 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-999da3fc-1784-4bf4-86dc-b55d9a8dd1d9 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.161582 Jun 04 21:37:09.246515 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2981/5860] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:09 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:10.263194 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:10.263885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:10.271913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:10.272371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:10.273144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:10.273582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:10.412925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:10.421043 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a3c3928e-5840-404c-9bb6-5dccb2133954 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.161858 Jun 04 21:37:10.421631 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2880/5861] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:10 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:11.442572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:11.443787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:11.454886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:11.455372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:11.456189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:11.456641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:11.599123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:11.607111 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-edb58ddc-5196-4fac-89b1-c59fb8af1933 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.171588 Jun 04 21:37:11.607817 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2982/5862] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:11 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:12.627526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:12.628166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:12.636105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:12.636519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:12.637367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:12.637831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:12.777722 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:12.786136 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a009da55-7407-4169-8d2e-d32b09164975 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.164095 Jun 04 21:37:12.786735 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2881/5863] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:12 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:13.806574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:13.807578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:13.819407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:13.820231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:13.821513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:13.822256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:13.972086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:13.979939 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-039fed76-7232-4328-8800-880b4922dac0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.180245 Jun 04 21:37:13.980491 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2983/5864] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:13 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:15.001446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:15.002129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:15.009522 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:15.010011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:15.010792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:15.011222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:15.158166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:15.170131 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4fe7f973-7869-46bc-afe8-e6a89ebaed35 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.175066 Jun 04 21:37:15.170935 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2882/5865] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:14 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:16.192578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:16.193625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:16.205118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:16.205587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:16.206384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:16.206841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:16.361664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:16.369577 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-20df3f2c-2c6c-496d-ad6c-51f3c3ba5559 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.183803 Jun 04 21:37:16.370217 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2984/5866] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:16 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:17.389747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:17.390404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:17.398206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:17.398652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:17.399419 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:17.399882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:17.547013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:17.555335 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-908c90c0-5778-44fd-9035-0a3fc377198b tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.172048 Jun 04 21:37:17.555944 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2883/5867] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:17 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:18.573099 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:18.573834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:18.582705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:18.583195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:18.584052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:18.584542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:18.726471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:18.734894 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4f882cfe-930e-411e-8664-68c609f01cd1 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.166270 Jun 04 21:37:18.735490 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2985/5868] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:18 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:19.756837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:19.757896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:19.768666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:19.769146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:19.770265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:19.770702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:19.918001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:19.926105 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6abaed9d-a3ba-4faf-8c94-7859a3b260ab tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.175949 Jun 04 21:37:19.926695 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2884/5869] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:19 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:20.946996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:20.947807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:20.955644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:20.956216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:20.957269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:20.957899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:21.102159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:21.110555 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d7fee8d3-7e6b-424b-a727-e3a3c46510e4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.169714 Jun 04 21:37:21.111134 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2986/5870] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:20 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:22.132775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:22.133625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:22.144826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:22.145278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:22.146044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:22.146478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:22.292957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:22.301083 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-21e2f8fa-c26d-41c4-8408-cd56256735a6 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.175584 Jun 04 21:37:22.301691 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2885/5871] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:22 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:23.324816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:23.325698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:23.338238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:23.339008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:23.340384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:23.341143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:23.483278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:23.491651 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5932a6c2-1ac4-41e8-8c29-61a7314162f0 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.173657 Jun 04 21:37:23.492231 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2987/5872] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:23 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:24.509883 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:24.510499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:24.518180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:24.518629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:24.519395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:24.520201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:24.664756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:24.673331 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-37750926-4b28-4560-b0ef-0eb040c1d834 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1515 microversion: 2.1 time: 0.168011 Jun 04 21:37:24.673904 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2886/5873] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:24 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:25.696010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:25.696713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:25.704268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:25.704741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:25.705619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:25.706053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:25.847713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:25.855936 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09db363a-23b1-4a9b-a97a-faec3d398508 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1514 microversion: 2.1 time: 0.163915 Jun 04 21:37:25.856567 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2988/5874] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:25 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:26.025387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2c4c370b-3536-4de6-9118-28b4b90b7533 req-2dc721c4-0fab-4555-81de-8663efcd7ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b3172-8315-4160-92f2-02539d4e45cb", "name": "network-vif-unplugged", "status": "completed", "tag": "49785bbb-59e1-4338-a48e-8643d2aeb626"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:26.035745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2c4c370b-3536-4de6-9118-28b4b90b7533 req-2dc721c4-0fab-4555-81de-8663efcd7ac4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:26.036320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2c4c370b-3536-4de6-9118-28b4b90b7533 req-2dc721c4-0fab-4555-81de-8663efcd7ac4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:26.050509 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2c4c370b-3536-4de6-9118-28b4b90b7533 req-2dc721c4-0fab-4555-81de-8663efcd7ac4 service nova] Creating event network-vif-unplugged:49785bbb-59e1-4338-a48e-8643d2aeb626 for instance e52b3172-8315-4160-92f2-02539d4e45cb on nch1-master-1 Jun 04 21:37:26.056299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-2c4c370b-3536-4de6-9118-28b4b90b7533 req-2dc721c4-0fab-4555-81de-8663efcd7ac4 service nova] Instance e52b3172-8315-4160-92f2-02539d4e45cb is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:37:26.068137 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2c4c370b-3536-4de6-9118-28b4b90b7533 req-2dc721c4-0fab-4555-81de-8663efcd7ac4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046655 Jun 04 21:37:26.068751 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2887/5875] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:37:26.874121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:26.874786 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:26.882866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:26.883397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:26.884186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:26.884640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:26.888811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:27.025093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:27.032866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b709d38-0e77-4fde-bf06-a499d49289b5 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1514 microversion: 2.1 time: 0.162970 Jun 04 21:37:27.033455 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2989/5876] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:26 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:27.348788 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:37:27.349124 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 21:37:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:37:28.053357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:28.054089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:28.062539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:28.062989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:28.063799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:28.064234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:28.087010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c7aa3ce0-1f52-46e8-8134-fa4f3263944c req-89701d0a-0c3e-499c-b638-d7b10e111f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e52b3172-8315-4160-92f2-02539d4e45cb", "tag": "49785bbb-59e1-4338-a48e-8643d2aeb626"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:28.097391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c7aa3ce0-1f52-46e8-8134-fa4f3263944c req-89701d0a-0c3e-499c-b638-d7b10e111f32 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:28.097851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c7aa3ce0-1f52-46e8-8134-fa4f3263944c req-89701d0a-0c3e-499c-b638-d7b10e111f32 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:28.110077 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c7aa3ce0-1f52-46e8-8134-fa4f3263944c req-89701d0a-0c3e-499c-b638-d7b10e111f32 service nova] Creating event network-changed:49785bbb-59e1-4338-a48e-8643d2aeb626 for instance e52b3172-8315-4160-92f2-02539d4e45cb on nch1-master-1 Jun 04 21:37:28.118351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-c7aa3ce0-1f52-46e8-8134-fa4f3263944c req-89701d0a-0c3e-499c-b638-d7b10e111f32 service nova] Instance e52b3172-8315-4160-92f2-02539d4e45cb is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:37:28.131555 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c7aa3ce0-1f52-46e8-8134-fa4f3263944c req-89701d0a-0c3e-499c-b638-d7b10e111f32 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048118 Jun 04 21:37:28.132603 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2990/5877] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:37:28.221995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:28.230040 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9df66f3b-8edb-4fd4-8e2d-9ce4d2bb88b4 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1512 microversion: 2.1 time: 0.183396 Jun 04 21:37:28.230640 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2888/5878] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:28 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:29.252543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:29.255587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:29.262276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:29.262746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:29.263567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:29.264027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:29.402569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:29.411030 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7f46a58f-a5cf-454c-ab59-574bd56e0033 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1509 microversion: 2.1 time: 0.166116 Jun 04 21:37:29.411675 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2991/5879] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:29 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:29.428053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:29.428594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:29.436799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:29.437273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:29.438041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:29.438480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:29.466741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:37:29.522371 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Found an unconfirmed migration during delete, id: 16, status: finished Jun 04 21:37:30.860958 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b50847a-aa6c-4e2c-969f-6aab54685ecf tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 204 len: 0 microversion: 2.1 time: 1.437352 Jun 04 21:37:30.862008 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2889/5880] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:37:29 2022] DELETE /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 0 bytes in 1439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:37:30.870639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:30.871269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:30.878627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:30.879194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:30.880004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:30.880450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:31.014810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:31.023500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eb89e94f-feca-4299-bc1d-94427c193dba tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1501 microversion: 2.1 time: 0.157158 Jun 04 21:37:31.024285 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2992/5881] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:30 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:32.047388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:32.048935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:32.061681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:32.062422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:32.063719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:32.064539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:32.213816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6ec0768b414f93861ebb3da7615753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9da76d6d254fe0995e9642e330bad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:32.222035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8104c562-3289-4202-a5dc-bd30b37581df tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 200 len: 1501 microversion: 2.1 time: 0.182974 Jun 04 21:37:32.222619 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2890/5882] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:32 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:32.297213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fc243d80-f4b3-47c6-a6ac-d113005b135f req-b96b0eae-d7a4-47ed-9f16-494a91ac0b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b3172-8315-4160-92f2-02539d4e45cb", "name": "network-vif-plugged", "status": "completed", "tag": "49785bbb-59e1-4338-a48e-8643d2aeb626"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:32.301903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=30 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:32.309082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fc243d80-f4b3-47c6-a6ac-d113005b135f req-b96b0eae-d7a4-47ed-9f16-494a91ac0b29 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:32.309788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fc243d80-f4b3-47c6-a6ac-d113005b135f req-b96b0eae-d7a4-47ed-9f16-494a91ac0b29 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:32.322974 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fc243d80-f4b3-47c6-a6ac-d113005b135f req-b96b0eae-d7a4-47ed-9f16-494a91ac0b29 service nova] Creating event network-vif-plugged:49785bbb-59e1-4338-a48e-8643d2aeb626 for instance e52b3172-8315-4160-92f2-02539d4e45cb on nch1-master-1 Jun 04 21:37:32.328273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fc243d80-f4b3-47c6-a6ac-d113005b135f req-b96b0eae-d7a4-47ed-9f16-494a91ac0b29 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 Jun 04 21:37:32.328894 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2993/5883] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:37:32.879739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-10ffc048-2d47-437a-abd2-a62bba86b6c0 req-81cddb95-0501-4f10-ba73-c2edd102f2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e52b3172-8315-4160-92f2-02539d4e45cb", "name": "network-vif-deleted", "tag": "49785bbb-59e1-4338-a48e-8643d2aeb626"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:32.888961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-10ffc048-2d47-437a-abd2-a62bba86b6c0 req-81cddb95-0501-4f10-ba73-c2edd102f2d5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:32.889348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-10ffc048-2d47-437a-abd2-a62bba86b6c0 req-81cddb95-0501-4f10-ba73-c2edd102f2d5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:32.901375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-10ffc048-2d47-437a-abd2-a62bba86b6c0 req-81cddb95-0501-4f10-ba73-c2edd102f2d5 service nova] Creating event network-vif-deleted:49785bbb-59e1-4338-a48e-8643d2aeb626 for instance e52b3172-8315-4160-92f2-02539d4e45cb on nch1-master-1 Jun 04 21:37:32.906247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-10ffc048-2d47-437a-abd2-a62bba86b6c0 req-81cddb95-0501-4f10-ba73-c2edd102f2d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030310 Jun 04 21:37:32.906848 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2891/5884] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:37:33.240146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:33.240897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:33.247771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:33.248202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:33.248986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:33.249431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:33.263466 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] HTTP exception thrown: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Request method failure captured: Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb HTTP/1.1 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9BuGQo5eeawi5iT6bBy9A8oEvCJvOt46W9Mv5i0NGSVGFSMoxWETgbZQME_44_AiqXOfJ5TOcZ_qzGeoSMRr8o1wnP1v8l6ty5Rt8VxDSFmxYD4ryUoODLDkwkP5zj-G7RtCo9AWQuvJ9GTwjNh7bvgZtRnh3FdY_AU9dDyObP56eU Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0c9da76d6d254fe0995e9642e330bad7 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0c9da76d6d254fe0995e9642e330bad7 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1801294835-project Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ca6ec0768b414f93861ebb3da7615753 Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1801294835-project Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e52b3172-8315-4160-92f2-02539d4e45cb'} Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:37:33.265141 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Returning 404 to user: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b200ade5-33b2-4c36-860a-08ed2701b9e8 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 404 len: 111 microversion: 2.1 time: 0.031687 Jun 04 21:37:33.271248 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2994/5885] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:33 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:37:33.281460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:33.282268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:33.284410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:33.290772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:33.291222 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:33.292057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:33.292500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:33.295669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:33.308695 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] HTTP exception thrown: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Request method failure captured: Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb HTTP/1.1 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9BuGQo5eeawi5iT6bBy9A8oEvCJvOt46W9Mv5i0NGSVGFSMoxWETgbZQME_44_AiqXOfJ5TOcZ_qzGeoSMRr8o1wnP1v8l6ty5Rt8VxDSFmxYD4ryUoODLDkwkP5zj-G7RtCo9AWQuvJ9GTwjNh7bvgZtRnh3FdY_AU9dDyObP56eU Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0c9da76d6d254fe0995e9642e330bad7 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0c9da76d6d254fe0995e9642e330bad7 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-DeleteServersTestJSON-1801294835-project Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ca6ec0768b414f93861ebb3da7615753 Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-DeleteServersTestJSON-1801294835-project Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e52b3172-8315-4160-92f2-02539d4e45cb'} Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:37:33.310347 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Returning 404 to user: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5c24155a-586a-4786-a1bc-06521f583813 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 404 len: 111 microversion: 2.1 time: 0.035618 Jun 04 21:37:33.316234 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2892/5886] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:37:33 2022] DELETE /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:37:33.320623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:33.321262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] [instance: e52b3172-8315-4160-92f2-02539d4e45cb] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:33.328438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:33.328903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:33.329684 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:33.330139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:33.344357 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] HTTP exception thrown: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Request method failure captured: Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb HTTP/1.1 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9BuGQo5eeawi5iT6bBy9A8oEvCJvOt46W9Mv5i0NGSVGFSMoxWETgbZQME_44_AiqXOfJ5TOcZ_qzGeoSMRr8o1wnP1v8l6ty5Rt8VxDSFmxYD4ryUoODLDkwkP5zj-G7RtCo9AWQuvJ9GTwjNh7bvgZtRnh3FdY_AU9dDyObP56eU Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0c9da76d6d254fe0995e9642e330bad7 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0c9da76d6d254fe0995e9642e330bad7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0c9da76d6d254fe0995e9642e330bad7 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-DeleteServersTestJSON-1801294835 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-DeleteServersTestJSON-1801294835-project Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ca6ec0768b414f93861ebb3da7615753 Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-DeleteServersTestJSON-1801294835-project Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'e52b3172-8315-4160-92f2-02539d4e45cb'} Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:37:33.345944 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] Returning 404 to user: Instance e52b3172-8315-4160-92f2-02539d4e45cb could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-24db4215-f57d-42c7-b4f9-87be3c883667 tempest-DeleteServersTestJSON-1801294835 tempest-DeleteServersTestJSON-1801294835-project] 10.222.0.18 "GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb" status: 404 len: 111 microversion: 2.1 time: 0.030689 Jun 04 21:37:33.350977 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2995/5887] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:33 2022] GET /compute/v2.1/servers/e52b3172-8315-4160-92f2-02539d4e45cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:37:35.955649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-717594400", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "37c13840-c179-4257-b43e-8b2d42046cbe"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:36.007974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] validate_networks() for [('37c13840-c179-4257-b43e-8b2d42046cbe', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:37:36.372562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:37:36.373024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:37:36.373500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:37:36.373911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:37:36.374325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:37:36.384440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:36.384899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:36.385702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:36.386145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:36.403818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Getting quotas for project 6ed5588bf9fd4a94b2cfa302d7cdd02a. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:37:36.409317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Getting quotas for user 3a55fa711a6146b5a30c456c33f2c01c and project 6ed5588bf9fd4a94b2cfa302d7cdd02a. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:37:36.422160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:37:36.424649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:37:36.471427 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bb2d5d67-411d-43ad-aaf1-6987aa5f1536 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636759 Jun 04 21:37:36.472122 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2893/5888] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:37:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:37:36.482716 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c187c9fc-fef8-4404-9523-c0958c98cb58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:36.483997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c187c9fc-fef8-4404-9523-c0958c98cb58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:36.542881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c187c9fc-fef8-4404-9523-c0958c98cb58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:36.550163 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c187c9fc-fef8-4404-9523-c0958c98cb58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1217 microversion: 2.1 time: 0.071477 Jun 04 21:37:36.550976 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2996/5889] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:36 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:37.571004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:37.572013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:37.582396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:37.583241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:37.584105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:37.584572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:37.715660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:37.724809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0a7b4935-b9e4-4e44-9b92-92d4b5e3f701 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1269 microversion: 2.1 time: 0.160187 Jun 04 21:37:37.725760 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2894/5890] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:37 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:38.742917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:38.743625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:38.751849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:38.752386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:38.753170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:38.753614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:38.957264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:38.966557 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8b209d38-6623-48c0-be0c-57bc6c2e7b47 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1317 microversion: 2.1 time: 0.227935 Jun 04 21:37:38.967131 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2997/5891] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:38 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:39.396296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-30d46713-9aab-4bd3-a46c-51ceed94cf8a req-dd1deabb-149f-4d91-86fe-7f86b456750c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615a7241-b091-492c-93b7-489da1682bd1", "tag": "f2ed64cf-5ab9-4745-9e72-97612b11183c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:39.406996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-30d46713-9aab-4bd3-a46c-51ceed94cf8a req-dd1deabb-149f-4d91-86fe-7f86b456750c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:39.407594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-30d46713-9aab-4bd3-a46c-51ceed94cf8a req-dd1deabb-149f-4d91-86fe-7f86b456750c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:39.421722 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-30d46713-9aab-4bd3-a46c-51ceed94cf8a req-dd1deabb-149f-4d91-86fe-7f86b456750c service nova] Creating event network-changed:f2ed64cf-5ab9-4745-9e72-97612b11183c for instance 615a7241-b091-492c-93b7-489da1682bd1 on nch1-master-1 Jun 04 21:37:39.428757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-30d46713-9aab-4bd3-a46c-51ceed94cf8a req-dd1deabb-149f-4d91-86fe-7f86b456750c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034495 Jun 04 21:37:39.429593 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2895/5892] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:37:39.984474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:39.985147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:39.992757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:39.993225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:39.994010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:39.994452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:40.135854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:40.144026 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cadbac26-0a67-4f7f-8a00-bf202cafabb4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1317 microversion: 2.1 time: 0.163671 Jun 04 21:37:40.145000 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2998/5893] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:39 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:41.163035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:41.163798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:41.171250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:41.171738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:41.172557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:41.173000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:41.313940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:41.321757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-91e58fad-842b-443f-9e18-0ce6e0cb8932 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1317 microversion: 2.1 time: 0.163465 Jun 04 21:37:41.322334 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2896/5894] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:41 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:42.339739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:42.340287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:42.346989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:42.347454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:42.348291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:42.348738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:42.484235 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:42.492460 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b5543131-674c-4126-9ce8-d5a30bbfc8fd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1317 microversion: 2.1 time: 0.157402 Jun 04 21:37:42.493057 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 2999/5895] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:42 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:43.511677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:43.512537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:43.521856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:43.522536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:43.523869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:43.524670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:43.686564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:43.694964 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-76bc84c8-e0c8-434a-8d15-a16b19a15f4c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1317 microversion: 2.1 time: 0.188101 Jun 04 21:37:43.695544 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2897/5896] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:43 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:44.316443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-e3852759-861d-410c-9c5c-01604de32c20 req-6472e3a6-fd6d-49bf-8028-3c764c0d7614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615a7241-b091-492c-93b7-489da1682bd1", "name": "network-vif-plugged", "status": "completed", "tag": "f2ed64cf-5ab9-4745-9e72-97612b11183c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:44.326171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e3852759-861d-410c-9c5c-01604de32c20 req-6472e3a6-fd6d-49bf-8028-3c764c0d7614 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:44.326630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-e3852759-861d-410c-9c5c-01604de32c20 req-6472e3a6-fd6d-49bf-8028-3c764c0d7614 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:44.339473 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-e3852759-861d-410c-9c5c-01604de32c20 req-6472e3a6-fd6d-49bf-8028-3c764c0d7614 service nova] Creating event network-vif-plugged:f2ed64cf-5ab9-4745-9e72-97612b11183c for instance 615a7241-b091-492c-93b7-489da1682bd1 on nch1-master-1 Jun 04 21:37:44.346186 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-e3852759-861d-410c-9c5c-01604de32c20 req-6472e3a6-fd6d-49bf-8028-3c764c0d7614 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 Jun 04 21:37:44.346809 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3000/5897] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:37:44.712584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:44.713296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:44.721916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:44.722450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:44.723495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:44.724146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:44.859258 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:44.871289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2702cdbb-4835-4f6a-8e69-a0188b93ecbb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1317 microversion: 2.1 time: 0.163187 Jun 04 21:37:44.872196 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2898/5898] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:44 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:45.892453 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:45.893284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:45.901658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:45.902123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:45.902919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:45.903369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.043969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:46.052226 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-afda826a-1120-4ac8-9733-8152df735505 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1507 microversion: 2.1 time: 0.164199 Jun 04 21:37:46.052798 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3001/5899] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:45 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:46.069340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:46.069910 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:46.077328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.077783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.078630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.079069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.219330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:46.228133 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a76003ee-bced-42fc-8b10-e4e2637a4f6e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1507 microversion: 2.1 time: 0.163306 Jun 04 21:37:46.228712 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2899/5900] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:46 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:46.244517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:46.245686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:46.252378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.252851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.253644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.254109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.322801 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ae5cf72e-2b8f-4e31-b80b-c36e01868bfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "PUT /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1079 microversion: 2.1 time: 0.082363 Jun 04 21:37:46.324075 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3002/5901] 10.222.0.18 () {60 vars in 1255 bytes} [Sat Jun 4 21:37:46 2022] PUT /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1079 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:46.337858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:46.338473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:46.344856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.345309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.346079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.346525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.393148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:46.416263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:46.480870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:46.492453 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-37077639-a839-4d90-8325-85984c111047 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1505 microversion: 2.1 time: 0.158221 Jun 04 21:37:46.493337 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2900/5902] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:46 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:46.513433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:46.514121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:46.521149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.521611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.522397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.522849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.547043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:46.675846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:46.684316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15295a04-39ef-49c6-8eeb-fe408f6b28a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1505 microversion: 2.1 time: 0.175093 Jun 04 21:37:46.684871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3003/5903] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:46 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:46.701257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:37:46.702279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:46.708702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.709150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.709915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.710335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.740290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:46.746544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Old instance type m1.heat2, new instance type m1.heat {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:37:46.753176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:37:46.753598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:37:46.754071 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:37:46.754569 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:37:46.755104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:37:46.824291 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4c3a0645-6bb4-49c0-926b-cd3e45bb5ce6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1/action" status: 202 len: 0 microversion: 2.1 time: 0.126888 Jun 04 21:37:46.824830 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2901/5904] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:37:46 2022] POST /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:37:46.833938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:46.834562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:46.840828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.841285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.842060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:46.842509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:46.983129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:46.991802 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54c41b55-7f5b-4ae6-a4e6-baf193346156 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1516 microversion: 2.1 time: 0.162250 Jun 04 21:37:46.992387 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3004/5905] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:46 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:48.013767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:48.015201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:48.023091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:48.023557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:48.024347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:48.024788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:48.170383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:48.179279 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5b004ad-b407-49f3-8bb4-fa04105dfbac tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1516 microversion: 2.1 time: 0.171936 Jun 04 21:37:48.179902 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2902/5906] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:48 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:49.198292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:49.198893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:49.206408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:49.206879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:49.207709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:49.208196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:49.348094 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:49.356469 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55db42ec-427b-44d4-a33a-ddff8cb7ab7a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.162229 Jun 04 21:37:49.357048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3005/5907] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:49 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:50.374433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:50.375066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:50.382905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:50.383359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:50.384178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:50.384647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:50.529884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:50.541322 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9c7195b1-3112-491a-8ddb-efcddb300872 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.170617 Jun 04 21:37:50.542122 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2903/5908] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:50 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:51.562626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:51.563386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:51.571367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:51.571860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:51.572656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:51.573101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:51.723710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:51.732836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd9870d4-0296-4ad3-931c-80c5a370f9a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.174275 Jun 04 21:37:51.733389 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3006/5909] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:51 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:52.754428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:52.755363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:52.767588 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:52.768372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:52.769645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:52.770750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:52.904947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:52.913254 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-abadfe61-a4db-423c-8be4-e74fd752fbfe tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.165214 Jun 04 21:37:52.913838 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2904/5910] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:52 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:53.934834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:53.935949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:53.946899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:53.947392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:53.948193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:53.948760 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:54.096011 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:54.105193 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d46e11ba-f189-4f30-b826-4ded5a112e4d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.177069 Jun 04 21:37:54.105779 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3007/5911] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:53 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:55.127081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:55.128162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:55.136707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:55.137154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:55.137915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:55.138331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:55.272871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:55.280633 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-37d0463f-df15-486c-a671-182b2dd317db tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.160075 Jun 04 21:37:55.281210 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2905/5912] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:55 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:56.303928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:56.304620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:56.311640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:56.312102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:56.312886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:56.313339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:56.455300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:56.463808 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-facbb1ad-39f4-43d0-8db8-9db1b45b7e58 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.168144 Jun 04 21:37:56.464380 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3008/5913] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:56 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:57.483262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:57.483929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:57.490620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:57.491079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:57.491922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:57.492363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:57.630378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:57.638350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8389922d-679d-4685-9d2a-670a52378adc tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.160192 Jun 04 21:37:57.638937 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2906/5914] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:57 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:58.660359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:58.661432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:58.670312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:58.670772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:58.671563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:58.672035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:58.674749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:37:58.811814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:37:58.820359 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7c8d8712-5dce-4b52-b30a-e637d8038fb8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.166603 Jun 04 21:37:58.821143 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3009/5915] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:58 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:37:59.840822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:37:59.841507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:37:59.849678 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:59.850181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:59.851035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:37:59.851547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:37:59.999182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:00.010428 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ac95d3d-a215-4725-8086-153539d43d7c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.174616 Jun 04 21:38:00.011013 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2907/5916] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:37:59 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:01.033219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:01.034306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:01.044127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:01.044593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:01.045381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:01.045832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:01.186476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:01.194487 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55bb75cf-463c-4ccb-b7b2-b8eefc3810de tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.168047 Jun 04 21:38:01.195064 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3010/5917] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:01 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:02.222480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:02.223584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:02.232585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:02.233043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:02.233824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:02.234260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:02.368256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:02.376102 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-449ffe82-6542-427f-b732-411212227421 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.160126 Jun 04 21:38:02.376689 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2908/5918] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:02 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:03.395084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:03.395776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:03.398618 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=38 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:03.404685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:03.405152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:03.405937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:03.406386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:03.570375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:03.581674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1c5ccbba-7d68-4ae3-aabb-6fe32a09bf1d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.190845 Jun 04 21:38:03.582629 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3011/5919] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:03 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:04.602619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:04.603241 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:04.606061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:04.613356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:04.614026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:04.615187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:04.615930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:04.642038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:04.786698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:04.794853 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-63251950-fb21-4077-991d-29b6486a64d1 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.198901 Jun 04 21:38:04.795440 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2909/5920] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:04 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:05.817132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:05.818129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:05.829946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:05.830738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:05.832108 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:05.832877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:05.988008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:05.996422 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-54c9a60c-c203-4717-9eab-fa8fa742eb7e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.186085 Jun 04 21:38:05.997303 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3012/5921] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:05 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:07.015346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:07.016043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:07.027709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:07.028236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:07.029048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:07.029483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:07.171642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:07.179995 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-78a6fc51-3aed-4724-bbe9-5edd972bf51d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.169774 Jun 04 21:38:07.180553 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2910/5922] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:07 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:08.201540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:08.202169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:08.210631 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:08.211077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:08.211919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:08.212879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:08.362905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:08.373033 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bff9cc3c-6596-440f-b0ef-75afd7395ff0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.175633 Jun 04 21:38:08.381712 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3013/5923] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:08 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:09.390654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:09.391261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:09.399052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:09.399502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:09.400286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:09.400725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:09.549881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:09.558227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f8ea986-28cc-45d8-b727-2918fda219a2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.171812 Jun 04 21:38:09.558824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2911/5924] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:09 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:10.576604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:10.577239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:10.585536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:10.586048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:10.586912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:10.587408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:10.725856 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:10.733777 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85b8a31b-9191-4897-854a-a54d0dc031ae tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.162035 Jun 04 21:38:10.734352 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3014/5925] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:10 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:11.754663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:11.755731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:11.767853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:11.768615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:11.770221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:11.770985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:11.908335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:11.916069 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df75294c-dfc6-48d1-bdfd-f01a689387f8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.167948 Jun 04 21:38:11.916650 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2912/5926] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:11 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:12.935523 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:12.936440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:12.946217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:12.946862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:12.947962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:12.948569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:13.088142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:13.096275 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37fddc81-1734-49e2-98e2-3407bd857513 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.166719 Jun 04 21:38:13.096855 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3015/5927] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:12 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:14.117982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:14.119041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:14.131183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:14.132015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:14.133290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:14.134023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:14.276424 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:14.287607 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-96965729-a381-4ced-b110-4c7c0ac2abfd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.175874 Jun 04 21:38:14.288363 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2913/5928] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:14 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:15.308591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:15.309206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:15.317259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:15.317718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:15.318508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:15.318955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:15.455999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:15.464156 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-526afa31-49d4-4539-b506-9811c52d9b68 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1521 microversion: 2.1 time: 0.160660 Jun 04 21:38:15.464738 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3016/5929] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:15 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:16.482100 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:16.482709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:16.490199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:16.490647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:16.491420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:16.491877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:16.625209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:16.633030 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d262eea5-c038-4c73-99a5-c649294d6e27 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1520 microversion: 2.1 time: 0.155342 Jun 04 21:38:16.633838 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2914/5930] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:16 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:16.765111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-46aae849-67a5-4a24-8e83-eb8bf48d7dc8 req-5d0b85f6-9cc6-4adf-ba28-9755fd72a14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615a7241-b091-492c-93b7-489da1682bd1", "name": "network-vif-unplugged", "status": "completed", "tag": "f2ed64cf-5ab9-4745-9e72-97612b11183c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:16.778329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-46aae849-67a5-4a24-8e83-eb8bf48d7dc8 req-5d0b85f6-9cc6-4adf-ba28-9755fd72a14d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:16.778863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-46aae849-67a5-4a24-8e83-eb8bf48d7dc8 req-5d0b85f6-9cc6-4adf-ba28-9755fd72a14d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:16.792402 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-46aae849-67a5-4a24-8e83-eb8bf48d7dc8 req-5d0b85f6-9cc6-4adf-ba28-9755fd72a14d service nova] Creating event network-vif-unplugged:f2ed64cf-5ab9-4745-9e72-97612b11183c for instance 615a7241-b091-492c-93b7-489da1682bd1 on nch2-master-1 Jun 04 21:38:16.798514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-46aae849-67a5-4a24-8e83-eb8bf48d7dc8 req-5d0b85f6-9cc6-4adf-ba28-9755fd72a14d service nova] Instance 615a7241-b091-492c-93b7-489da1682bd1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:38:16.809761 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-46aae849-67a5-4a24-8e83-eb8bf48d7dc8 req-5d0b85f6-9cc6-4adf-ba28-9755fd72a14d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050124 Jun 04 21:38:16.810408 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3017/5931] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:17.650927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:17.651552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:17.659190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:17.659712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:17.660481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:17.660917 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:17.810229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:17.818403 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-de044db0-beb9-44cc-833d-294005fd5ec8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1518 microversion: 2.1 time: 0.171804 Jun 04 21:38:17.818988 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2915/5932] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:17 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:18.833568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d801600f-608e-4b20-b011-4ec8e73ae3c9 req-26712678-439d-4db5-a0dc-85ce439d00b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615a7241-b091-492c-93b7-489da1682bd1", "tag": "f2ed64cf-5ab9-4745-9e72-97612b11183c"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:18.835968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:18.836584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:18.844256 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:18.844706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:18.845477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:18.845925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:18.848825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d801600f-608e-4b20-b011-4ec8e73ae3c9 req-26712678-439d-4db5-a0dc-85ce439d00b1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:18.849370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d801600f-608e-4b20-b011-4ec8e73ae3c9 req-26712678-439d-4db5-a0dc-85ce439d00b1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:18.864519 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d801600f-608e-4b20-b011-4ec8e73ae3c9 req-26712678-439d-4db5-a0dc-85ce439d00b1 service nova] Creating event network-changed:f2ed64cf-5ab9-4745-9e72-97612b11183c for instance 615a7241-b091-492c-93b7-489da1682bd1 on nch2-master-1 Jun 04 21:38:18.870397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-d801600f-608e-4b20-b011-4ec8e73ae3c9 req-26712678-439d-4db5-a0dc-85ce439d00b1 service nova] Instance 615a7241-b091-492c-93b7-489da1682bd1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:38:18.881773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d801600f-608e-4b20-b011-4ec8e73ae3c9 req-26712678-439d-4db5-a0dc-85ce439d00b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053971 Jun 04 21:38:18.882456 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3018/5933] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:18.990736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:19.000305 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-df9eb15f-0bb4-4925-9e9f-d679b16a4bd8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1518 microversion: 2.1 time: 0.168102 Jun 04 21:38:19.010423 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2916/5934] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:18 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:20.021985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:20.022598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:20.033148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:20.033628 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:20.034427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:20.034887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:20.185457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:20.194123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7e6c5075-eb4f-4668-9a78-705818dfb8e6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1515 microversion: 2.1 time: 0.179669 Jun 04 21:38:20.194678 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3019/5935] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:20 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:20.211386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:20.211996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:20.219310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:20.219781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:20.220546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:20.220972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:20.285910 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-040f5935-c208-44cd-9127-c3a3e420cb1c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1/action" status: 204 len: 0 microversion: 2.1 time: 0.078211 Jun 04 21:38:20.286483 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2917/5936] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:38:20 2022] POST /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 04 21:38:20.300809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:20.301412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:20.308336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:20.308945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:20.309830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:20.310282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:20.457182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:20.465078 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3334cddb-c495-49d2-b0b8-f8669c70656c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1515 microversion: 2.1 time: 0.168574 Jun 04 21:38:20.465682 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3020/5937] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:20 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:21.489779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:21.490913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:21.501965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:21.502534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:21.503311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:21.503809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:21.643876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:21.652393 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9371543e-9188-47a1-a255-9ca1a04d448e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1515 microversion: 2.1 time: 0.171748 Jun 04 21:38:21.653009 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2918/5938] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:21 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:22.670922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:22.671495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:22.679105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:22.679553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:22.680360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:22.680805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:22.728431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-c447a61f-18ea-4d63-91c8-fc916b5d4a8f req-deb2ca3c-b226-41d2-a507-69bf909346e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615a7241-b091-492c-93b7-489da1682bd1", "name": "network-vif-plugged", "status": "completed", "tag": "f2ed64cf-5ab9-4745-9e72-97612b11183c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:22.742885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c447a61f-18ea-4d63-91c8-fc916b5d4a8f req-deb2ca3c-b226-41d2-a507-69bf909346e3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:22.743450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-c447a61f-18ea-4d63-91c8-fc916b5d4a8f req-deb2ca3c-b226-41d2-a507-69bf909346e3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:22.757350 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-c447a61f-18ea-4d63-91c8-fc916b5d4a8f req-deb2ca3c-b226-41d2-a507-69bf909346e3 service nova] Creating event network-vif-plugged:f2ed64cf-5ab9-4745-9e72-97612b11183c for instance 615a7241-b091-492c-93b7-489da1682bd1 on nch2-master-1 Jun 04 21:38:22.762932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-c447a61f-18ea-4d63-91c8-fc916b5d4a8f req-deb2ca3c-b226-41d2-a507-69bf909346e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038863 Jun 04 21:38:22.763992 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2919/5939] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:22.826135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:22.834206 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3fca83d5-14b6-4bcb-bc4d-4e768831e013 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1507 microversion: 2.1 time: 0.167523 Jun 04 21:38:22.834787 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3021/5940] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:22 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:22.851731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:22.852467 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:22.858879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:22.859692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:22.860469 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:22.860904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:22.998101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:23.010506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-55ebdea1-6816-48e4-893b-23ee2b5324a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1507 microversion: 2.1 time: 0.163100 Jun 04 21:38:23.011103 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2920/5941] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:22 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:23.030869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce3275ca-9dbb-4a1f-8a13-259b809cd55d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'create', calling method: .version_select at 0x7f2d01049c10>, body: {"keypair": {"name": "tempest-keypair-1061704569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHSYBxTirXr2TYo4hChSHZvN532GJhl1IkvUBXI7LTE7CdsOAU+UgoKijHHj3B+oHLb0pzhc2KnqzuGtLPmWrIJmZ7Y688enbmAwUxlbcP9nmyY/R1lwWpayi/nYQzA5Q=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:23.046340 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ce3275ca-9dbb-4a1f-8a13-259b809cd55d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Getting quotas for project 6ed5588bf9fd4a94b2cfa302d7cdd02a. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:38:23.054199 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ce3275ca-9dbb-4a1f-8a13-259b809cd55d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Getting quotas for user 3a55fa711a6146b5a30c456c33f2c01c and project 6ed5588bf9fd4a94b2cfa302d7cdd02a. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:38:23.092866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce3275ca-9dbb-4a1f-8a13-259b809cd55d tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065938 Jun 04 21:38:23.093474 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3022/5942] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:38:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:24.775696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:24.776325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:24.783309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:24.783810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:24.784618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:24.785054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:24.928421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:24.939298 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b780eed6-c15d-4911-b376-5a29b0b20db3 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 200 len: 1507 microversion: 2.1 time: 0.167786 Jun 04 21:38:24.939925 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2921/5943] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:24 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:38:24.956776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:24.957375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:24.964634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:24.965114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:24.965970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:24.966431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:24.992189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:38:25.073895 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c3781e33-9012-4aa1-b118-00ba0e5c77fb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 204 len: 0 microversion: 2.1 time: 0.121917 Jun 04 21:38:25.074818 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3023/5944] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:38:24 2022] DELETE /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:38:25.136530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-942711174", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "37c13840-c179-4257-b43e-8b2d42046cbe"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:25.197762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] validate_networks() for [('37c13840-c179-4257-b43e-8b2d42046cbe', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:38:25.890203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:38:25.890807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:38:25.891236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:38:25.891709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:38:25.892129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:38:25.901866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:25.902322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:25.903387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:25.903871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:25.922516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Getting quotas for project 6ed5588bf9fd4a94b2cfa302d7cdd02a. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:38:25.927947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Getting quotas for user 3a55fa711a6146b5a30c456c33f2c01c and project 6ed5588bf9fd4a94b2cfa302d7cdd02a. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:38:25.940807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:38:25.943141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:38:25.990261 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6209a38-21cd-4bc7-a864-e81001d4089c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860283 Jun 04 21:38:25.990965 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2922/5945] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:38:26.002420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fd00b8ce-3cee-4525-8f49-330172338dd9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:26.003254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fd00b8ce-3cee-4525-8f49-330172338dd9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:26.059485 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fd00b8ce-3cee-4525-8f49-330172338dd9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:26.068125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fd00b8ce-3cee-4525-8f49-330172338dd9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1217 microversion: 2.1 time: 0.070485 Jun 04 21:38:26.068717 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3024/5946] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:25 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:26.888261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-37edf122-399a-45a2-ba98-7936a4defdd2 req-54a4391c-3496-4910-9320-fb0ff6461e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615a7241-b091-492c-93b7-489da1682bd1", "name": "network-vif-deleted", "tag": "f2ed64cf-5ab9-4745-9e72-97612b11183c"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:26.899766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-37edf122-399a-45a2-ba98-7936a4defdd2 req-54a4391c-3496-4910-9320-fb0ff6461e0a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:26.900477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-37edf122-399a-45a2-ba98-7936a4defdd2 req-54a4391c-3496-4910-9320-fb0ff6461e0a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:26.913250 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-37edf122-399a-45a2-ba98-7936a4defdd2 req-54a4391c-3496-4910-9320-fb0ff6461e0a service nova] Creating event network-vif-deleted:f2ed64cf-5ab9-4745-9e72-97612b11183c for instance 615a7241-b091-492c-93b7-489da1682bd1 on nch2-master-1 Jun 04 21:38:26.926358 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-37edf122-399a-45a2-ba98-7936a4defdd2 req-54a4391c-3496-4910-9320-fb0ff6461e0a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042923 Jun 04 21:38:26.927405 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2923/5947] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:27.086209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:27.087802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:27.097307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:27.097885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:27.098788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:27.099309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:27.175969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:27.187732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c1d741d4-3cb7-49b5-9610-62a7b4b2e3ab tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1275 microversion: 2.1 time: 0.105960 Jun 04 21:38:27.197315 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3025/5948] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:27 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:28.206378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:28.207207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:28.215196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:28.215701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:28.216475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:28.216957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:28.356386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:28.365047 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f3d58155-d359-4058-80ca-8997276d9246 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1317 microversion: 2.1 time: 0.163308 Jun 04 21:38:28.366071 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2924/5949] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:28 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:28.946885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cffa5a68-daad-4584-bd36-0ce3e75d47c6 req-e6845d35-e4f5-4ab4-abbd-9268bc43ad41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8609fed0-1158-4589-afd5-7e6d184e613c", "tag": "383f93a6-2fed-46cf-ba97-af06e600f513"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:28.957229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cffa5a68-daad-4584-bd36-0ce3e75d47c6 req-e6845d35-e4f5-4ab4-abbd-9268bc43ad41 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:28.957708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cffa5a68-daad-4584-bd36-0ce3e75d47c6 req-e6845d35-e4f5-4ab4-abbd-9268bc43ad41 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:28.960503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:28.971174 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cffa5a68-daad-4584-bd36-0ce3e75d47c6 req-e6845d35-e4f5-4ab4-abbd-9268bc43ad41 service nova] Creating event network-changed:383f93a6-2fed-46cf-ba97-af06e600f513 for instance 8609fed0-1158-4589-afd5-7e6d184e613c on nch2-master-1 Jun 04 21:38:28.976333 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cffa5a68-daad-4584-bd36-0ce3e75d47c6 req-e6845d35-e4f5-4ab4-abbd-9268bc43ad41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033390 Jun 04 21:38:28.977024 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3026/5950] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:29.384578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:29.385582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:29.394648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:29.395456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:29.396270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:29.396716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:29.555379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:29.573157 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-074f5bfd-c2e6-4235-b6a6-7f19d9bd1c1b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1317 microversion: 2.1 time: 0.194326 Jun 04 21:38:29.573742 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2925/5951] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:29 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:30.595905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:30.596652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:30.604842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:30.605303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:30.606114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:30.606574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:30.744339 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:30.752313 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0c5b4844-57cf-416b-9fbd-66990a18ca76 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1317 microversion: 2.1 time: 0.162613 Jun 04 21:38:30.753006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3027/5952] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:30 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:31.774402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:31.775382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:31.786496 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:31.786948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:31.787746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:31.788185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:31.931838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:31.937146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:31.943011 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-99ff8f6a-cc7a-44d0-954d-624b528dc6ed tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1317 microversion: 2.1 time: 0.175992 Jun 04 21:38:31.943648 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2926/5953] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:31 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:32.784899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fb4e7309-b02a-4f40-825e-2a5475876206 req-1eee9c5f-f357-409e-8cda-6913c57a469c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8609fed0-1158-4589-afd5-7e6d184e613c", "name": "network-vif-plugged", "status": "completed", "tag": "383f93a6-2fed-46cf-ba97-af06e600f513"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:32.794999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fb4e7309-b02a-4f40-825e-2a5475876206 req-1eee9c5f-f357-409e-8cda-6913c57a469c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:32.795500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fb4e7309-b02a-4f40-825e-2a5475876206 req-1eee9c5f-f357-409e-8cda-6913c57a469c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:32.811794 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fb4e7309-b02a-4f40-825e-2a5475876206 req-1eee9c5f-f357-409e-8cda-6913c57a469c service nova] Creating event network-vif-plugged:383f93a6-2fed-46cf-ba97-af06e600f513 for instance 8609fed0-1158-4589-afd5-7e6d184e613c on nch2-master-1 Jun 04 21:38:32.817353 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fb4e7309-b02a-4f40-825e-2a5475876206 req-1eee9c5f-f357-409e-8cda-6913c57a469c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Jun 04 21:38:32.817974 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3028/5954] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:38:32.960061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:32.960708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:32.969497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:32.969948 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:32.971106 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:32.971561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:33.107214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:33.115344 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6d52b9dc-d42b-48da-b00c-c9079bfdeda2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1317 microversion: 2.1 time: 0.159505 Jun 04 21:38:33.115964 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2927/5955] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:32 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:34.136123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:34.137110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:34.140439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:34.149117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.149761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.150852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.151480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.295912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:34.303795 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1a4f6007-8dfa-475a-9f41-86421739be8b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1508 microversion: 2.1 time: 0.173701 Jun 04 21:38:34.304345 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3029/5956] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:34 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:34.320271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:34.320852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:34.328210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.328660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.329431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.329870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.464599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:34.476486 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-206e253e-1595-4297-8a65-b4c4beaaf7bd tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1508 microversion: 2.1 time: 0.159831 Jun 04 21:38:34.477239 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2928/5957] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:34 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:34.503661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:38:34.504696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:34.510950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.511415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.512244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.512693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.542170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:34.548604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Old instance type m1.heat2, new instance type m1.heat {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:38:34.555198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:38:34.555672 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:38:34.556161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:38:34.556586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:38:34.557017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:38:34.625994 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-38161c45-daec-4c3d-a751-2dba4e597646 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c/action" status: 202 len: 0 microversion: 2.1 time: 0.134583 Jun 04 21:38:34.626921 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3030/5958] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:38:34 2022] POST /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:38:34.635265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:34.636671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:34.640008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:34.643870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.644337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.645543 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:34.646095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:34.783905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:34.794854 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-abc70fb8-a8ea-4807-a060-0565fc9cc61f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1515 microversion: 2.1 time: 0.163501 Jun 04 21:38:34.795456 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2929/5959] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:34 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:35.815157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:35.815948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:35.823701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:35.824259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:35.825183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:35.825717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:35.969965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:35.981610 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f8f53b8a-ad3b-4856-9bcc-a9d3341ede5c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1515 microversion: 2.1 time: 0.171932 Jun 04 21:38:35.982460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3031/5960] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:35 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:37.002018 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:37.002685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:37.005505 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:37.006183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:37.012057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:37.012519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:37.013301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:37.013741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:37.456211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:37.464834 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b8e30abd-930a-467e-a301-7b3938e8ef22 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.466889 Jun 04 21:38:37.465426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2930/5961] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:36 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:38.482821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:38.483425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:38.485401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:38:38.492370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:38.492833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:38.493616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:38.494064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:38.628877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:38.637634 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5494c7c-c97a-45ca-bb0e-e267bfef6a96 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.158787 Jun 04 21:38:38.638138 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3032/5962] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:38 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:39.663316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:39.664223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:39.675022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:39.675780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:39.677208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:39.677756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:39.833109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:39.841441 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-da584bda-5a0a-4e70-ab83-8f29ecdc976a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.184550 Jun 04 21:38:39.842097 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2931/5963] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:39 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:40.864381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:40.865551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:40.877232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:40.878001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:40.879283 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:40.880080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:41.021642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:41.029840 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01994eca-9833-4426-9cc3-e331b33eb3a0 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.172187 Jun 04 21:38:41.030416 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3033/5964] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:40 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:42.051310 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:42.052445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:42.064790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:42.065554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:42.066843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:42.067591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:42.204343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:42.216087 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-84bd1d6f-899f-4559-9dad-0bea22cc7dd7 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.170961 Jun 04 21:38:42.216906 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2932/5965] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:42 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:43.239787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:43.240801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:43.247875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:43.248347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:43.249140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:43.249594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:43.392662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:43.401982 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-770a8def-33cd-4710-b138-92287d4ad38b tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.170558 Jun 04 21:38:43.402871 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3034/5966] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:43 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:44.427483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:44.428405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:44.438983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:44.439711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:44.440792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:44.441417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:44.588495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:44.596275 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-be3006f6-7907-4b7d-b49a-eb4305892858 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.174464 Jun 04 21:38:44.596869 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2933/5967] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:44 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:45.614310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:45.614876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:45.622552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:45.623009 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:45.623838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:45.624288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:45.773102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:45.784579 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a9d1bb96-3f10-41b0-ad4d-9e602c7b98e4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.174203 Jun 04 21:38:45.785330 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3035/5968] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:45 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:46.806949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:46.807892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:46.820017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:46.820784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:46.822105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:46.822615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:46.956452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:46.964508 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a615db67-09ba-4ae7-a0b0-67de30bc18df tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.164585 Jun 04 21:38:46.965049 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2934/5969] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:46 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:47.982779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:47.983438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:47.990977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:47.991442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:47.992267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:47.992754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:48.157901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:48.166501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-643d8374-8ac5-4e47-8aa5-63860d960d60 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.187940 Jun 04 21:38:48.167059 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3036/5970] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:47 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:49.189517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:49.190116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:49.197778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:49.198242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:49.199063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:49.199539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:49.336866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:49.344904 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7466f1af-ce41-429d-99dc-4be6d7e1d2c5 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.159483 Jun 04 21:38:49.345487 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2935/5971] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:49 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:50.365909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:50.366820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:50.378345 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:50.379052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:50.380304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:50.381401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:50.518261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:50.528862 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8456bb62-0c84-4841-99d1-9cbf0e271aa8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.168791 Jun 04 21:38:50.529680 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3037/5972] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:50 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:51.554816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:51.555660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:51.563170 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:51.563660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:51.564439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:51.564889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:51.713257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:51.724850 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b218cf01-8e17-4577-98e0-ad45e44d8a1a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.173804 Jun 04 21:38:51.725430 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2936/5973] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:51 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:52.745710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:52.746616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:52.757962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:52.758893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:52.759853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:52.760316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:52.906000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:52.914145 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-24529c75-a2bf-4786-bb4e-798e016c5ad8 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.174917 Jun 04 21:38:52.914832 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3038/5974] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:52 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:53.933886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:53.934535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:53.942126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:53.942589 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:53.943367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:53.943843 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:54.085127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:54.094575 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef7d3525-a01d-40dc-bc49-7c34d2d2af33 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.165293 Jun 04 21:38:54.095294 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2937/5975] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:53 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:55.116658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:55.117690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:55.126149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:55.126614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:55.127392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:55.127875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:55.271828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:55.280546 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a927bc9-6945-4129-ba35-5cfc3826dc05 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.170487 Jun 04 21:38:55.281130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3039/5976] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:55 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:56.303753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:56.304435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:56.311704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:56.312156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:56.312932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:56.313366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:56.445519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:56.453345 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9fbebf7e-42cb-4018-b59a-223fb51619ea tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.153918 Jun 04 21:38:56.453960 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2938/5977] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:56 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:57.476273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:57.476905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:57.484749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:57.485215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:57.486013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:57.486486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:57.631122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:57.639318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6f71c0b8-5671-4531-a9c6-3578f44195b9 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.167277 Jun 04 21:38:57.639940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3040/5978] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:57 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:58.661888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:58.662879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:58.672529 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:58.672981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:58.673751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:58.674185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:58.816571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:38:58.827844 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-633a93db-731c-4a33-a1d8-e5ef1b74b35c tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.172548 Jun 04 21:38:58.828452 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2939/5979] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:58 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:38:59.847263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:38:59.848125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:38:59.856811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:59.857355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:38:59.858306 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:38:59.858829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:00.012030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:00.020687 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc6b3119-4df0-42ea-9e67-00efda0c4e84 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.177833 Jun 04 21:39:00.021272 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3041/5980] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:38:59 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:01.042507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:01.043557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:01.055482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:01.056278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:01.057604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:01.058249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:01.197481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:01.206237 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eff428dc-a312-4e68-8dff-97db87b1850a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.170572 Jun 04 21:39:01.206877 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2940/5981] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:01 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:02.224257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:02.224936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:02.233126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:02.233598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:02.234397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:02.234855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:02.237591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:02.374071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:02.382107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4311d77-aefd-423a-888c-f2f62b1e6354 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.162204 Jun 04 21:39:02.382736 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3042/5982] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:02 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:03.400450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:03.401056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:03.409653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:03.410112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:03.410899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:03.411340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:03.414046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=85 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:03.559457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:03.567448 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3ac34d97-c8e3-43d1-a6e1-65bb57c5acee tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1520 microversion: 2.1 time: 0.171188 Jun 04 21:39:03.568083 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2941/5983] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:03 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:03.999675 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-37a772bb-b9fe-4207-be91-4555a58d0746 req-1e69c016-fd01-4f8d-9483-b29404787671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8609fed0-1158-4589-afd5-7e6d184e613c", "name": "network-vif-unplugged", "status": "completed", "tag": "383f93a6-2fed-46cf-ba97-af06e600f513"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:04.009129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-37a772bb-b9fe-4207-be91-4555a58d0746 req-1e69c016-fd01-4f8d-9483-b29404787671 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:04.009587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-37a772bb-b9fe-4207-be91-4555a58d0746 req-1e69c016-fd01-4f8d-9483-b29404787671 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:04.025852 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-37a772bb-b9fe-4207-be91-4555a58d0746 req-1e69c016-fd01-4f8d-9483-b29404787671 service nova] Creating event network-vif-unplugged:383f93a6-2fed-46cf-ba97-af06e600f513 for instance 8609fed0-1158-4589-afd5-7e6d184e613c on nch1-master-1 Jun 04 21:39:04.033527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-37a772bb-b9fe-4207-be91-4555a58d0746 req-1e69c016-fd01-4f8d-9483-b29404787671 service nova] Instance 8609fed0-1158-4589-afd5-7e6d184e613c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:39:04.044833 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-37a772bb-b9fe-4207-be91-4555a58d0746 req-1e69c016-fd01-4f8d-9483-b29404787671 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049516 Jun 04 21:39:04.045666 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3043/5984] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:04.585481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:04.586503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:04.594343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:04.594798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:04.595605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:04.596047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:04.733947 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:04.742758 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00461a09-2660-4788-93db-05a006edf1b4 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1519 microversion: 2.1 time: 0.161119 Jun 04 21:39:04.743215 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2942/5985] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:04 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:05.765873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:05.767091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:05.771581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=34 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:05.781248 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:05.781717 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:05.782531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:05.782965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:05.935312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:05.945311 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89175ed4-22a7-4385-aa11-33fe0e1d9195 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1517 microversion: 2.1 time: 0.187160 Jun 04 21:39:05.945924 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3044/5986] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:05 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:06.065158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-96575859-3372-4e95-bdab-bf4ad44dac6d req-d2df5fa0-cca0-49a0-befb-b5d3638258b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8609fed0-1158-4589-afd5-7e6d184e613c", "tag": "383f93a6-2fed-46cf-ba97-af06e600f513"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:06.071779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=28 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:06.079846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-96575859-3372-4e95-bdab-bf4ad44dac6d req-d2df5fa0-cca0-49a0-befb-b5d3638258b1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:06.080320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-96575859-3372-4e95-bdab-bf4ad44dac6d req-d2df5fa0-cca0-49a0-befb-b5d3638258b1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:06.093144 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-96575859-3372-4e95-bdab-bf4ad44dac6d req-d2df5fa0-cca0-49a0-befb-b5d3638258b1 service nova] Creating event network-changed:383f93a6-2fed-46cf-ba97-af06e600f513 for instance 8609fed0-1158-4589-afd5-7e6d184e613c on nch1-master-1 Jun 04 21:39:06.099205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-96575859-3372-4e95-bdab-bf4ad44dac6d req-d2df5fa0-cca0-49a0-befb-b5d3638258b1 service nova] Instance 8609fed0-1158-4589-afd5-7e6d184e613c is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:39:06.110596 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-96575859-3372-4e95-bdab-bf4ad44dac6d req-d2df5fa0-cca0-49a0-befb-b5d3638258b1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051434 Jun 04 21:39:06.111231 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2943/5987] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:06.963969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:06.964595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:06.973724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:06.974182 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:06.974978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:06.975423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:07.113916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:07.124539 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-01ca2361-7638-44e2-9a65-65bbf280c8ec tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1514 microversion: 2.1 time: 0.165988 Jun 04 21:39:07.125392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3045/5988] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:06 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:07.142692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:07.143342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:07.150247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:07.150807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:07.151686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:07.152114 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:07.216396 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68122eab-c6a3-4ab1-84e9-915501dc9e69 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "POST /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c/action" status: 204 len: 0 microversion: 2.1 time: 0.078601 Jun 04 21:39:07.217495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2944/5989] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:39:07 2022] POST /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:39:07.227205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:07.228841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:07.238553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:07.239086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:07.239870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:07.240351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:07.383690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:07.392220 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c6b731db-1d32-4ef6-b92d-0d52e1308bcb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1514 microversion: 2.1 time: 0.170350 Jun 04 21:39:07.393228 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3046/5990] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:07 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:08.411264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:08.411999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:08.418986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.419443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.420255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.421125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.564340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:08.572163 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d663d860-fbcc-4ed7-8776-ecd4dc9dcc08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1506 microversion: 2.1 time: 0.166030 Jun 04 21:39:08.572745 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2945/5991] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:08 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:08.589134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:08.589763 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:08.597700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.598166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.598957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.599402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.717870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ac2a673e-4dfc-461e-a0d6-7ea907007a4d req-58d73d4a-30d5-43e9-93f6-6132bce48449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8609fed0-1158-4589-afd5-7e6d184e613c", "name": "network-vif-plugged", "status": "completed", "tag": "383f93a6-2fed-46cf-ba97-af06e600f513"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:08.727816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ac2a673e-4dfc-461e-a0d6-7ea907007a4d req-58d73d4a-30d5-43e9-93f6-6132bce48449 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.728741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ac2a673e-4dfc-461e-a0d6-7ea907007a4d req-58d73d4a-30d5-43e9-93f6-6132bce48449 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.741014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:08.742747 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ac2a673e-4dfc-461e-a0d6-7ea907007a4d req-58d73d4a-30d5-43e9-93f6-6132bce48449 service nova] Creating event network-vif-plugged:383f93a6-2fed-46cf-ba97-af06e600f513 for instance 8609fed0-1158-4589-afd5-7e6d184e613c on nch1-master-1 Jun 04 21:39:08.747912 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ac2a673e-4dfc-461e-a0d6-7ea907007a4d req-58d73d4a-30d5-43e9-93f6-6132bce48449 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034270 Jun 04 21:39:08.748974 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2946/5992] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:39:08.752002 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e9e589f-eaec-42c8-b2a4-504fa8e502c6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1506 microversion: 2.1 time: 0.166910 Jun 04 21:39:08.752826 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3047/5993] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:08 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:08.769786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:08.771126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:08.777847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.778513 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.779517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.780061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.917771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:08.928006 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-65ebc261-7663-4251-a147-4284b7d357a6 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1506 microversion: 2.1 time: 0.162835 Jun 04 21:39:08.928775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2947/5994] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:08 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:39:08.944529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:08.945006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:08.951913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.952197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.953202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:08.953656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:08.979886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:39:09.068707 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1769c3c6-61ea-4bf1-b65a-471ced5b2ceb tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 204 len: 0 microversion: 2.1 time: 0.127956 Jun 04 21:39:09.069316 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3048/5995] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:39:08 2022] DELETE /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:39:09.083266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:09.083822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:09.090512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:09.090997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:09.091788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:09.092226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:09.122341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:39:09.167301 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.compute.api [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Instance is already in deleting state, ignoring this request Jun 04 21:39:09.168186 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-51f49cbc-bb8c-44fb-bfd2-8fda5f0c422e tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 204 len: 0 microversion: 2.1 time: 0.089115 Jun 04 21:39:09.168772 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2948/5996] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:39:09 2022] DELETE /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:39:09.179330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:09.180097 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:09.186962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:09.187433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:09.188233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:09.188708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:09.331445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:09.339947 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b80c047a-deda-418c-bd68-0710aa874ef2 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1512 microversion: 2.1 time: 0.164911 Jun 04 21:39:09.340538 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3049/5997] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:09 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:39:10.360044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:10.360627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:10.368176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:10.368647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:10.369442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:10.369889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:10.517968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a55fa711a6146b5a30c456c33f2c01c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed5588bf9fd4a94b2cfa302d7cdd02a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:10.526978 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e3e93a3-2f25-4226-91c6-d950f9c5f784 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 200 len: 1512 microversion: 2.1 time: 0.172123 Jun 04 21:39:10.527556 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2949/5998] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:10 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:11.133257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-71bbdde5-d7b4-4a85-8e76-db753fb6d06b req-cea2f4ca-b67e-4e3a-9d8a-dad78b880aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8609fed0-1158-4589-afd5-7e6d184e613c", "name": "network-vif-deleted", "tag": "383f93a6-2fed-46cf-ba97-af06e600f513"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:11.144889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-71bbdde5-d7b4-4a85-8e76-db753fb6d06b req-cea2f4ca-b67e-4e3a-9d8a-dad78b880aa7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:11.145710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-71bbdde5-d7b4-4a85-8e76-db753fb6d06b req-cea2f4ca-b67e-4e3a-9d8a-dad78b880aa7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:11.158648 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-71bbdde5-d7b4-4a85-8e76-db753fb6d06b req-cea2f4ca-b67e-4e3a-9d8a-dad78b880aa7 service nova] Creating event network-vif-deleted:383f93a6-2fed-46cf-ba97-af06e600f513 for instance 8609fed0-1158-4589-afd5-7e6d184e613c on nch1-master-1 Jun 04 21:39:11.163444 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-71bbdde5-d7b4-4a85-8e76-db753fb6d06b req-cea2f4ca-b67e-4e3a-9d8a-dad78b880aa7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033997 Jun 04 21:39:11.164060 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3050/5999] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:11.544775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:11.545493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 8609fed0-1158-4589-afd5-7e6d184e613c] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:11.553355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:11.553814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:11.554592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:11.555059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:11.569926 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] HTTP exception thrown: Instance 8609fed0-1158-4589-afd5-7e6d184e613c could not be found. Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Request method failure captured: Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c HTTP/1.1 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Cf0LQs5Bw3CRodgSiV6W33IvkvPZra150xUudHOHaq6BQNeYFbwe13zFctvceIwkn99Fz98xQH9jUMaKtnrnoc80LTxpSyi8KEEYOxuyPIi7UhKq1ice0yOxv6ZNAVIVj23DF7pLT4mdAdGXHkD7Vrj0Xh5Kt9ET1K05SNIyAFaEw Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6ed5588bf9fd4a94b2cfa302d7cdd02a Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6ed5588bf9fd4a94b2cfa302d7cdd02a Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-2094157977-project Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3a55fa711a6146b5a30c456c33f2c01c Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-2094157977-project Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 8609fed0-1158-4589-afd5-7e6d184e613c could not be found. Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '8609fed0-1158-4589-afd5-7e6d184e613c'} Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8609fed0-1158-4589-afd5-7e6d184e613c could not be found. Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8609fed0-1158-4589-afd5-7e6d184e613c could not be found. Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:39:11.571541 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8609fed0-1158-4589-afd5-7e6d184e613c could not be found. Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Returning 404 to user: Instance 8609fed0-1158-4589-afd5-7e6d184e613c could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d8fe3384-6381-4580-b7bd-e228fa23b55f tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c" status: 404 len: 111 microversion: 2.1 time: 0.032236 Jun 04 21:39:11.577014 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2950/6000] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:11 2022] GET /compute/v2.1/servers/8609fed0-1158-4589-afd5-7e6d184e613c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:39:11.584089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b46a9bac-cd9f-4db0-a7b5-705731253d08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '.version_select at 0x7f2d01a6bd30>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:11.607316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b46a9bac-cd9f-4db0-a7b5-705731253d08 tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061704569" status: 202 len: 0 microversion: 2.1 time: 0.029019 Jun 04 21:39:11.607940 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3051/6001] 10.222.0.18 () {58 vars in 1220 bytes} [Sat Jun 4 21:39:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061704569 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:39:12.224187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:12.224691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:12.231137 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:12.231623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:12.232395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:12.232839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:12.246594 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] HTTP exception thrown: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Request method failure captured: Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 HTTP/1.1 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Cf0LQs5Bw3CRodgSiV6W33IvkvPZra150xUudHOHaq6BQNeYFbwe13zFctvceIwkn99Fz98xQH9jUMaKtnrnoc80LTxpSyi8KEEYOxuyPIi7UhKq1ice0yOxv6ZNAVIVj23DF7pLT4mdAdGXHkD7Vrj0Xh5Kt9ET1K05SNIyAFaEw Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 6ed5588bf9fd4a94b2cfa302d7cdd02a Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 6ed5588bf9fd4a94b2cfa302d7cdd02a Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerDiskConfigTestJSON-2094157977-project Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 3a55fa711a6146b5a30c456c33f2c01c Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerDiskConfigTestJSON-2094157977-project Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '615a7241-b091-492c-93b7-489da1682bd1'} Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:39:12.248172 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Returning 404 to user: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-602664cd-af5b-416e-9084-15e0737982ce tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "DELETE /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 404 len: 111 microversion: 2.1 time: 0.029475 Jun 04 21:39:12.252950 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2951/6002] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:39:12 2022] DELETE /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:39:12.260291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:12.261055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] [instance: 615a7241-b091-492c-93b7-489da1682bd1] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:12.268323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:12.268792 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:12.269588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:12.270046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:12.286091 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] HTTP exception thrown: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Request method failure captured: Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 HTTP/1.1 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9Cf0LQs5Bw3CRodgSiV6W33IvkvPZra150xUudHOHaq6BQNeYFbwe13zFctvceIwkn99Fz98xQH9jUMaKtnrnoc80LTxpSyi8KEEYOxuyPIi7UhKq1ice0yOxv6ZNAVIVj23DF7pLT4mdAdGXHkD7Vrj0Xh5Kt9ET1K05SNIyAFaEw Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 6ed5588bf9fd4a94b2cfa302d7cdd02a Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/6ed5588bf9fd4a94b2cfa302d7cdd02a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 6ed5588bf9fd4a94b2cfa302d7cdd02a Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2094157977 Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerDiskConfigTestJSON-2094157977-project Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 3a55fa711a6146b5a30c456c33f2c01c Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerDiskConfigTestJSON-2094157977-project Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '615a7241-b091-492c-93b7-489da1682bd1'} Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:39:12.288022 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] Returning 404 to user: Instance 615a7241-b091-492c-93b7-489da1682bd1 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1b958c8f-3ed5-4562-93ce-74f1ad92583a tempest-ServerDiskConfigTestJSON-2094157977 tempest-ServerDiskConfigTestJSON-2094157977-project] 10.222.0.18 "GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1" status: 404 len: 111 microversion: 2.1 time: 0.034287 Jun 04 21:39:12.293269 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3052/6003] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:12 2022] GET /compute/v2.1/servers/615a7241-b091-492c-93b7-489da1682bd1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:39:18.453224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9f62b416-e1a9-4431-8f70-70e96a3b9467 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'create', calling method: .version_select at 0x7f2d019975e0>, body: {"keypair": {"name": "tempest-keypair-151987683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf5Y1rvAPxmu4bhmoKnWHWtP3aCj1NRCtKUdaebChhmGVrLKuxYBdh/xDYZjELTY7XRG+3N2tEVCzL8IcLAcF+LwnyMG6RS7K3uJuUHqf6l/OEp7G8u0PV9jZIROdPlew=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:18.468308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9f62b416-e1a9-4431-8f70-70e96a3b9467 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:39:18.473852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-9f62b416-e1a9-4431-8f70-70e96a3b9467 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:39:18.502565 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9f62b416-e1a9-4431-8f70-70e96a3b9467 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183647 Jun 04 21:39:18.503126 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2952/6004] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:39:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:19.842158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1944354963", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae8953a-cfb8-40a4-afa7-3050dc7715f8"}], "security_groups": [{"name": "tempest-securitygroup--542966001"}], "key_name": "tempest-keypair-151987683", "user_data": "}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:19.947109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] validate_networks() for [('dae8953a-cfb8-40a4-afa7-3050dc7715f8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:39:20.441142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:39:20.447148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:39:20.447773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:39:20.448278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:39:20.448839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:39:20.462466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:20.462937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:20.463794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:20.464250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:20.493288 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:39:20.501789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:39:20.516960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:39:20.519727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:39:20.581214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb7e55b6-7c7d-478a-91e8-cbb2f61bf072 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.743309 Jun 04 21:39:20.582718 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3053/6005] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:39:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:39:20.593125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-53bae2d3-0a6c-4a0a-aa54-447d43297e2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:20.596701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-53bae2d3-0a6c-4a0a-aa54-447d43297e2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:20.675219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-53bae2d3-0a6c-4a0a-aa54-447d43297e2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:20.689881 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-53bae2d3-0a6c-4a0a-aa54-447d43297e2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1238 microversion: 2.1 time: 0.100585 Jun 04 21:39:20.690483 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2953/6006] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:20 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:21.708621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:21.709201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:21.717284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:21.717920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:21.719274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:21.719868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:21.801023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:21.810566 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d32b110d-1079-4b55-9232-83a49801b8ca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1290 microversion: 2.1 time: 0.107915 Jun 04 21:39:21.811191 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3054/6007] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:21 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:22.827457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:22.828565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:22.831652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:22.838062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:22.838572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:22.839362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:22.839798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:22.978226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:22.988272 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ca384d8d-b1e5-4c94-926a-5160c9ce8e9f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.164874 Jun 04 21:39:22.988860 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2954/6008] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:22 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:23.338327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-33848d72-2762-4d88-9c76-f26eeac3c67d req-47e2e6ca-6653-4cbb-8c68-cac571f6f188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:23.353636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-33848d72-2762-4d88-9c76-f26eeac3c67d req-47e2e6ca-6653-4cbb-8c68-cac571f6f188 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:23.354123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-33848d72-2762-4d88-9c76-f26eeac3c67d req-47e2e6ca-6653-4cbb-8c68-cac571f6f188 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:23.376135 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-33848d72-2762-4d88-9c76-f26eeac3c67d req-47e2e6ca-6653-4cbb-8c68-cac571f6f188 service nova] Creating event network-changed:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch1-master-1 Jun 04 21:39:23.381547 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-33848d72-2762-4d88-9c76-f26eeac3c67d req-47e2e6ca-6653-4cbb-8c68-cac571f6f188 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047034 Jun 04 21:39:23.382287 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3055/6009] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:39:24.007759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:24.008490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:24.017977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:24.018449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:24.019232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:24.019749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:24.160262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:24.171075 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2a880866-3844-47f2-8e2b-de77a2129354 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.168530 Jun 04 21:39:24.171911 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2955/6010] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:24 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:25.194880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:25.195619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:25.203253 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:25.203950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:25.204917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:25.205515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:25.341435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:25.351300 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3fd1cea9-0096-4164-af21-3196bdbe4f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.161889 Jun 04 21:39:25.351933 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3056/6011] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:25 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:26.369166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:26.369771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:26.377821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:26.377821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:26.378761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:26.379210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:26.521725 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:26.529840 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-36ad2a6c-c73b-44ff-8a3d-9a684dd70df5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.164861 Jun 04 21:39:26.530418 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2956/6012] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:26 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:27.547194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:27.548020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:27.557434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:27.558039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:27.558864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:27.559317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:27.703815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:27.711903 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc759b43-43fa-4b50-a67b-76113e341fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.168749 Jun 04 21:39:27.712509 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3057/6013] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:27 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:28.731470 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:28.732149 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:28.741862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:28.742309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:28.743066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:28.743537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:28.832911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-abc13f8e-a1fa-4d03-8426-138ec7ba424b req-13531ab3-c22c-4739-bf92-1a1f391fb087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "name": "network-vif-plugged", "status": "completed", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:28.842269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-abc13f8e-a1fa-4d03-8426-138ec7ba424b req-13531ab3-c22c-4739-bf92-1a1f391fb087 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:28.842722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-abc13f8e-a1fa-4d03-8426-138ec7ba424b req-13531ab3-c22c-4739-bf92-1a1f391fb087 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:28.857447 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-abc13f8e-a1fa-4d03-8426-138ec7ba424b req-13531ab3-c22c-4739-bf92-1a1f391fb087 service nova] Creating event network-vif-plugged:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch1-master-1 Jun 04 21:39:28.863602 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-abc13f8e-a1fa-4d03-8426-138ec7ba424b req-13531ab3-c22c-4739-bf92-1a1f391fb087 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034400 Jun 04 21:39:28.864563 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3058/6014] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:39:28.881902 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:28.890107 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-44a2aa70-f215-4a3d-98f4-5a861bfd4100 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.165111 Jun 04 21:39:28.890777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2957/6015] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:28 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:29.911197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:29.911947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:29.920042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:29.920507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:29.921291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:29.921738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:30.063318 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:30.071617 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-75f98325-267c-4c0d-adea-6988982868e7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1363 microversion: 2.1 time: 0.166505 Jun 04 21:39:30.072141 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3059/6016] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:29 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:31.089059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:31.089656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:31.092420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:31.100332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:31.100776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:31.101560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:31.102006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:31.267856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:31.276242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e3c74ae-4021-457d-8fe3-fdc1e060172a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1551 microversion: 2.1 time: 0.191279 Jun 04 21:39:31.276793 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2958/6017] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:31 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1551 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:31.293314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:31.293825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:31.295957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:31.296696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:31.305327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:31.306240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:31.307563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:31.308300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:31.393625 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-884ec445-622c-48a0-a15c-0b26e0d3ef41 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103930 Jun 04 21:39:31.394580 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3060/6018] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:39:31 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:32.700783 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:32.701650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:32.702977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-2c130c40-d1c3-4ae9-827f-c3be8450c3b3 req-a11549c5-4716-49c0-a23a-0d867abe79af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:32.710307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:32.710857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:32.711542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2c130c40-d1c3-4ae9-827f-c3be8450c3b3 req-a11549c5-4716-49c0-a23a-0d867abe79af service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:32.711765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:32.712064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-2c130c40-d1c3-4ae9-827f-c3be8450c3b3 req-a11549c5-4716-49c0-a23a-0d867abe79af service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:32.712403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:32.714790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:32.726693 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-2c130c40-d1c3-4ae9-827f-c3be8450c3b3 req-a11549c5-4716-49c0-a23a-0d867abe79af service nova] Creating event network-changed:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch1-master-1 Jun 04 21:39:32.732068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-2c130c40-d1c3-4ae9-827f-c3be8450c3b3 req-a11549c5-4716-49c0-a23a-0d867abe79af service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033471 Jun 04 21:39:32.732906 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3061/6019] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:39:32.862038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:32.872393 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-089f1959-ccd4-493a-ae4e-0ef8d7026342 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1551 microversion: 2.1 time: 0.175082 Jun 04 21:39:32.872993 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2959/6020] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:32 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1551 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:32.890139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:32.890857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:32.900221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:32.900978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:32.901781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:32.902222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:33.044263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:33.052326 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-57279c6f-cee5-440c-876b-00c6579301d8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1551 microversion: 2.1 time: 0.166725 Jun 04 21:39:33.053115 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3062/6021] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:32 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:34.070135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:34.070760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:34.078401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.078864 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.079685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.080127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.230583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:34.239091 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-81a9087e-dd06-4080-bd82-b2ffb075ef44 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1670 microversion: 2.1 time: 0.172762 Jun 04 21:39:34.239411 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2960/6022] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:34 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:34.261491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:34.262091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:34.269843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.270881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.271423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.271901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.412966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:34.421437 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1549eec1-aa44-4c3e-a529-182f52ec908b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1670 microversion: 2.1 time: 0.163563 Jun 04 21:39:34.422033 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3063/6023] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:34 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:34.438360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:34.439440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:34.446580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.447034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.447848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.448288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.477738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:34.483724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Old instance type m1.heat2, new instance type m1.heat {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:39:34.490894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:39:34.491325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:39:34.492188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:39:34.492347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:39:34.492676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:39:34.570755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-25c3e95c-cf3c-4946-bc43-0490faf88f59 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661/action" status: 202 len: 0 microversion: 2.1 time: 0.136341 Jun 04 21:39:34.571282 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2961/6024] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:39:34 2022] POST /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:39:34.579500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:34.580192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:34.586903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.587367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.588198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:34.588650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:34.732636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:34.741568 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1e60a278-6cf8-43dd-b57a-ef98d0e336c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1679 microversion: 2.1 time: 0.165951 Jun 04 21:39:34.742361 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3064/6025] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:34 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:35.761952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:35.762751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:35.776840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:35.777294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:35.778074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:35.778511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:35.923119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:35.933433 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c26526e4-7024-4431-a719-dab2657716ff tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1679 microversion: 2.1 time: 0.177807 Jun 04 21:39:35.934055 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2962/6026] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:35 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:36.951636 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:36.952291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:36.955126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:36.962117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:36.962658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:36.963621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:36.964068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:37.104541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:37.116609 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a716575-f994-497f-8c48-1dcd7afcd272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.168787 Jun 04 21:39:37.117368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3065/6027] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:36 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:38.141993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:38.142944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:38.147058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:38.152751 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:38.153200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:38.153992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:38.154404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:38.304930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:38.312952 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c362dff8-e2d1-402d-90e7-8cdeb2faf275 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.177416 Jun 04 21:39:38.313540 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2963/6028] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:38 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:39.335713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:39.336610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:39.349037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:39.349507 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:39.350302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:39.350757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:39.487557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:39.496637 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-698c0ccb-e1e7-44f8-917d-e80289101a48 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.168412 Jun 04 21:39:39.497193 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3066/6029] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:39 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:40.519109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:40.520859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:40.528359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:40.528814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:40.529594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:40.530040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:40.702030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:40.710683 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-57d48d3f-eb20-4fad-a6df-d07036d3e724 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.198341 Jun 04 21:39:40.711240 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2964/6030] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:40 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:41.730183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:41.730898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:41.739666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:41.740217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:41.741295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:41.741782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:41.882328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:41.890431 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1d36fea8-cc68-4afc-a26a-62ad44a57bcf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.165100 Jun 04 21:39:41.891025 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3067/6031] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:41 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:42.912612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:42.913594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:42.921261 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:42.921711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:42.922484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:42.922921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:43.059062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:43.067090 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d58c76d2-bcbb-4473-9237-cf6fefc7c334 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.161167 Jun 04 21:39:43.067870 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2965/6032] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:42 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:44.088062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:44.088840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:44.097658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:44.098257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:44.099227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:44.099814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:44.241367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:44.249232 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a4d56055-7437-4126-8794-da4ac6707704 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.166894 Jun 04 21:39:44.249816 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3068/6033] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:44 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:45.266619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:45.267263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:45.275133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:45.275614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:45.276387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:45.276830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:45.418217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:45.426379 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-be4b87e7-41ca-4328-8105-b15dbf2ffbca tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.163765 Jun 04 21:39:45.426964 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2966/6034] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:45 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:46.447298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:46.448260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:46.459145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:46.459853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:46.460963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:46.461573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:46.611257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:46.624023 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cac6e89d-69c6-4fe4-b50d-a23a640ebf24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.182081 Jun 04 21:39:46.624882 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3069/6035] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:46 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:47.643960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:47.644640 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:47.653391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:47.653846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:47.654617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:47.655078 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:47.795762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:47.804227 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-33f18f0c-04b4-4bef-a6a0-938aadc86db5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.165455 Jun 04 21:39:47.805172 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2967/6036] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:47 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:48.826712 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:48.827829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:48.840181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:48.840948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:48.842687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:48.843448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:48.996840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:49.008125 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f82f1c63-dcc4-4e06-b295-b044e4725cc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.188565 Jun 04 21:39:49.008715 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3070/6037] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:48 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:50.025695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:50.026335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:50.033729 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:50.034182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:50.034953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:50.035388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:50.183279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:50.196186 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-83b76678-cdbd-452d-906c-73ee6f4b643a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.174314 Jun 04 21:39:50.197084 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2968/6038] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:50 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:51.221059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:51.221800 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:51.230495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:51.230966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:51.231787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:51.232239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:51.377710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:51.385667 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b25a551-f1c7-4aa1-8788-fb08c0f94fb8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.169338 Jun 04 21:39:51.386236 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3071/6039] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:51 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:52.402791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:52.403448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:52.410996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:52.411452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:52.412273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:52.412717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:52.416878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:52.568819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:52.577181 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-420ba767-cd6d-4847-bf2e-eff0778f07a1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.178457 Jun 04 21:39:52.577763 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2969/6040] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:52 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:53.596308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:53.597038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:53.606430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:53.606888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:53.607714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:53.608162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:53.746844 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:53.756258 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3b9b1207-9595-4bc4-98f9-45824be0f123 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1684 microversion: 2.1 time: 0.163930 Jun 04 21:39:53.756991 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3072/6041] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:53 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:54.523612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-701a7b9f-13eb-4c11-9232-537afb1ad355 req-4d50c06f-fc30-4c73-b90c-94efb07ec1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "name": "network-vif-unplugged", "status": "completed", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:54.532774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-701a7b9f-13eb-4c11-9232-537afb1ad355 req-4d50c06f-fc30-4c73-b90c-94efb07ec1d8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:54.533232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-701a7b9f-13eb-4c11-9232-537afb1ad355 req-4d50c06f-fc30-4c73-b90c-94efb07ec1d8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:54.545791 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-701a7b9f-13eb-4c11-9232-537afb1ad355 req-4d50c06f-fc30-4c73-b90c-94efb07ec1d8 service nova] Creating event network-vif-unplugged:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch2-master-1 Jun 04 21:39:54.551926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-701a7b9f-13eb-4c11-9232-537afb1ad355 req-4d50c06f-fc30-4c73-b90c-94efb07ec1d8 service nova] Instance b4dbeeee-162c-4f16-9645-0a2792a97661 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:39:54.563073 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-701a7b9f-13eb-4c11-9232-537afb1ad355 req-4d50c06f-fc30-4c73-b90c-94efb07ec1d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043709 Jun 04 21:39:54.563733 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2970/6042] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:39:54.775010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:54.775803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:54.783414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:54.783939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:54.784734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:54.785397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:54.926208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:54.935446 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fe97e48a-e47c-445a-a027-3baff2892c47 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1683 microversion: 2.1 time: 0.164802 Jun 04 21:39:54.945841 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3073/6043] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:54 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:55.955291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:55.956021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:55.962805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:55.963254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:55.964062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:55.964499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:56.103259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:56.111608 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72898a74-25e3-498e-ab1a-463f555027ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1681 microversion: 2.1 time: 0.161641 Jun 04 21:39:56.112221 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2971/6044] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:55 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:56.579045 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-37a434a5-a9fc-469a-b907-3ca3b8a16c39 req-71d9bffe-d2b3-4e49-8031-4b6ce1ce9e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:56.588645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-37a434a5-a9fc-469a-b907-3ca3b8a16c39 req-71d9bffe-d2b3-4e49-8031-4b6ce1ce9e62 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:56.589131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-37a434a5-a9fc-469a-b907-3ca3b8a16c39 req-71d9bffe-d2b3-4e49-8031-4b6ce1ce9e62 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:56.601469 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-37a434a5-a9fc-469a-b907-3ca3b8a16c39 req-71d9bffe-d2b3-4e49-8031-4b6ce1ce9e62 service nova] Creating event network-changed:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch2-master-1 Jun 04 21:39:56.607646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-37a434a5-a9fc-469a-b907-3ca3b8a16c39 req-71d9bffe-d2b3-4e49-8031-4b6ce1ce9e62 service nova] Instance b4dbeeee-162c-4f16-9645-0a2792a97661 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:39:56.618778 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-37a434a5-a9fc-469a-b907-3ca3b8a16c39 req-71d9bffe-d2b3-4e49-8031-4b6ce1ce9e62 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043588 Jun 04 21:39:56.619375 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3074/6045] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:57.130311 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:57.131737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:57.141191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:57.141737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:57.142653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:57.143148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:57.292822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:57.301518 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77ad29c8-8404-4a1b-9f65-99826c6920c2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1678 microversion: 2.1 time: 0.174913 Jun 04 21:39:57.302105 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2972/6046] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:57 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:57.320057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:57.320803 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:57.327402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:57.327981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:57.328832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:57.329375 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:57.392865 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-18799302-8172-4ae9-b18d-47b89dedd129 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661/action" status: 204 len: 0 microversion: 2.1 time: 0.077583 Jun 04 21:39:57.393536 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3075/6047] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:39:57 2022] POST /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:39:57.402379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:57.403017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:57.409269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:57.409733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:57.410519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:57.411186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:57.571478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:57.580012 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cb29ebcb-2137-4720-a2d6-4823c5e8ffc7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1678 microversion: 2.1 time: 0.181500 Jun 04 21:39:57.581171 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2973/6048] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:57 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:58.601001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:58.601842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:58.611342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:58.611823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:58.612620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:58.613077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:58.760867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:58.769087 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-683bd197-e3e8-4b64-ae9e-bdffdad37d2a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1678 microversion: 2.1 time: 0.175133 Jun 04 21:39:58.769660 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3076/6049] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:58 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:59.211313 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5e2ad715-7477-4bab-8c11-9db4af2d2a1d req-824efd09-c17b-4b11-9e88-806d8d6b2ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "name": "network-vif-plugged", "status": "completed", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:39:59.224270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5e2ad715-7477-4bab-8c11-9db4af2d2a1d req-824efd09-c17b-4b11-9e88-806d8d6b2ccd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:59.225065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5e2ad715-7477-4bab-8c11-9db4af2d2a1d req-824efd09-c17b-4b11-9e88-806d8d6b2ccd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:59.238751 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5e2ad715-7477-4bab-8c11-9db4af2d2a1d req-824efd09-c17b-4b11-9e88-806d8d6b2ccd service nova] Creating event network-vif-plugged:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch2-master-1 Jun 04 21:39:59.244246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5e2ad715-7477-4bab-8c11-9db4af2d2a1d req-824efd09-c17b-4b11-9e88-806d8d6b2ccd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037167 Jun 04 21:39:59.245552 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2974/6050] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:39:59.799227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:59.799895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:39:59.808406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:59.809171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:59.810941 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:39:59.811586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:39:59.837506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:39:59.969855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:39:59.978016 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f50e91f-09b4-403c-8938-421fc2df1447 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1670 microversion: 2.1 time: 0.190306 Jun 04 21:39:59.978621 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3077/6051] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:59 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:39:59.995642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:39:59.996385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:00.003132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.003855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.004625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.005063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.142010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:00.150508 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6f241e5-5413-4d79-9ddf-f1c6a5376983 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1670 microversion: 2.1 time: 0.159235 Jun 04 21:40:00.151090 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2975/6052] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:39:59 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:40:00.166919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:00.167567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:00.174166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.174654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.175433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.175924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.312249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:00.320546 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-de065fc8-3833-4106-afdc-9d543c97984f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1670 microversion: 2.1 time: 0.157761 Jun 04 21:40:00.321100 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3078/6053] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:00 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:00.338032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:00.338540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:00.346874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.347273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.348084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.348525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.378407 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:40:00.462781 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-776563ae-3641-4f4e-afb2-17b67190fa46 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 204 len: 0 microversion: 2.1 time: 0.128413 Jun 04 21:40:00.463327 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2976/6054] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:40:00 2022] DELETE /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:40:00.472468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:00.473084 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:00.479549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.480008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.481458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:00.481920 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:00.619551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:00.627977 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4f5db9f-e919-447b-8e95-e452ca3b32e6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1676 microversion: 2.1 time: 0.159587 Jun 04 21:40:00.628555 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3079/6055] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:00 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:01.651095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:01.651740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:01.660397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:01.660899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:01.661759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:01.662248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:01.797615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:01.805583 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a6d77054-e553-402e-a617-8f8177e64f0f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 200 len: 1676 microversion: 2.1 time: 0.159806 Jun 04 21:40:01.806172 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2977/6056] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:01 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:02.551268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fb806603-ad42-403c-b9e8-62db16d081c1 req-84b75a35-446e-4d10-8979-62e8fef7c64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4dbeeee-162c-4f16-9645-0a2792a97661", "name": "network-vif-deleted", "tag": "03b5eb32-2b62-4a89-bd50-e7b301276692"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:40:02.561728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fb806603-ad42-403c-b9e8-62db16d081c1 req-84b75a35-446e-4d10-8979-62e8fef7c64e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:02.562680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fb806603-ad42-403c-b9e8-62db16d081c1 req-84b75a35-446e-4d10-8979-62e8fef7c64e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:02.575683 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fb806603-ad42-403c-b9e8-62db16d081c1 req-84b75a35-446e-4d10-8979-62e8fef7c64e service nova] Creating event network-vif-deleted:03b5eb32-2b62-4a89-bd50-e7b301276692 for instance b4dbeeee-162c-4f16-9645-0a2792a97661 on nch2-master-1 Jun 04 21:40:02.581375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fb806603-ad42-403c-b9e8-62db16d081c1 req-84b75a35-446e-4d10-8979-62e8fef7c64e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033941 Jun 04 21:40:02.581997 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3080/6057] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:40:02.824053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:02.824637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:02.832281 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:02.832731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:02.833507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:02.833942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:02.848377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 HTTP/1.1 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b4dbeeee-162c-4f16-9645-0a2792a97661'} Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:40:02.850095 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cef73cb0-03eb-4b30-ac32-271495f43c55 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 404 len: 111 microversion: 2.1 time: 0.031736 Jun 04 21:40:02.855482 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2978/6058] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:02 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:40:02.864881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:02.865621 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:02.872352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:02.872824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:02.873836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:02.874325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:02.888968 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 HTTP/1.1 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b4dbeeee-162c-4f16-9645-0a2792a97661'} Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:40:02.890811 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4bfeea8f-179a-4f05-b132-3a368647a55f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 404 len: 111 microversion: 2.1 time: 0.032131 Jun 04 21:40:02.897126 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3081/6059] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:02 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:40:02.941260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-302159805", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "dae8953a-cfb8-40a4-afa7-3050dc7715f8"}], "security_groups": [{"name": "tempest-securitygroup--542966001"}], "key_name": "tempest-keypair-151987683", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:40:03.051566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] validate_networks() for [('dae8953a-cfb8-40a4-afa7-3050dc7715f8', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:40:03.443124 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:40:03.443823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:40:03.444511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:40:03.444925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:40:03.445341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:40:03.455278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:03.455801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:03.456612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:03.457374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:03.475093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:40:03.480433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:40:03.493067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:40:03.495442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:40:03.543859 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5128a8bb-cc01-471e-8ce1-37679c1484fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.606822 Jun 04 21:40:03.544718 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2979/6060] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:40:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:40:03.555121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8c5e770e-12a5-4403-8dc6-8557d425c787 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:03.556492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8c5e770e-12a5-4403-8dc6-8557d425c787 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:03.628201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8c5e770e-12a5-4403-8dc6-8557d425c787 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:03.635063 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8c5e770e-12a5-4403-8dc6-8557d425c787 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1237 microversion: 2.1 time: 0.084108 Jun 04 21:40:03.635660 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3082/6061] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:03 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:04.653646 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:04.654253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:04.661991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:04.662453 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:04.663229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:04.663710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:04.729413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:04.741052 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5626e048-2fcf-4b94-a00a-83ba02cac0ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1297 microversion: 2.1 time: 0.092259 Jun 04 21:40:04.741656 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2980/6062] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:04 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:05.760737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:05.761752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:05.770343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:05.771461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:05.772412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:05.773043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:05.920311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:05.929799 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0bd68066-d830-4751-963b-ad7faf9db8ad tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1362 microversion: 2.1 time: 0.173277 Jun 04 21:40:05.930394 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3083/6063] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:05 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:06.508359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-975a7a91-77f6-438b-9eab-92830d04473c req-41379706-3f4e-4c60-85d6-b440bbd32cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:40:06.519485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-975a7a91-77f6-438b-9eab-92830d04473c req-41379706-3f4e-4c60-85d6-b440bbd32cb7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:06.520080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-975a7a91-77f6-438b-9eab-92830d04473c req-41379706-3f4e-4c60-85d6-b440bbd32cb7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:06.535535 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-975a7a91-77f6-438b-9eab-92830d04473c req-41379706-3f4e-4c60-85d6-b440bbd32cb7 service nova] Creating event network-changed:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch1-master-1 Jun 04 21:40:06.541357 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-975a7a91-77f6-438b-9eab-92830d04473c req-41379706-3f4e-4c60-85d6-b440bbd32cb7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042650 Jun 04 21:40:06.541983 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2981/6064] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:40:06.949320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:06.949979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:06.958232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:06.958808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:06.959653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:06.960168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:07.106804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:07.115318 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f0b239ef-b07f-4c0e-8cb0-aaeb5c8efa20 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1362 microversion: 2.1 time: 0.170233 Jun 04 21:40:07.115930 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3084/6065] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:06 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:08.134391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:08.135108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:08.142173 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:08.142630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:08.143421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:08.143900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:08.282232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:08.290137 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1add8d68-1854-4aaa-b7ac-b4bd5bd638be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1362 microversion: 2.1 time: 0.161008 Jun 04 21:40:08.290729 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2982/6066] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:08 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:09.311434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:09.312677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:09.316770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=42 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:09.325885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:09.326602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:09.327991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:09.328457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:09.474656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:09.482457 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd3a2d68-6772-4111-a8b7-3e94bc26fa5e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1362 microversion: 2.1 time: 0.177270 Jun 04 21:40:09.483036 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3085/6067] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:09 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:10.502372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:10.503000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:10.506030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:10.511693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:10.512155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:10.512935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:10.513378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:10.653255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:10.661888 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7aad514-02f7-4619-a586-fbe24115905f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1362 microversion: 2.1 time: 0.164215 Jun 04 21:40:10.662479 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2983/6068] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:10 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:11.118843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-7e616706-c5e6-48cf-9645-3ad271d165b4 req-a87acafc-147c-4fd3-9443-450464a8d542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "name": "network-vif-plugged", "status": "completed", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:40:11.129403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7e616706-c5e6-48cf-9645-3ad271d165b4 req-a87acafc-147c-4fd3-9443-450464a8d542 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:11.129782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-7e616706-c5e6-48cf-9645-3ad271d165b4 req-a87acafc-147c-4fd3-9443-450464a8d542 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:11.142184 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-7e616706-c5e6-48cf-9645-3ad271d165b4 req-a87acafc-147c-4fd3-9443-450464a8d542 service nova] Creating event network-vif-plugged:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch1-master-1 Jun 04 21:40:11.147785 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-7e616706-c5e6-48cf-9645-3ad271d165b4 req-a87acafc-147c-4fd3-9443-450464a8d542 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Jun 04 21:40:11.148432 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3086/6069] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:40:11.683484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:11.684485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:11.697248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:11.698025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:11.699274 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:11.700659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:11.841452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:11.853031 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ccf2a846-c7cb-46ab-9a0a-435abe479f28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1362 microversion: 2.1 time: 0.176048 Jun 04 21:40:11.853854 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2984/6070] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:11 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:12.878036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:12.878753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:12.885386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:12.885855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:12.886650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:12.887100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:13.030164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:13.038101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-912393be-caa8-4c89-9c0d-8c5065bf83cb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1550 microversion: 2.1 time: 0.167068 Jun 04 21:40:13.038691 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3087/6071] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:12 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:13.055105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:13.055713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:13.063011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:13.063571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:13.064434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:13.064951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:13.147035 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e819880c-8c03-4b7b-ad5c-96c3f4cb7674 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095861 Jun 04 21:40:13.147681 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2985/6072] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:40:13 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:40:14.115824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-05ec36db-571f-4f24-b983-7abb1d7cb16e req-663af62e-9a4a-4920-b504-2cba4b50b71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:40:14.120012 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:14.126881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-05ec36db-571f-4f24-b983-7abb1d7cb16e req-663af62e-9a4a-4920-b504-2cba4b50b71a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:14.127405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-05ec36db-571f-4f24-b983-7abb1d7cb16e req-663af62e-9a4a-4920-b504-2cba4b50b71a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:14.139912 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-05ec36db-571f-4f24-b983-7abb1d7cb16e req-663af62e-9a4a-4920-b504-2cba4b50b71a service nova] Creating event network-changed:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch1-master-1 Jun 04 21:40:14.145055 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-05ec36db-571f-4f24-b983-7abb1d7cb16e req-663af62e-9a4a-4920-b504-2cba4b50b71a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033134 Jun 04 21:40:14.146002 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3088/6073] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:40:50.088180 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:50.089602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:50.092903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=5 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:50.093958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:50.100988 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e9335b15-da2a-4e98-baa8-046c23794356 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:40:50.111838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9335b15-da2a-4e98-baa8-046c23794356 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:50.112299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e9335b15-da2a-4e98-baa8-046c23794356 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:50.136542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e9335b15-da2a-4e98-baa8-046c23794356 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Going to try to stop instance {{(pid=137229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:40:50.192236 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e9335b15-da2a-4e98-baa8-046c23794356 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action" status: 202 len: 0 microversion: 2.1 time: 0.104870 Jun 04 21:40:50.193258 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2986/6074] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:40:50 2022] POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:40:50.200599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=7 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:50.201486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=46 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:40:50.205645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:50.206368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:50.214358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:50.214998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:50.216158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:50.216762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:50.357104 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:50.365415 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f18076db-ff6b-452b-b53e-bdcf4d792b3c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.166953 Jun 04 21:40:50.366002 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3089/6075] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:50 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:51.388777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:51.389577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:51.396920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:51.397365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:51.398133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:51.398571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:51.532235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:51.540189 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bea84cf9-97ec-4b18-bffe-eccbc69bbddb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.159964 Jun 04 21:40:51.540792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2987/6076] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:51 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:52.565456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:52.566059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:52.572685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:52.573156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:52.573951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:52.574408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:52.720483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:52.728618 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59835f75-8845-43ac-9094-f87991a61f3a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.168739 Jun 04 21:40:52.729200 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3090/6077] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:52 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:53.750630 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:53.751723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:53.763819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:53.764578 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:53.765803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:53.766205 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:53.909043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:53.917015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d59afbc0-dfb3-48fd-b4a7-1af0b7985131 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.173245 Jun 04 21:40:53.917603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2988/6078] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:53 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:54.938783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:54.939435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:54.947359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:54.947847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:54.948657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:54.949106 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:55.091102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:55.100061 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53f65a37-a79f-42af-a2d1-c03d4586bdb2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.166968 Jun 04 21:40:55.100642 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3091/6079] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:54 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:56.119462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:56.120121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:56.128287 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:56.128741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:56.129521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:56.129965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:56.265765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:56.278394 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0c6e4d5e-d8e8-4418-aaf1-689daa62d34a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.163448 Jun 04 21:40:56.279326 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2989/6080] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:56 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:57.306400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:57.307174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:57.319163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:57.319917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:57.321226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:57.322003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:57.465309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:57.477812 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-11235070-39a7-41e2-923a-a4764fe92e1b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.177727 Jun 04 21:40:57.478609 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3092/6081] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:57 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:58.502717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:58.503440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:58.512833 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:58.513400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:58.514360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:58.514916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:58.664490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:58.676264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5002b649-3c14-4b15-863a-6bc998b96cfe tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.180173 Jun 04 21:40:58.676979 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2990/6082] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:58 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:40:59.700925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:40:59.702013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:40:59.714540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:59.715314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:59.716664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:40:59.717416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:40:59.864295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:40:59.876639 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5231cd8-dbdb-4ab0-ad6e-995e6ba654f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.182174 Jun 04 21:40:59.877432 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3093/6083] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:40:59 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:00.896264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:00.896996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:00.905172 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:00.905627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:00.906417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:00.906854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:01.050014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:01.058331 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6bb0f74c-0e4e-4068-9781-5c518590de83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.166869 Jun 04 21:41:01.058916 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2991/6084] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:00 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:02.076939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:02.077567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:02.085244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:02.085713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:02.086502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:02.086955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:02.240641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:02.248626 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df66872b-e425-41aa-a9e0-d0a52dbb1016 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.175731 Jun 04 21:41:02.249219 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3094/6085] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:02 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:03.266999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:03.267892 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:03.275817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:03.276265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:03.277041 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:03.277476 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:03.425269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:03.436803 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-60c09518-fbe7-4f3b-b563-5eb41087cd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.173906 Jun 04 21:41:03.437609 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2992/6086] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:03 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:04.460534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:04.461152 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:04.468159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:04.468602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:04.469419 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:04.469873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:04.611796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:04.619836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ead9897d-207c-4725-b7b4-8d0f33d49e6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.163433 Jun 04 21:41:04.620459 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3095/6087] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:04 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:05.637627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:05.638210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:05.648393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:05.648945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:05.650708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:05.651216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:05.793415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:05.801917 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77558173-e9d8-4e93-9ea7-b02ab6d479db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1656 microversion: 2.1 time: 0.168416 Jun 04 21:41:05.802505 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2993/6088] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:05 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:05.827707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:05.829297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:05.837851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:05.838490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:05.839274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:05.839764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:05.869068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:05.875933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Old instance type m1.heat2, new instance type m1.heat {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:41:05.883522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:41:05.883964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:41:05.884450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:41:05.884868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:41:05.885291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:41:05.956700 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-677ba0cd-a438-4b0d-8549-ad5c748980c3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action" status: 202 len: 0 microversion: 2.1 time: 0.135303 Jun 04 21:41:05.957575 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3096/6089] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:41:05 2022] POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:41:05.969695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:05.970750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:05.976604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:05.977062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:05.977867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:05.978289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:06.114201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:06.122107 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f09eb180-28e3-45ef-a64a-79a84a5ecb09 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.160239 Jun 04 21:41:06.122682 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2994/6090] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:05 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:07.140111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:07.140741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:07.148112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:07.148573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:07.149374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:07.149822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:07.298713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:07.307153 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-615cfee0-6bd2-40bf-97b7-6189d766a4d3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1679 microversion: 2.1 time: 0.171841 Jun 04 21:41:07.308355 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3097/6091] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:07 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:08.328206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:08.329182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:08.337490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:08.337944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:08.338726 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:08.339164 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:08.498813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:08.508733 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2f6d4e10-e474-44ef-a1ab-a25ec6f7cf6f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1684 microversion: 2.1 time: 0.186182 Jun 04 21:41:08.509324 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2995/6092] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:08 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1684 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:09.530896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:09.531955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:09.544140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:09.544849 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:09.546157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:09.546923 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:09.696740 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:09.704564 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-27056dd9-e0e5-42fd-a980-a783a49205c9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1684 microversion: 2.1 time: 0.180273 Jun 04 21:41:09.705152 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3098/6093] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:09 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:10.723428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:10.724927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:10.732391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:10.732821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:10.733607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:10.734043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:10.873377 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:10.881783 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-694ce9f3-4b37-4638-8c21-42679ae13afb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1683 microversion: 2.1 time: 0.163967 Jun 04 21:41:10.882342 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2996/6094] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:10 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:10.912240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-5a0730f1-cf78-47d9-b8dc-91f3521c0202 req-db7e9717-5d32-45df-a6a7-3d30e78e7826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "name": "network-vif-unplugged", "status": "completed", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:10.923820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5a0730f1-cf78-47d9-b8dc-91f3521c0202 req-db7e9717-5d32-45df-a6a7-3d30e78e7826 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:10.924255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-5a0730f1-cf78-47d9-b8dc-91f3521c0202 req-db7e9717-5d32-45df-a6a7-3d30e78e7826 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:10.937185 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-5a0730f1-cf78-47d9-b8dc-91f3521c0202 req-db7e9717-5d32-45df-a6a7-3d30e78e7826 service nova] Creating event network-vif-unplugged:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch2-master-1 Jun 04 21:41:10.943121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-5a0730f1-cf78-47d9-b8dc-91f3521c0202 req-db7e9717-5d32-45df-a6a7-3d30e78e7826 service nova] Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:41:10.954636 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-5a0730f1-cf78-47d9-b8dc-91f3521c0202 req-db7e9717-5d32-45df-a6a7-3d30e78e7826 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046146 Jun 04 21:41:10.955258 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3099/6095] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:11.900068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:11.900672 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:11.908380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:11.908853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:11.909653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:11.910271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:12.054174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:12.061968 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14cbb5f0-d4ce-4e1a-95c3-477842a9a017 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1683 microversion: 2.1 time: 0.166220 Jun 04 21:41:12.062550 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2997/6096] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:11 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:13.058586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-186f5f61-b772-4bbd-ab53-5b98357ae660 req-d59f2669-1378-4412-ad80-28c2be133bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:13.067380 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-186f5f61-b772-4bbd-ab53-5b98357ae660 req-d59f2669-1378-4412-ad80-28c2be133bb8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:13.067873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-186f5f61-b772-4bbd-ab53-5b98357ae660 req-d59f2669-1378-4412-ad80-28c2be133bb8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:13.079916 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-186f5f61-b772-4bbd-ab53-5b98357ae660 req-d59f2669-1378-4412-ad80-28c2be133bb8 service nova] Creating event network-changed:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch2-master-1 Jun 04 21:41:13.085220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:13.085841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:13.086213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-186f5f61-b772-4bbd-ab53-5b98357ae660 req-d59f2669-1378-4412-ad80-28c2be133bb8 service nova] Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:41:13.093076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:13.093676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:13.094591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:13.095140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:13.098323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-186f5f61-b772-4bbd-ab53-5b98357ae660 req-d59f2669-1378-4412-ad80-28c2be133bb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125454 Jun 04 21:41:13.099135 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3100/6097] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:13.240965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:13.253515 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ff0e8e96-8f22-4759-bf1f-dc8e7071f8a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1681 microversion: 2.1 time: 0.172862 Jun 04 21:41:13.254128 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2998/6098] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:13 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:14.275411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:14.276229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:14.283791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:14.284320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:14.285259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:14.285778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:14.432626 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:14.446709 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6d7c880e-66c6-4d81-87ea-007c376a47f9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1677 microversion: 2.1 time: 0.177902 Jun 04 21:41:14.447312 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3101/6099] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:14 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:14.463690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:14.464227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:14.471636 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:14.472085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:14.472990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:14.473432 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:14.543814 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-422f2f90-54c6-4f63-be62-e7f4837f5164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action" status: 204 len: 0 microversion: 2.1 time: 0.083717 Jun 04 21:41:14.544370 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 2999/6100] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:41:14 2022] POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:41:14.553292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:14.553911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:14.560569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:14.561038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:14.561828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:14.562276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:14.695882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:14.703680 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-438c1250-d61e-42aa-82e2-ce10e51ea251 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1677 microversion: 2.1 time: 0.154952 Jun 04 21:41:14.704263 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3102/6101] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:14 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:15.669385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-49af3ace-e606-4d67-bb9d-0df3dfa55474 req-5ef839e3-5d4a-4635-afac-805268cabad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "name": "network-vif-plugged", "status": "completed", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:15.678973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-49af3ace-e606-4d67-bb9d-0df3dfa55474 req-5ef839e3-5d4a-4635-afac-805268cabad2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:15.679382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-49af3ace-e606-4d67-bb9d-0df3dfa55474 req-5ef839e3-5d4a-4635-afac-805268cabad2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:15.691894 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-49af3ace-e606-4d67-bb9d-0df3dfa55474 req-5ef839e3-5d4a-4635-afac-805268cabad2 service nova] Creating event network-vif-plugged:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch2-master-1 Jun 04 21:41:15.694540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:15.698664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-49af3ace-e606-4d67-bb9d-0df3dfa55474 req-5ef839e3-5d4a-4635-afac-805268cabad2 service nova] Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:41:15.711178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-49af3ace-e606-4d67-bb9d-0df3dfa55474 req-5ef839e3-5d4a-4635-afac-805268cabad2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120440 Jun 04 21:41:15.711839 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3000/6102] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:15.722999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:15.723658 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:15.730774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:15.731242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:15.732102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:15.732783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:15.878123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:15.886298 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-aeeb77fd-cc3a-4203-a18b-1ac1e65cb899 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1677 microversion: 2.1 time: 0.168353 Jun 04 21:41:15.886891 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3103/6103] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:15 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:16.907789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:16.908386 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:16.916896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:16.917350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:16.918125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:16.918559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:17.053595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:17.063433 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8e9a4fff-39f9-4061-b2f2-384d49dde8be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1656 microversion: 2.1 time: 0.161168 Jun 04 21:41:17.064046 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3001/6104] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:16 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:17.086010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:17.086620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:17.094156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:17.094623 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:17.095411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:17.095897 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:17.258257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:17.263882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:17.271644 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-239cbd7b-59b3-4eb0-a7db-4fbb549e4d7a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1656 microversion: 2.1 time: 0.188929 Jun 04 21:41:17.272238 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3104/6105] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:17 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1656 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:17.288650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30992581-5021-4f73-a6d0-7718bc8daaa8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:17.294987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30992581-5021-4f73-a6d0-7718bc8daaa8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:17.295441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30992581-5021-4f73-a6d0-7718bc8daaa8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:17.322435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-30992581-5021-4f73-a6d0-7718bc8daaa8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Going to try to start instance {{(pid=137229) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:41:17.373122 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-30992581-5021-4f73-a6d0-7718bc8daaa8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action" status: 202 len: 0 microversion: 2.1 time: 0.088708 Jun 04 21:41:17.373739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3002/6106] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:41:17 2022] POST /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:41:17.383257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:17.384038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:17.390806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:17.391258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:17.398044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:17.398044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:17.538483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:17.546345 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-397211ea-73bd-4870-9475-c7b5ed7298ee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1665 microversion: 2.1 time: 0.167531 Jun 04 21:41:17.547209 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3105/6107] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:17 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:18.569239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:18.569962 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:18.577054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:18.577512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:18.578318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:18.578792 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:18.718244 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:18.729877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1dc80322-c2d6-4c14-84f0-0ea6d9f3390f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1669 microversion: 2.1 time: 0.167768 Jun 04 21:41:18.730636 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3003/6108] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:18 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:18.747274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:18.747832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:18.755180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:18.755730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:18.756556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:18.757027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:18.785825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:41:18.877470 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98bfeb2b-2383-4303-8ba0-a334497802b6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 204 len: 0 microversion: 2.1 time: 0.133910 Jun 04 21:41:18.878089 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3106/6109] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:41:18 2022] DELETE /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:41:18.886632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:18.887254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:18.893598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:18.894056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:18.894824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:18.895275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:19.051084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:19.063054 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52ee59a2-8886-49c8-b3c8-7ac8ae48c700 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1675 microversion: 2.1 time: 0.180022 Jun 04 21:41:19.063916 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3004/6110] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:18 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:20.088613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:20.089457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:20.098203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:20.098754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:20.099724 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:20.100294 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:20.239937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:20.248695 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-10f37036-a1d2-46a4-9038-0f58361d8e56 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 200 len: 1675 microversion: 2.1 time: 0.166692 Jun 04 21:41:20.249436 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3107/6111] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:20 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:21.009708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e722f0de-c62f-4f3d-93d8-30ad70acb8df req-f76400bd-843c-46c2-aabc-ada7a629cd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81efcb1-4eed-42bc-ad04-f268fc41f083", "name": "network-vif-deleted", "tag": "01d5196e-9629-441b-aacc-e3d6eebd6ecf"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:21.018210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=39 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:21.025135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e722f0de-c62f-4f3d-93d8-30ad70acb8df req-f76400bd-843c-46c2-aabc-ada7a629cd8f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:21.025794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e722f0de-c62f-4f3d-93d8-30ad70acb8df req-f76400bd-843c-46c2-aabc-ada7a629cd8f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:21.040647 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e722f0de-c62f-4f3d-93d8-30ad70acb8df req-f76400bd-843c-46c2-aabc-ada7a629cd8f service nova] Creating event network-vif-deleted:01d5196e-9629-441b-aacc-e3d6eebd6ecf for instance c81efcb1-4eed-42bc-ad04-f268fc41f083 on nch2-master-1 Jun 04 21:41:21.046317 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e722f0de-c62f-4f3d-93d8-30ad70acb8df req-f76400bd-843c-46c2-aabc-ada7a629cd8f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041631 Jun 04 21:41:21.046925 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3005/6112] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:21.266733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:21.267337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:21.272527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:21.280082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:21.280670 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:21.281473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:21.281945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:21.298169 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 HTTP/1.1 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c81efcb1-4eed-42bc-ad04-f268fc41f083'} Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:41:21.298772 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd2d94dd-528e-446c-b697-31f32381d4f1 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 404 len: 111 microversion: 2.1 time: 0.037835 Jun 04 21:41:21.307440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3108/6113] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:21 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:41:21.314974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:21.315825 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:21.322778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:21.323210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:21.324023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:21.324457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:21.338528 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 HTTP/1.1 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'c81efcb1-4eed-42bc-ad04-f268fc41f083'} Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:41:21.340253 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:41:21.345046 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c16d40b-1441-4f57-a7a5-3160778d0c84 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 404 len: 111 microversion: 2.1 time: 0.031077 Jun 04 21:41:21.346985 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3006/6114] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:21 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 04 21:41:21.394544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1796453897", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "dae8953a-cfb8-40a4-afa7-3050dc7715f8"}], "security_groups": [{"name": "tempest-securitygroup--542966001"}], "key_name": "tempest-keypair-151987683", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:21.498816 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] validate_networks() for [('dae8953a-cfb8-40a4-afa7-3050dc7715f8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:41:22.201700 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:41:22.202317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:41:22.202813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:41:22.203238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:41:22.203718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:41:22.214574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:22.215041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:22.215907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:22.216364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:22.234329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:41:22.239841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:41:22.252795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:41:22.255158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:41:22.310188 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a72517e5-e053-49cc-8748-c0e1d3562fa9 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.919463 Jun 04 21:41:22.311666 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3109/6115] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:41:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:41:22.321277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-806dd78b-6f4c-483f-a762-0118a17b24f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:22.322009 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-806dd78b-6f4c-483f-a762-0118a17b24f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:22.378973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-806dd78b-6f4c-483f-a762-0118a17b24f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:22.387972 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-806dd78b-6f4c-483f-a762-0118a17b24f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1238 microversion: 2.1 time: 0.069707 Jun 04 21:41:22.388543 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3007/6116] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:22 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:23.406830 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:23.407484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:23.416825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:23.417529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:23.418491 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:23.418968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:23.502967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:23.511575 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7081ffa-42d9-4e59-9aec-c2afa760af6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1308 microversion: 2.1 time: 0.109229 Jun 04 21:41:23.512158 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3110/6117] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:23 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:24.530876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:24.531614 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:24.541445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:24.542000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:24.542863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:24.543373 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:24.699056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:24.708253 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c0aec132-19b1-4f0c-8858-7aa8943c8b31 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1363 microversion: 2.1 time: 0.181430 Jun 04 21:41:24.708810 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3008/6118] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:24 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:24.798743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-19b5c713-edf5-4ebc-b740-28a1fe01d62a req-a64f73eb-79f0-4965-85dc-fb99f0c92ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:24.819529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-19b5c713-edf5-4ebc-b740-28a1fe01d62a req-a64f73eb-79f0-4965-85dc-fb99f0c92ef1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:24.819982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-19b5c713-edf5-4ebc-b740-28a1fe01d62a req-a64f73eb-79f0-4965-85dc-fb99f0c92ef1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:24.832262 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-19b5c713-edf5-4ebc-b740-28a1fe01d62a req-a64f73eb-79f0-4965-85dc-fb99f0c92ef1 service nova] Creating event network-changed:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch2-master-1 Jun 04 21:41:24.837875 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-19b5c713-edf5-4ebc-b740-28a1fe01d62a req-a64f73eb-79f0-4965-85dc-fb99f0c92ef1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044550 Jun 04 21:41:24.839636 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3111/6119] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:25.727385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:25.728275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:25.735709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:25.736155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:25.736925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:25.737355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:25.870452 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:25.878330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-95c347f1-ac9b-4edf-8f4b-12efa849e9f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1363 microversion: 2.1 time: 0.155716 Jun 04 21:41:25.878901 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3009/6120] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:25 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:26.901483 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:26.902191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:26.909393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:26.909860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:26.910652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:26.911134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:27.047083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:27.055252 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09188594-289b-4acd-8b5e-b905bf27aacf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1363 microversion: 2.1 time: 0.161746 Jun 04 21:41:27.055872 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3112/6121] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:26 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:28.075052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:28.075710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:28.083291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:28.083798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:28.084623 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:28.085070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:28.225706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:28.235979 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a9fd2217-1e8d-4cc4-acd0-069b4a04869b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1363 microversion: 2.1 time: 0.165538 Jun 04 21:41:28.236736 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3010/6122] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:28 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:29.259295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:29.260189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:29.268187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:29.268656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:29.269432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:29.269880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:29.417478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:29.429631 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a1ea432-0f28-43da-a804-344e14d77c8c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1363 microversion: 2.1 time: 0.175843 Jun 04 21:41:29.430501 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3113/6123] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:29 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:29.658410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-347af3f0-3431-4fe7-90c3-23c6fe85b374 req-460b5bea-f270-4c13-9364-f0f7cf6b5863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "name": "network-vif-plugged", "status": "completed", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:29.668696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-347af3f0-3431-4fe7-90c3-23c6fe85b374 req-460b5bea-f270-4c13-9364-f0f7cf6b5863 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:29.669211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-347af3f0-3431-4fe7-90c3-23c6fe85b374 req-460b5bea-f270-4c13-9364-f0f7cf6b5863 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:29.683067 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-347af3f0-3431-4fe7-90c3-23c6fe85b374 req-460b5bea-f270-4c13-9364-f0f7cf6b5863 service nova] Creating event network-vif-plugged:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch2-master-1 Jun 04 21:41:29.688614 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-347af3f0-3431-4fe7-90c3-23c6fe85b374 req-460b5bea-f270-4c13-9364-f0f7cf6b5863 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 Jun 04 21:41:29.689214 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3011/6124] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:30.454451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:30.455397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:30.465595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:30.466066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:30.466864 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:30.467305 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:30.612654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:30.620846 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9214c0ba-da8e-435c-941d-9d04010c1097 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1363 microversion: 2.1 time: 0.171700 Jun 04 21:41:30.621448 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3114/6125] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:30 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:31.641398 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:31.641982 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:31.650685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:31.651116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:31.652639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:31.653075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:31.821545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:41:31.831882 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf4e2c6f-69ae-4589-a1a9-c7d9af1c84ef tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1551 microversion: 2.1 time: 0.195547 Jun 04 21:41:31.834331 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3012/6126] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:41:31 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:41:31.853796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:41:31.856302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:41:31.863999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:31.864463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:31.865261 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:31.865720 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:31.959234 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-29ed189f-eff9-4150-8015-afb878918d83 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109454 Jun 04 21:41:31.960182 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3115/6127] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:41:31 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:41:33.014600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:41:33.081857 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-65ab1d4e-b76a-4029-824c-a77c20b6ace7 req-592bac65-26b1-43b1-8f27-f9de42ab1917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:41:33.090399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-65ab1d4e-b76a-4029-824c-a77c20b6ace7 req-592bac65-26b1-43b1-8f27-f9de42ab1917 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:41:33.090849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-65ab1d4e-b76a-4029-824c-a77c20b6ace7 req-592bac65-26b1-43b1-8f27-f9de42ab1917 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:41:33.102470 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-65ab1d4e-b76a-4029-824c-a77c20b6ace7 req-592bac65-26b1-43b1-8f27-f9de42ab1917 service nova] Creating event network-changed:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch2-master-1 Jun 04 21:41:33.107808 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-65ab1d4e-b76a-4029-824c-a77c20b6ace7 req-592bac65-26b1-43b1-8f27-f9de42ab1917 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097947 Jun 04 21:41:33.108416 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3013/6128] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:05.926129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:05.927227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:05.930676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:05.931659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:05.939165 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:05.940422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:05.952258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:05.952773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:05.953564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:05.954014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:05.987622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:05.994035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Old instance type m1.heat2, new instance type m1.heat {{(pid=137228) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:42:06.001541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:42:06.001985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:42:06.002476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:42:06.002899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:42:06.003324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:42:06.075810 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-272b039d-81ff-4ce0-a8b3-2a0b18e05d6d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91/action" status: 202 len: 0 microversion: 2.1 time: 0.150680 Jun 04 21:42:06.076466 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3116/6129] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:42:05 2022] POST /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:42:06.086072 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=19 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:06.087347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:06.095849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:06.097125 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:06.109581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:06.110367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:06.111778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:06.112572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:06.263881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:06.272447 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0aa01bb7-4a99-43ba-97ec-69f7af89285a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1679 microversion: 2.1 time: 0.190680 Jun 04 21:42:06.273059 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3014/6130] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:06 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:07.292241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:07.292933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:07.299924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:07.300701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:07.301768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:07.302233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:07.442282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:07.450535 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-caba98b9-180a-4145-a12f-242187a1a4c8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1679 microversion: 2.1 time: 0.163325 Jun 04 21:42:07.451542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3117/6131] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:07 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:08.469799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:08.470520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:08.477733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:08.478187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:08.478981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:08.479408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:08.621195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:08.632220 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2cf9a207-d005-415f-9f6d-d992a4b87082 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1679 microversion: 2.1 time: 0.167486 Jun 04 21:42:08.632739 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3015/6132] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:08 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:09.654506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:09.655161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:09.666315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:09.666937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:09.668148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:09.668912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:09.802965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:09.811501 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-38cebccf-548e-457e-8805-16ea3d869122 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.164332 Jun 04 21:42:09.812085 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3118/6133] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:09 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:10.833312 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:10.834285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:10.844319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:10.844778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:10.845547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:10.845980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:10.991243 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:11.001302 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-88d38787-3e7d-4b93-87d0-7c71ec5b01bb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.174373 Jun 04 21:42:11.001890 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3016/6134] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:10 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:12.021774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:12.022578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:12.033391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:12.034018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:12.035062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:12.035728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:12.189737 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:12.201180 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bc5b3f99-9f6d-4ddb-970e-aadc32307558 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.185024 Jun 04 21:42:12.201968 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3119/6135] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:12 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:13.221449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:13.222176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:13.230047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:13.230580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:13.231490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:13.232107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:13.372570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:13.382475 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0870c13-ea35-4d50-a898-c30c237666be tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.166484 Jun 04 21:42:13.383332 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3017/6136] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:13 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:14.403832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:14.404562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:14.412114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:14.412576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:14.413353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:14.413797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:14.567718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:14.575800 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b7a10c0b-56d8-4ec4-ad24-44478f4d6fd8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.176045 Jun 04 21:42:14.576482 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3120/6137] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:14 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:15.595353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:15.596182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:15.605745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:15.606349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:15.607359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:15.607987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:15.756264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:15.764936 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5b4bb444-3563-4843-adee-4a158dcf2ead tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.175037 Jun 04 21:42:15.765677 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3018/6138] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:15 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:16.785026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:16.785663 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:16.793456 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:16.793924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:16.794703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:16.795150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:16.937178 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:16.945053 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-86a0e7eb-e9dc-4c0f-8012-c6c766e86967 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.164437 Jun 04 21:42:16.945667 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3121/6139] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:16 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:17.967491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:17.968270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:17.978368 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:17.979012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:17.980153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:17.980765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:18.123378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:18.132143 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f0f8dae2-ad37-454d-b5ff-a9cc92b06de3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.170736 Jun 04 21:42:18.132730 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3019/6140] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:17 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:19.150221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:19.150848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:19.159169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:19.159944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:19.161147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:19.161840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:19.306074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:19.314825 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f02f8c50-a143-44d4-85b6-736b55ae50f2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.169003 Jun 04 21:42:19.315407 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3122/6141] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:19 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:20.336766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:20.337815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:20.347934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:20.348395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:20.349181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:20.349625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:20.488874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:20.496807 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e0638fc6-e218-4922-9087-a76121628d7f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.166728 Jun 04 21:42:20.497397 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3020/6142] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:20 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:21.518254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:21.518925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:21.527539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:21.528048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:21.528910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:21.529407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:21.672554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:21.680619 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5a915e76-3cdd-45f9-9022-01f17c892da4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.168489 Jun 04 21:42:21.681198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3123/6143] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:21 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:22.702354 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:22.703291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:22.715299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:22.716099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:22.717359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:22.718080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:22.867480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:22.879673 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-462ec25a-f65f-430b-8b84-7baca97ef884 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.183625 Jun 04 21:42:22.880410 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3021/6144] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:22 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:23.903291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:23.904297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:23.917320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:23.918100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:23.919401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:23.920203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:24.062665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:24.071338 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-425381ff-35eb-4c83-b651-614927f110eb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.175019 Jun 04 21:42:24.071988 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3124/6145] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:23 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:25.093207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:25.094192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:25.106095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:25.106840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:25.108171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:25.108896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:25.261887 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:25.272246 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a52c42da-cf8b-4cba-9c5f-c517ca7c3750 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1684 microversion: 2.1 time: 0.185748 Jun 04 21:42:25.272832 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3022/6146] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:25 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:26.044887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-dec875ee-7320-48c1-8055-38a9413e2ccf req-7bbb6f06-370e-49d2-9cb5-39736146353e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "name": "network-vif-unplugged", "status": "completed", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:26.054878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dec875ee-7320-48c1-8055-38a9413e2ccf req-7bbb6f06-370e-49d2-9cb5-39736146353e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:26.055348 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dec875ee-7320-48c1-8055-38a9413e2ccf req-7bbb6f06-370e-49d2-9cb5-39736146353e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:26.069475 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dec875ee-7320-48c1-8055-38a9413e2ccf req-7bbb6f06-370e-49d2-9cb5-39736146353e service nova] Creating event network-vif-unplugged:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch1-master-1 Jun 04 21:42:26.074882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-dec875ee-7320-48c1-8055-38a9413e2ccf req-7bbb6f06-370e-49d2-9cb5-39736146353e service nova] Instance 4da5c8ff-3252-4788-8692-98c225ecce91 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:42:26.086317 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-dec875ee-7320-48c1-8055-38a9413e2ccf req-7bbb6f06-370e-49d2-9cb5-39736146353e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045315 Jun 04 21:42:26.087401 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3125/6147] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:26.290093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:26.291375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:26.298328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:26.298828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:26.299721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:26.300346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:26.449776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:26.458806 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9d047dba-0bae-4118-8cce-e4abe26e86ab tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1683 microversion: 2.1 time: 0.172883 Jun 04 21:42:26.459401 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3023/6148] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:26 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:27.365712 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:42:27.366325 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 21:42:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:42:27.483433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:27.484682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:27.492984 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:27.493445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:27.494233 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:27.494687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:27.642652 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:27.651143 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2deb7402-93d8-4d0e-b8b5-4da2d7233450 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1681 microversion: 2.1 time: 0.176668 Jun 04 21:42:27.651757 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3126/6149] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:27 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:28.109331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fe6798d1-f56c-4df1-a24e-b983541451f9 req-3c5d4896-c236-4e80-8d09-37a6c2ffadb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:28.119488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe6798d1-f56c-4df1-a24e-b983541451f9 req-3c5d4896-c236-4e80-8d09-37a6c2ffadb2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:28.119956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe6798d1-f56c-4df1-a24e-b983541451f9 req-3c5d4896-c236-4e80-8d09-37a6c2ffadb2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:28.132569 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fe6798d1-f56c-4df1-a24e-b983541451f9 req-3c5d4896-c236-4e80-8d09-37a6c2ffadb2 service nova] Creating event network-changed:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch1-master-1 Jun 04 21:42:28.138492 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-fe6798d1-f56c-4df1-a24e-b983541451f9 req-3c5d4896-c236-4e80-8d09-37a6c2ffadb2 service nova] Instance 4da5c8ff-3252-4788-8692-98c225ecce91 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:42:28.150076 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fe6798d1-f56c-4df1-a24e-b983541451f9 req-3c5d4896-c236-4e80-8d09-37a6c2ffadb2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045929 Jun 04 21:42:28.150822 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3024/6150] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:28.669308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:28.670634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:28.678379 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:28.678852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:28.679821 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:28.680472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:28.820714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:28.828861 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-337eaee1-31cb-40e2-b23f-37f0bc8a582d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1681 microversion: 2.1 time: 0.163761 Jun 04 21:42:28.829791 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3127/6151] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:28 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:29.851737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:29.852437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:29.859369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:29.859841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:29.860612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:29.861043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.003284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:30.011835 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43b518db-77a5-4ea7-9530-902c0d993c12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1678 microversion: 2.1 time: 0.167277 Jun 04 21:42:30.012428 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3025/6152] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:29 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:30.030077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:30.030674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:30.038721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:30.039189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.040030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:30.040479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.079128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:30.079620 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.080420 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:30.080865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.102189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:42:30.109191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:42:30.195127 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:30.220587 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8019f250-9745-4e66-aaa3-8303883423a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91/action" status: 202 len: 0 microversion: 2.1 time: 0.194377 Jun 04 21:42:30.221202 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3128/6153] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:42:30 2022] POST /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:42:30.229621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:30.230379 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:30.236895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:30.237376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.238138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:30.238573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:30.372163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:30.380242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4a67a648-73a8-42c4-b7d5-534820264114 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1677 microversion: 2.1 time: 0.154663 Jun 04 21:42:30.380891 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3026/6154] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:30 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:30.857196 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:42:30.857871 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 21:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:42:31.400134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:31.400845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:31.408946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:31.409397 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:31.410193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:31.410642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:31.562449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:31.570759 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8ffb72fb-d425-45a4-bf73-2bdcc0c27f7c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1677 microversion: 2.1 time: 0.176440 Jun 04 21:42:31.571342 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3129/6155] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:31 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:32.588952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:32.589581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:32.597096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:32.597555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:32.598330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:32.598773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:32.749847 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:32.761586 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-07dc454b-0970-45be-9003-a7f1c8910b7b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1677 microversion: 2.1 time: 0.176647 Jun 04 21:42:32.762452 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3027/6156] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:32 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:33.784214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:33.785905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:33.796748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:33.797539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:33.799297 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:33.799976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:33.962260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:33.976818 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2768c33d-53ec-4b6e-a59c-d8a623e4ddaa tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1677 microversion: 2.1 time: 0.197119 Jun 04 21:42:33.977774 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3130/6157] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:33 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:34.044201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-786f917d-d92a-4f54-9b0e-3f8b7ce1185c req-aeff5f9c-dc16-46d0-b2e6-16a2718c4c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:34.072011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-786f917d-d92a-4f54-9b0e-3f8b7ce1185c req-aeff5f9c-dc16-46d0-b2e6-16a2718c4c69 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:34.072541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-786f917d-d92a-4f54-9b0e-3f8b7ce1185c req-aeff5f9c-dc16-46d0-b2e6-16a2718c4c69 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:34.090507 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-786f917d-d92a-4f54-9b0e-3f8b7ce1185c req-aeff5f9c-dc16-46d0-b2e6-16a2718c4c69 service nova] Creating event network-changed:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch2-master-1 Jun 04 21:42:34.096786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-786f917d-d92a-4f54-9b0e-3f8b7ce1185c req-aeff5f9c-dc16-46d0-b2e6-16a2718c4c69 service nova] Instance 4da5c8ff-3252-4788-8692-98c225ecce91 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:42:34.110679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-786f917d-d92a-4f54-9b0e-3f8b7ce1185c req-aeff5f9c-dc16-46d0-b2e6-16a2718c4c69 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079100 Jun 04 21:42:34.111687 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3028/6158] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:34.998532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:34.999149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:35.006683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:35.007123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:35.007955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:35.008409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:35.145193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:35.153962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45e0b150-89b5-4c78-af75-29581b66c5da tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1677 microversion: 2.1 time: 0.161644 Jun 04 21:42:35.154542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3131/6159] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:34 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:36.174526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:36.176090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:36.182087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=31 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:36.185027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:36.185931 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:36.187064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:36.187728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:36.191490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=87 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:36.355206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:36.366289 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-55bb8e24-17f0-458a-9c62-34e775829c6e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1677 microversion: 2.1 time: 0.197382 Jun 04 21:42:36.368152 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3029/6160] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:36 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:37.388181 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:37.388873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:37.391973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:37.398019 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.398479 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.399282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.399758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.541582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:37.549934 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8e2c6d03-3b7c-4e20-8a2c-8b2014ee29cc tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1670 microversion: 2.1 time: 0.167004 Jun 04 21:42:37.550516 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3132/6161] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:37 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:37.566434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:37.567079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:37.574438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.574891 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.575694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.576127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.711397 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:37.719937 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9137ed45-0612-4915-911b-bfceaea14e05 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1670 microversion: 2.1 time: 0.157386 Jun 04 21:42:37.720519 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3030/6162] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:37 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:37.736639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:37.737209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:37.744079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.744546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.745443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.745900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.882526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:37.891101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0564a271-d6a8-4e44-8ceb-e78f8e402303 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1670 microversion: 2.1 time: 0.158525 Jun 04 21:42:37.891739 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3133/6163] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:37 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:37.908964 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:37.909502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:37.915721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.916177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.917371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:37.917804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:37.947045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:42:38.035328 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6ac51dc2-d251-4ced-8546-8801b4db869a tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 204 len: 0 microversion: 2.1 time: 0.130019 Jun 04 21:42:38.035971 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3031/6164] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:42:37 2022] DELETE /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:42:38.044633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:38.045267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:38.051869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:38.052334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:38.053113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:38.053563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:38.186974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:38.195051 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9ee3f9a-b679-43ef-9e37-02a9755812fb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1676 microversion: 2.1 time: 0.154431 Jun 04 21:42:38.195647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3134/6165] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:38 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:39.216844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:39.217587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:39.225320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:39.225775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:39.226553 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:39.226984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:39.532853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:39.541568 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7c849225-1e9e-449c-9a39-f561b5701a9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1676 microversion: 2.1 time: 0.330678 Jun 04 21:42:39.542318 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3032/6166] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:39 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1676 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:40.489267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0de79f90-e29c-462e-b419-5973f2534fd1 req-325791ad-e9e7-45a8-ba2c-8c24a9eafaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da5c8ff-3252-4788-8692-98c225ecce91", "name": "network-vif-deleted", "tag": "5b3e2533-7207-4cf5-af63-a22e23bff5e6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:40.494280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:40.500651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0de79f90-e29c-462e-b419-5973f2534fd1 req-325791ad-e9e7-45a8-ba2c-8c24a9eafaba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:40.501130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0de79f90-e29c-462e-b419-5973f2534fd1 req-325791ad-e9e7-45a8-ba2c-8c24a9eafaba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:40.513964 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0de79f90-e29c-462e-b419-5973f2534fd1 req-325791ad-e9e7-45a8-ba2c-8c24a9eafaba service nova] Creating event network-vif-deleted:5b3e2533-7207-4cf5-af63-a22e23bff5e6 for instance 4da5c8ff-3252-4788-8692-98c225ecce91 on nch2-master-1 Jun 04 21:42:40.519557 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0de79f90-e29c-462e-b419-5973f2534fd1 req-325791ad-e9e7-45a8-ba2c-8c24a9eafaba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Jun 04 21:42:40.523931 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3135/6167] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:40.560821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:40.561724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:40.570271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:40.570898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:40.572061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:40.572547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:40.610928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:40.611692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:40.611874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lazy-loading 'fault' on Instance uuid 4da5c8ff-3252-4788-8692-98c225ecce91 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:42:40.656087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:40.664191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-09f4ac95-31d5-46e1-aa31-b48792e673f0 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 200 len: 1328 microversion: 2.1 time: 0.107835 Jun 04 21:42:40.664777 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3033/6168] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:40 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:42:41.687138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:41.687955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:41.695562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:41.696147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:41.697007 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:41.697508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:41.712416 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 HTTP/1.1 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '4da5c8ff-3252-4788-8692-98c225ecce91'} Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:42:41.714074 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-60737eed-08af-487c-b302-eb1cf9bbe679 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 404 len: 111 microversion: 2.1 time: 0.036092 Jun 04 21:42:41.719825 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3136/6169] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:41 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:42:41.737772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:41.738448 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:41.748371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:41.748977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:41.750118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:41.750778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:41.768889 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 HTTP/1.1 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '4da5c8ff-3252-4788-8692-98c225ecce91'} Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:42:41.770565 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-311f38cb-9567-4bd8-8616-693bcf99d194 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 404 len: 111 microversion: 2.1 time: 0.041490 Jun 04 21:42:41.776054 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3034/6170] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:41 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:42:41.819939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1017357117", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "dae8953a-cfb8-40a4-afa7-3050dc7715f8"}], "security_groups": [{"name": "tempest-securitygroup--542966001"}], "key_name": "tempest-keypair-151987683", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:42.117698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] validate_networks() for [('dae8953a-cfb8-40a4-afa7-3050dc7715f8', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:42:42.514111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:42:42.514550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:42:42.515070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:42:42.515493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:42:42.515946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:42:42.526309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:42.526775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:42.527608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:42.528290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:42.545913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:42:42.551845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:42:42.564855 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:42:42.567143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:42:42.615538 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb8d63b2-bc84-455a-83e4-d7a312aaf13d tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.799685 Jun 04 21:42:42.616216 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3137/6171] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:42:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:42:42.626701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d53586b-ff62-4797-b0f3-9f9ebb08f735 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:42.627441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d53586b-ff62-4797-b0f3-9f9ebb08f735 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:42.683032 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d53586b-ff62-4797-b0f3-9f9ebb08f735 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:42.690346 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d53586b-ff62-4797-b0f3-9f9ebb08f735 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1238 microversion: 2.1 time: 0.067733 Jun 04 21:42:42.690934 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3035/6172] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:42 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:43.708745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:43.709396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:43.716949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:43.717416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:43.718210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:43.718661 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:43.783403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:43.791408 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9590b197-9b53-4286-a446-8d29882b1f33 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1296 microversion: 2.1 time: 0.087631 Jun 04 21:42:43.792024 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3138/6173] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:43 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:44.810181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:44.811489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:44.819197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:44.819972 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:44.820772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:44.821360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:44.967026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:44.974692 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d890bcf6-6e60-4c29-9a8d-03207d2f5422 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.169060 Jun 04 21:42:44.975277 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3036/6174] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:44 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:45.003860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d811c69d-1bd4-4d3e-b433-6b1325c73ef8 req-d9f50d56-9c08-43a5-b821-771335c460f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:45.026828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d811c69d-1bd4-4d3e-b433-6b1325c73ef8 req-d9f50d56-9c08-43a5-b821-771335c460f7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:45.027595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d811c69d-1bd4-4d3e-b433-6b1325c73ef8 req-d9f50d56-9c08-43a5-b821-771335c460f7 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:45.040475 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d811c69d-1bd4-4d3e-b433-6b1325c73ef8 req-d9f50d56-9c08-43a5-b821-771335c460f7 service nova] Creating event network-changed:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch2-master-1 Jun 04 21:42:45.046569 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d811c69d-1bd4-4d3e-b433-6b1325c73ef8 req-d9f50d56-9c08-43a5-b821-771335c460f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047050 Jun 04 21:42:45.047356 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3139/6175] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:45.996197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:45.997340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:46.004824 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:46.005268 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:46.006045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:46.006485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:46.179531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:46.188126 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e4ba84e4-0200-4a49-a48b-47e4f775d96b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.198267 Jun 04 21:42:46.188714 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3037/6176] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:45 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:47.207687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:47.208408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:47.215441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:47.215936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:47.216780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:47.217806 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:47.371383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:47.382715 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53af7ea3-8bf3-4970-a4a9-65e42f7697df tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.179957 Jun 04 21:42:47.383551 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3140/6177] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:47 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:48.406185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:48.406802 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:48.414167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:48.414620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:48.415385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:48.415850 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:48.565308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:48.577463 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ae9148c6-477d-4f14-91f4-93de00c1aa77 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.175269 Jun 04 21:42:48.578056 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3038/6178] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:48 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:49.596983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:49.597611 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:49.606411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:49.606958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:49.607958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:49.608565 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:49.747236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:49.756028 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce4081f0-0f9e-4c10-abea-c41ba25998a6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.164253 Jun 04 21:42:49.756613 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3141/6179] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:49 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:50.774240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:50.774987 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:50.783171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:50.783661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:50.784426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:50.784863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:50.928571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:50.937029 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a93f2c1-2be6-452a-b368-72f6c9bc58a8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.167191 Jun 04 21:42:50.937576 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3039/6180] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:50 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:51.960637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:51.961218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:51.970001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:51.970471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:51.971274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:51.971753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:51.980080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d19a9852-f0c0-4382-823e-b2019e03e0ad req-8156ff99-d068-44fa-bfd7-384a8ec7b28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "name": "network-vif-plugged", "status": "completed", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:51.990102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d19a9852-f0c0-4382-823e-b2019e03e0ad req-8156ff99-d068-44fa-bfd7-384a8ec7b28c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:51.990629 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d19a9852-f0c0-4382-823e-b2019e03e0ad req-8156ff99-d068-44fa-bfd7-384a8ec7b28c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:52.002719 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d19a9852-f0c0-4382-823e-b2019e03e0ad req-8156ff99-d068-44fa-bfd7-384a8ec7b28c service nova] Creating event network-vif-plugged:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch2-master-1 Jun 04 21:42:52.008250 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d19a9852-f0c0-4382-823e-b2019e03e0ad req-8156ff99-d068-44fa-bfd7-384a8ec7b28c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031974 Jun 04 21:42:52.009042 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3040/6181] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:52.111024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:52.119334 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f27acfb3-2f9b-48c7-a427-11e08b22ffcd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.162667 Jun 04 21:42:52.120140 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3142/6182] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:51 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:53.137329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:53.143399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:53.144474 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:53.152333 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:53.152835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:53.153607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:53.154045 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:53.298166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:53.308864 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-adff25dd-3a30-4516-b9ad-8d45a124e2f6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1363 microversion: 2.1 time: 0.173356 Jun 04 21:42:53.309989 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3041/6183] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:53 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:54.332910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:54.334034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:54.337247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:54.338377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:42:54.347801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:54.348268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:54.349059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:54.349514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:54.485080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:42:54.493597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-65acdacd-8694-47db-9c94-b4154147b490 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1550 microversion: 2.1 time: 0.168267 Jun 04 21:42:54.494198 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3143/6184] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:42:54 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:42:54.511391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:42:54.511952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:42:54.519150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:54.519627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:54.520399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:54.520830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:54.604890 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2734a1a7-3e68-4beb-b299-eb94c1f7b418 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097593 Jun 04 21:42:54.605491 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3042/6185] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:42:54 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:42:55.912140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d3698e77-ad75-4cbc-a069-4893a17eb9df req-a4420634-f733-46bb-9194-fcc7fd0ae6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:42:55.921591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d3698e77-ad75-4cbc-a069-4893a17eb9df req-a4420634-f733-46bb-9194-fcc7fd0ae6ba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:42:55.922153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d3698e77-ad75-4cbc-a069-4893a17eb9df req-a4420634-f733-46bb-9194-fcc7fd0ae6ba service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:42:55.934406 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d3698e77-ad75-4cbc-a069-4893a17eb9df req-a4420634-f733-46bb-9194-fcc7fd0ae6ba service nova] Creating event network-changed:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch2-master-1 Jun 04 21:42:55.940176 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d3698e77-ad75-4cbc-a069-4893a17eb9df req-a4420634-f733-46bb-9194-fcc7fd0ae6ba service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031706 Jun 04 21:42:55.941402 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3144/6186] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:43:30.180074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:30.180852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:30.185120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:30.185776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:30.193446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:30.193906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:30.194777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:30.195227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:30.335067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:30.348413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1c3ba50e-2c26-4697-b5b6-8e262445760e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1669 microversion: 2.1 time: 0.170462 Jun 04 21:43:30.349370 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3043/6187] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:30 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:30.364173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:30.365092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:30.369529 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b7ae1b-9353-4aaa-a267-82f69dec40b3"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:43:30.370808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:30.378499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:30.378957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:30.379764 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:30.380206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:30.645420 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-29693e16-7c1f-4624-bcd7-835544c9cff6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283180 Jun 04 21:43:30.646748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3145/6188] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:43:30 2022] POST /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:43:33.984671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:43:33.985666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:33.993209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:33.993597 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:33.994385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:33.994829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:34.029919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:34.038105 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Old instance type m1.heat2, new instance type m1.heat {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:43:34.046981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:43:34.047412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:43:34.047922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:43:34.048335 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:43:34.048749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:43:34.129726 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7235c8bd-74aa-4ec9-bbc9-2258c273cc4b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/action" status: 202 len: 0 microversion: 2.1 time: 0.153241 Jun 04 21:43:34.130348 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3044/6189] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:43:33 2022] POST /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:43:34.141001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:34.141747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:34.151502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:34.152201 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:34.153573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:34.154114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:34.303282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:34.311646 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-71416221-3ad1-4b11-b65e-98246ab1f13b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1724 microversion: 2.1 time: 0.175982 Jun 04 21:43:34.312245 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3146/6190] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:34 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:35.331440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:35.332138 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:35.343977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:35.344481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:35.345329 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:35.345874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:35.482182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:35.495825 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73a8e344-d3fa-4bca-bd66-29837aafa5fd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1724 microversion: 2.1 time: 0.169533 Jun 04 21:43:35.496559 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3045/6191] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:35 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:36.518237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:36.519550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:36.527651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:36.528190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:36.529025 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:36.529458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:36.668369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:36.677039 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0bc04b22-0cf0-4035-91c0-f38086d802b7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.162824 Jun 04 21:43:36.678041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3147/6192] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:36 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:37.699163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:37.700280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:37.708126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:37.708601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:37.709404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:37.709859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:37.860803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:37.872939 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-de0d1e36-a569-46f1-bbee-53c10386bc24 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.180196 Jun 04 21:43:37.873724 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3046/6193] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:37 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:38.900945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:38.902064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:38.910022 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:38.910487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:38.911274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:38.911771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:39.056055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:39.064903 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89aa7e22-c53c-4b87-b434-165621e29164 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.171323 Jun 04 21:43:39.065518 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3148/6194] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:38 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:40.086869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:40.087890 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:40.100255 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:40.101006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:40.102297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:40.103023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:40.236465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:40.245152 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fe2ddeb2-19d2-4c50-849b-93882f668996 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.164836 Jun 04 21:43:40.245788 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3047/6195] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:40 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:41.264583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:41.265231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:41.273194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:41.273673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:41.274470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:41.274924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:41.416753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:41.425415 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1224e9ef-2c28-4d0c-8992-71f53d77ebbf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.165674 Jun 04 21:43:41.426027 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3149/6196] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:41 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:42.448621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:42.449275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:42.458001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:42.458761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:42.459227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:42.459839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:42.597799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:42.606182 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c8616baf-f989-428c-b0e8-dced8c5f91b4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.162258 Jun 04 21:43:42.606748 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3048/6197] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:42 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:43.624304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:43.624925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:43.632215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:43.632686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:43.633474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:43.633930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:43.768291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:43.777272 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-23670adf-9b74-4442-a6b4-fd103f9e65d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.157080 Jun 04 21:43:43.777864 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3150/6198] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:43 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:44.795806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:44.796494 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:44.805343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:44.805819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:44.806677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:44.807165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:44.952200 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:44.960777 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7d054f5-5b13-4d97-9ff2-0eca7bea83cf tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.169467 Jun 04 21:43:44.961361 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3049/6199] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:44 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:45.982596 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:45.983643 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:45.991057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:45.991536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:45.992326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:45.992778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:46.127316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:46.136213 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bb2a55bf-0a8b-4c7b-8088-8a775eb96a94 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.160291 Jun 04 21:43:46.137113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3151/6200] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:45 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:47.158733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:47.159371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:47.166463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:47.166935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:47.167740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:47.168176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:47.315000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:47.327742 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-adb80bb7-86bd-4264-ae14-170d5c536c9e tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.174355 Jun 04 21:43:47.328321 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3050/6201] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:47 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:48.348056 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:48.348975 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:48.358925 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:48.359659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:48.360519 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:48.360973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:48.506237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:48.514380 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4be7ac68-0797-4ba5-8fd9-4b443cf30f39 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1729 microversion: 2.1 time: 0.172829 Jun 04 21:43:48.514983 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3152/6202] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:48 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:49.389769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-dee47192-30d2-4dbe-94f6-c57e61db79c3 req-d60d1595-7561-4aad-b936-ca7aa08bb107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "name": "network-vif-unplugged", "status": "completed", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:43:49.400294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-dee47192-30d2-4dbe-94f6-c57e61db79c3 req-d60d1595-7561-4aad-b936-ca7aa08bb107 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:49.400745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-dee47192-30d2-4dbe-94f6-c57e61db79c3 req-d60d1595-7561-4aad-b936-ca7aa08bb107 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:49.416728 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-dee47192-30d2-4dbe-94f6-c57e61db79c3 req-d60d1595-7561-4aad-b936-ca7aa08bb107 service nova] Creating event network-vif-unplugged:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch1-master-1 Jun 04 21:43:49.422899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-dee47192-30d2-4dbe-94f6-c57e61db79c3 req-d60d1595-7561-4aad-b936-ca7aa08bb107 service nova] Instance 59058341-965e-4ff5-be11-b07b1411d961 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:43:49.438208 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-dee47192-30d2-4dbe-94f6-c57e61db79c3 req-d60d1595-7561-4aad-b936-ca7aa08bb107 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052294 Jun 04 21:43:49.439129 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3051/6203] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:43:49.532905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:49.533552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:49.541430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:49.541898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:49.542911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:49.543550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:49.688157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:49.697646 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-466785c5-e7ac-4b5b-8230-edc3e806b062 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1728 microversion: 2.1 time: 0.169405 Jun 04 21:43:49.698174 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3153/6204] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:49 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:50.717799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:50.718904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:50.726174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:50.726615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:50.727390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:50.727859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:50.867415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:50.876655 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e62d98ba-c587-4fe6-86c5-e41ffd2c3ccb tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1726 microversion: 2.1 time: 0.164293 Jun 04 21:43:50.877513 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3052/6205] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:50 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:51.453373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6aa321be-3053-4bf1-bdc7-718f9666d49f req-23db5be8-a0f7-4f7f-a4ef-08703266fedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:43:51.462997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6aa321be-3053-4bf1-bdc7-718f9666d49f req-23db5be8-a0f7-4f7f-a4ef-08703266fedd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:51.463450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6aa321be-3053-4bf1-bdc7-718f9666d49f req-23db5be8-a0f7-4f7f-a4ef-08703266fedd service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:51.476358 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6aa321be-3053-4bf1-bdc7-718f9666d49f req-23db5be8-a0f7-4f7f-a4ef-08703266fedd service nova] Creating event network-changed:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch1-master-1 Jun 04 21:43:51.482185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-6aa321be-3053-4bf1-bdc7-718f9666d49f req-23db5be8-a0f7-4f7f-a4ef-08703266fedd service nova] Instance 59058341-965e-4ff5-be11-b07b1411d961 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:43:51.493842 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6aa321be-3053-4bf1-bdc7-718f9666d49f req-23db5be8-a0f7-4f7f-a4ef-08703266fedd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044158 Jun 04 21:43:51.494992 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3154/6206] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:43:51.894885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:51.895596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:51.904392 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:51.904983 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:51.906056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:51.906361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:52.043708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:52.053470 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-56937686-bf38-432c-a392-a2cdf672ef12 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1726 microversion: 2.1 time: 0.162583 Jun 04 21:43:52.054079 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3053/6207] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:51 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:53.072034 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:53.072756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:53.080153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:53.080630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:53.081455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:53.081939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:53.227129 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:53.236494 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ed9c0561-f5f8-4770-9a33-200c27922de8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1726 microversion: 2.1 time: 0.169721 Jun 04 21:43:53.237092 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3155/6208] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:53 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:54.258299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:54.259406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:54.268650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:54.269103 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:54.269908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:54.270346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:54.409812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:54.418072 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a40e7faa-a626-4b9b-b36c-882b1aabd3c7 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1726 microversion: 2.1 time: 0.166275 Jun 04 21:43:54.418651 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3054/6209] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:54 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:55.435164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:55.435866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:55.443682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:55.444215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:55.445052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:55.445512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:55.589008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:55.597542 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0a933a08-68bf-400a-b6f3-3c1fa01e25ce tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1726 microversion: 2.1 time: 0.166480 Jun 04 21:43:55.598147 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3156/6210] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:55 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:56.618381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:56.619402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:56.628560 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:56.629025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:56.629809 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:56.630250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:56.776439 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:56.785715 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-42c44c22-bf98-4264-b69f-d3e65316bc69 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1723 microversion: 2.1 time: 0.173463 Jun 04 21:43:56.786296 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3055/6211] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:56 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:56.803250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:43:56.803862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:56.810995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:56.811642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:56.812458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:56.812913 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:56.851583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:56.852356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:56.853183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:56.853635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:56.874502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:43:56.879810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Getting quotas for user ce8a9c03cdf04d72bbecb875aa275693 and project 4089cd0379c94abe9a77baa27012aa7c. Resources: {'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:43:56.963431 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:43:56.988880 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d40a7daf-20a9-438b-b8a4-d080c0e1d272 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "POST /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/action" status: 202 len: 0 microversion: 2.1 time: 0.189701 Jun 04 21:43:56.989498 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3157/6212] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:43:56 2022] POST /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:43:56.997814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:56.998380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:57.005118 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:57.005577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:57.006366 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:57.006884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:57.142153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:57.150965 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b4ec3d1-df01-4cca-ae0f-dbddcc228629 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.157169 Jun 04 21:43:57.151569 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3056/6213] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:56 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:43:58.172080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:58.172907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:58.182337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:58.182799 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:58.183638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:58.184134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:58.326289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:58.334802 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-33285bc0-9156-4dab-8aa2-213a48f2889b tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.169290 Jun 04 21:43:58.335404 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3158/6214] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:58 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:43:58.403778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3344883e-ccde-44c1-b6ee-9c735145fe2c req-255b6abb-74f1-45f7-8147-8f0e03b694fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "name": "network-vif-plugged", "status": "completed", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:43:58.413420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3344883e-ccde-44c1-b6ee-9c735145fe2c req-255b6abb-74f1-45f7-8147-8f0e03b694fe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:58.413860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3344883e-ccde-44c1-b6ee-9c735145fe2c req-255b6abb-74f1-45f7-8147-8f0e03b694fe service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:58.426824 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3344883e-ccde-44c1-b6ee-9c735145fe2c req-255b6abb-74f1-45f7-8147-8f0e03b694fe service nova] Creating event network-vif-plugged:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch1-master-1 Jun 04 21:43:58.432426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-3344883e-ccde-44c1-b6ee-9c735145fe2c req-255b6abb-74f1-45f7-8147-8f0e03b694fe service nova] Instance 59058341-965e-4ff5-be11-b07b1411d961 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:43:58.444231 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3344883e-ccde-44c1-b6ee-9c735145fe2c req-255b6abb-74f1-45f7-8147-8f0e03b694fe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044132 Jun 04 21:43:58.444809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3057/6215] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:43:59.356767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:43:59.357460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:43:59.366130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:59.366603 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:59.367396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:43:59.367872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:43:59.511715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:43:59.520816 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a337033b-fda9-4fe7-96e0-5ade2f5af06c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.169524 Jun 04 21:43:59.521758 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3159/6216] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:43:59 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:00.540239 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:00.540996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:00.542979 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=35 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:00.549621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:00.550153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:00.550941 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:00.551844 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:00.555087 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:00.699718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:00.708252 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-72f9b19f-07b4-4016-bc3f-eab83cd34056 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.173291 Jun 04 21:44:00.708840 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3058/6217] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:00 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:01.223971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-631970df-5bed-44c0-a566-08ceae6f69dc req-47303d14-a0e2-42bd-b124-1a6dec139892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "name": "network-vif-unplugged", "status": "completed", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:01.229243 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:01.234602 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-631970df-5bed-44c0-a566-08ceae6f69dc req-47303d14-a0e2-42bd-b124-1a6dec139892 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:01.235137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-631970df-5bed-44c0-a566-08ceae6f69dc req-47303d14-a0e2-42bd-b124-1a6dec139892 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:01.248420 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-631970df-5bed-44c0-a566-08ceae6f69dc req-47303d14-a0e2-42bd-b124-1a6dec139892 service nova] Creating event network-vif-unplugged:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch2-master-1 Jun 04 21:44:01.254100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-631970df-5bed-44c0-a566-08ceae6f69dc req-47303d14-a0e2-42bd-b124-1a6dec139892 service nova] Instance 59058341-965e-4ff5-be11-b07b1411d961 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:44:01.265084 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-631970df-5bed-44c0-a566-08ceae6f69dc req-47303d14-a0e2-42bd-b124-1a6dec139892 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045042 Jun 04 21:44:01.266067 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3160/6218] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:44:01.725444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:01.726185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:01.733556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:01.734111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:01.735066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:01.735841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:01.877950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:01.886375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-02ae26b4-e7bb-4071-8e95-592f07bb2bee tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.164757 Jun 04 21:44:01.886869 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3059/6219] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:01 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:02.906080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:02.907563 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:02.914208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:02.914713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:02.915645 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:02.916180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:03.057977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:03.067668 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-99e46e1a-b8f7-40a6-8ad1-2ead703e95f3 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.167042 Jun 04 21:44:03.068264 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3161/6220] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:02 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:03.287203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-53e9296f-2994-42f6-b3de-a22a76ea9a98 req-acbd5c0d-e5ff-4a48-a0a1-a0bfd4b1722a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:03.300005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-53e9296f-2994-42f6-b3de-a22a76ea9a98 req-acbd5c0d-e5ff-4a48-a0a1-a0bfd4b1722a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:03.300458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-53e9296f-2994-42f6-b3de-a22a76ea9a98 req-acbd5c0d-e5ff-4a48-a0a1-a0bfd4b1722a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:03.312777 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-53e9296f-2994-42f6-b3de-a22a76ea9a98 req-acbd5c0d-e5ff-4a48-a0a1-a0bfd4b1722a service nova] Creating event network-changed:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch2-master-1 Jun 04 21:44:03.318683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-53e9296f-2994-42f6-b3de-a22a76ea9a98 req-acbd5c0d-e5ff-4a48-a0a1-a0bfd4b1722a service nova] Instance 59058341-965e-4ff5-be11-b07b1411d961 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:44:03.330241 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-53e9296f-2994-42f6-b3de-a22a76ea9a98 req-acbd5c0d-e5ff-4a48-a0a1-a0bfd4b1722a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048827 Jun 04 21:44:03.331010 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3060/6221] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:44:04.086656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:04.087410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:04.096101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:04.096668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:04.097377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:04.097804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:04.243153 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:04.251800 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dcd27f42-2421-4058-a356-34e17f8e15e8 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.170489 Jun 04 21:44:04.261175 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3162/6222] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:04 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:05.283900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:05.284642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:05.291643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:05.292094 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:05.292919 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:05.293351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:05.430144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:05.441055 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-59e5e546-f9e6-4484-8390-03f4887b5c2c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1722 microversion: 2.1 time: 0.162608 Jun 04 21:44:05.441751 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3061/6223] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:05 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:06.468050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:06.469428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:06.476995 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:06.477463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:06.478249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:06.478703 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:06.621829 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:06.632343 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4a0e356d-85b6-471b-b24f-a536e96ffffd tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1715 microversion: 2.1 time: 0.170320 Jun 04 21:44:06.632845 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3163/6224] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:06 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:06.649320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:06.649901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:06.659821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:06.660577 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:06.661367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:06.661814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:06.804518 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:06.817566 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-00e9de2a-0013-4921-8535-08105b649244 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1715 microversion: 2.1 time: 0.172474 Jun 04 21:44:06.818401 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3062/6225] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:06 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1715 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:06.838079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:06.838729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:06.845395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:06.845865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:06.846644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:06.847096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:06.865962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:06.992245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:07.008222 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-42dfea58-0aab-44f8-8342-e54786069ee5 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1715 microversion: 2.1 time: 0.173572 Jun 04 21:44:07.009130 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3164/6226] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:06 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1715 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:07.026632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:07.027109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:07.034262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:07.034770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:07.035692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:07.036158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:07.062681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:44:07.149800 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ec91da0-7995-472f-8f87-8a5af57aba87 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 204 len: 0 microversion: 2.1 time: 0.127812 Jun 04 21:44:07.150410 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3063/6227] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:07 2022] DELETE /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:44:07.159310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:07.160046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:07.166681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:07.167133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:07.168006 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:07.168451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:07.312641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:07.321357 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1f0ce53d-5ef5-4aaf-ba5c-8b0bf74819db tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1721 microversion: 2.1 time: 0.166327 Jun 04 21:44:07.321952 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3165/6228] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:07 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:08.340536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:08.341140 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:08.349656 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:08.350119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:08.350904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:08.351330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:08.490827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:08.502945 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b79f9fa1-4d62-45eb-b06f-6203dbe25991 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1721 microversion: 2.1 time: 0.166519 Jun 04 21:44:08.503881 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3064/6229] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:08 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:09.527425 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:09.528170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:09.537795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:09.538319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:09.539383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:09.539943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:09.583739 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bea61364-9c42-411f-a060-41eb3676018a req-d3591eff-5a13-4cc1-ab5f-7d40c117b699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59058341-965e-4ff5-be11-b07b1411d961", "name": "network-vif-deleted", "tag": "1e3ae578-9070-45cc-a7c4-3bb9c9602821"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:09.594715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bea61364-9c42-411f-a060-41eb3676018a req-d3591eff-5a13-4cc1-ab5f-7d40c117b699 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:09.595265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bea61364-9c42-411f-a060-41eb3676018a req-d3591eff-5a13-4cc1-ab5f-7d40c117b699 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:09.615589 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bea61364-9c42-411f-a060-41eb3676018a req-d3591eff-5a13-4cc1-ab5f-7d40c117b699 service nova] Creating event network-vif-deleted:1e3ae578-9070-45cc-a7c4-3bb9c9602821 for instance 59058341-965e-4ff5-be11-b07b1411d961 on nch2-master-1 Jun 04 21:44:09.621465 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bea61364-9c42-411f-a060-41eb3676018a req-d3591eff-5a13-4cc1-ab5f-7d40c117b699 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041424 Jun 04 21:44:09.622303 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3065/6230] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:44:09.640998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8a9c03cdf04d72bbecb875aa275693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4089cd0379c94abe9a77baa27012aa7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:09.654147 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-59cc4dfa-1b69-4d1a-aad8-8da82f4edc96 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 200 len: 1654 microversion: 2.1 time: 0.131784 Jun 04 21:44:09.654751 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3166/6231] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:09 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 1654 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:10.674259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:10.674960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:10.681854 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:10.682302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:10.683065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:10.683497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:10.698355 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 HTTP/1.1 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '59058341-965e-4ff5-be11-b07b1411d961'} Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:10.700043 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7db2af20-cbf4-41aa-86ce-3ee1b3ae6176 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 404 len: 111 microversion: 2.1 time: 0.032704 Jun 04 21:44:10.705670 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3066/6232] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:10 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:10.768085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:10.769046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:10.776714 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:10.777192 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:10.777981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:10.778438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:10.791767 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-volume_attachments HTTP/1.1 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'server_id': '59058341-965e-4ff5-be11-b07b1411d961'} Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:10.793496 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5d0a9cbf-e339-42f6-b9ca-f8943942b9f4 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031293 Jun 04 21:44:10.798439 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3167/6233] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:44:10 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.008516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.009047 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.017193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.017660 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.018446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.018886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.033812 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 HTTP/1.1 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '59058341-965e-4ff5-be11-b07b1411d961'} Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.037532 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ebf09006-14f1-4734-a9aa-77c266b6f1a2 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 404 len: 111 microversion: 2.1 time: 0.032362 Jun 04 21:44:12.043019 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3067/6234] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:12 2022] DELETE /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.047789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.048427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 59058341-965e-4ff5-be11-b07b1411d961] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.055673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.056135 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.056915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.057361 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.071264 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 HTTP/1.1 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '59058341-965e-4ff5-be11-b07b1411d961'} Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.072880 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 59058341-965e-4ff5-be11-b07b1411d961 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87a5bc58-d591-461c-b19a-8a3e0d5d74d6 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961" status: 404 len: 111 microversion: 2.1 time: 0.032379 Jun 04 21:44:12.078046 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3168/6235] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:12 2022] GET /compute/v2.1/servers/59058341-965e-4ff5-be11-b07b1411d961 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.083711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.084223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.090607 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.091052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.091855 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.092296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.107330 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 HTTP/1.1 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '4da5c8ff-3252-4788-8692-98c225ecce91'} Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.108918 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-de3416fe-1213-486d-91c9-ee2b985a8363 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 404 len: 111 microversion: 2.1 time: 0.031078 Jun 04 21:44:12.114620 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3068/6236] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:12 2022] DELETE /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.119573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.120210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: 4da5c8ff-3252-4788-8692-98c225ecce91] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.127880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.128346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.129213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.129667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.145157 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 HTTP/1.1 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '4da5c8ff-3252-4788-8692-98c225ecce91'} Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.147062 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance 4da5c8ff-3252-4788-8692-98c225ecce91 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd3e0164-f2aa-4c60-8933-3b0f0095661f tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91" status: 404 len: 111 microversion: 2.1 time: 0.032956 Jun 04 21:44:12.152328 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3169/6237] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:12 2022] GET /compute/v2.1/servers/4da5c8ff-3252-4788-8692-98c225ecce91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.157907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.158404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.164799 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.165249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.166010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.166443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.180664 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 HTTP/1.1 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'c81efcb1-4eed-42bc-ad04-f268fc41f083'} Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.182517 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0c35a514-4559-4974-b8f1-f5ef6256dd23 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 404 len: 111 microversion: 2.1 time: 0.029937 Jun 04 21:44:12.188666 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3069/6238] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:12 2022] DELETE /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.192987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.193614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: c81efcb1-4eed-42bc-ad04-f268fc41f083] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.206298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.206791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.207801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.208072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.229341 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 HTTP/1.1 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'c81efcb1-4eed-42bc-ad04-f268fc41f083'} Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.231615 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance c81efcb1-4eed-42bc-ad04-f268fc41f083 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-927f483a-96c5-4fa3-be9a-f0ef516b3734 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083" status: 404 len: 111 microversion: 2.1 time: 0.043992 Jun 04 21:44:12.237267 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3170/6239] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:12 2022] GET /compute/v2.1/servers/c81efcb1-4eed-42bc-ad04-f268fc41f083 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.242272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.242774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.249521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.249976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.250943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.251384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.266466 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 HTTP/1.1 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'b4dbeeee-162c-4f16-9645-0a2792a97661'} Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.268052 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e3d1c924-47b9-4ea4-94fe-bbffc8da9b28 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 404 len: 111 microversion: 2.1 time: 0.031206 Jun 04 21:44:12.273860 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3070/6240] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:12 2022] DELETE /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.280316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.281266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [instance: b4dbeeee-162c-4f16-9645-0a2792a97661] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:12.289967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.290600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.291750 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:12.292266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:12.308222 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] HTTP exception thrown: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Request method failure captured: Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 HTTP/1.1 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9EGIOTsiBHrZYGKh22pJjeZhUqcJCcwVFWIDFsKhOnin96WX1_giU_wpcQ22UPmNcAZyd-1L4Qj0bxg9pxijuUbuzXHv4jTv3Rg7Z1lLcyEKcIDBJ9f4Ys7XbJhbmScOSKK6BNh31xNac4-c2fzPQTGQHbCA5ymAz0tQ9iNdpX5Vkw Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4089cd0379c94abe9a77baa27012aa7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 4089cd0379c94abe9a77baa27012aa7c Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServerActionsTestJSON-1358527532 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: ce8a9c03cdf04d72bbecb875aa275693 Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServerActionsTestJSON-1358527532-project Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'b4dbeeee-162c-4f16-9645-0a2792a97661'} Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:12.310036 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Returning 404 to user: Instance b4dbeeee-162c-4f16-9645-0a2792a97661 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fce6ae75-ac78-4807-85c8-89ca41ef3e82 tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661" status: 404 len: 111 microversion: 2.1 time: 0.037220 Jun 04 21:44:12.316259 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3171/6241] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:12 2022] GET /compute/v2.1/servers/b4dbeeee-162c-4f16-9645-0a2792a97661 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:12.321604 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce6c94b1-a368-4485-8fe2-3e4c764fbd9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] Calling method '.version_select at 0x7f2d0214e700>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:12.324943 ncdv-master-1 devstack@n-api.service[137229]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce6c94b1-a368-4485-8fe2-3e4c764fbd9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [21884617-350d-464d-afb5-2969a7e466e7] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 21:44:13.336069 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [None req-ce6c94b1-a368-4485-8fe2-3e4c764fbd9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] [21884617-350d-464d-afb5-2969a7e466e7] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49478. Jun 04 21:44:13.363377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce6c94b1-a368-4485-8fe2-3e4c764fbd9c tempest-ServerActionsTestJSON-1358527532 tempest-ServerActionsTestJSON-1358527532-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151987683" status: 202 len: 0 microversion: 2.1 time: 1.045564 Jun 04 21:44:13.364227 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3071/6242] 10.222.0.18 () {58 vars in 1217 bytes} [Sat Jun 4 21:44:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151987683 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:44:19.519058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1285724290", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "639acd82-0c31-4d95-9b91-4b7890f7da3d"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:19.580893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] validate_networks() for [('639acd82-0c31-4d95-9b91-4b7890f7da3d', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:44:19.954578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:44:19.955049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:44:19.955539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:44:19.955973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:44:19.956396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:44:19.966266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:19.966736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:19.967606 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:19.968208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:19.986701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Getting quotas for project 0a78aca073fb4afaa48be967cb19c339. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:44:19.992385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Getting quotas for user c7aa4e4d238241e39839ce9a2f208bfa and project 0a78aca073fb4afaa48be967cb19c339. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:44:20.005608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:44:20.007985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:44:20.057251 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c9840cb0-f01b-490d-aafa-68252d777f7d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665165 Jun 04 21:44:20.058047 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3172/6243] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:44:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:44:20.068284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b3bb4285-44c4-499b-a91f-1a0609174fb8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:20.068913 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b3bb4285-44c4-499b-a91f-1a0609174fb8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:20.125934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b3bb4285-44c4-499b-a91f-1a0609174fb8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:20.133320 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b3bb4285-44c4-499b-a91f-1a0609174fb8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1217 microversion: 2.1 time: 0.068918 Jun 04 21:44:20.134246 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3072/6244] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:20 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:21.151098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:21.151693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:21.160070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:21.160531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:21.161320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:21.161765 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:21.232583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:21.242956 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9aefa1d7-d3b8-4fb2-84a2-80bf6f1bfa63 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1277 microversion: 2.1 time: 0.096289 Jun 04 21:44:21.243774 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3173/6245] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:21 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:22.263006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:22.263634 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:22.266528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:22.274185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:22.274643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:22.275463 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:22.275944 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:22.420088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:22.428534 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b18927ed-e4f2-4deb-990f-8ba269a39111 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.169598 Jun 04 21:44:22.429364 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3073/6246] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:22 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:22.629726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-10f04ef4-bcb8-48b6-908f-971b49f5fa1b req-69cb024e-5e65-4fb5-91d8-ae45baec1c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cae7ccd9-0efe-4294-a0dd-ca33d06084b2", "tag": "76605e08-668c-4d25-8a65-239a66106d49"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:22.639742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-10f04ef4-bcb8-48b6-908f-971b49f5fa1b req-69cb024e-5e65-4fb5-91d8-ae45baec1c6f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:22.640213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-10f04ef4-bcb8-48b6-908f-971b49f5fa1b req-69cb024e-5e65-4fb5-91d8-ae45baec1c6f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:22.653521 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-10f04ef4-bcb8-48b6-908f-971b49f5fa1b req-69cb024e-5e65-4fb5-91d8-ae45baec1c6f service nova] Creating event network-changed:76605e08-668c-4d25-8a65-239a66106d49 for instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 on nch1-master-1 Jun 04 21:44:22.659203 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-10f04ef4-bcb8-48b6-908f-971b49f5fa1b req-69cb024e-5e65-4fb5-91d8-ae45baec1c6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034075 Jun 04 21:44:22.659864 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3174/6247] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:44:23.449531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:23.450417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:23.459188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:23.459692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:23.460473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:23.460915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:23.596174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:23.604414 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8b98336d-4544-4926-993b-bfe2946fcd46 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.160728 Jun 04 21:44:23.605003 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3074/6248] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:23 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:24.623422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:24.624270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:24.631002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:24.631435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:24.632300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:24.632711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:24.780198 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:24.787947 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd6eff24-43ac-498b-bb40-8ee392a24bd5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.169955 Jun 04 21:44:24.788526 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3175/6249] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:24 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:25.810236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:25.811165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:25.819558 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:25.820048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:25.820815 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:25.821248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:25.965431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:25.973760 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8f84a814-809e-46ab-8c04-41083d69bbe0 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.170441 Jun 04 21:44:25.974349 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3075/6250] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:25 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:26.990825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:26.991542 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:26.998785 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:26.999254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:27.000068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:27.000527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:27.142149 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:27.150921 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-247275b5-eb9f-4b8f-9d6d-0327131bc78b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.164348 Jun 04 21:44:27.151496 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3176/6251] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:26 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:28.168459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:28.169095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:28.176479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:28.176934 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:28.177720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:28.178160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:28.321378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:28.329238 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-22d59baf-0e2d-48a0-9be2-6c8c3d2fea62 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.164738 Jun 04 21:44:28.329814 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3076/6252] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:28 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:28.523115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-b4cb6cf2-f93d-4598-8d5e-f3be5b7f1c0c req-b94a6386-c59f-42cf-b802-d0374c1188c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae7ccd9-0efe-4294-a0dd-ca33d06084b2", "name": "network-vif-plugged", "status": "completed", "tag": "76605e08-668c-4d25-8a65-239a66106d49"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:28.533249 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b4cb6cf2-f93d-4598-8d5e-f3be5b7f1c0c req-b94a6386-c59f-42cf-b802-d0374c1188c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:28.533721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-b4cb6cf2-f93d-4598-8d5e-f3be5b7f1c0c req-b94a6386-c59f-42cf-b802-d0374c1188c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:28.537986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:28.546107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-b4cb6cf2-f93d-4598-8d5e-f3be5b7f1c0c req-b94a6386-c59f-42cf-b802-d0374c1188c6 service nova] Creating event network-vif-plugged:76605e08-668c-4d25-8a65-239a66106d49 for instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 on nch1-master-1 Jun 04 21:44:28.551323 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-b4cb6cf2-f93d-4598-8d5e-f3be5b7f1c0c req-b94a6386-c59f-42cf-b802-d0374c1188c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032415 Jun 04 21:44:28.551962 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3177/6253] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:44:29.350916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:29.351968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:29.363290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:29.363770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:29.364551 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:29.364956 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:29.499645 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:29.507792 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d35a8dfa-107a-4c25-a7d9-9a13cc380ba5 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1317 microversion: 2.1 time: 0.163856 Jun 04 21:44:29.508372 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3077/6254] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:29 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:30.523543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:30.524370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:30.529423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:30.530156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:30.538060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:30.538524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:30.539312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:30.539791 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:30.691167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:30.699431 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5e11b22f-f21e-4c8d-908c-24f2a6de8527 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.178185 Jun 04 21:44:30.699986 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3178/6255] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:30 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:30.757734 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627920619", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "639acd82-0c31-4d95-9b91-4b7890f7da3d"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:30.769341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:30.772269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:30.814997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] validate_networks() for [('639acd82-0c31-4d95-9b91-4b7890f7da3d', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:44:31.591374 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:44:31.591821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:44:31.592301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:44:31.592709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:44:31.593119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:44:31.602750 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:31.603221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:31.604054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:31.604483 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:31.622411 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Getting quotas for project 0a78aca073fb4afaa48be967cb19c339. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:44:31.627930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Getting quotas for user c7aa4e4d238241e39839ce9a2f208bfa and project 0a78aca073fb4afaa48be967cb19c339. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:44:31.640871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:44:31.643148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:44:31.689452 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4be2d2cd-0d7b-409c-bb37-2b36a0696ba3 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936716 Jun 04 21:44:31.690121 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3078/6256] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:44:31.700280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d68b83ed-cf0f-4329-9abd-7fd58bfd5a1a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:31.700963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d68b83ed-cf0f-4329-9abd-7fd58bfd5a1a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:31.703801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:31.761093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d68b83ed-cf0f-4329-9abd-7fd58bfd5a1a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:31.768402 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d68b83ed-cf0f-4329-9abd-7fd58bfd5a1a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1216 microversion: 2.1 time: 0.072045 Jun 04 21:44:31.768988 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3179/6257] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:31 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:32.787113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:32.787775 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:32.795345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:32.795830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:32.796599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:32.797035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:32.860950 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:32.869232 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c67051ca-216b-420c-a624-19603dc286b8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1274 microversion: 2.1 time: 0.087153 Jun 04 21:44:32.870042 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3079/6258] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:32 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:33.886847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:33.888316 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:33.895832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:33.896879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:33.897845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:33.898464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:34.001564 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-ff35f89a-b2f2-44f2-affb-948a1728ac99 req-e7139cae-bb69-4016-9b9a-be84be81442b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10de0d34-137e-4d91-b2f6-3a79dd710cd7", "tag": "619d40dc-6460-4391-8fa0-27963b25845f"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:34.018321 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ff35f89a-b2f2-44f2-affb-948a1728ac99 req-e7139cae-bb69-4016-9b9a-be84be81442b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:34.019098 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-ff35f89a-b2f2-44f2-affb-948a1728ac99 req-e7139cae-bb69-4016-9b9a-be84be81442b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:34.034610 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-ff35f89a-b2f2-44f2-affb-948a1728ac99 req-e7139cae-bb69-4016-9b9a-be84be81442b service nova] Creating event network-changed:619d40dc-6460-4391-8fa0-27963b25845f for instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 on nch2-master-1 Jun 04 21:44:34.040628 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-ff35f89a-b2f2-44f2-affb-948a1728ac99 req-e7139cae-bb69-4016-9b9a-be84be81442b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044731 Jun 04 21:44:34.041643 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3080/6259] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:44:34.042326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:34.050470 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b14b03c3-cb44-44a4-b3d5-bb33f3b2944a tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.167867 Jun 04 21:44:34.054782 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3180/6260] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:33 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:35.068442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:35.069168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:35.077060 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:35.077507 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:35.078296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:35.078731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:35.244679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:35.253075 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-731da84b-1a88-4e9f-9382-347e35faf401 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.189142 Jun 04 21:44:35.253852 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3081/6261] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:35 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:36.274282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:36.274926 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:36.285256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:36.285918 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:36.287210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:36.287790 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:36.433422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:36.442442 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-261f9436-9b12-4fdb-adc8-407b125c85f8 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.174432 Jun 04 21:44:36.443191 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3181/6262] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:36 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:37.462731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:37.463536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:37.472458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:37.472999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:37.474144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:37.474795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:37.628003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:37.640377 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2c691381-2dc7-481b-b63f-bf8c165fad83 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.183276 Jun 04 21:44:37.641208 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3082/6263] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:37 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:38.658673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:38.659313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:38.666841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:38.667315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:38.668175 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:38.668638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:38.808227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:38.816291 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c899cd65-2210-4957-9ab5-2bbc0af0a605 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.161715 Jun 04 21:44:38.816884 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3182/6264] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:38 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:39.836664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:39.837450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:39.846779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:39.847347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:39.848351 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:39.848898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:39.993618 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:40.002015 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-28605308-b5ec-499a-9fbc-e0c8781e4b24 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.171206 Jun 04 21:44:40.002593 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3083/6265] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:39 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:40.683761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4dc72d99-9430-44e1-826b-30a0c6b189fa req-6a9a3bc0-0e05-4fc2-9888-260c00490603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10de0d34-137e-4d91-b2f6-3a79dd710cd7", "name": "network-vif-plugged", "status": "completed", "tag": "619d40dc-6460-4391-8fa0-27963b25845f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:40.695095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4dc72d99-9430-44e1-826b-30a0c6b189fa req-6a9a3bc0-0e05-4fc2-9888-260c00490603 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:40.695586 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4dc72d99-9430-44e1-826b-30a0c6b189fa req-6a9a3bc0-0e05-4fc2-9888-260c00490603 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:40.707396 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4dc72d99-9430-44e1-826b-30a0c6b189fa req-6a9a3bc0-0e05-4fc2-9888-260c00490603 service nova] Creating event network-vif-plugged:619d40dc-6460-4391-8fa0-27963b25845f for instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 on nch2-master-1 Jun 04 21:44:40.712564 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4dc72d99-9430-44e1-826b-30a0c6b189fa req-6a9a3bc0-0e05-4fc2-9888-260c00490603 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032608 Jun 04 21:44:40.713286 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3183/6266] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:44:41.024195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:41.025013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:41.036594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:41.037204 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:41.038003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:41.038441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:41.174150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:41.183707 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19a8c92a-4e9a-47ba-ae2a-1c22a676adbc tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1316 microversion: 2.1 time: 0.166798 Jun 04 21:44:41.184293 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3084/6267] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:41 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:42.205929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:42.207093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:42.211801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:42.221872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:42.222719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:42.224428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:42.224899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:42.376857 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:42.385724 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0dcdc85d-8249-4f71-b983-56a4581380f6 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1504 microversion: 2.1 time: 0.186999 Jun 04 21:44:42.386283 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3184/6268] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:42 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:42.402977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:42.403537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:42.405510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:42.406188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:42.413908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:42.414381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:42.415169 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:42.415631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:42.442036 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:44:42.526883 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7265be4-40a3-45ab-8d35-fb7ecd2826f7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "DELETE /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 204 len: 0 microversion: 2.1 time: 0.127514 Jun 04 21:44:42.527573 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3085/6269] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:42 2022] DELETE /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:44:42.536833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:42.537508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:42.543968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:42.544439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:42.545231 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:42.545690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:42.681516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:42.689885 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4e23da97-29a2-4010-a306-5ab4f4b5ff87 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1510 microversion: 2.1 time: 0.157267 Jun 04 21:44:42.690466 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3185/6270] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:42 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:44:43.710133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:43.710901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:43.718865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:43.719314 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:43.720120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:43.720550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:43.858220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:43.866274 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4716fcd5-2b35-409e-b9ff-aaa5dac1e0f2 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 200 len: 1510 microversion: 2.1 time: 0.161140 Jun 04 21:44:43.866857 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3086/6271] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:43 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:44.245680 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ce35fac0-8497-44bd-8f44-590e339c358f req-fa6d07a1-b356-455b-a8ee-690eeee1d4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10de0d34-137e-4d91-b2f6-3a79dd710cd7", "name": "network-vif-deleted", "tag": "619d40dc-6460-4391-8fa0-27963b25845f"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:44.257515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ce35fac0-8497-44bd-8f44-590e339c358f req-fa6d07a1-b356-455b-a8ee-690eeee1d4f5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:44.258355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ce35fac0-8497-44bd-8f44-590e339c358f req-fa6d07a1-b356-455b-a8ee-690eeee1d4f5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:44.271101 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ce35fac0-8497-44bd-8f44-590e339c358f req-fa6d07a1-b356-455b-a8ee-690eeee1d4f5 service nova] Creating event network-vif-deleted:619d40dc-6460-4391-8fa0-27963b25845f for instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 on nch2-master-1 Jun 04 21:44:44.277085 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ce35fac0-8497-44bd-8f44-590e339c358f req-fa6d07a1-b356-455b-a8ee-690eeee1d4f5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035048 Jun 04 21:44:44.278060 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3186/6272] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:44:44.886288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:44.887076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:44.897252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:44.897859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:44.898816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:44.899249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:44.913991 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] HTTP exception thrown: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 HTTP/1.1 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '10de0d34-137e-4d91-b2f6-3a79dd710cd7'} Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:44.915702 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 404 to user: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-43527271-fa83-485a-8fd4-7432a8b22432 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 404 len: 111 microversion: 2.1 time: 0.036455 Jun 04 21:44:44.921436 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3087/6273] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:44 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:44.927075 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:44.927828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:44.935046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:44.935550 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:44.936334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:44.936778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.080321 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:45.088545 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87e9419d-5c26-40a7-87a9-c7c1186ad445 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.165874 Jun 04 21:44:45.089126 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3187/6274] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:44 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:44:45.105122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77bbcf5f-ce99-4e4a-bc0c-3a7cd66f680d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:45.106177 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-77bbcf5f-ce99-4e4a-bc0c-3a7cd66f680d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: ee6e7986-055e-4ce1-8b01-30afa88a1844] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.112238 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-77bbcf5f-ce99-4e4a-bc0c-3a7cd66f680d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] HTTP exception thrown: Instance ee6e7986-055e-4ce1-8b01-30afa88a1844 could not be found. Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77bbcf5f-ce99-4e4a-bc0c-3a7cd66f680d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/ee6e7986-055e-4ce1-8b01-30afa88a1844/action HTTP/1.1 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 32 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: {"resize": {"flavorRef": "452"}} Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance ee6e7986-055e-4ce1-8b01-30afa88a1844 could not be found. Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'ee6e7986-055e-4ce1-8b01-30afa88a1844', 'body': {'resize': {'flavorRef': '452'}}} Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6e7986-055e-4ce1-8b01-30afa88a1844 could not be found. Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:45.113852 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6e7986-055e-4ce1-8b01-30afa88a1844 could not be found. Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6e7986-055e-4ce1-8b01-30afa88a1844 could not be found. Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-77bbcf5f-ce99-4e4a-bc0c-3a7cd66f680d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 404 to user: Instance ee6e7986-055e-4ce1-8b01-30afa88a1844 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-77bbcf5f-ce99-4e4a-bc0c-3a7cd66f680d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "POST /compute/v2.1/servers/ee6e7986-055e-4ce1-8b01-30afa88a1844/action" status: 404 len: 111 microversion: 2.1 time: 0.014220 Jun 04 21:44:45.122291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3088/6275] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:44:45 2022] POST /compute/v2.1/servers/ee6e7986-055e-4ce1-8b01-30afa88a1844/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:45.124593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:45.125534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.134155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.134630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.135421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.135910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.287390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:45.295964 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-66b637f6-fd1e-4266-b899-a9d37c30911b tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.175591 Jun 04 21:44:45.296554 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3188/6276] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:45 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:44:45.313639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:45.314327 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.321823 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.322284 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.323050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.323484 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.463251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:45.471867 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-68fd4c3c-f309-4195-8a46-ea1625d99151 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.162059 Jun 04 21:44:45.472461 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3089/6277] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:45 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:45.489236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "f0bbef69-bf56-48d7-b7eb-e1bd4b68204a"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:45.490170 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.497610 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.498077 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.498861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.499308 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.531795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:45.537168 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] HTTP exception thrown: Flavor f0bbef69-bf56-48d7-b7eb-e1bd4b68204a could not be found. Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: request: POST /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2/action HTTP/1.1 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 65 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: {"resize": {"flavorRef": "f0bbef69-bf56-48d7-b7eb-e1bd4b68204a"}} Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: exception: Flavor f0bbef69-bf56-48d7-b7eb-e1bd4b68204a could not be found. Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': 'cae7ccd9-0efe-4294-a0dd-ca33d06084b2', 'body': {'resize': {'flavorRef': 'f0bbef69-bf56-48d7-b7eb-e1bd4b68204a'}}} Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 04 21:44:45.545846 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f0bbef69-bf56-48d7-b7eb-e1bd4b68204a could not be found. Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor f0bbef69-bf56-48d7-b7eb-e1bd4b68204a could not be found. Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f0bbef69-bf56-48d7-b7eb-e1bd4b68204a could not be found. Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 400 to user: Flavor f0bbef69-bf56-48d7-b7eb-e1bd4b68204a could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e69313f7-1e26-4635-9449-22b3cad342a4 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "POST /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2/action" status: 400 len: 107 microversion: 2.1 time: 0.062248 Jun 04 21:44:45.550500 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3189/6278] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:44:45 2022] POST /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2/action => generated 107 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:44:45.556616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:45.557381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.564174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.564637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.565416 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.565858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.718631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:45.723882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:44:45.730557 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-59fd2768-7fb7-4053-8fdc-ede91608bc94 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.177718 Jun 04 21:44:45.731322 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3090/6279] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:45 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:45.752035 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:45.752634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.759128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.759624 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.760447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.760884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.906826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:45.916188 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4bf41f9-bc5b-46c1-a977-093dcd3af64e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.168216 Jun 04 21:44:45.916819 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3190/6280] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:45 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:45.938136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d41555e4-d33e-4986-bd18-f9be98cac354 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d41555e4-d33e-4986-bd18-f9be98cac354 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: request: POST /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2/action HTTP/1.1 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 29 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: {"resize": {"flavorRef": ""}} Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'cae7ccd9-0efe-4294-a0dd-ca33d06084b2', 'body': {'resize': {'flavorRef': ''}}} Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise error Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi On instance['resize']: Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi '' Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.940510 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d41555e4-d33e-4986-bd18-f9be98cac354 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d41555e4-d33e-4986-bd18-f9be98cac354 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "POST /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2/action" status: 400 len: 113 microversion: 2.1 time: 0.008231 Jun 04 21:44:45.946056 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3091/6281] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:44:45 2022] POST /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 04 21:44:45.952567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:45.953200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:45.959823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.960291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:45.961080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:45.961532 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.105916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:46.114072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c08eb501-872a-40da-a518-fc2c6f5fc81d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1505 microversion: 2.1 time: 0.165451 Jun 04 21:44:46.114658 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3191/6282] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:45 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:46.137174 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:46.137712 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:46.145426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.145877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.147197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.147650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.164282 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] HTTP exception thrown: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 HTTP/1.1 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '10de0d34-137e-4d91-b2f6-3a79dd710cd7'} Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:46.165901 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 404 to user: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-94214fe6-1c15-4139-bfdf-24f13762bbe7 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "DELETE /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 404 len: 111 microversion: 2.1 time: 0.035965 Jun 04 21:44:46.174516 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3092/6283] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:46 2022] DELETE /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:46.178702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:46.179409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: 10de0d34-137e-4d91-b2f6-3a79dd710cd7] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:46.186196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.186664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.187442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.187924 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.201952 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] HTTP exception thrown: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 HTTP/1.1 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '10de0d34-137e-4d91-b2f6-3a79dd710cd7'} Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:46.203544 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 404 to user: Instance 10de0d34-137e-4d91-b2f6-3a79dd710cd7 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db9c31b2-7a21-447b-a943-12bbdb8c0755 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7" status: 404 len: 111 microversion: 2.1 time: 0.031810 Jun 04 21:44:46.208894 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3192/6284] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:46 2022] GET /compute/v2.1/servers/10de0d34-137e-4d91-b2f6-3a79dd710cd7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:44:46.213765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:46.214275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:46.220537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.220991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.221772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.222216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.249499 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:44:46.335536 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a0137153-ce49-4b44-9c26-db2486756fcd tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "DELETE /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 204 len: 0 microversion: 2.1 time: 0.125524 Jun 04 21:44:46.336168 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3093/6285] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:44:46 2022] DELETE /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:44:46.345578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:46.346204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:46.354549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.355167 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.356024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:46.356476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:46.500449 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:46.512007 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37215508-fd03-413d-8d03-2e789540843e tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1511 microversion: 2.1 time: 0.170588 Jun 04 21:44:46.512559 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3193/6286] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:46 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:47.531627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:47.532279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:47.539539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:47.540053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:47.540832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:47.541276 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:47.679814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:47.688440 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b0faa38c-20ae-4925-bdfa-b36c05336b12 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1511 microversion: 2.1 time: 0.161249 Jun 04 21:44:47.689297 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3094/6287] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:47 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:48.706256 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:48.706967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:48.718520 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:48.719005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:48.719810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:48.721016 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:48.779168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d5210c46-a32c-4615-9bf5-aebc894a7e0f req-7e67b923-90a7-4def-a888-0061e4ba3fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cae7ccd9-0efe-4294-a0dd-ca33d06084b2", "name": "network-vif-deleted", "tag": "76605e08-668c-4d25-8a65-239a66106d49"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:44:48.789331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d5210c46-a32c-4615-9bf5-aebc894a7e0f req-7e67b923-90a7-4def-a888-0061e4ba3fbf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:48.789769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d5210c46-a32c-4615-9bf5-aebc894a7e0f req-7e67b923-90a7-4def-a888-0061e4ba3fbf service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:48.799202 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7aa4e4d238241e39839ce9a2f208bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a78aca073fb4afaa48be967cb19c339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:44:48.802154 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d5210c46-a32c-4615-9bf5-aebc894a7e0f req-7e67b923-90a7-4def-a888-0061e4ba3fbf service nova] Creating event network-vif-deleted:76605e08-668c-4d25-8a65-239a66106d49 for instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 on nch1-master-1 Jun 04 21:44:48.808075 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d5210c46-a32c-4615-9bf5-aebc894a7e0f req-7e67b923-90a7-4def-a888-0061e4ba3fbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032581 Jun 04 21:44:48.808771 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3095/6288] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:44:48.809234 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6ca09ba0-42b5-4b9c-b21f-db3dfa41af26 tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 200 len: 1469 microversion: 2.1 time: 0.106991 Jun 04 21:44:48.810048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3194/6289] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:48 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 1469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:44:49.831417 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:44:49.832186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] [instance: cae7ccd9-0efe-4294-a0dd-ca33d06084b2] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:44:49.841016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:49.841471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:49.842245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:44:49.842683 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:44:49.857375 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] HTTP exception thrown: Instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 could not be found. Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Request method failure captured: Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 HTTP/1.1 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9Izo0I-dZG-ZGhAe3A4v4y6BGYe0w_5vihClz6W8qYAlWtBV7s48BVMcDaICA18_u_vtMw6VpYmmIoGxIJWROTnCRN9tpxxHW_GeaG-0NRljSS1bh9SGPvpaMM2MTfT9pX5dqtxp8x1Xmmu2wm4vSr7vjZ5cz2HoCWfHvhmv9aXNpM Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0a78aca073fb4afaa48be967cb19c339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0a78aca073fb4afaa48be967cb19c339 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2040957412 Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: c7aa4e4d238241e39839ce9a2f208bfa Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-ServersNegativeTestJSON-2040957412-project Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 could not be found. Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'cae7ccd9-0efe-4294-a0dd-ca33d06084b2'} Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 could not be found. Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 could not be found. Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:44:49.859024 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 could not be found. Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] Returning 404 to user: Instance cae7ccd9-0efe-4294-a0dd-ca33d06084b2 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ee3b78fb-e497-4ff6-a25a-986fd9e7793d tempest-ServersNegativeTestJSON-2040957412 tempest-ServersNegativeTestJSON-2040957412-project] 10.222.0.18 "GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2" status: 404 len: 111 microversion: 2.1 time: 0.037321 Jun 04 21:44:49.864755 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3096/6290] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:44:49 2022] GET /compute/v2.1/servers/cae7ccd9-0efe-4294-a0dd-ca33d06084b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:45:29.099330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d408afc2-8fc5-4f67-8a07-4d727576af64 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Action: 'create', calling method: .version_select at 0x7f2d0bd49af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1652273223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8GkNxKPNpdax9CacDDNcPN31VhzXzqxTBwVDqoUeRsoJ+VWdjTpepMlSkhuycb+qt7NS3anO0tuhxWXR9YPakv7Zbp0nNelaTa7q9MZXKs08BA3P384Yl7WtWy5GMhKQ=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:29.106619 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=35 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:29.107293 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=83 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:29.119377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d408afc2-8fc5-4f67-8a07-4d727576af64 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Getting quotas for project 0664a859e40746a59c5cf6e6c0c6a1b3. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:45:29.124749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-d408afc2-8fc5-4f67-8a07-4d727576af64 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Getting quotas for user 4a7dbe74559048949cdf5658d15925c6 and project 0664a859e40746a59c5cf6e6c0c6a1b3. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:45:29.138719 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d408afc2-8fc5-4f67-8a07-4d727576af64 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [cc3f508e-fc49-493a-b29b-5d8fc3cf99f0] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 21:45:30.147434 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [None req-d408afc2-8fc5-4f67-8a07-4d727576af64 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [cc3f508e-fc49-493a-b29b-5d8fc3cf99f0] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 49988. Jun 04 21:45:30.164586 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d408afc2-8fc5-4f67-8a07-4d727576af64 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.077896 Jun 04 21:45:30.165205 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3195/6291] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:45:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:45:30.225132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1390958449", "imageRef": "34b2fbd1-02fa-48fc-8052-052a6c00a585", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1652273223", "networks": [{"uuid": "ff8c48e0-2d2e-435b-aabe-602f8b52e95f"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:30.235159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:30.235896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:30.287361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] validate_networks() for [('ff8c48e0-2d2e-435b-aabe-602f8b52e95f', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:45:30.696760 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:45:30.697191 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:45:30.697670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:45:30.698086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:45:30.698482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:45:30.708748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:30.709201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:30.710006 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:30.710449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:30.729108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Getting quotas for project 0664a859e40746a59c5cf6e6c0c6a1b3. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:45:30.735136 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Getting quotas for user 4a7dbe74559048949cdf5658d15925c6 and project 0664a859e40746a59c5cf6e6c0c6a1b3. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:45:30.748477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:45:30.750778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='34b2fbd1-02fa-48fc-8052-052a6c00a585',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:45:30.800367 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a924add0-42c8-476c-93bd-a6a5610eb220 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582039 Jun 04 21:45:30.801211 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3097/6292] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:45:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:45:30.811776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2a4de711-3b5d-4886-b2ff-5615ad324556 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:30.812418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2a4de711-3b5d-4886-b2ff-5615ad324556 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:30.874299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2a4de711-3b5d-4886-b2ff-5615ad324556 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:30.882461 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2a4de711-3b5d-4886-b2ff-5615ad324556 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1259 microversion: 2.1 time: 0.074972 Jun 04 21:45:30.883070 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3196/6293] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:30 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1259 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:31.901215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:31.901839 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:31.914017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:31.914473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:31.915456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:31.915936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:31.985576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:31.994285 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79c9a3bc-720d-43bc-8d26-ccb6de4a9025 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1317 microversion: 2.1 time: 0.097502 Jun 04 21:45:31.994976 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3098/6294] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:31 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:33.014185 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:33.023186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:33.031486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:33.032704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:33.033604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:33.034144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:33.176729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:33.184825 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fa197480-7e3d-4c4b-a1c9-2ab3bc0d5523 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.175911 Jun 04 21:45:33.185572 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3197/6295] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:33 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:34.203567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:34.204267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:34.214031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:34.214554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:34.215318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:34.216152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:34.368884 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:34.377071 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-30da15c3-ea1d-4982-8dce-4ede952d9653 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.178265 Jun 04 21:45:34.377671 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3099/6296] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:34 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:35.400280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:35.401280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:35.410873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:35.410873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:35.411302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:35.411878 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:35.601068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:35.610238 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ddb8bbfe-3fa1-4d81-8cc8-5ec118dccbd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.218703 Jun 04 21:45:35.611194 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3198/6297] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:35 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:36.628842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:36.629556 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:36.637263 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:36.637763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:36.638733 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:36.639176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:36.791669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:36.801086 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ce07e3fd-1a87-4e19-b317-55d52bf6d21d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.176311 Jun 04 21:45:36.801702 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3100/6298] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:36 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:37.820082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:37.820722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:37.829314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:37.829817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:37.830635 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:37.831128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:37.982793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:37.990692 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2cdcb04-d434-4122-a147-f8672eeec378 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.174780 Jun 04 21:45:37.991277 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3199/6299] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:37 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:39.009613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:39.011211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:39.020092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:39.020680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:39.022003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:39.022450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:39.177349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:39.186007 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-075b0ee7-9f77-4a24-876a-054231472cb4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.181017 Jun 04 21:45:39.187069 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3101/6300] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:39 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:40.202794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:40.203450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:40.211353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:40.211859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:40.212705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:40.213197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:40.363470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:40.371360 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-195e2b26-e97b-4ab4-bd4c-c5270784b29b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.172722 Jun 04 21:45:40.371963 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3200/6301] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:40 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:41.388694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:41.389322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:41.392238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:41.392969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:41.400642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:41.401242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:41.402022 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:41.402583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:41.547119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:41.555875 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-08186006-f703-4a85-aa3c-32014af1aaa8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.170921 Jun 04 21:45:41.556521 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3102/6302] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:41 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:41.680690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d43274a3-8cfa-40cc-bb7c-9f1eedd0d4d7 req-423b2dee-d889-4bdf-b6ca-b18ac77fc477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:41.684289 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:45:41.710497 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d43274a3-8cfa-40cc-bb7c-9f1eedd0d4d7 req-423b2dee-d889-4bdf-b6ca-b18ac77fc477 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:41.711229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d43274a3-8cfa-40cc-bb7c-9f1eedd0d4d7 req-423b2dee-d889-4bdf-b6ca-b18ac77fc477 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:41.724319 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-d43274a3-8cfa-40cc-bb7c-9f1eedd0d4d7 req-423b2dee-d889-4bdf-b6ca-b18ac77fc477 service nova] Creating event network-changed:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:45:41.738218 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d43274a3-8cfa-40cc-bb7c-9f1eedd0d4d7 req-423b2dee-d889-4bdf-b6ca-b18ac77fc477 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061226 Jun 04 21:45:41.739018 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3201/6303] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:45:42.578400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:42.579069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:42.586649 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:42.587112 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:42.587940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:42.588388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:42.727664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:42.735823 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ed5753b-4bec-4945-ae91-bb2381995885 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.164350 Jun 04 21:45:42.736403 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3103/6304] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:42 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:43.757323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:43.758117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:43.765841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:43.766351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:43.767300 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:43.767832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:43.918122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:43.927713 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-19d00b44-5636-4b59-9009-67b3e671ff00 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.176207 Jun 04 21:45:43.928300 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3202/6305] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:43 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:44.945567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:44.946193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:44.953528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:44.953991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:44.954954 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:44.955405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:45.108867 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:45.116571 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e7e42733-3b5d-4926-91a2-833ab519e677 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.175110 Jun 04 21:45:45.117162 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3104/6306] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:44 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:46.135731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:46.136370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:46.144347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:46.145030 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:46.145669 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:46.146132 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:46.588457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:46.596656 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-578d48ce-1db5-49c8-bd9f-92bbceebdfe6 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.464965 Jun 04 21:45:46.597239 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3203/6307] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:46 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:46.814895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-442e7861-1e34-4aab-9d0e-10bb60e3ce4a req-9448922a-9279-4a58-8140-33e754b86b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "name": "network-vif-plugged", "status": "completed", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:46.824237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-442e7861-1e34-4aab-9d0e-10bb60e3ce4a req-9448922a-9279-4a58-8140-33e754b86b6b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:46.824628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-442e7861-1e34-4aab-9d0e-10bb60e3ce4a req-9448922a-9279-4a58-8140-33e754b86b6b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:46.836990 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-442e7861-1e34-4aab-9d0e-10bb60e3ce4a req-9448922a-9279-4a58-8140-33e754b86b6b service nova] Creating event network-vif-plugged:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:45:46.842191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-442e7861-1e34-4aab-9d0e-10bb60e3ce4a req-9448922a-9279-4a58-8140-33e754b86b6b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031145 Jun 04 21:45:46.842988 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3105/6308] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:45:47.613947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:47.614492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:47.622038 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:47.622505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:47.623286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:47.623772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:47.765568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:47.774241 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3affb326-01dd-45dc-9d08-a0480489c685 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1359 microversion: 2.1 time: 0.164454 Jun 04 21:45:47.774817 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3204/6309] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:47 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:48.798360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:48.799980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:48.811030 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:48.811810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:48.813133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:48.813860 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:48.952337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:48.960247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6a2de827-e704-4d3d-b2dc-9ca97f6058a4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1548 microversion: 2.1 time: 0.170496 Jun 04 21:45:48.960830 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3106/6310] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:48 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:48.976871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:48.977508 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:48.985259 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:48.985726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:48.986503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:48.987157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:49.125627 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:49.134234 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-98098c89-3f3c-4fe2-818e-b9196be839bd tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1548 microversion: 2.1 time: 0.161314 Jun 04 21:45:49.134829 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3205/6311] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:48 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:49.153959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:49.157511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:49.158420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Searching by: {'deleted': False, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3'} {{(pid=137229) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 04 21:45:49.165049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:49.165686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:49.166382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:49.166831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:49.191425 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.multi_cell_list [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137229) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 04 21:45:49.219151 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1d372c22-391f-4f54-a073-8e271bad4e46 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069195 Jun 04 21:45:49.219784 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3107/6312] 10.222.0.18 () {58 vars in 1124 bytes} [Sat Jun 4 21:45:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:45:49.230111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:49.230736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:49.237000 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:49.237455 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:49.238225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:49.238685 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:49.381524 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:49.389367 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9011a2bb-2e6d-4fb3-a406-8d0cf456b90a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1548 microversion: 2.1 time: 0.163114 Jun 04 21:45:49.389938 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3206/6313] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:49 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:50.945120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "472cdb18-8fee-48d0-a481-1de21f03a120"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:50.946197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:50.953202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:50.953644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:50.954428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:50.954861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:51.211959 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f091e59a-a1da-40d7-95e4-6a3162649dd0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270743 Jun 04 21:45:51.212595 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3108/6314] 10.222.0.18 () {60 vars in 1322 bytes} [Sat Jun 4 21:45:50 2022] POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:45:54.586503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:54.587128 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:54.594536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:54.594997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:54.595882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:54.596351 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:54.739238 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:54.748025 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-144b43eb-63b0-44a5-ad6f-694d65c8d635 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1594 microversion: 2.1 time: 0.165704 Jun 04 21:45:54.748611 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3207/6315] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:54 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:56.578120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-d7bb099e-fe68-475d-84c3-6202eab50e62 req-97cef1f4-7ee0-4816-a5ab-80d35d11531e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:56.586814 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d7bb099e-fe68-475d-84c3-6202eab50e62 req-97cef1f4-7ee0-4816-a5ab-80d35d11531e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:56.587546 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-d7bb099e-fe68-475d-84c3-6202eab50e62 req-97cef1f4-7ee0-4816-a5ab-80d35d11531e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:56.599951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-d7bb099e-fe68-475d-84c3-6202eab50e62 req-97cef1f4-7ee0-4816-a5ab-80d35d11531e service nova] Creating event network-changed:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:45:56.605780 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-d7bb099e-fe68-475d-84c3-6202eab50e62 req-97cef1f4-7ee0-4816-a5ab-80d35d11531e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032916 Jun 04 21:45:56.606404 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3109/6316] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:45:57.698656 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2992546"}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:57.699245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:57.706696 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:57.707168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:57.708055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:57.708604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:57.849814 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.network.security_group_api [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Adding security group d92d3c56-05b6-4551-bfdc-dd7d233af24b to port 0549b9c1-d5e5-427c-ba07-75bab07264ac Jun 04 21:45:58.307988 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dccb7fd9-ec7e-4c51-af57-511cc2593dc4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/action" status: 202 len: 0 microversion: 2.1 time: 0.613306 Jun 04 21:45:58.309365 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3208/6317] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:45:57 2022] POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:45:58.321912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:45:58.324519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:45:58.335361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:58.335746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:58.336674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:58.343849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:58.505280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:45:58.514083 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dc4a35d9-733d-4557-8e0d-7202c78c0b5a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1757 microversion: 2.1 time: 0.200262 Jun 04 21:45:58.525815 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3110/6318] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:45:58 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:45:58.622774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ef009bfd-6877-4fe4-93ae-249e4945e9ac req-7d8d9565-4182-4b30-b2af-da4ec4933781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:45:58.632278 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ef009bfd-6877-4fe4-93ae-249e4945e9ac req-7d8d9565-4182-4b30-b2af-da4ec4933781 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:45:58.632819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ef009bfd-6877-4fe4-93ae-249e4945e9ac req-7d8d9565-4182-4b30-b2af-da4ec4933781 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:45:58.644947 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-ef009bfd-6877-4fe4-93ae-249e4945e9ac req-7d8d9565-4182-4b30-b2af-da4ec4933781 service nova] Creating event network-changed:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:45:58.650799 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ef009bfd-6877-4fe4-93ae-249e4945e9ac req-7d8d9565-4182-4b30-b2af-da4ec4933781 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031814 Jun 04 21:45:58.653471 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3209/6319] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:46:21.851845 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:46:21.853147 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:21.856730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:21.858050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:21.858691 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:21.873894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:21.874489 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:21.875746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:21.876198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:21.957011 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52aa4a03-fd55-4e5f-a0d6-e0fbb739cb21 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/action" status: 202 len: 0 microversion: 2.1 time: 0.111482 Jun 04 21:46:21.957712 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3111/6320] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:46:21 2022] POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:46:21.964796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:21.965591 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=68 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:46:21.970863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:21.972079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:21.980668 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:21.981131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:21.982018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:21.982511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:22.141407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:22.150134 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-746199c9-2669-4189-b928-429b90098a68 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1749 microversion: 2.1 time: 0.187881 Jun 04 21:46:22.150687 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3210/6321] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:21 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:46:23.170761 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:23.171457 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:23.178719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:23.179143 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:23.179976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:23.180408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:23.332946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:23.341738 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aee84416-9434-4b48-9fab-1c6cce179ed0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.176179 Jun 04 21:46:23.342317 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3112/6322] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:23 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:24.359671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:24.360958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:24.368653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:24.369123 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:24.369919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:24.370368 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:24.525522 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:24.534221 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e91b4c6f-2475-41be-bf9b-a14350b75108 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.178552 Jun 04 21:46:24.534800 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3211/6323] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:24 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:25.552458 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:25.553050 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:25.560440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:25.560812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:25.561579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:25.562011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:25.713707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:25.723101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-16854383-eeca-4b04-81d8-c9985f542de0 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.175022 Jun 04 21:46:25.723698 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3113/6324] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:25 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:26.743954 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:26.744900 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:26.754240 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:26.754705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:26.755533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:26.756013 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:26.916743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:26.927123 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a9ab5b3e-33f9-4c05-96ce-f76f488f585f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.189466 Jun 04 21:46:26.927733 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3212/6325] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:26 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:27.954324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:27.954996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:27.962503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:27.962953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:27.963762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:27.964224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:28.132570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:28.145109 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd932cba-a2ce-46ac-a721-0c9f1fb8109f tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.197083 Jun 04 21:46:28.146053 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3114/6326] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:27 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:29.172195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:29.173480 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:29.181404 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:29.181889 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:29.182719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:29.183237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:29.338461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:29.346995 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5eff3bb7-5d2b-4bd3-8f85-1b5800be2616 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.181566 Jun 04 21:46:29.347580 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3213/6327] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:29 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:30.368886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:30.370005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:30.380048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:30.380500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:30.381288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:30.381727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:30.546981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:30.555730 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-32c1186e-715f-43ac-ad0f-e5953f3e4cc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.193455 Jun 04 21:46:30.556356 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3115/6328] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:30 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:31.580327 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:31.581089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:31.588475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:31.588951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:31.589768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:31.590218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:31.736665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:31.745516 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-67255cf6-7642-4e5e-aa78-7ca382a8b136 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.172175 Jun 04 21:46:31.746097 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3214/6329] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:31 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:32.765061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:32.765662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:32.776742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:32.777346 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:32.778420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:32.778958 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:32.939064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:32.949226 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-52e4a42c-62db-47d3-8ee4-10481e5df9ce tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.188149 Jun 04 21:46:32.949809 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3116/6330] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:32 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:33.973757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:33.974746 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:33.986482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:33.986961 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:33.987781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:33.988230 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:34.135216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:34.144594 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-45be768e-4ac9-483f-b2e6-7579f2e4c0d1 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.178113 Jun 04 21:46:34.145170 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3215/6331] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:33 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:35.167473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:35.168447 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:35.178027 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:35.178468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:35.179240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:35.179714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:35.348749 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:35.357909 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0398d775-d112-4af3-9bc2-b74b14a882c2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.198216 Jun 04 21:46:35.358498 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3117/6332] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:35 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:36.376960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:36.377585 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:36.385365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:36.385840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:36.386640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:36.387096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:36.547815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:36.559555 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-39d646fd-4a9b-4a96-ad74-598d094f2029 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.186627 Jun 04 21:46:36.560361 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3216/6333] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:36 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:37.579715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:37.580363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:37.587707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:37.588158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:37.588924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:37.589360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:37.737162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:37.745966 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cacfb427-0178-49a2-a7f7-613014324f3c tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1754 microversion: 2.1 time: 0.171408 Jun 04 21:46:37.746534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3118/6334] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:37 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:46:38.768795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:46:38.769827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:46:38.782593 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:38.783551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:38.784505 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:46:38.784962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:46:38.937544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:46:38.946719 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-217995e4-4eec-4015-9282-0903895abc4d tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1757 microversion: 2.1 time: 0.184549 Jun 04 21:46:38.947299 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3217/6335] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:46:38 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:10.974758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2992546"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:10.975361 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:10.979016 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:10.979693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:10.985434 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:10.985908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:10.986684 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:10.987115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:11.125230 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.network.security_group_api [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Removing security group d92d3c56-05b6-4551-bfdc-dd7d233af24b from port 0549b9c1-d5e5-427c-ba07-75bab07264ac Jun 04 21:47:11.540242 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-743eca38-c66b-4c20-a7ec-56b1cb95b431 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/action" status: 202 len: 0 microversion: 2.1 time: 0.571952 Jun 04 21:47:11.540862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3119/6336] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:47:10 2022] POST /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:47:11.562882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=16 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:11.563818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=48 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:11.817771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-dcb64652-c7a6-4e5a-964d-b473d0214529 req-e21afa6d-6249-414b-b98a-ef6602adc734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:11.827874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dcb64652-c7a6-4e5a-964d-b473d0214529 req-e21afa6d-6249-414b-b98a-ef6602adc734 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:11.828572 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dcb64652-c7a6-4e5a-964d-b473d0214529 req-e21afa6d-6249-414b-b98a-ef6602adc734 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:11.840672 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dcb64652-c7a6-4e5a-964d-b473d0214529 req-e21afa6d-6249-414b-b98a-ef6602adc734 service nova] Creating event network-changed:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:47:11.846151 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-dcb64652-c7a6-4e5a-964d-b473d0214529 req-e21afa6d-6249-414b-b98a-ef6602adc734 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298030 Jun 04 21:47:11.846713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3218/6337] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:12.996877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:12.997430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:13.003951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:13.004401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:13.005176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:13.005590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:13.096471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lazy-loading 'services' on Instance uuid 4b87722c-8c77-473d-9670-933a7265debe {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:47:13.175346 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-178ca600-8ec3-4919-ae0d-9aae8415644e tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments/472cdb18-8fee-48d0-a481-1de21f03a120" status: 202 len: 0 microversion: 2.1 time: 0.184059 Jun 04 21:47:13.176267 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3120/6338] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:47:12 2022] DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments/472cdb18-8fee-48d0-a481-1de21f03a120 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:47:13.186779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:13.187839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:13.195766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:13.196224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:13.197093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:13.198087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:13.233666 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8303b235-1c37-40bf-9296-36bf2102eea9 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052910 Jun 04 21:47:13.238025 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3219/6339] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:47:13 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:13.865525 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8aea0b13-a492-463e-a198-3099af68b8d7 req-6cad3be2-cba0-4a67-9992-5fd0ea0602cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:13.874846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8aea0b13-a492-463e-a198-3099af68b8d7 req-6cad3be2-cba0-4a67-9992-5fd0ea0602cb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:13.875585 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8aea0b13-a492-463e-a198-3099af68b8d7 req-6cad3be2-cba0-4a67-9992-5fd0ea0602cb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:13.891480 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8aea0b13-a492-463e-a198-3099af68b8d7 req-6cad3be2-cba0-4a67-9992-5fd0ea0602cb service nova] Creating event network-changed:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:47:13.896925 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8aea0b13-a492-463e-a198-3099af68b8d7 req-6cad3be2-cba0-4a67-9992-5fd0ea0602cb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036902 Jun 04 21:47:13.897550 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3121/6340] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:14.246469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:14.247575 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:14.254937 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:14.255407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:14.256226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:14.256677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:14.290622 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3b0a7235-f500-499f-84a6-7d702fe18dc8 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048525 Jun 04 21:47:14.291419 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3220/6341] 10.222.0.18 () {58 vars in 1301 bytes} [Sat Jun 4 21:47:14 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 04 21:47:14.303655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:14.304248 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:14.311049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:14.311500 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:14.312288 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:14.312723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:14.402348 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] HTTP exception thrown: Instance 4b87722c-8c77-473d-9670-933a7265debe is not attached to volume 472cdb18-8fee-48d0-a481-1de21f03a120 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Request method failure captured: Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: request: DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments/472cdb18-8fee-48d0-a481-1de21f03a120 HTTP/1.1 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9JqtGVZzS_6B1U9O7uFzcT4ygV7O4QVqpuJJnx2X-_acVytpybYEkxWlFZutiVObmoK4p0AJqAFhgPX_lLyhWSpF8bpN5rQjcaa3yQaxQ-lIQoqy5l5FIhG04xgSBX1IU8IfOMXxtwWyAWZSeVHomvVf-8rbGUnhdo1D0izXOXfcbA Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0664a859e40746a59c5cf6e6c0c6a1b3 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestMinimumBasicScenario-1027701286 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestMinimumBasicScenario-1027701286 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0664a859e40746a59c5cf6e6c0c6a1b3 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1027701286 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestMinimumBasicScenario-1027701286-project Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 4a7dbe74559048949cdf5658d15925c6 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestMinimumBasicScenario-1027701286-project Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4b87722c-8c77-473d-9670-933a7265debe is not attached to volume 472cdb18-8fee-48d0-a481-1de21f03a120 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'server_id': '4b87722c-8c77-473d-9670-933a7265debe', 'id': '472cdb18-8fee-48d0-a481-1de21f03a120'} Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 472cdb18-8fee-48d0-a481-1de21f03a120. Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b87722c-8c77-473d-9670-933a7265debe is not attached to volume 472cdb18-8fee-48d0-a481-1de21f03a120 Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:47:14.409984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b87722c-8c77-473d-9670-933a7265debe is not attached to volume 472cdb18-8fee-48d0-a481-1de21f03a120 Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Returning 404 to user: Instance 4b87722c-8c77-473d-9670-933a7265debe is not attached to volume 472cdb18-8fee-48d0-a481-1de21f03a120 {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-14248269-e7d9-47e5-bb3d-cc2b3d2bc393 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments/472cdb18-8fee-48d0-a481-1de21f03a120" status: 404 len: 154 microversion: 2.1 time: 0.113759 Jun 04 21:47:14.413668 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3122/6342] 10.222.0.18 () {58 vars in 1415 bytes} [Sat Jun 4 21:47:14 2022] DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe/os-volume_attachments/472cdb18-8fee-48d0-a481-1de21f03a120 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:47:15.572376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:15.572917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:15.584536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:15.585177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:15.586495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:15.587101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:15.614521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:47:15.699331 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46ed0ef0-e9ff-4c9e-a150-8276298dbd82 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 204 len: 0 microversion: 2.1 time: 0.133017 Jun 04 21:47:15.700174 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3221/6343] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:47:15 2022] DELETE /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:47:15.708707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:15.709328 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:15.717226 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:15.717681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:15.718487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:15.718955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:15.864242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:15.872179 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-074e57f2-3b89-4a4a-8cca-97f5027f96b7 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1554 microversion: 2.1 time: 0.167569 Jun 04 21:47:15.872761 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3123/6344] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:15 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:16.892330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:16.893225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:16.903820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:16.904583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:16.905365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:16.905810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:17.043827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:17.052394 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9167cfb4-ee25-4e1a-a9c6-a656d027ffa4 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1554 microversion: 2.1 time: 0.165589 Jun 04 21:47:17.052977 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3222/6345] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:16 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:17.878673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-558e2298-f4b1-4f17-b4dd-727cda97834a req-c44155e1-6cec-4772-84ec-013d38353838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b87722c-8c77-473d-9670-933a7265debe", "name": "network-vif-deleted", "tag": "0549b9c1-d5e5-427c-ba07-75bab07264ac"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:17.889861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-558e2298-f4b1-4f17-b4dd-727cda97834a req-c44155e1-6cec-4772-84ec-013d38353838 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:17.890444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-558e2298-f4b1-4f17-b4dd-727cda97834a req-c44155e1-6cec-4772-84ec-013d38353838 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:17.903527 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-558e2298-f4b1-4f17-b4dd-727cda97834a req-c44155e1-6cec-4772-84ec-013d38353838 service nova] Creating event network-vif-deleted:0549b9c1-d5e5-427c-ba07-75bab07264ac for instance 4b87722c-8c77-473d-9670-933a7265debe on nch2-master-1 Jun 04 21:47:17.909003 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-558e2298-f4b1-4f17-b4dd-727cda97834a req-c44155e1-6cec-4772-84ec-013d38353838 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110454 Jun 04 21:47:17.909705 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3124/6346] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:18.072535 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:18.073444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:18.088353 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:18.088827 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:18.089667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:18.090180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:18.132594 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:18.133130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:18.133759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lazy-loading 'fault' on Instance uuid 4b87722c-8c77-473d-9670-933a7265debe {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:47:18.182891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a7dbe74559048949cdf5658d15925c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0664a859e40746a59c5cf6e6c0c6a1b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:18.192068 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c4f1c96b-42d3-40de-898a-197525f4be1b tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 200 len: 1349 microversion: 2.1 time: 0.125195 Jun 04 21:47:18.192659 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3223/6347] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:18 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 1349 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:19.212161 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:19.212863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] [instance: 4b87722c-8c77-473d-9670-933a7265debe] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:19.219818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:19.220265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:19.221038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:19.221473 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:19.235662 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] HTTP exception thrown: Instance 4b87722c-8c77-473d-9670-933a7265debe could not be found. Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Request method failure captured: Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe HTTP/1.1 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9JqtGVZzS_6B1U9O7uFzcT4ygV7O4QVqpuJJnx2X-_acVytpybYEkxWlFZutiVObmoK4p0AJqAFhgPX_lLyhWSpF8bpN5rQjcaa3yQaxQ-lIQoqy5l5FIhG04xgSBX1IU8IfOMXxtwWyAWZSeVHomvVf-8rbGUnhdo1D0izXOXfcbA Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 0664a859e40746a59c5cf6e6c0c6a1b3 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestMinimumBasicScenario-1027701286 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/0664a859e40746a59c5cf6e6c0c6a1b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestMinimumBasicScenario-1027701286 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 0664a859e40746a59c5cf6e6c0c6a1b3 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1027701286 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestMinimumBasicScenario-1027701286-project Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 4a7dbe74559048949cdf5658d15925c6 Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestMinimumBasicScenario-1027701286-project Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 4b87722c-8c77-473d-9670-933a7265debe could not be found. Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '4b87722c-8c77-473d-9670-933a7265debe'} Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b87722c-8c77-473d-9670-933a7265debe could not be found. Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b87722c-8c77-473d-9670-933a7265debe could not be found. Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:47:19.237299 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b87722c-8c77-473d-9670-933a7265debe could not be found. Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Returning 404 to user: Instance 4b87722c-8c77-473d-9670-933a7265debe could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4715a503-be86-4344-8fd6-ebe59f14713a tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe" status: 404 len: 111 microversion: 2.1 time: 0.031957 Jun 04 21:47:19.240822 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3125/6348] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:19 2022] GET /compute/v2.1/servers/4b87722c-8c77-473d-9670-933a7265debe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:47:19.248448 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a07f54a-aeb6-4df8-b591-5352858a12d2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] Calling method '.version_select at 0x7f2d027efa60>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:19.270037 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a07f54a-aeb6-4df8-b591-5352858a12d2 tempest-TestMinimumBasicScenario-1027701286 tempest-TestMinimumBasicScenario-1027701286-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1652273223" status: 202 len: 0 microversion: 2.1 time: 0.025589 Jun 04 21:47:19.270616 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3224/6349] 10.222.0.18 () {58 vars in 1271 bytes} [Sat Jun 4 21:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1652273223 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:47:27.472312 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:47:27.472888 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 21:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:47:28.611721 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5097dbe9-6f05-4d4a-9dfe-e4b4c2425902 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: .version_select at 0x7f2d024a95e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-8872369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVoSJmeaTuvzG4dcyiqe3izBC4orf3Y4er63+5h4mtFz5u/IyZN4m8JC7K+Oq2hL2YlKcFX/leNI7bVwhy6cjPfvPkTV1CfrqgrxZBiE9E6lF/hwwWME23Pwma+5rlqTA=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:28.637264 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5097dbe9-6f05-4d4a-9dfe-e4b4c2425902 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:47:28.643380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5097dbe9-6f05-4d4a-9dfe-e4b4c2425902 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:47:28.674073 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5097dbe9-6f05-4d4a-9dfe-e4b4c2425902 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.236796 Jun 04 21:47:28.674690 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3126/6350] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:47:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:30.868808 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:47:30.869508 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 21:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:47:34.861992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:34.862877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:34.868190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-462648419", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "1fd8cbeb-88e5-4877-a9f0-173820842d0f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-8872369", "security_groups": [{"name": "tempest-secgroup-smoke-306792338"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:34.977983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] validate_networks() for [('1fd8cbeb-88e5-4877-a9f0-173820842d0f', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:47:35.524245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:47:35.525068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:47:35.525738 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:47:35.526332 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:47:35.526908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:47:35.538782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:35.539587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:35.540922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:35.541616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:35.563644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:47:35.569789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:47:35.585815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:47:35.588634 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:47:35.646904 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4c26df13-196f-4d8d-aa36-9f0aba670ca1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.786334 Jun 04 21:47:35.647665 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3225/6351] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:47:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:47:35.658246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a4b1108c-e06f-4523-a2d9-82f6506c225e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:35.658874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a4b1108c-e06f-4523-a2d9-82f6506c225e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:35.660955 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:35.738801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a4b1108c-e06f-4523-a2d9-82f6506c225e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:35.747878 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a4b1108c-e06f-4523-a2d9-82f6506c225e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1263 microversion: 2.1 time: 0.093851 Jun 04 21:47:35.748898 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3127/6352] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:35 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:36.767090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:36.768676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:36.775947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:36.777092 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:36.778144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:36.778874 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:36.861356 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:36.871571 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64b86972-f8a9-46f5-8c01-1989c9fc73db tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1315 microversion: 2.1 time: 0.109853 Jun 04 21:47:36.872941 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3226/6353] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:36 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1315 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:37.890766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:37.892178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:37.901273 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:37.901746 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:37.902715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:37.903162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:38.142819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:38.152525 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af3eaf4e-f28a-4101-9b56-7610872d8094 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1388 microversion: 2.1 time: 0.266485 Jun 04 21:47:38.153135 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3128/6354] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:37 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1388 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:38.601355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0922ddf3-ff77-4d9c-814d-b21b85aecd70 req-462428f7-1fed-4159-a5f3-828d9b9df542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7897a9-8234-4baf-977f-1e0d004d1ac8", "tag": "90df52ed-975c-4808-b2ab-a425017fb9b6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:38.629852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0922ddf3-ff77-4d9c-814d-b21b85aecd70 req-462428f7-1fed-4159-a5f3-828d9b9df542 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:38.630319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0922ddf3-ff77-4d9c-814d-b21b85aecd70 req-462428f7-1fed-4159-a5f3-828d9b9df542 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:38.645801 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0922ddf3-ff77-4d9c-814d-b21b85aecd70 req-462428f7-1fed-4159-a5f3-828d9b9df542 service nova] Creating event network-changed:90df52ed-975c-4808-b2ab-a425017fb9b6 for instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 on nch2-master-1 Jun 04 21:47:38.651563 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0922ddf3-ff77-4d9c-814d-b21b85aecd70 req-462428f7-1fed-4159-a5f3-828d9b9df542 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053877 Jun 04 21:47:38.652186 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3227/6355] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:39.170650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:39.171410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:39.178905 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:39.179341 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:39.180168 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:39.180605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:39.321410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:39.329746 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-16aa4b3e-00d4-4064-bcba-df0be4a98e41 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1388 microversion: 2.1 time: 0.163495 Jun 04 21:47:39.330308 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3129/6356] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:39 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:40.349187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:40.349818 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:40.356687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:40.357137 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:40.357944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:40.358414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:40.504492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:40.512585 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-041787ee-3272-4413-a01d-4e170b3ae61a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1388 microversion: 2.1 time: 0.168753 Jun 04 21:47:40.513156 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3228/6357] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:40 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:41.531383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:41.532024 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:41.534774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:41.540067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:41.540519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:41.541291 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:41.541735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:41.683716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:41.691950 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-01d40107-c3e6-4868-934e-fe7ed8ee05cb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1388 microversion: 2.1 time: 0.164552 Jun 04 21:47:41.692547 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3130/6358] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:41 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1388 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:42.713271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:42.714112 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:42.723257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:42.723770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:42.724612 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:42.725066 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:42.920798 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:42.929578 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-493562f5-e1f8-4a0c-827a-53acdd0eeddc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1388 microversion: 2.1 time: 0.222848 Jun 04 21:47:42.930170 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3229/6359] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:42 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1388 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:43.495039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-41dc3ccc-618a-4a87-8d47-f3ab57535346 req-ef2a41a7-0c84-4f72-9536-d7238fc44723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7897a9-8234-4baf-977f-1e0d004d1ac8", "name": "network-vif-plugged", "status": "completed", "tag": "90df52ed-975c-4808-b2ab-a425017fb9b6"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:43.503408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-41dc3ccc-618a-4a87-8d47-f3ab57535346 req-ef2a41a7-0c84-4f72-9536-d7238fc44723 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:43.503873 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-41dc3ccc-618a-4a87-8d47-f3ab57535346 req-ef2a41a7-0c84-4f72-9536-d7238fc44723 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:43.515009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-41dc3ccc-618a-4a87-8d47-f3ab57535346 req-ef2a41a7-0c84-4f72-9536-d7238fc44723 service nova] Creating event network-vif-plugged:90df52ed-975c-4808-b2ab-a425017fb9b6 for instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 on nch2-master-1 Jun 04 21:47:43.520604 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-41dc3ccc-618a-4a87-8d47-f3ab57535346 req-ef2a41a7-0c84-4f72-9536-d7238fc44723 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096113 Jun 04 21:47:43.521200 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3131/6360] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:43.948319 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:43.948919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:43.956435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:43.956904 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:43.957715 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:43.958374 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:44.115063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:44.123132 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-05d41cb3-f55c-4475-8f90-2b030ada801b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1388 microversion: 2.1 time: 0.178840 Jun 04 21:47:44.123677 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3230/6361] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:43 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1388 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:45.143077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:45.143866 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:45.151480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:45.151963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:45.152744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:45.153178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:45.299669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:45.307797 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2677f234-a774-45b0-b9d0-23f26cf4c9e8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1560 microversion: 2.1 time: 0.170575 Jun 04 21:47:45.308392 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3132/6362] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:45 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:45.327428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:45.328085 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:45.335825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:45.336284 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:45.337190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:45.337646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:45.480303 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:45.488180 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-07e9cfcf-c898-4010-b135-86032410a9c0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1560 microversion: 2.1 time: 0.164788 Jun 04 21:47:45.488753 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3231/6363] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:45 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:47:47.173812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:47:47.174627 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:47:47.177551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-69811f0b-4cc0-4a32-93dd-4a96b7c5afcb req-c71a37fe-cc23-42fe-b130-9616ccc48082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7897a9-8234-4baf-977f-1e0d004d1ac8", "tag": "90df52ed-975c-4808-b2ab-a425017fb9b6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:47:47.178462 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:47.182301 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:47.183320 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:47:47.183617 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:47.184061 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:47.185108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:47.185547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:47.191229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-69811f0b-4cc0-4a32-93dd-4a96b7c5afcb req-c71a37fe-cc23-42fe-b130-9616ccc48082 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:47:47.191710 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-69811f0b-4cc0-4a32-93dd-4a96b7c5afcb req-c71a37fe-cc23-42fe-b130-9616ccc48082 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:47:47.204845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-69811f0b-4cc0-4a32-93dd-4a96b7c5afcb req-c71a37fe-cc23-42fe-b130-9616ccc48082 service nova] Creating event network-changed:90df52ed-975c-4808-b2ab-a425017fb9b6 for instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 on nch2-master-1 Jun 04 21:47:47.210836 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-69811f0b-4cc0-4a32-93dd-4a96b7c5afcb req-c71a37fe-cc23-42fe-b130-9616ccc48082 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037391 Jun 04 21:47:47.211786 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3232/6364] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:47:47.332708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:47:47.340408 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-004bb330-c266-47c0-9bd6-ab17e9870ae5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1560 microversion: 2.1 time: 0.170711 Jun 04 21:47:47.340991 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3133/6365] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:47:47 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:08.642930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:08.643679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=36 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:08.648401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:08.649450 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:08.656973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:08.657438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:08.658222 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:08.658674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:08.713742 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3cb838cb-c6bd-4bbf-9fbd-87b00bcfcb36 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action" status: 200 len: 24570 microversion: 2.1 time: 0.072662 Jun 04 21:48:08.714391 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3233/6366] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:48:08 2022] POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action => generated 24570 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:48:19.785682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:19.786317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:19.788583 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=7 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:19.789304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=32 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:19.795067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:19.795531 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:19.796332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:19.796776 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:19.881412 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5a446bea-f810-4687-933d-12616649b883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action" status: 202 len: 0 microversion: 2.1 time: 0.100203 Jun 04 21:48:19.882067 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3134/6367] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:48:19 2022] POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:48:19.890983 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:19.891952 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:19.894834 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:19.895525 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:19.905958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:19.906424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:19.907224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:19.907770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:20.366468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:20.378072 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a8b48c2-736d-405d-8134-1afd5cc7b0f0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1684 microversion: 2.1 time: 0.491367 Jun 04 21:48:20.378876 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3234/6368] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:19 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1684 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:48:21.399275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:21.400014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:21.407643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:21.408088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:21.408991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:21.409431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:21.557491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:21.566327 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-56662873-a760-4c7c-bc80-8d1f17c03468 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1664 microversion: 2.1 time: 0.173676 Jun 04 21:48:21.566910 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3135/6369] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:21 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:22.660144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:22.661046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:22.669498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:22.669970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:22.670761 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:22.671216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:22.723104 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd082ff5-6cb8-4525-9604-7b9195b9f113 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action" status: 200 len: 32643 microversion: 2.1 time: 0.068176 Jun 04 21:48:22.723780 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3235/6370] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:48:22 2022] POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action => generated 32643 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:48:22.735410 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:22.736038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:22.743523 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:22.743999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:22.744780 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:22.745235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:22.823072 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0dae3b3f-8e97-4d10-9b5b-8d106376d341 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action" status: 202 len: 0 microversion: 2.1 time: 0.091677 Jun 04 21:48:22.823793 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3136/6371] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:48:22 2022] POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:48:22.833506 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:22.834217 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:22.842088 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:22.842599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:22.843384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:22.843870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:22.983409 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:22.994106 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8f0194a9-3d57-4bdc-b2fe-a0102f588be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1671 microversion: 2.1 time: 0.165178 Jun 04 21:48:22.994713 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3236/6372] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:22 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:24.017280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:24.018495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:24.031167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:24.031977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:24.033157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:24.033715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:24.170898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:24.179433 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-face6993-fee2-4213-8e4e-7e9f20938d17 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1679 microversion: 2.1 time: 0.169587 Jun 04 21:48:24.180291 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3137/6373] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:24 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:24.276533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:24.277392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:24.285069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:24.285540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:24.286334 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:24.286778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:24.338054 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a226aefd-4c4f-4f6b-b945-ae61ece0ea1f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action" status: 200 len: 38403 microversion: 2.1 time: 0.065788 Jun 04 21:48:24.338740 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3237/6374] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:48:24 2022] POST /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8/action => generated 38403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:48:25.361774 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:25.362306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:25.368447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-102f4933-49c4-48e0-9ed4-5295b081fc53 req-e9bf3f4c-6514-408a-8c62-1254b510acfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7897a9-8234-4baf-977f-1e0d004d1ac8", "tag": "90df52ed-975c-4808-b2ab-a425017fb9b6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:25.369796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:25.370431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:25.371428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:25.371899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:25.384510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-102f4933-49c4-48e0-9ed4-5295b081fc53 req-e9bf3f4c-6514-408a-8c62-1254b510acfa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:25.385214 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-102f4933-49c4-48e0-9ed4-5295b081fc53 req-e9bf3f4c-6514-408a-8c62-1254b510acfa service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:25.400612 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-102f4933-49c4-48e0-9ed4-5295b081fc53 req-e9bf3f4c-6514-408a-8c62-1254b510acfa service nova] Creating event network-changed:90df52ed-975c-4808-b2ab-a425017fb9b6 for instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 on nch2-master-1 Jun 04 21:48:25.403324 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:48:25.405782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-102f4933-49c4-48e0-9ed4-5295b081fc53 req-e9bf3f4c-6514-408a-8c62-1254b510acfa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041523 Jun 04 21:48:25.406639 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3238/6375] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:48:25.499851 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8ffaf128-704f-48f3-8638-c5b4f0cce599 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 204 len: 0 microversion: 2.1 time: 0.141614 Jun 04 21:48:25.500413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3138/6376] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:48:25 2022] DELETE /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:48:25.510029 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:25.510879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:25.519802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:25.520384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:25.522267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:25.522809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:25.678511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:25.686806 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-55d12a8d-6f34-4eb1-9b55-91227f37bc8f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1685 microversion: 2.1 time: 0.181468 Jun 04 21:48:25.687390 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3239/6377] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:25 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:26.706115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:26.706835 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:26.714249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:26.714704 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:26.715478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:26.715960 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:26.859606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:26.868274 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f22d1275-2e9c-4c8a-9330-4d3b8affe608 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1685 microversion: 2.1 time: 0.166783 Jun 04 21:48:26.868876 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3139/6378] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:26 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:27.440498 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-11c806a8-2b30-432a-9c47-331fc4b3ea3b req-7dd14b3e-0fcb-449c-80a7-ed95d7e94feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7897a9-8234-4baf-977f-1e0d004d1ac8", "name": "network-vif-deleted", "tag": "90df52ed-975c-4808-b2ab-a425017fb9b6"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:27.452204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-11c806a8-2b30-432a-9c47-331fc4b3ea3b req-7dd14b3e-0fcb-449c-80a7-ed95d7e94feb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:27.453046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-11c806a8-2b30-432a-9c47-331fc4b3ea3b req-7dd14b3e-0fcb-449c-80a7-ed95d7e94feb service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:27.465548 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-11c806a8-2b30-432a-9c47-331fc4b3ea3b req-7dd14b3e-0fcb-449c-80a7-ed95d7e94feb service nova] Creating event network-vif-deleted:90df52ed-975c-4808-b2ab-a425017fb9b6 for instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 on nch2-master-1 Jun 04 21:48:27.471936 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-11c806a8-2b30-432a-9c47-331fc4b3ea3b req-7dd14b3e-0fcb-449c-80a7-ed95d7e94feb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034918 Jun 04 21:48:27.472551 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3240/6379] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:48:27.886475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:27.887055 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:27.895285 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:27.895762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:27.897075 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:27.897742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:27.939063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:27.939767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:27.940303 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lazy-loading 'fault' on Instance uuid 1e7897a9-8234-4baf-977f-1e0d004d1ac8 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:48:27.986655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:27.994044 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79267feb-4b36-495b-a686-fc9b054c2d14 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 200 len: 1353 microversion: 2.1 time: 0.111675 Jun 04 21:48:27.994594 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3140/6380] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:27 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 1353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:29.017826 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:29.018657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 1e7897a9-8234-4baf-977f-1e0d004d1ac8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:29.026745 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:29.027204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:29.028028 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:29.028474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:29.045214 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] HTTP exception thrown: Instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 could not be found. Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Request method failure captured: Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 HTTP/1.1 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9LvZTWbor-yDugxMo_4V-WiFToZ6IwjpX9Lb_ePGGCmdSK2xosUXCvt8c6DVsz0nQ7Z7DtRrJQg0HC0yjzZup4C-K7Ic1bPnC641HysWo9aa_40SrzZtkon_D4JCMuI8RzGVDpAZQkvo-eDbU_gwo6cjnxpLNCcgcZi2TrwVevqzTs Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2c33c0ba0b4445189c48dcd50d68f517 Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 could not be found. Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '1e7897a9-8234-4baf-977f-1e0d004d1ac8'} Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 could not be found. Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 could not be found. Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:48:29.046881 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 could not be found. Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Returning 404 to user: Instance 1e7897a9-8234-4baf-977f-1e0d004d1ac8 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e3315746-2e4b-49a6-b8bd-5275b121b4a3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8" status: 404 len: 111 microversion: 2.1 time: 0.038006 Jun 04 21:48:29.050999 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3241/6381] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:29 2022] GET /compute/v2.1/servers/1e7897a9-8234-4baf-977f-1e0d004d1ac8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:48:32.417184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9905f0cf-066a-4628-850c-090baf087fa4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '.version_select at 0x7f2d020c8ca0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:32.456390 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9905f0cf-066a-4628-850c-090baf087fa4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-8872369" status: 202 len: 0 microversion: 2.1 time: 0.043112 Jun 04 21:48:32.457104 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3141/6382] 10.222.0.18 () {58 vars in 1274 bytes} [Sat Jun 4 21:48:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-8872369 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:48:32.488061 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a37ec268-702d-4fe8-a78e-2690689c9972 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: .version_select at 0x7f2d00e1cdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-990495253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKa9vuGPsxydacsg0f5OnBS0pmzsvqdKcSD3Lz2MsCMLP3z4xOlpjHZZyDei1epNRo+YkWy+XUPaGqsm07kQaYVSvQnckZJd9BfHtfWvzLj+NrFx//bB2PiExMoMqXh1eA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:32.503391 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a37ec268-702d-4fe8-a78e-2690689c9972 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:48:32.509581 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-a37ec268-702d-4fe8-a78e-2690689c9972 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:48:32.535144 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a37ec268-702d-4fe8-a78e-2690689c9972 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054018 Jun 04 21:48:32.535790 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3242/6383] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:48:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:48:38.369331 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1223726164", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "dfd8a365-2e0f-4dc4-87e6-c4ab03a97d41"}], "key_name": "tempest-TestNetworkAdvancedServerOps-990495253", "security_groups": [{"name": "tempest-secgroup-smoke-814794893"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:38.379385 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:38.484848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] validate_networks() for [('dfd8a365-2e0f-4dc4-87e6-c4ab03a97d41', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:48:38.957139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:48:38.957571 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:48:38.958048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:48:38.958456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:48:38.958935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:48:38.968904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:38.969350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:38.970210 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:38.970832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:38.989842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:48:38.996059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:48:39.009786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:48:39.013693 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:48:39.070301 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bf8605d3-93d2-4c8a-b7a3-f45df7f71be3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705747 Jun 04 21:48:39.071703 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3142/6384] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:48:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:48:39.081638 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cdf66580-be83-4ac7-a370-8e5ee493ddef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:39.082270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cdf66580-be83-4ac7-a370-8e5ee493ddef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:39.085509 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=32 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:39.146884 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cdf66580-be83-4ac7-a370-8e5ee493ddef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:39.158871 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cdf66580-be83-4ac7-a370-8e5ee493ddef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1266 microversion: 2.1 time: 0.081419 Jun 04 21:48:39.163556 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3243/6385] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:39 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:40.180805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:40.181421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:40.197806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:40.198259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:40.199107 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:40.199748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:40.331429 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:40.339685 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4eb46400-75e6-456c-9d21-a2931361b97e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1326 microversion: 2.1 time: 0.163044 Jun 04 21:48:40.340967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3143/6386] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:40 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1326 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:41.357838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:41.359087 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:41.367629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:41.368100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:41.368908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:41.369369 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:41.635946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:41.645084 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-168eafab-aa88-42e8-acb9-40eb38c06084 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.291128 Jun 04 21:48:41.652030 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3244/6387] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:41 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:41.861048 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-3f34f366-fa9d-4ec4-b3f4-2e51a6ae1141 req-d6dddea9-6eb5-4e3e-adca-1f2a097a2316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15b5250-4645-4b30-9dca-718d5ee4a66d", "tag": "1752d429-5912-49f3-98ef-26077a11b440"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:41.873542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3f34f366-fa9d-4ec4-b3f4-2e51a6ae1141 req-d6dddea9-6eb5-4e3e-adca-1f2a097a2316 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:41.874238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-3f34f366-fa9d-4ec4-b3f4-2e51a6ae1141 req-d6dddea9-6eb5-4e3e-adca-1f2a097a2316 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:41.887877 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-3f34f366-fa9d-4ec4-b3f4-2e51a6ae1141 req-d6dddea9-6eb5-4e3e-adca-1f2a097a2316 service nova] Creating event network-changed:1752d429-5912-49f3-98ef-26077a11b440 for instance e15b5250-4645-4b30-9dca-718d5ee4a66d on nch2-master-1 Jun 04 21:48:41.894976 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-3f34f366-fa9d-4ec4-b3f4-2e51a6ae1141 req-d6dddea9-6eb5-4e3e-adca-1f2a097a2316 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037734 Jun 04 21:48:41.896343 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3144/6388] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:48:42.665424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:42.665955 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:42.674517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:42.674994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:42.675822 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:42.676276 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:42.824574 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:42.832962 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7dc0216c-ab2b-455a-bc23-d214f1671e28 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.171711 Jun 04 21:48:42.833547 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3245/6389] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:42 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:43.856787 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:43.857687 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:43.866212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:43.866661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:43.867428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:43.867899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:44.014740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:44.023303 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a8aceba7-5115-4441-91da-b89f797c16ce tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.175357 Jun 04 21:48:44.023925 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3145/6390] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:43 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:45.044971 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:45.046174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:45.058828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:45.059646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:45.060974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:45.061723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:45.198239 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:45.209918 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1ff0ca67-79e4-4e53-b63c-352f9e4b1d31 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.171274 Jun 04 21:48:45.210716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3246/6391] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:45 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:46.233841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:46.234716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:46.243099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:46.243557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:46.244363 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:46.244797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:46.395876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:46.403986 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd159115-e0c2-4a91-b2e7-308305e9c3d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.175829 Jun 04 21:48:46.404674 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3146/6392] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:46 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:47.422465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:47.423109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:47.431044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:47.431538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:47.432347 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:47.432804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:47.574416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:47.582847 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b4dcf40e-6228-44c2-8924-13455dac8b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.164364 Jun 04 21:48:47.583439 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3247/6393] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:47 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:47.679395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-75c657b9-958c-4102-82a4-68fcd96adeb5 req-96a0b4d9-7885-44b4-9fae-340047be61df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15b5250-4645-4b30-9dca-718d5ee4a66d", "name": "network-vif-plugged", "status": "completed", "tag": "1752d429-5912-49f3-98ef-26077a11b440"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:47.688674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-75c657b9-958c-4102-82a4-68fcd96adeb5 req-96a0b4d9-7885-44b4-9fae-340047be61df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:47.689062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-75c657b9-958c-4102-82a4-68fcd96adeb5 req-96a0b4d9-7885-44b4-9fae-340047be61df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:47.701684 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-75c657b9-958c-4102-82a4-68fcd96adeb5 req-96a0b4d9-7885-44b4-9fae-340047be61df service nova] Creating event network-vif-plugged:1752d429-5912-49f3-98ef-26077a11b440 for instance e15b5250-4645-4b30-9dca-718d5ee4a66d on nch2-master-1 Jun 04 21:48:47.707017 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-75c657b9-958c-4102-82a4-68fcd96adeb5 req-96a0b4d9-7885-44b4-9fae-340047be61df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Jun 04 21:48:47.707752 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3147/6394] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:48:48.605295 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:48.606262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:48.616070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:48.616538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:48.617325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:48.617781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:48.764809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:48.776309 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a766a73-3d54-40dc-896c-380af064d711 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1391 microversion: 2.1 time: 0.177600 Jun 04 21:48:48.777048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3248/6395] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:48 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:49.794554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:49.795402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:49.800234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:49.801132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:49.803081 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:49.810344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:49.810874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:49.811668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:49.812085 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:49.949337 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:49.957688 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ac34097-3af1-4239-9b9b-941656ae0139 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1562 microversion: 2.1 time: 0.164977 Jun 04 21:48:49.958178 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3148/6396] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:49 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:49.974367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:49.975002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:49.976928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:49.978442 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:48:49.987758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:49.988451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:49.989370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:49.989824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:50.148883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:50.157040 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-267b29fd-6e57-4711-8987-4f6bf595fa91 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1562 microversion: 2.1 time: 0.186763 Jun 04 21:48:50.157628 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3249/6397] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:49 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:48:52.142350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:48:52.146952 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:48:52.147057 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1f81c223-276e-4f5b-b654-5f5ce2106628 req-133e2233-0136-426b-b643-7a66d612a7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15b5250-4645-4b30-9dca-718d5ee4a66d", "tag": "1752d429-5912-49f3-98ef-26077a11b440"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:48:52.151969 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:52.152539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:52.153464 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:52.154139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:52.155707 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1f81c223-276e-4f5b-b654-5f5ce2106628 req-133e2233-0136-426b-b643-7a66d612a7b8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:48:52.156168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1f81c223-276e-4f5b-b654-5f5ce2106628 req-133e2233-0136-426b-b643-7a66d612a7b8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:48:52.169277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1f81c223-276e-4f5b-b654-5f5ce2106628 req-133e2233-0136-426b-b643-7a66d612a7b8 service nova] Creating event network-changed:1752d429-5912-49f3-98ef-26077a11b440 for instance e15b5250-4645-4b30-9dca-718d5ee4a66d on nch2-master-1 Jun 04 21:48:52.174845 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1f81c223-276e-4f5b-b654-5f5ce2106628 req-133e2233-0136-426b-b643-7a66d612a7b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034718 Jun 04 21:48:52.176181 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3250/6398] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:48:52.376655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:48:52.386953 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7d793aec-dea9-43ee-82a1-8738081c0ac1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1562 microversion: 2.1 time: 0.249000 Jun 04 21:48:52.387884 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3149/6399] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:48:52 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1562 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:13.671945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:13.672622 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=38 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:13.676960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:49:13.678002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:13.685133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:13.685599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:13.686424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:13.686876 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:13.735866 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2e616e5-8e45-4ede-85f8-0e7437ba2bb7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d/action" status: 200 len: 24564 microversion: 2.1 time: 0.065895 Jun 04 21:49:13.736501 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3251/6400] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:49:13 2022] POST /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d/action => generated 24564 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:49:20.164524 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:49:20.165521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:20.167763 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:20.168421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=36 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:20.174294 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:20.174741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:20.175584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:20.175978 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:20.267066 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-528cee6c-f7d1-4a81-a1ae-fba24152c760 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d/action" status: 202 len: 0 microversion: 2.1 time: 0.109158 Jun 04 21:49:20.267783 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3150/6401] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:49:20 2022] POST /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:49:20.277438 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:20.278155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:20.286477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:20.287068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:20.287858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:20.288315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:20.525886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:20.537556 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0dd1b747-5cc3-40c2-8c92-39c0f061f204 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1673 microversion: 2.1 time: 0.264175 Jun 04 21:49:20.538491 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3252/6402] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:20 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1673 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:21.564466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:21.565334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:21.573115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:21.573570 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:21.574347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:21.574793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:21.713880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:21.725779 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eab1b629-5be5-49c5-baba-d4fcf75a8983 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.167202 Jun 04 21:49:21.726691 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3151/6403] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:21 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:22.748382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:22.749514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:22.762986 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:22.763808 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:22.765109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:22.765866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:22.906739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:22.914907 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c42e47ff-4358-4f2f-8c98-2dc67691c95e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.173271 Jun 04 21:49:22.915486 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3253/6404] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:22 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:23.933088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:23.933899 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:23.942209 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:23.942663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:23.943430 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:23.943900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:24.099077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:24.107439 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3d9d65cb-d68e-4031-8ce1-b15011b7ff3f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.178408 Jun 04 21:49:24.108176 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3152/6405] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:23 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:25.129778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:25.130872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:25.143399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:25.144269 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:25.145567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:25.146322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:25.285069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:25.293071 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-85281977-2cbb-4fec-beb6-fd217acceecb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.170103 Jun 04 21:49:25.293647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3254/6406] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:25 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:26.313668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:26.314338 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:26.321851 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:26.322332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:26.323158 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:26.323659 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:26.465438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:26.473583 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-30dcfc32-80a6-47c2-b61c-7441ea4c4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.165368 Jun 04 21:49:26.474160 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3153/6407] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:26 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:27.495296 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:27.496408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:27.508430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:27.509207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:27.510515 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:27.511271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:27.647552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:27.656167 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-47ae9a3f-5a41-4d9b-8be6-b7fe44ac4786 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.167642 Jun 04 21:49:27.656746 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3255/6408] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:27 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:28.676993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:28.677643 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:28.687269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:28.687767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:28.688538 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:28.688980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:28.840052 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:28.848060 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-121c5267-ee1e-4329-912a-20612c95ad71 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.176804 Jun 04 21:49:28.848635 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3154/6409] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:28 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:29.870161 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:29.871117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:29.883928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:29.884701 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:29.886010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:29.886767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:30.030416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:30.038576 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-53446571-5516-4dd0-ad96-a710d1cbc895 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.175273 Jun 04 21:49:30.039171 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3256/6410] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:29 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:31.058160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:31.059042 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:31.067083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:31.067541 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:31.068380 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:31.068826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:31.225767 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:31.233948 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d1565533-01c4-4129-a377-718d66a0f9a0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1678 microversion: 2.1 time: 0.181113 Jun 04 21:49:31.234508 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3155/6411] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:31 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:32.252042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:49:32.252666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:32.260160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:32.260625 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:32.261412 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:32.261873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:32.398921 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:49:32.407278 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-90f71c5f-3003-41e5-a916-74ab5df230b7 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1681 microversion: 2.1 time: 0.159372 Jun 04 21:49:32.407931 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3257/6412] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:49:32 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:49:56.626339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:49:56.627435 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:49:56.630542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:56.631685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:49:56.639548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:56.640035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:56.640812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:49:56.641272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:49:56.704381 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7915f685-7243-4c78-9f3b-e399df4b042e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d/action" status: 200 len: 69107 microversion: 2.1 time: 0.083064 Jun 04 21:49:56.705090 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3156/6413] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:49:56 2022] POST /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d/action => generated 69107 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:50:04.381141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:04.384282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-9c9fa41e-f3d1-414a-9414-e488c474a9cc req-93fcc9d5-41b3-4e49-9d8a-a18868b9af9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15b5250-4645-4b30-9dca-718d5ee4a66d", "tag": "1752d429-5912-49f3-98ef-26077a11b440"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:04.384863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:04.391686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=14 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:04.397015 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=40 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:04.403395 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9c9fa41e-f3d1-414a-9414-e488c474a9cc req-93fcc9d5-41b3-4e49-9d8a-a18868b9af9f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:04.403989 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-9c9fa41e-f3d1-414a-9414-e488c474a9cc req-93fcc9d5-41b3-4e49-9d8a-a18868b9af9f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:04.410141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:04.410674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:04.411674 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:04.412272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:04.420283 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-9c9fa41e-f3d1-414a-9414-e488c474a9cc req-93fcc9d5-41b3-4e49-9d8a-a18868b9af9f service nova] Creating event network-changed:1752d429-5912-49f3-98ef-26077a11b440 for instance e15b5250-4645-4b30-9dca-718d5ee4a66d on nch2-master-1 Jun 04 21:50:04.425763 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-9c9fa41e-f3d1-414a-9414-e488c474a9cc req-93fcc9d5-41b3-4e49-9d8a-a18868b9af9f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055774 Jun 04 21:50:04.429477 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3157/6414] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:50:04.444487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:50:04.533735 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3980483f-cf91-43ec-9c0f-43771b7bc75d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 204 len: 0 microversion: 2.1 time: 0.165575 Jun 04 21:50:04.537569 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3258/6415] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:50:04 2022] DELETE /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:50:04.544271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:04.544992 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:04.552727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:04.553187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:04.553970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:04.554412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:04.697928 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:04.707902 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-28aceb44-bf1a-49ff-8c77-2f117cac0591 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1687 microversion: 2.1 time: 0.168396 Jun 04 21:50:04.708518 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3158/6416] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:04 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:50:05.726865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:05.727604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:05.735322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:05.735836 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:05.736608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:05.737058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:05.885382 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:05.893846 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-defa5a67-9dd1-4a28-9295-8753e3760b09 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1687 microversion: 2.1 time: 0.171533 Jun 04 21:50:05.894431 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3259/6417] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:05 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:06.518961 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bce4d36a-b3a6-4287-a035-f0827c5c5dde req-9d51446a-5cf3-4780-8131-65be8f4ff117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15b5250-4645-4b30-9dca-718d5ee4a66d", "name": "network-vif-deleted", "tag": "1752d429-5912-49f3-98ef-26077a11b440"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:06.530211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bce4d36a-b3a6-4287-a035-f0827c5c5dde req-9d51446a-5cf3-4780-8131-65be8f4ff117 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:06.530768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bce4d36a-b3a6-4287-a035-f0827c5c5dde req-9d51446a-5cf3-4780-8131-65be8f4ff117 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:06.543383 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bce4d36a-b3a6-4287-a035-f0827c5c5dde req-9d51446a-5cf3-4780-8131-65be8f4ff117 service nova] Creating event network-vif-deleted:1752d429-5912-49f3-98ef-26077a11b440 for instance e15b5250-4645-4b30-9dca-718d5ee4a66d on nch2-master-1 Jun 04 21:50:06.548616 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bce4d36a-b3a6-4287-a035-f0827c5c5dde req-9d51446a-5cf3-4780-8131-65be8f4ff117 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033441 Jun 04 21:50:06.549725 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3159/6418] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:50:06.912473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:06.913082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:06.921237 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:06.921708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:06.922521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:06.922989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:06.964406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:06.964877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:06.965364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lazy-loading 'fault' on Instance uuid e15b5250-4645-4b30-9dca-718d5ee4a66d {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:50:07.018868 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:07.026248 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c783f945-5151-4c02-8362-28daf03c7226 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 200 len: 1356 microversion: 2.1 time: 0.118089 Jun 04 21:50:07.026836 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3260/6419] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:06 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:50:08.050817 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:08.052012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e15b5250-4645-4b30-9dca-718d5ee4a66d] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:08.061633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:08.062084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:08.062853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:08.063292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:08.080071 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] HTTP exception thrown: Instance e15b5250-4645-4b30-9dca-718d5ee4a66d could not be found. Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Request method failure captured: Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d HTTP/1.1 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9LvZTWbor-yDugxMo_4V-WiFToZ6IwjpX9Lb_ePGGCmdSK2xosUXCvt8c6DVsz0nQ7Z7DtRrJQg0HC0yjzZup4C-K7Ic1bPnC641HysWo9aa_40SrzZtkon_D4JCMuI8RzGVDpAZQkvo-eDbU_gwo6cjnxpLNCcgcZi2TrwVevqzTs Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2c33c0ba0b4445189c48dcd50d68f517 Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e15b5250-4645-4b30-9dca-718d5ee4a66d could not be found. Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e15b5250-4645-4b30-9dca-718d5ee4a66d'} Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15b5250-4645-4b30-9dca-718d5ee4a66d could not be found. Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15b5250-4645-4b30-9dca-718d5ee4a66d could not be found. Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:50:08.081718 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15b5250-4645-4b30-9dca-718d5ee4a66d could not be found. Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Returning 404 to user: Instance e15b5250-4645-4b30-9dca-718d5ee4a66d could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c6d95093-d0a8-4ece-ad70-baf6fbda9f1c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d" status: 404 len: 111 microversion: 2.1 time: 0.041505 Jun 04 21:50:08.085980 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3160/6420] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:08 2022] GET /compute/v2.1/servers/e15b5250-4645-4b30-9dca-718d5ee4a66d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:50:11.153788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d6db849a-5a95-4402-bae8-c176aae5557b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '.version_select at 0x7f2d014b9ee0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:11.176922 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d6db849a-5a95-4402-bae8-c176aae5557b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-990495253" status: 202 len: 0 microversion: 2.1 time: 0.027106 Jun 04 21:50:11.177611 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3261/6421] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 21:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-990495253 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:50:11.205190 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b81f5261-ea8a-414a-a564-417bcab8d9f3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: .version_select at 0x7f2d021ae1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1110502087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmAwoG26ucr/ZntXdTwE6NRJ8hH7jLg+YBuXn439A8QWXd7+AWDxLWnNWTlbRM5AT7oUhdCA9ptFec8qLaQ3SfSIWDXN/yU0lvzuz2CTeONvQP6aObzHSWzYDmp07DjPg=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:11.221459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b81f5261-ea8a-414a-a564-417bcab8d9f3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:50:11.227781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b81f5261-ea8a-414a-a564-417bcab8d9f3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:50:11.253313 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b81f5261-ea8a-414a-a564-417bcab8d9f3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052830 Jun 04 21:50:11.253987 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3161/6422] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:50:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:50:17.077561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:17.082688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1709310135", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "6baca0c6-a512-4066-ae8d-760b83251be9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1110502087", "security_groups": [{"name": "tempest-secgroup-smoke-1839086527"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:17.195173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] validate_networks() for [('6baca0c6-a512-4066-ae8d-760b83251be9', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:50:17.990482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:50:17.991036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:50:17.991943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:50:17.993654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:50:17.994447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:50:18.011081 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:18.015310 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:18.018162 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:18.019157 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:18.040194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:50:18.046490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:50:18.060633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:50:18.063398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:50:18.118603 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ffed415e-1726-4593-bd33-f4ca786422fe tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.043913 Jun 04 21:50:18.125678 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3262/6423] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:50:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:50:18.128730 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:18.132975 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a5445de1-3d72-4c18-8639-4c618d99892f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:18.133596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a5445de1-3d72-4c18-8639-4c618d99892f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:18.220403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a5445de1-3d72-4c18-8639-4c618d99892f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:18.231701 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a5445de1-3d72-4c18-8639-4c618d99892f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1267 microversion: 2.1 time: 0.104637 Jun 04 21:50:18.241557 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3162/6424] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:18 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:19.257447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:19.259407 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:19.269561 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:19.270414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:19.271841 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:19.272605 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:19.394218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:19.409558 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a99069b8-2afe-47de-ba10-9f75d6799b3a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1327 microversion: 2.1 time: 0.162600 Jun 04 21:50:19.411634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3263/6425] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:19 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:20.430159 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:20.430798 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:20.439167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:20.439677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:20.440682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:20.441127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:20.580707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:20.589192 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8fada895-3aef-4028-8711-126bc1955467 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1393 microversion: 2.1 time: 0.163137 Jun 04 21:50:20.591926 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3163/6426] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:20 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:21.008377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0c33d632-366e-4335-80a2-0c3536a78575 req-a8626b28-cfa2-4ec7-84c7-516dcc774854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:21.021794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c33d632-366e-4335-80a2-0c3536a78575 req-a8626b28-cfa2-4ec7-84c7-516dcc774854 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:21.022647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0c33d632-366e-4335-80a2-0c3536a78575 req-a8626b28-cfa2-4ec7-84c7-516dcc774854 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:21.041648 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0c33d632-366e-4335-80a2-0c3536a78575 req-a8626b28-cfa2-4ec7-84c7-516dcc774854 service nova] Creating event network-changed:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch1-master-1 Jun 04 21:50:21.047238 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0c33d632-366e-4335-80a2-0c3536a78575 req-a8626b28-cfa2-4ec7-84c7-516dcc774854 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044019 Jun 04 21:50:21.047932 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3264/6427] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:50:21.607822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:21.608444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:21.615822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:21.616360 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:21.617227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:21.617702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:21.760528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:21.771191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5e4b431d-09e0-45e4-ba14-46e0c0a81c8d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1393 microversion: 2.1 time: 0.167459 Jun 04 21:50:21.772173 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3164/6428] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:21 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:22.790797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:22.791549 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:22.799148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:22.799651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:22.800436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:22.800892 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:22.946270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:22.954573 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-72761e19-9798-4d2a-9268-8f9f86ed3472 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1393 microversion: 2.1 time: 0.168966 Jun 04 21:50:22.955152 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3265/6429] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:22 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:23.971831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:23.972535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:23.979744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:23.980192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:23.981001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:23.981436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:24.117991 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:24.126675 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a7b60d56-cb69-49e8-89c5-02e483be6038 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1393 microversion: 2.1 time: 0.159033 Jun 04 21:50:24.127263 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3165/6430] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:23 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:25.144705 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:25.145336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:25.153465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:25.154020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:25.155342 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:25.155832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:25.306370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:25.316084 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d75b9078-e1df-4afe-8e40-ebf9e17809e5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1393 microversion: 2.1 time: 0.175416 Jun 04 21:50:25.316671 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3266/6431] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:25 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:25.956625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5c03ab78-21af-4612-880f-d5a6405b75d9 req-9ecf1031-4aaa-45ef-9bb6-080478e07da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "name": "network-vif-plugged", "status": "completed", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:25.965059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5c03ab78-21af-4612-880f-d5a6405b75d9 req-9ecf1031-4aaa-45ef-9bb6-080478e07da9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:25.965509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5c03ab78-21af-4612-880f-d5a6405b75d9 req-9ecf1031-4aaa-45ef-9bb6-080478e07da9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:25.977283 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5c03ab78-21af-4612-880f-d5a6405b75d9 req-9ecf1031-4aaa-45ef-9bb6-080478e07da9 service nova] Creating event network-vif-plugged:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch1-master-1 Jun 04 21:50:25.982754 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5c03ab78-21af-4612-880f-d5a6405b75d9 req-9ecf1031-4aaa-45ef-9bb6-080478e07da9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 Jun 04 21:50:25.983438 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3166/6432] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:50:26.334584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:26.335265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:26.343246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:26.343802 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:26.344681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:26.345187 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:26.488359 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:26.496438 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-eed9747a-e08e-46a9-8bbf-7f3d5e3ac07d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1393 microversion: 2.1 time: 0.166288 Jun 04 21:50:26.497024 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3267/6433] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:26 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:27.515882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:27.516772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:27.518793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:27.525936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:27.526806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:27.527662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:27.528277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:27.741942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:27.750267 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c8b390b6-4c4a-4789-9399-664ad3d99e11 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1564 microversion: 2.1 time: 0.240211 Jun 04 21:50:27.750845 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3167/6434] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:27 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1564 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:27.766657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:27.767277 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:27.774780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:27.775270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:27.776091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:27.776540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:27.913682 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:27.921815 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b49b2eb7-9310-4937-b068-dd342c2b77ea tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1564 microversion: 2.1 time: 0.159353 Jun 04 21:50:27.922400 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3268/6435] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:27 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:29.621021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:50:29.622301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:29.624654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:29.626124 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-efebaf43-86bf-46fa-924b-1e9ca4d5dbd6 req-d856656c-2601-49da-991a-c2b0c9cf8900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:29.632428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:29.632795 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:29.633576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:29.634014 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:29.638722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:29.639956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:29.644805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-efebaf43-86bf-46fa-924b-1e9ca4d5dbd6 req-d856656c-2601-49da-991a-c2b0c9cf8900 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:29.645443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-efebaf43-86bf-46fa-924b-1e9ca4d5dbd6 req-d856656c-2601-49da-991a-c2b0c9cf8900 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:29.661100 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-efebaf43-86bf-46fa-924b-1e9ca4d5dbd6 req-d856656c-2601-49da-991a-c2b0c9cf8900 service nova] Creating event network-changed:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch1-master-1 Jun 04 21:50:29.667453 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-efebaf43-86bf-46fa-924b-1e9ca4d5dbd6 req-d856656c-2601-49da-991a-c2b0c9cf8900 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048144 Jun 04 21:50:29.668424 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3269/6436] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:50:29.862187 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:50:29.870521 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c2584849-91b3-4002-a3d5-731e56bd078a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1564 microversion: 2.1 time: 0.253534 Jun 04 21:50:29.871204 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3168/6437] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:50:29 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1564 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:50:53.209493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:50:53.210547 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:50:53.212801 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:53.213689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=36 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:50:53.220041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:53.220511 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:53.221654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:50:53.222113 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:50:53.290899 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2e9bed7b-8e14-4dcc-bff3-23332f2d9ff4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action" status: 200 len: 24571 microversion: 2.1 time: 0.085848 Jun 04 21:50:53.291975 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3270/6438] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:50:53 2022] POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action => generated 24571 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:51:04.205059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:04.206121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:04.208481 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:04.209197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=32 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:04.215082 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:04.215544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:04.216325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:04.216758 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:04.318615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:04.325526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Old instance type m1.heat2, new instance type m1.heat {{(pid=137229) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 04 21:51:04.332657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:51:04.333064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:51:04.333576 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:51:04.333993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:51:04.334426 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:51:04.405693 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d49e395-61a7-4f16-9c80-83df9217fc64 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action" status: 202 len: 0 microversion: 2.1 time: 0.204656 Jun 04 21:51:04.406523 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3169/6439] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:51:04 2022] POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:51:04.415471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:04.416226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:04.419141 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=4 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:04.419899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:04.426846 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:04.427470 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:04.428383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:04.429049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:04.699110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:04.706957 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb009e83-9527-4773-822e-31ec3f796234 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1692 microversion: 2.1 time: 0.295783 Jun 04 21:51:04.707779 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3271/6440] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:04 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1692 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:05.727257 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:05.727907 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:05.736388 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:05.736837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:05.737615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:05.738039 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:05.889017 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:05.898663 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-507e0f26-5451-4143-9d19-927db407be2e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1692 microversion: 2.1 time: 0.175765 Jun 04 21:51:05.899240 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3170/6441] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:05 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:06.921337 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:06.922244 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:06.932400 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:06.932869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:06.933665 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:06.934121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:07.076158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:07.091235 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-3e099e5b-d794-48c9-8b91-685061682530 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.176820 Jun 04 21:51:07.091895 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3272/6442] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:06 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:08.113486 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:08.114718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:08.124927 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:08.125353 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:08.126861 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:08.127413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:08.278615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:08.286957 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb9cf2d3-2fc5-44c2-83da-130336d3d07e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.180441 Jun 04 21:51:08.287560 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3171/6443] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:08 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:09.310944 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:09.311629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:09.321492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:09.321964 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:09.322909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:09.323367 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:09.474490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:09.482787 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b1dc4496-6fbb-4248-8637-1d7da8f4b30a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.178235 Jun 04 21:51:09.483340 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3273/6444] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:09 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:10.503877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:10.504888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:10.517547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:10.518300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:10.519595 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:10.520367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:10.667999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:10.676185 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-217756f2-cb53-43ad-9e26-bd8b478da879 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.179059 Jun 04 21:51:10.676771 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3172/6445] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:10 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:11.697693 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:11.698476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:11.707614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:11.708205 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:11.709851 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:11.710433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:11.867150 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:11.878996 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-141b5099-7fef-42b3-a9d4-d6fa17b0c893 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.187284 Jun 04 21:51:11.879875 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3274/6446] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:11 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:12.899755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:12.900355 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:12.907853 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:12.908306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:12.909073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:12.909511 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:13.048356 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:13.056383 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1633d874-bd87-4e63-92a8-094a577d3f4d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.161704 Jun 04 21:51:13.056964 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3173/6447] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:12 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:14.073644 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:14.074272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:14.082063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:14.082526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:14.083378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:14.083883 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:14.228845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:14.236701 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87f6f77d-cef3-4204-b63b-12556d6e47be tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.167046 Jun 04 21:51:14.237262 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3275/6448] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:14 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:15.254203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:15.254779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:15.262548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:15.263004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:15.263804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:15.264240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:15.406690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:15.414843 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5dea8a50-a747-4bae-8b60-80235a3df2b8 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.164703 Jun 04 21:51:15.415446 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3174/6449] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:15 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:16.432464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:16.433080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:16.440820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:16.441302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:16.442110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:16.442558 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:16.603681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:16.616526 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b212b67a-c93d-4667-87df-4553ab1f3a2b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.188013 Jun 04 21:51:16.617137 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3276/6450] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:16 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:17.635804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:17.636382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:17.643609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:17.644076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:17.644908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:17.645345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:17.797171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:17.806041 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-97962de7-3541-48d1-a403-42a5199deabb tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.174967 Jun 04 21:51:17.806662 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3175/6451] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:17 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:18.824600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:18.825322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:18.832772 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:18.833322 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:18.834206 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:18.834664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:18.973589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:18.983984 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09e02450-0934-4fae-9e52-1919306e981d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1697 microversion: 2.1 time: 0.163640 Jun 04 21:51:18.984768 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3277/6452] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:18 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:19.627807 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-85b3a0de-93ba-4b84-ae94-a19d798fd180 req-5f7d9f55-9467-4aec-ae4e-ee85bcc38401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "name": "network-vif-unplugged", "status": "completed", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:19.637898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-85b3a0de-93ba-4b84-ae94-a19d798fd180 req-5f7d9f55-9467-4aec-ae4e-ee85bcc38401 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:19.638521 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-85b3a0de-93ba-4b84-ae94-a19d798fd180 req-5f7d9f55-9467-4aec-ae4e-ee85bcc38401 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:19.658153 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-85b3a0de-93ba-4b84-ae94-a19d798fd180 req-5f7d9f55-9467-4aec-ae4e-ee85bcc38401 service nova] Creating event network-vif-unplugged:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch2-master-1 Jun 04 21:51:19.665278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [req-85b3a0de-93ba-4b84-ae94-a19d798fd180 req-5f7d9f55-9467-4aec-ae4e-ee85bcc38401 service nova] Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137229) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:51:19.677809 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-85b3a0de-93ba-4b84-ae94-a19d798fd180 req-5f7d9f55-9467-4aec-ae4e-ee85bcc38401 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114566 Jun 04 21:51:19.678735 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3176/6453] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:51:20.002894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:20.003727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:20.013117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:20.013582 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:20.014383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:20.014840 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:20.173879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:20.181865 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bfabaf71-39dc-487c-9731-fc0b03f1de81 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1696 microversion: 2.1 time: 0.183308 Jun 04 21:51:20.182451 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3278/6454] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:19 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:21.206412 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:21.207591 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:21.218904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:21.219732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:21.221026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:21.221765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:21.363810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:21.373558 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c7ac13ad-8412-459a-bc93-2718e25b6149 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1694 microversion: 2.1 time: 0.175834 Jun 04 21:51:21.374147 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3177/6455] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:21 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:21.706266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-0aec3d4e-1d5c-4f7e-977c-961915d05193 req-c682c4bf-c9c6-42b0-a894-93f1ff3726c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:21.717432 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0aec3d4e-1d5c-4f7e-977c-961915d05193 req-c682c4bf-c9c6-42b0-a894-93f1ff3726c3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:21.717898 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-0aec3d4e-1d5c-4f7e-977c-961915d05193 req-c682c4bf-c9c6-42b0-a894-93f1ff3726c3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:21.730272 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-0aec3d4e-1d5c-4f7e-977c-961915d05193 req-c682c4bf-c9c6-42b0-a894-93f1ff3726c3 service nova] Creating event network-changed:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch2-master-1 Jun 04 21:51:21.735987 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [req-0aec3d4e-1d5c-4f7e-977c-961915d05193 req-c682c4bf-c9c6-42b0-a894-93f1ff3726c3 service nova] Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=137228) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 04 21:51:21.749676 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-0aec3d4e-1d5c-4f7e-977c-961915d05193 req-c682c4bf-c9c6-42b0-a894-93f1ff3726c3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051096 Jun 04 21:51:21.751021 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3279/6456] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:51:22.393336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:22.393939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:22.401904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.402365 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.403153 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.403631 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.546152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:22.556823 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-246238ce-5409-4984-82e9-05769f5b793f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1691 microversion: 2.1 time: 0.167436 Jun 04 21:51:22.557443 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3178/6457] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:22 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:22.574349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:22.574992 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:22.581782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.582245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.583027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.583495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.649967 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-099e045e-6754-4fa0-aea1-8c44c79d19e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action" status: 204 len: 0 microversion: 2.1 time: 0.079852 Jun 04 21:51:22.650836 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3280/6458] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:51:22 2022] POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:51:22.659922 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:22.660933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:22.669706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.670157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.671109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.671856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.814154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:22.823213 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8fba963e-f98b-4d8b-8f68-5988d0ec508c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1691 microversion: 2.1 time: 0.167993 Jun 04 21:51:22.823862 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3179/6459] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:22 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:22.841392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:22.842218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:22.848908 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.849481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.850390 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:22.850916 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:22.992405 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:23.000447 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4cecc911-ac3c-4d6a-8a2a-adebe4e920b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1691 microversion: 2.1 time: 0.164533 Jun 04 21:51:23.001041 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3281/6460] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:22 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:24.017621 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:24.018260 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:24.026819 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:24.027270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:24.028076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:24.028508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:24.173768 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:24.182290 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6bc40b4a-2d64-4654-8245-523ca19935ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1683 microversion: 2.1 time: 0.168588 Jun 04 21:51:24.182921 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3180/6461] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:24 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:26.628363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-6d9ae7d8-59c8-4f4c-9521-9aeb31402403 req-c550156a-071c-40cc-851c-0700cf01b586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "name": "network-vif-plugged", "status": "completed", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:26.637687 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6d9ae7d8-59c8-4f4c-9521-9aeb31402403 req-c550156a-071c-40cc-851c-0700cf01b586 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:26.638148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-6d9ae7d8-59c8-4f4c-9521-9aeb31402403 req-c550156a-071c-40cc-851c-0700cf01b586 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:26.650811 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-6d9ae7d8-59c8-4f4c-9521-9aeb31402403 req-c550156a-071c-40cc-851c-0700cf01b586 service nova] Creating event network-vif-plugged:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch2-master-1 Jun 04 21:51:26.656124 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-6d9ae7d8-59c8-4f4c-9521-9aeb31402403 req-c550156a-071c-40cc-851c-0700cf01b586 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093188 Jun 04 21:51:26.656733 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3282/6462] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:51:46.383710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:46.384685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:46.388011 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=28 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:46.388713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:46.397932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:46.398371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:46.399146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:46.399608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:46.459715 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fd884349-dd4a-4f59-9e98-72948ec3f2b5 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action" status: 200 len: 24552 microversion: 2.1 time: 0.079876 Jun 04 21:51:46.460362 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3181/6463] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:51:46 2022] POST /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3/action => generated 24552 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:51:54.022867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=24 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:54.023708 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:51:54.027859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-33dab6b1-7655-4863-aa35-183f430724ab req-0621907c-0020-424c-80bb-23e43cf82bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:54.028333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:54.028614 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:54.036747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:54.037183 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:54.037998 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:54.038452 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:54.039926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-33dab6b1-7655-4863-aa35-183f430724ab req-0621907c-0020-424c-80bb-23e43cf82bde service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:54.040490 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-33dab6b1-7655-4863-aa35-183f430724ab req-0621907c-0020-424c-80bb-23e43cf82bde service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:54.057346 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-33dab6b1-7655-4863-aa35-183f430724ab req-0621907c-0020-424c-80bb-23e43cf82bde service nova] Creating event network-changed:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch2-master-1 Jun 04 21:51:54.063233 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-33dab6b1-7655-4863-aa35-183f430724ab req-0621907c-0020-424c-80bb-23e43cf82bde service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040180 Jun 04 21:51:54.064328 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3182/6464] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:51:54.079633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:51:54.191474 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9f89284d-a8be-49fa-af1e-b84b683d506a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 204 len: 0 microversion: 2.1 time: 0.170502 Jun 04 21:51:54.192991 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3283/6465] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:51:54 2022] DELETE /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:51:54.206465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:54.207555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:54.215220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:54.216401 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:54.216837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:54.217454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:54.357880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:54.366893 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c324fdb2-0831-4b05-837a-427fcb8d6883 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1689 microversion: 2.1 time: 0.165894 Jun 04 21:51:54.367482 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3183/6466] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:54 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:55.386513 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:55.387360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:55.395052 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:55.395495 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:55.396762 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:55.397190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:55.570447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:51:55.583110 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2315246d-d1f0-4b83-b07d-cf1b9950bb76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 200 len: 1689 microversion: 2.1 time: 0.200862 Jun 04 21:51:55.584048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3284/6467] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:55 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 1689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:51:56.133090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bcb68182-e23b-4d5e-99f8-1670e1fb9169 req-42f01c7a-dd1b-4548-8dbc-25bf5b1e180f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f5b2a80-290c-4c1d-a802-0cc140e9e9d3", "name": "network-vif-deleted", "tag": "da4f7e92-15b8-46e9-bf44-4c810b1bc5b2"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:51:56.141318 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bcb68182-e23b-4d5e-99f8-1670e1fb9169 req-42f01c7a-dd1b-4548-8dbc-25bf5b1e180f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:56.141755 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bcb68182-e23b-4d5e-99f8-1670e1fb9169 req-42f01c7a-dd1b-4548-8dbc-25bf5b1e180f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:56.154861 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bcb68182-e23b-4d5e-99f8-1670e1fb9169 req-42f01c7a-dd1b-4548-8dbc-25bf5b1e180f service nova] Creating event network-vif-deleted:da4f7e92-15b8-46e9-bf44-4c810b1bc5b2 for instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 on nch2-master-1 Jun 04 21:51:56.160486 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bcb68182-e23b-4d5e-99f8-1670e1fb9169 req-42f01c7a-dd1b-4548-8dbc-25bf5b1e180f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087535 Jun 04 21:51:56.162975 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3184/6468] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:51:56.601963 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:51:56.602544 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:51:56.610569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:56.611328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:56.612476 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:51:56.613121 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:51:56.628953 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] HTTP exception thrown: Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 could not be found. Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Request method failure captured: Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 HTTP/1.1 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9LvZTWbor-yDugxMo_4V-WiFToZ6IwjpX9Lb_ePGGCmdSK2xosUXCvt8c6DVsz0nQ7Z7DtRrJQg0HC0yjzZup4C-K7Ic1bPnC641HysWo9aa_40SrzZtkon_D4JCMuI8RzGVDpAZQkvo-eDbU_gwo6cjnxpLNCcgcZi2TrwVevqzTs Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2c33c0ba0b4445189c48dcd50d68f517 Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 could not be found. Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '6f5b2a80-290c-4c1d-a802-0cc140e9e9d3'} Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 could not be found. Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 could not be found. Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:51:56.630973 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 could not be found. Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Returning 404 to user: Instance 6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e327651b-e445-41ce-8e72-66b694f42e0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3" status: 404 len: 111 microversion: 2.1 time: 0.035181 Jun 04 21:51:56.636839 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3285/6469] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:51:56 2022] GET /compute/v2.1/servers/6f5b2a80-290c-4c1d-a802-0cc140e9e9d3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:52:00.367428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dcc70653-fe14-4425-af52-39d418365231 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '.version_select at 0x7f2d016ebb80>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:00.395429 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dcc70653-fe14-4425-af52-39d418365231 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110502087" status: 202 len: 0 microversion: 2.1 time: 0.033194 Jun 04 21:52:00.400632 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3185/6470] 10.222.0.18 () {58 vars in 1283 bytes} [Sat Jun 4 21:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1110502087 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:52:00.422679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-46e1819d-c0eb-4242-9073-8c32cc7a9a18 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: .version_select at 0x7f2d00f938b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-912563671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPx5Hgi1o+KUpGATYTpkLJxn4a8CNoy0ue9bIYb1w9hjG3/oOk1JM+JOwmzzth7la3ahdu2nMAhjVgnS+7aoFyxChO84KhOQLdSWpCI+FOAmxbB74k+osZzx7vBzA3O5AA=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:00.441069 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-46e1819d-c0eb-4242-9073-8c32cc7a9a18 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:52:00.447325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-46e1819d-c0eb-4242-9073-8c32cc7a9a18 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:52:00.473419 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-46e1819d-c0eb-4242-9073-8c32cc7a9a18 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054777 Jun 04 21:52:00.474042 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3286/6471] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:52:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:52:06.257766 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2024351267", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "45506798-f9b1-4db2-b1e5-b01214e78661"}], "key_name": "tempest-TestNetworkAdvancedServerOps-912563671", "security_groups": [{"name": "tempest-secgroup-smoke-563408020"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:06.267959 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=14 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:06.402620 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] validate_networks() for [('45506798-f9b1-4db2-b1e5-b01214e78661', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:52:06.805275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:52:06.805708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:52:06.806382 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:52:06.806797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:52:06.807224 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:52:06.819479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:06.819976 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:06.820791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:06.821230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:06.841073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:52:06.846581 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:52:06.859330 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:52:06.861781 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:52:06.912037 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5169ebfa-6301-4197-8141-2d4d11d03666 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.658491 Jun 04 21:52:06.913082 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3186/6472] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:52:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:52:06.921385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:06.926096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9b35f647-bbd1-4f7a-b781-164fd88b95c6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:06.926739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9b35f647-bbd1-4f7a-b781-164fd88b95c6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:06.986134 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9b35f647-bbd1-4f7a-b781-164fd88b95c6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:06.994364 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9b35f647-bbd1-4f7a-b781-164fd88b95c6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1266 microversion: 2.1 time: 0.074975 Jun 04 21:52:06.995031 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3287/6473] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:06 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:52:08.014315 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:08.017101 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:08.027692 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:08.029406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:08.030534 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:08.032068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:08.112247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:08.123901 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-73ea2165-89dc-41c9-b1b8-311112e5d83c tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1336 microversion: 2.1 time: 0.114753 Jun 04 21:52:08.126170 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3187/6474] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:08 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:09.143118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:09.143789 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:09.153102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:09.153552 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:09.154540 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:09.155172 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:09.373371 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:09.384273 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef7fc9af-ad9b-441c-a57f-917910dcc72d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1391 microversion: 2.1 time: 0.245037 Jun 04 21:52:09.384876 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3288/6475] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:09 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:09.673059 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-fe2a43f6-866e-4d76-a9f6-1f1ade6ba3a7 req-4db4a02c-f0d5-4217-a9f8-fa9b8239e3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59ed5b3-ddda-45f0-986a-88544b5c026e", "tag": "77ae4bac-02ea-4630-af14-7bf27d9c98c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:09.694406 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe2a43f6-866e-4d76-a9f6-1f1ade6ba3a7 req-4db4a02c-f0d5-4217-a9f8-fa9b8239e3d6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:09.697821 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-fe2a43f6-866e-4d76-a9f6-1f1ade6ba3a7 req-4db4a02c-f0d5-4217-a9f8-fa9b8239e3d6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:09.711495 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-fe2a43f6-866e-4d76-a9f6-1f1ade6ba3a7 req-4db4a02c-f0d5-4217-a9f8-fa9b8239e3d6 service nova] Creating event network-changed:77ae4bac-02ea-4630-af14-7bf27d9c98c0 for instance e59ed5b3-ddda-45f0-986a-88544b5c026e on nch2-master-1 Jun 04 21:52:09.719368 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-fe2a43f6-866e-4d76-a9f6-1f1ade6ba3a7 req-4db4a02c-f0d5-4217-a9f8-fa9b8239e3d6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051495 Jun 04 21:52:09.720792 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3188/6476] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:52:10.402512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:10.403154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:10.410734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:10.411207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:10.412037 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:10.412499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:10.561969 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:10.574277 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bd2d2f3c-9b38-4c40-beef-afeae0f702ac tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1391 microversion: 2.1 time: 0.175405 Jun 04 21:52:10.575159 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3289/6477] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:10 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:11.596305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:11.597005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:11.604046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:11.604495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:11.605269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:11.605701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:11.744408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:11.756175 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5abe68a0-b372-4863-aae8-71611490c906 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1391 microversion: 2.1 time: 0.165142 Jun 04 21:52:11.756774 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3189/6478] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:11 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:12.774463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:12.775752 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:12.782996 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:12.783490 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:12.784298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:12.784759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:12.927560 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:12.935358 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-779df6ef-6b72-4dd9-a728-7fd5adeb0176 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1391 microversion: 2.1 time: 0.165609 Jun 04 21:52:12.935954 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3290/6479] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:12 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:13.956184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:13.957116 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:13.968217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:13.968909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:13.970122 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:13.970797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:14.119001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:14.127132 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-7097ba9d-2604-4c89-b3ee-1c247be81869 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1391 microversion: 2.1 time: 0.177231 Jun 04 21:52:14.127778 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3190/6480] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:13 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:14.697168 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-fa128a47-9bec-4488-8af8-1ef516232177 req-3d0a4642-4a4e-41e1-8ac3-835f7cef12d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59ed5b3-ddda-45f0-986a-88544b5c026e", "name": "network-vif-plugged", "status": "completed", "tag": "77ae4bac-02ea-4630-af14-7bf27d9c98c0"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:14.706465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fa128a47-9bec-4488-8af8-1ef516232177 req-3d0a4642-4a4e-41e1-8ac3-835f7cef12d9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:14.706919 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-fa128a47-9bec-4488-8af8-1ef516232177 req-3d0a4642-4a4e-41e1-8ac3-835f7cef12d9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:14.722265 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-fa128a47-9bec-4488-8af8-1ef516232177 req-3d0a4642-4a4e-41e1-8ac3-835f7cef12d9 service nova] Creating event network-vif-plugged:77ae4bac-02ea-4630-af14-7bf27d9c98c0 for instance e59ed5b3-ddda-45f0-986a-88544b5c026e on nch2-master-1 Jun 04 21:52:14.727879 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-fa128a47-9bec-4488-8af8-1ef516232177 req-3d0a4642-4a4e-41e1-8ac3-835f7cef12d9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034600 Jun 04 21:52:14.728535 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3291/6481] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:52:15.148070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:15.148705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:15.157127 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:15.157552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:15.158400 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:15.158889 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:15.304104 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:15.312171 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3723a3b7-3b39-4e1c-8c95-aedc9819527f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1391 microversion: 2.1 time: 0.171108 Jun 04 21:52:15.312734 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3191/6482] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:15 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:16.330204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:16.330960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:16.337950 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:16.338486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:16.339224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:16.339698 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:16.488065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:16.496424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-43c0fcca-d624-4cad-aafa-59ab1d30ec2a tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1562 microversion: 2.1 time: 0.171438 Jun 04 21:52:16.497002 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3292/6483] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:16 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:16.518566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:16.519189 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:16.522530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:16.528123 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:16.528582 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:16.529344 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:16.529786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:16.670423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:16.678537 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f42b5399-74d8-457e-b3aa-b28844a172f1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1562 microversion: 2.1 time: 0.164063 Jun 04 21:52:16.679123 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3192/6484] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:16 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:18.367076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:18.368486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:18.374920 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-2b765be5-57ea-4f95-90d5-622c7493dc67 req-602558e3-1170-4700-bb3c-badff96bffe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59ed5b3-ddda-45f0-986a-88544b5c026e", "tag": "77ae4bac-02ea-4630-af14-7bf27d9c98c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:18.381376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:18.386657 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:18.387147 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:18.389062 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:18.389752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:18.397797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2b765be5-57ea-4f95-90d5-622c7493dc67 req-602558e3-1170-4700-bb3c-badff96bffe6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:18.398228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-2b765be5-57ea-4f95-90d5-622c7493dc67 req-602558e3-1170-4700-bb3c-badff96bffe6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:18.400160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:18.400640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:18.413813 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-2b765be5-57ea-4f95-90d5-622c7493dc67 req-602558e3-1170-4700-bb3c-badff96bffe6 service nova] Creating event network-changed:77ae4bac-02ea-4630-af14-7bf27d9c98c0 for instance e59ed5b3-ddda-45f0-986a-88544b5c026e on nch2-master-1 Jun 04 21:52:18.419124 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-2b765be5-57ea-4f95-90d5-622c7493dc67 req-602558e3-1170-4700-bb3c-badff96bffe6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048048 Jun 04 21:52:18.420070 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3193/6485] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:52:18.620266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:18.628364 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4de4a41d-4b52-45a9-84d6-d22eca9902a1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1562 microversion: 2.1 time: 0.265258 Jun 04 21:52:18.629021 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3293/6486] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:18 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1562 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:27.482822 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:52:27.483530 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 21:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:52:39.897391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:39.898156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=36 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:39.980611 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:39.981707 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:39.990841 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:39.991297 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:39.992096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:39.992540 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:40.043878 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c720452c-e21f-49fa-87d3-a3c8b89c6211 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action" status: 200 len: 24566 microversion: 2.1 time: 0.148447 Jun 04 21:52:40.044508 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3194/6487] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:52:39 2022] POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action => generated 24566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:52:46.446567 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-749fca23-5194-459e-b4ab-d7362eda2d72 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:46.449014 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:46.449854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=32 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:52:46.455886 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-749fca23-5194-459e-b4ab-d7362eda2d72 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:46.456346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-749fca23-5194-459e-b4ab-d7362eda2d72 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:46.480053 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-749fca23-5194-459e-b4ab-d7362eda2d72 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Going to try to stop instance {{(pid=137228) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 04 21:52:46.528540 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-749fca23-5194-459e-b4ab-d7362eda2d72 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action" status: 202 len: 0 microversion: 2.1 time: 0.085901 Jun 04 21:52:46.529164 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3294/6488] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:52:46 2022] POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:52:46.539501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:46.540269 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:46.548254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:46.548709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:46.549544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:46.549966 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:46.702908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:46.711405 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-87fcce9c-13be-4c82-84d2-e32655add76b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.176332 Jun 04 21:52:46.712026 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3195/6489] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:46 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:47.735958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:47.737154 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:47.750968 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:47.751441 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:47.752270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:47.752727 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:47.897482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:47.905782 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-35c0832f-bee3-4321-928e-356f97361933 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.179153 Jun 04 21:52:47.906368 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3295/6490] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:47 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:48.929184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:48.929901 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:48.939872 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:48.940408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:48.941309 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:48.941822 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:49.099465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:49.107585 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-34a967f2-874d-43ba-a379-c6cafa6a5115 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.183206 Jun 04 21:52:49.108220 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3196/6491] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:48 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:50.128782 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:50.129914 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:50.142072 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:50.142858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:50.144241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:50.145010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:50.286775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:50.294883 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-61c038be-5e06-41f9-94cf-741980011ff3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.172889 Jun 04 21:52:50.295493 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3296/6492] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:50 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:51.316152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:51.316878 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:51.326053 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:51.326613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:51.327662 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:51.328214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:51.479778 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:51.488262 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-40c107f2-3ec9-49af-a077-f4bb09b4c8e9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.178384 Jun 04 21:52:51.488881 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3197/6493] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:51 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:52.513424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:52.514461 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:52.523189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:52.523732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:52.524512 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:52.524966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:52.668872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:52.677265 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4a5d7fc9-e3fb-4063-ab64-42364ed2646e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.170536 Jun 04 21:52:52.677840 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3297/6494] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:52 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:53.698680 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:53.699735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:53.711753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:53.712509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:53.713784 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:53.714512 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:53.849990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:53.857842 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-861c1216-2095-4b0f-9549-c963a3022458 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.165901 Jun 04 21:52:53.858426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3198/6495] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:53 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:54.879554 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:54.880651 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:54.892105 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:54.892573 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:54.893364 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:54.893825 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:55.042503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:55.051044 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7f997f70-1073-4af5-8064-91f85e9317dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.179218 Jun 04 21:52:55.051631 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3298/6496] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:54 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:56.069459 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:56.070068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:56.077334 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:56.077801 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:56.078608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:56.079064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:56.220871 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:56.229081 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d7427e3f-ebc2-462b-b393-7f46ab243ef3 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1691 microversion: 2.1 time: 0.163626 Jun 04 21:52:56.229658 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3199/6497] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:56 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:57.253676 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:57.254313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:57.261880 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:57.262352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:57.263146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:57.263637 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:57.407873 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:57.415772 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-67d65cfb-9249-4382-8178-5661075208cc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1668 microversion: 2.1 time: 0.168282 Jun 04 21:52:57.416346 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3299/6498] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:57 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:52:58.526536 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:58.527731 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:58.537810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:58.538451 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:58.539624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:58.540225 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:58.591324 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-58a10791-06d0-4038-ac58-4e77955a31d9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action" status: 200 len: 35017 microversion: 2.1 time: 0.070492 Jun 04 21:52:58.592001 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3200/6499] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:52:58 2022] POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action => generated 35017 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:52:58.603502 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ffac1342-89d0-4bcd-940b-5ead1129535f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:52:58.611691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffac1342-89d0-4bcd-940b-5ead1129535f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:58.612268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ffac1342-89d0-4bcd-940b-5ead1129535f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:58.636042 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ffac1342-89d0-4bcd-940b-5ead1129535f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Going to try to start instance {{(pid=137228) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 04 21:52:58.684815 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ffac1342-89d0-4bcd-940b-5ead1129535f tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action" status: 202 len: 0 microversion: 2.1 time: 0.085157 Jun 04 21:52:58.685440 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3300/6500] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:52:58 2022] POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:52:58.695070 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:58.695876 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:58.703974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:58.704669 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:58.705709 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:58.706157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:58.940567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:52:58.948886 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-8d147f8d-ebe4-4df0-a592-cef34a593012 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1677 microversion: 2.1 time: 0.258257 Jun 04 21:52:58.949576 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3201/6501] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:58 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:52:59.971426 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:52:59.972171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:52:59.979063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:59.979541 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:52:59.980333 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:52:59.980779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:00.121414 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:00.133762 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8a8c3365-35cb-45cb-87de-8c52399eb0ed tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1681 microversion: 2.1 time: 0.167426 Jun 04 21:53:00.134601 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3301/6502] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:52:59 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:24.355606 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:24.356516 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:24.359192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:24.359896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=44 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:24.366912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:24.367387 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:24.368304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:24.368735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:24.423398 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6cec1bbf-5b07-44e9-b2e3-44e3d81eac9e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action" status: 200 len: 59579 microversion: 2.1 time: 0.072832 Jun 04 21:53:24.424096 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3202/6503] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:53:24 2022] POST /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e/action => generated 59579 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:53:31.493859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0789d5ca-4c52-4ef0-b6b1-5dc383139b71 req-1c383264-0ff8-49ac-8cb4-353845beddd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59ed5b3-ddda-45f0-986a-88544b5c026e", "tag": "77ae4bac-02ea-4630-af14-7bf27d9c98c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:31.501564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:31.502082 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:31.505728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=16 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:31.506403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:31.510100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:31.510580 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:31.514475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:31.515194 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:31.517012 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0789d5ca-4c52-4ef0-b6b1-5dc383139b71 req-1c383264-0ff8-49ac-8cb4-353845beddd5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:31.517579 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0789d5ca-4c52-4ef0-b6b1-5dc383139b71 req-1c383264-0ff8-49ac-8cb4-353845beddd5 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:31.533844 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0789d5ca-4c52-4ef0-b6b1-5dc383139b71 req-1c383264-0ff8-49ac-8cb4-353845beddd5 service nova] Creating event network-changed:77ae4bac-02ea-4630-af14-7bf27d9c98c0 for instance e59ed5b3-ddda-45f0-986a-88544b5c026e on nch2-master-1 Jun 04 21:53:31.539679 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0789d5ca-4c52-4ef0-b6b1-5dc383139b71 req-1c383264-0ff8-49ac-8cb4-353845beddd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049829 Jun 04 21:53:31.540658 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3203/6504] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:53:31.546457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:53:31.647609 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c788c67f-0e20-43d8-bca3-510ed08f72ef tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 204 len: 0 microversion: 2.1 time: 0.159028 Jun 04 21:53:31.650874 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3302/6505] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:53:31 2022] DELETE /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:53:31.663858 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:31.664786 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:31.672251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:31.672710 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:31.673547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:31.673994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:31.828963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:31.836932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8d6b30d-72c9-4a18-8e31-777be68db034 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1687 microversion: 2.1 time: 0.180667 Jun 04 21:53:31.837521 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3204/6506] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:31 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:32.855173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:32.855958 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:32.863396 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:32.863903 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:32.864695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:32.865820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:33.039796 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:33.048152 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8bf3166c-a45e-45b4-99dd-a2b7f4018bb2 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1687 microversion: 2.1 time: 0.197310 Jun 04 21:53:33.048715 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3303/6507] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:32 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:33.605820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8c9c2e27-3288-472a-8098-2dfd6416bd5f req-69aaabca-182b-4b79-b0ef-d49c906b2dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59ed5b3-ddda-45f0-986a-88544b5c026e", "name": "network-vif-deleted", "tag": "77ae4bac-02ea-4630-af14-7bf27d9c98c0"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:33.616272 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8c9c2e27-3288-472a-8098-2dfd6416bd5f req-69aaabca-182b-4b79-b0ef-d49c906b2dc2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:33.616723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8c9c2e27-3288-472a-8098-2dfd6416bd5f req-69aaabca-182b-4b79-b0ef-d49c906b2dc2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:33.629413 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8c9c2e27-3288-472a-8098-2dfd6416bd5f req-69aaabca-182b-4b79-b0ef-d49c906b2dc2 service nova] Creating event network-vif-deleted:77ae4bac-02ea-4630-af14-7bf27d9c98c0 for instance e59ed5b3-ddda-45f0-986a-88544b5c026e on nch2-master-1 Jun 04 21:53:33.635225 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8c9c2e27-3288-472a-8098-2dfd6416bd5f req-69aaabca-182b-4b79-b0ef-d49c906b2dc2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Jun 04 21:53:33.635933 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3205/6508] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:53:34.065378 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:34.066018 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:34.073866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:34.074329 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:34.075140 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:34.075615 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:34.111911 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:34.112250 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:34.112722 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lazy-loading 'fault' on Instance uuid e59ed5b3-ddda-45f0-986a-88544b5c026e {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:53:34.167972 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:34.175828 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7fdbf8b6-75c5-4237-9f1f-4e3a3816ec60 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 200 len: 1356 microversion: 2.1 time: 0.114645 Jun 04 21:53:34.176485 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3304/6509] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:34 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 1356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:35.200393 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:35.201113 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: e59ed5b3-ddda-45f0-986a-88544b5c026e] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:35.208176 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:35.208642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:35.209421 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:35.209870 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:35.224067 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] HTTP exception thrown: Instance e59ed5b3-ddda-45f0-986a-88544b5c026e could not be found. Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Request method failure captured: Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e HTTP/1.1 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9LvZTWbor-yDugxMo_4V-WiFToZ6IwjpX9Lb_ePGGCmdSK2xosUXCvt8c6DVsz0nQ7Z7DtRrJQg0HC0yjzZup4C-K7Ic1bPnC641HysWo9aa_40SrzZtkon_D4JCMuI8RzGVDpAZQkvo-eDbU_gwo6cjnxpLNCcgcZi2TrwVevqzTs Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 2c33c0ba0b4445189c48dcd50d68f517 Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance e59ed5b3-ddda-45f0-986a-88544b5c026e could not be found. Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'e59ed5b3-ddda-45f0-986a-88544b5c026e'} Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59ed5b3-ddda-45f0-986a-88544b5c026e could not be found. Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59ed5b3-ddda-45f0-986a-88544b5c026e could not be found. Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:53:35.225984 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59ed5b3-ddda-45f0-986a-88544b5c026e could not be found. Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Returning 404 to user: Instance e59ed5b3-ddda-45f0-986a-88544b5c026e could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-23a85c4e-337e-4f02-92d3-ee62397b1952 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e" status: 404 len: 111 microversion: 2.1 time: 0.036297 Jun 04 21:53:35.229764 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3206/6510] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:35 2022] GET /compute/v2.1/servers/e59ed5b3-ddda-45f0-986a-88544b5c026e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:53:38.923462 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a6f6143b-244c-4a6c-b8b2-572660057d23 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '.version_select at 0x7f2d00d5eca0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:38.947261 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a6f6143b-244c-4a6c-b8b2-572660057d23 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-912563671" status: 202 len: 0 microversion: 2.1 time: 0.028748 Jun 04 21:53:38.948223 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3305/6511] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 21:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-912563671 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:53:38.980675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d3620677-93c6-4b6e-bcd5-09e8875bf7e4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: .version_select at 0x7f2d01659310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-400492248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnpWiTLSg1EOoTqZHUrqO0kcyhfysHGDlro14f2ljx2q0Yhtsxiax4LyDcEgFusbFX2pIaneGLUEcUCkRtrbDFX9TzCa2gKD7a0KXZhoFVRftkEUF8m5cf5XXzwXKeOIQ=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:39.000219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-d3620677-93c6-4b6e-bcd5-09e8875bf7e4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:53:39.006131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-d3620677-93c6-4b6e-bcd5-09e8875bf7e4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:53:39.033540 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d3620677-93c6-4b6e-bcd5-09e8875bf7e4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057832 Jun 04 21:53:39.034199 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3207/6512] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:53:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:53:44.552487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:44.558216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-485377051", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "networks": [{"uuid": "6c18d277-c57b-4561-a42a-4c02afbb0975"}], "key_name": "tempest-TestNetworkAdvancedServerOps-400492248", "security_groups": [{"name": "tempest-secgroup-smoke-1060600103"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:44.686110 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] validate_networks() for [('6c18d277-c57b-4561-a42a-4c02afbb0975', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:53:45.266977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:53:45.267422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:53:45.267949 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:53:45.268401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:53:45.268910 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:53:45.280223 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:45.280697 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:45.281530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:45.282171 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:45.303403 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:53:45.309173 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Getting quotas for user 2c33c0ba0b4445189c48dcd50d68f517 and project 54b08e1dce6b4ab496c539019c6ab8da. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:53:45.323209 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:53:45.325654 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:53:45.385874 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-702a22da-8fcd-4ed6-aa61-fd5006f2d7b0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.834898 Jun 04 21:53:45.386759 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3306/6513] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:53:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:53:45.396567 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=16 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:45.402289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-902c7b1d-73e4-4fd0-a049-0dc62b19f6e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:45.403001 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-902c7b1d-73e4-4fd0-a049-0dc62b19f6e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:45.463644 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-902c7b1d-73e4-4fd0-a049-0dc62b19f6e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:45.473092 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-902c7b1d-73e4-4fd0-a049-0dc62b19f6e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1265 microversion: 2.1 time: 0.078941 Jun 04 21:53:45.480582 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3208/6514] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:45 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:46.492298 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0b1480fa-a4ae-49d8-8489-e9664abddd94 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:46.494117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0b1480fa-a4ae-49d8-8489-e9664abddd94 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:46.555036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0b1480fa-a4ae-49d8-8489-e9664abddd94 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:46.565315 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0b1480fa-a4ae-49d8-8489-e9664abddd94 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1265 microversion: 2.1 time: 0.077314 Jun 04 21:53:46.566542 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3307/6515] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:46 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:47.584230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-d374d73b-2f02-4adc-a364-336ea00d21e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:47.585555 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-d374d73b-2f02-4adc-a364-336ea00d21e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:47.664084 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-d374d73b-2f02-4adc-a364-336ea00d21e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:47.671299 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-d374d73b-2f02-4adc-a364-336ea00d21e0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1265 microversion: 2.1 time: 0.092765 Jun 04 21:53:47.672413 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3209/6516] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:47 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:48.693089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bcd37c5f-54b3-4d81-8341-7e70b9d24517 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:48.694145 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bcd37c5f-54b3-4d81-8341-7e70b9d24517 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:48.754196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bcd37c5f-54b3-4d81-8341-7e70b9d24517 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:48.761348 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bcd37c5f-54b3-4d81-8341-7e70b9d24517 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1265 microversion: 2.1 time: 0.074969 Jun 04 21:53:48.761908 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3308/6517] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:48 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1265 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:49.782015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:49.782689 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:49.790715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:49.791206 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:49.792086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:49.792559 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:49.857089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:49.865235 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5aab3c9-234e-4054-8aff-e4069caaec5b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1269 microversion: 2.1 time: 0.089358 Jun 04 21:53:49.865787 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3210/6518] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:49 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:50.885241 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:50.885845 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:50.894273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:50.894673 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:50.895487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:50.895970 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:50.960776 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:50.968586 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-75445036-ca73-4d16-b01c-16c7f62a26f4 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1323 microversion: 2.1 time: 0.087293 Jun 04 21:53:50.969364 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3309/6519] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:50 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1323 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:51.997477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:51.999619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:52.001537 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-4731294d-68d5-4722-9933-45d81e964b4f req-6d44f0da-368e-4467-908e-00df1734c641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1c0d16-c733-433c-8cf1-15045a55f20f", "tag": "74f40d97-761f-4f0e-adda-9789acf1d3dd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:52.015953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:52.016336 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:52.017167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:52.019247 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:52.029010 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4731294d-68d5-4722-9933-45d81e964b4f req-6d44f0da-368e-4467-908e-00df1734c641 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:52.029471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-4731294d-68d5-4722-9933-45d81e964b4f req-6d44f0da-368e-4467-908e-00df1734c641 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:52.043755 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-4731294d-68d5-4722-9933-45d81e964b4f req-6d44f0da-368e-4467-908e-00df1734c641 service nova] Creating event network-changed:74f40d97-761f-4f0e-adda-9789acf1d3dd for instance 4d1c0d16-c733-433c-8cf1-15045a55f20f on nch2-master-1 Jun 04 21:53:52.049975 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-4731294d-68d5-4722-9933-45d81e964b4f req-6d44f0da-368e-4467-908e-00df1734c641 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059378 Jun 04 21:53:52.050960 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3310/6520] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:53:52.181058 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:52.189563 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0326b80c-8550-43e5-b987-7b12c6c56c38 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1391 microversion: 2.1 time: 0.207153 Jun 04 21:53:52.190140 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3211/6521] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:51 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1391 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:53.213076 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:53.214285 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:53.227032 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:53.228227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:53.229979 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:53.231068 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:53.378346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:53.386260 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b55394c3-83dd-40d4-9851-91bcb54a3d49 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1391 microversion: 2.1 time: 0.181826 Jun 04 21:53:53.387078 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3311/6522] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:53 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:54.403599 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:54.404232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:54.406881 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:54.412997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:54.413441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:54.414212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:54.414652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:54.560212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:54.568468 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-800cae82-8ad8-4619-add9-a90bcbab2539 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1391 microversion: 2.1 time: 0.168959 Jun 04 21:53:54.569066 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3212/6523] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:54 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:55.585360 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:55.586191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:55.589538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:55.595780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:55.596424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:55.597355 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:55.597879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:55.744689 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:55.752538 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a75a2e6d-17bc-4ac2-a422-0ec5aa8d4c88 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1391 microversion: 2.1 time: 0.171242 Jun 04 21:53:55.753147 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3312/6524] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:55 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:56.774830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:56.775818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:56.784929 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:56.785378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:56.786152 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:56.786587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:56.939093 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:56.947526 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-261de36c-b3e7-46de-a473-70a9f03c7c7d tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1391 microversion: 2.1 time: 0.179817 Jun 04 21:53:56.948114 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3213/6525] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:56 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:57.220936 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-11583b3b-fedf-4b87-81d3-59529bf57b6c req-e3637ee9-f992-4071-a149-d5e59b7df35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1c0d16-c733-433c-8cf1-15045a55f20f", "name": "network-vif-plugged", "status": "completed", "tag": "74f40d97-761f-4f0e-adda-9789acf1d3dd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:53:57.231136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-11583b3b-fedf-4b87-81d3-59529bf57b6c req-e3637ee9-f992-4071-a149-d5e59b7df35c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:57.231642 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-11583b3b-fedf-4b87-81d3-59529bf57b6c req-e3637ee9-f992-4071-a149-d5e59b7df35c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:57.245076 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-11583b3b-fedf-4b87-81d3-59529bf57b6c req-e3637ee9-f992-4071-a149-d5e59b7df35c service nova] Creating event network-vif-plugged:74f40d97-761f-4f0e-adda-9789acf1d3dd for instance 4d1c0d16-c733-433c-8cf1-15045a55f20f on nch2-master-1 Jun 04 21:53:57.250558 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-11583b3b-fedf-4b87-81d3-59529bf57b6c req-e3637ee9-f992-4071-a149-d5e59b7df35c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034104 Jun 04 21:53:57.251460 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3313/6526] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:53:57.969690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:57.970772 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:57.973674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:57.984031 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:57.984456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:57.985240 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:57.985674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:58.134963 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:58.147029 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ff95a54-10f3-4cb3-82dc-f1cfffac69dc tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1391 microversion: 2.1 time: 0.183908 Jun 04 21:53:58.147837 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3214/6527] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:57 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:59.165794 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=10 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:53:59.169912 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:59.170664 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:59.177516 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:59.177978 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:59.178757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:59.179204 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:59.319267 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:59.327291 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d17dec0-dc9a-4084-ba70-d4b19e810baa tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1564 microversion: 2.1 time: 0.163708 Jun 04 21:53:59.327914 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3314/6528] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:59 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:53:59.349561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:53:59.350193 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:53:59.358183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:59.358642 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:59.359446 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:53:59.359923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:53:59.509777 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:53:59.521523 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0ce7a284-ad61-4e33-9afc-fec02ed6f944 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1564 microversion: 2.1 time: 0.175357 Jun 04 21:53:59.522197 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3215/6529] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:53:59 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:01.561607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:01.562242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:01.564403 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-150eb916-c55e-42a2-8131-82819c14fc70 req-797d8caf-84bf-4294-94dc-ab9e0b93b69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1c0d16-c733-433c-8cf1-15045a55f20f", "tag": "74f40d97-761f-4f0e-adda-9789acf1d3dd"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:01.568943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:01.571224 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:01.571741 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:01.572616 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:01.573460 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:01.576509 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-150eb916-c55e-42a2-8131-82819c14fc70 req-797d8caf-84bf-4294-94dc-ab9e0b93b69a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:01.577133 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-150eb916-c55e-42a2-8131-82819c14fc70 req-797d8caf-84bf-4294-94dc-ab9e0b93b69a service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:01.589818 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-150eb916-c55e-42a2-8131-82819c14fc70 req-797d8caf-84bf-4294-94dc-ab9e0b93b69a service nova] Creating event network-changed:74f40d97-761f-4f0e-adda-9789acf1d3dd for instance 4d1c0d16-c733-433c-8cf1-15045a55f20f on nch2-master-1 Jun 04 21:54:01.595923 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-150eb916-c55e-42a2-8131-82819c14fc70 req-797d8caf-84bf-4294-94dc-ab9e0b93b69a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035748 Jun 04 21:54:01.596814 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3216/6530] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:54:01.732095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:01.741443 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2de06034-0fd3-4e15-83ea-fd0cdaa29763 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1564 microversion: 2.1 time: 0.183748 Jun 04 21:54:01.742048 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3315/6531] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:01 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:23.316035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=9 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:23.317092 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=38 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:23.321442 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:23.322493 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:23.332376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:23.332830 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:23.333600 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:23.334038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:23.385748 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2ffaed8b-fd9e-4176-8dae-20a0ef475ed1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action" status: 200 len: 24574 microversion: 2.1 time: 0.071565 Jun 04 21:54:23.386426 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3217/6532] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:54:23 2022] POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:54:29.767111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:29.767756 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:29.770109 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:29.770778 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=36 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:29.777304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:29.777767 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:29.778568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:29.779024 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:29.804262 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lazy-loading 'flavor' on Instance uuid 4d1c0d16-c733-433c-8cf1-15045a55f20f {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:54:29.884027 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-164eb6ff-1d85-45d1-af22-9610129809d0 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action" status: 202 len: 0 microversion: 2.1 time: 0.120639 Jun 04 21:54:29.884641 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3316/6533] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:54:29 2022] POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:54:29.895097 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:29.895849 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:29.905069 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:29.905526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:29.906317 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:29.906939 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:30.054769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:30.062793 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b83938c8-a585-44de-8dcc-48a110271154 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1691 microversion: 2.1 time: 0.172329 Jun 04 21:54:30.063338 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3218/6534] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:29 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:31.081842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:31.082587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:31.089677 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:31.090144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:31.090940 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:31.091398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:31.248771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:31.257100 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c2daa6bc-9490-47d0-8a99-43bedf98de76 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1674 microversion: 2.1 time: 0.180507 Jun 04 21:54:31.257711 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3317/6535] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:31 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:32.353102 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:32.354054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:32.365820 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:32.366323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:32.367702 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:32.368503 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:32.424189 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e5eef183-8f05-410d-96b3-09fcedf30a32 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action" status: 200 len: 35854 microversion: 2.1 time: 0.076236 Jun 04 21:54:32.425128 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3219/6536] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:54:32 2022] POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action => generated 35854 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:54:32.436759 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:32.437323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:32.445600 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:32.445781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:32.446531 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:32.446982 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:32.525154 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2d09aab1-e7d9-4b0c-b608-1f7a6d2586e6 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action" status: 202 len: 0 microversion: 2.1 time: 0.092203 Jun 04 21:54:32.525823 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3318/6537] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:54:32 2022] POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:54:32.536003 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:32.536715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:32.544686 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:32.545391 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:32.546265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:32.546705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:32.695301 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:32.703419 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5eff255-573b-4d94-9261-dc70829ad91b tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1680 microversion: 2.1 time: 0.171739 Jun 04 21:54:32.704012 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3220/6538] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:32 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:33.729095 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:33.730272 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:33.741227 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:33.742020 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:33.742850 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:33.743313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:33.881862 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:33.890776 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-42f7d389-bbb8-41c6-bc1b-2b1854ede639 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1680 microversion: 2.1 time: 0.170680 Jun 04 21:54:33.891350 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3319/6539] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:33 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:34.913349 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:34.914456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:34.925491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:34.926068 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:34.927079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:34.927752 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:35.066785 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:35.075392 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ded7a999-1fb8-4611-84f7-e907c95b8dfd tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1683 microversion: 2.1 time: 0.168812 Jun 04 21:54:35.076233 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3221/6540] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:34 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:35.180639 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:35.181526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:35.188719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:35.189191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:35.189981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:35.190433 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:35.232424 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-249d47e3-da20-4985-ae0f-014f1da93fc9 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action" status: 200 len: 35854 microversion: 2.1 time: 0.057514 Jun 04 21:54:35.233277 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3320/6541] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:54:35 2022] POST /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f/action => generated 35854 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 04 21:54:36.378296 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:36.379350 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:36.381859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c5689f3d-8622-4279-a33e-240e1eb73679 req-763e8414-05d9-4038-8f53-ec2e8132a1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d1c0d16-c733-433c-8cf1-15045a55f20f", "tag": "74f40d97-761f-4f0e-adda-9789acf1d3dd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:36.387561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:36.388026 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:36.388985 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:36.389657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:36.392444 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c5689f3d-8622-4279-a33e-240e1eb73679 req-763e8414-05d9-4038-8f53-ec2e8132a1e8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:36.392909 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c5689f3d-8622-4279-a33e-240e1eb73679 req-763e8414-05d9-4038-8f53-ec2e8132a1e8 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:36.405183 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c5689f3d-8622-4279-a33e-240e1eb73679 req-763e8414-05d9-4038-8f53-ec2e8132a1e8 service nova] Creating event network-changed:74f40d97-761f-4f0e-adda-9789acf1d3dd for instance 4d1c0d16-c733-433c-8cf1-15045a55f20f on nch2-master-1 Jun 04 21:54:36.410213 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c5689f3d-8622-4279-a33e-240e1eb73679 req-763e8414-05d9-4038-8f53-ec2e8132a1e8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032452 Jun 04 21:54:36.410813 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3321/6542] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:54:36.418742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:54:36.512184 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5569d81e-b301-40bb-a47c-ed12108eed67 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 204 len: 0 microversion: 2.1 time: 0.136645 Jun 04 21:54:36.513101 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3222/6543] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:54:36 2022] DELETE /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:54:36.524001 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:36.524735 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:36.531694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:36.532156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:36.532946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:36.533393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:36.673043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:36.681464 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e084416f-d653-43b3-85ed-90db97c65219 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1689 microversion: 2.1 time: 0.162995 Jun 04 21:54:36.682090 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3322/6544] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:36 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:37.705076 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:37.706340 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:37.718423 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:37.719199 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:37.720554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:37.721304 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:37.870829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:37.879205 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-faa3f629-3176-41d8-8df2-5d4e7316ba73 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1689 microversion: 2.1 time: 0.181452 Jun 04 21:54:37.879810 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3223/6545] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:37 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:38.560875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-292c94d8-0379-4065-b9fb-adc2f5800e76 req-bfa43946-9572-467d-8989-fd338af09253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d1c0d16-c733-433c-8cf1-15045a55f20f", "name": "network-vif-deleted", "tag": "74f40d97-761f-4f0e-adda-9789acf1d3dd"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:38.571017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-292c94d8-0379-4065-b9fb-adc2f5800e76 req-bfa43946-9572-467d-8989-fd338af09253 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:38.571464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-292c94d8-0379-4065-b9fb-adc2f5800e76 req-bfa43946-9572-467d-8989-fd338af09253 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:38.584863 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-292c94d8-0379-4065-b9fb-adc2f5800e76 req-bfa43946-9572-467d-8989-fd338af09253 service nova] Creating event network-vif-deleted:74f40d97-761f-4f0e-adda-9789acf1d3dd for instance 4d1c0d16-c733-433c-8cf1-15045a55f20f on nch2-master-1 Jun 04 21:54:38.589784 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-292c94d8-0379-4065-b9fb-adc2f5800e76 req-bfa43946-9572-467d-8989-fd338af09253 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Jun 04 21:54:38.590392 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3323/6546] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:54:38.898438 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:38.899449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:38.907745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:38.908372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:38.909402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:38.909943 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:38.948117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:38.948673 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:38.949208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lazy-loading 'fault' on Instance uuid 4d1c0d16-c733-433c-8cf1-15045a55f20f {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:54:39.001782 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c33c0ba0b4445189c48dcd50d68f517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b08e1dce6b4ab496c539019c6ab8da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:39.011264 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b194f4eb-14f6-4482-8ee5-b4fe9de90ec1 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 200 len: 1355 microversion: 2.1 time: 0.117380 Jun 04 21:54:39.012133 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3224/6547] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:38 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 1355 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:40.032443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:40.033328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] [instance: 4d1c0d16-c733-433c-8cf1-15045a55f20f] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:40.041526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:40.041991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:40.042773 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:40.043219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:40.057107 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.wsgi [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] HTTP exception thrown: Instance 4d1c0d16-c733-433c-8cf1-15045a55f20f could not be found. Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Request method failure captured: Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: request: GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f HTTP/1.1 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Accept: application/json Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Accept-Encoding: identity Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Connection: close Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Content-Length: 0 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Content-Type: application/json Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Host: 10.222.0.18 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: Openstack-System-Scope: None Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: User-Agent: python-urllib3/1.26.9 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Auth-Token: gAAAAABim9LvZTWbor-yDugxMo_4V-WiFToZ6IwjpX9Lb_ePGGCmdSK2xosUXCvt8c6DVsz0nQ7Z7DtRrJQg0HC0yjzZup4C-K7Ic1bPnC641HysWo9aa_40SrzZtkon_D4JCMuI8RzGVDpAZQkvo-eDbU_gwo6cjnxpLNCcgcZi2TrwVevqzTs Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Id: None Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Domain-Name: None Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Identity-Status: Confirmed Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Is-Admin-Project: True Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Id: default Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Domain-Name: Default Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Role: member,reader Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Roles: member,reader Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/54b08e1dce6b4ab496c539019c6ab8da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Id: 54b08e1dce6b4ab496c539019c6ab8da Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1875438305 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-User: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Id: default Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Domain-Name: Default Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Id: 2c33c0ba0b4445189c48dcd50d68f517 Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1875438305-project Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: method: > Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: exception: Instance 4d1c0d16-c733-433c-8cf1-15045a55f20f could not be found. Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: action_args: {'id': '4d1c0d16-c733-433c-8cf1-15045a55f20f'} Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d1c0d16-c733-433c-8cf1-15045a55f20f could not be found. Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d1c0d16-c733-433c-8cf1-15045a55f20f could not be found. Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:54:40.058739 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d1c0d16-c733-433c-8cf1-15045a55f20f could not be found. Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: ERROR nova.api.openstack.wsgi Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Returning 404 to user: Instance 4d1c0d16-c733-433c-8cf1-15045a55f20f could not be found. {{(pid=137228) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dc6b4b89-6994-4940-b868-b4371aba0e89 tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f" status: 404 len: 111 microversion: 2.1 time: 0.034383 Jun 04 21:54:40.063158 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3324/6548] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:40 2022] GET /compute/v2.1/servers/4d1c0d16-c733-433c-8cf1-15045a55f20f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:54:43.443080 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-992c4997-4771-4595-923a-5e669249dd0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] Calling method '.version_select at 0x7f2d01f6a0d0>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:43.464507 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-992c4997-4771-4595-923a-5e669249dd0e tempest-TestNetworkAdvancedServerOps-1875438305 tempest-TestNetworkAdvancedServerOps-1875438305-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-400492248" status: 202 len: 0 microversion: 2.1 time: 0.025285 Jun 04 21:54:43.469494 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3225/6549] 10.222.0.18 () {58 vars in 1280 bytes} [Sat Jun 4 21:54:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-400492248 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:54:54.944534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=18 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:54.946472 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:55.152372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-b2aa9991-f61b-47ff-abe5-4ff5ea888fc8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'create', calling method: .version_select at 0x7f2d00398f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-686961193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGbvxy0/nwU8MCePV9G5iKaLkWGMYfs3MlPTRFeSm0Ax/fbmSKQQg8nV0fkN6i9UC/itC3/aHGsliZI+FGb0A4ysPPHEIrIfeweCF0E8lE/Qp+UsO+O+bI6jT2CIz7jIw=="}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:55.169770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b2aa9991-f61b-47ff-abe5-4ff5ea888fc8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for project 179af47cc6864305ab601ac5edd826ee. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:54:55.176325 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-b2aa9991-f61b-47ff-abe5-4ff5ea888fc8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for user e94e127dc47a477d848d7ff172109538 and project 179af47cc6864305ab601ac5edd826ee. Resources: {'key_pairs'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:54:55.206536 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-b2aa9991-f61b-47ff-abe5-4ff5ea888fc8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.267994 Jun 04 21:54:55.207152 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3325/6550] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:54:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:54:56.258119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:56.258888 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:54:56.263144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1386881258", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-686961193", "security_groups": [{"name": "tempest-secgroup-smoke-1201807743"}], "networks": [{"uuid": "b4834023-fcbf-4561-9638-40faf5a5bff3"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:56.375942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] validate_networks() for [('b4834023-fcbf-4561-9638-40faf5a5bff3', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:54:56.896508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:54:56.896936 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:54:56.897413 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:54:56.897886 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:54:56.898527 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:54:56.907953 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:56.908418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:56.909228 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:56.909661 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:56.927086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for project 179af47cc6864305ab601ac5edd826ee. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:54:56.932911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for user e94e127dc47a477d848d7ff172109538 and project 179af47cc6864305ab601ac5edd826ee. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:54:56.946565 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:54:56.948924 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:54:56.996618 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b078a436-6a1d-4a89-897e-1e045e7804bb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740467 Jun 04 21:54:56.997510 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3226/6551] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:54:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 21:54:57.008086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-80cc6937-42b6-4357-9145-110bbf9ab5e7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:57.008734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-80cc6937-42b6-4357-9145-110bbf9ab5e7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:57.074258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-80cc6937-42b6-4357-9145-110bbf9ab5e7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:57.081397 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-80cc6937-42b6-4357-9145-110bbf9ab5e7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1246 microversion: 2.1 time: 0.077953 Jun 04 21:54:57.082064 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3326/6552] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:57 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:58.100232 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:58.101601 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:58.110095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:58.110791 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:58.111608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:58.112383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:58.231580 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:58.263969 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-778aea93-bda1-4220-8d57-685bdd763906 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1298 microversion: 2.1 time: 0.169189 Jun 04 21:54:58.264588 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3227/6553] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:58 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:59.281156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:54:59.281807 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:54:59.289974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:59.290415 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:59.291446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:59.291928 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:59.494225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:54:59.503034 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70b4d4ae-955b-4bda-97ca-53d7bad6b181 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.225816 Jun 04 21:54:59.503643 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3327/6554] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:54:59 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:54:59.793747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-701b2487-f942-454e-86a9-cbd60e6a3081 req-f43bfaae-ada3-4318-a895-5ff71ea51e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:54:59.813454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-701b2487-f942-454e-86a9-cbd60e6a3081 req-f43bfaae-ada3-4318-a895-5ff71ea51e5d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:54:59.814259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-701b2487-f942-454e-86a9-cbd60e6a3081 req-f43bfaae-ada3-4318-a895-5ff71ea51e5d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:54:59.829698 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-701b2487-f942-454e-86a9-cbd60e6a3081 req-f43bfaae-ada3-4318-a895-5ff71ea51e5d service nova] Creating event network-changed:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch2-master-1 Jun 04 21:54:59.840654 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-701b2487-f942-454e-86a9-cbd60e6a3081 req-f43bfaae-ada3-4318-a895-5ff71ea51e5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063695 Jun 04 21:54:59.841842 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3228/6555] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:55:00.520526 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:00.521504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:00.529865 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:00.530504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:00.531328 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:00.531817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:00.676122 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:00.684207 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6fd2151d-8462-4321-b9d0-9f15cdc41aa1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.167745 Jun 04 21:55:00.684794 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3328/6556] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:00 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:01.702706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:01.703450 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:01.711004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:01.711396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:01.712277 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:01.712756 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:01.936150 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:01.944757 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4db190e1-57a0-406b-ba87-257927f707b5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.247145 Jun 04 21:55:01.945339 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3229/6557] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:01 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:02.962454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:02.963083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:02.970402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:02.970872 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:02.971690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:02.972138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:03.117469 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:03.125772 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-df1bae61-0cf9-478e-8492-a5de06ceacbf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.167575 Jun 04 21:55:03.126317 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3329/6558] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:02 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:04.143217 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:04.143811 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:04.152025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:04.152482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:04.153250 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:04.153681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:04.291834 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:04.300043 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f5839ba4-b842-44f7-87ad-39167f2a74c9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.160900 Jun 04 21:55:04.300623 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3230/6559] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:04 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:05.317877 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:05.318589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:05.326131 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:05.326570 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:05.327381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:05.327859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:05.466624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-003294ce-1fc0-40f5-9ab7-3398eb750dc6 req-2203fef8-35fa-403b-9412-5f7fbed3c456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "name": "network-vif-plugged", "status": "completed", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:55:05.470410 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:05.476742 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-003294ce-1fc0-40f5-9ab7-3398eb750dc6 req-2203fef8-35fa-403b-9412-5f7fbed3c456 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:05.477289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-003294ce-1fc0-40f5-9ab7-3398eb750dc6 req-2203fef8-35fa-403b-9412-5f7fbed3c456 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:05.478839 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cd72549d-815d-4aa0-a059-976ffc37a41f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.164806 Jun 04 21:55:05.479461 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3330/6560] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:05 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:05.499214 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-003294ce-1fc0-40f5-9ab7-3398eb750dc6 req-2203fef8-35fa-403b-9412-5f7fbed3c456 service nova] Creating event network-vif-plugged:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch2-master-1 Jun 04 21:55:05.504805 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-003294ce-1fc0-40f5-9ab7-3398eb750dc6 req-2203fef8-35fa-403b-9412-5f7fbed3c456 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042625 Jun 04 21:55:05.505896 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3231/6561] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:55:06.500694 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:06.501647 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:06.512473 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:06.512943 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:06.513726 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:06.514179 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:06.660815 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:06.669773 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a1f3a825-8875-4206-af8d-2bca8b43f9cd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1372 microversion: 2.1 time: 0.175651 Jun 04 21:55:06.670387 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3331/6562] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:06 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:07.688249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:07.689091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:07.694747 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:07.695650 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:07.704832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:07.705402 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:07.706275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:07.706805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:07.848323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:07.856421 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-dd166cde-2b25-48bb-b5a3-f2c85e0a45a4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1555 microversion: 2.1 time: 0.170443 Jun 04 21:55:07.856985 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3232/6563] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:07 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:55:07.873711 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:55:07.874346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:55:07.876307 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:55:07.883394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:07.883894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:07.884695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:07.885156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:08.034100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:55:08.042488 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-4765261f-2156-4887-aa05-41c2e70a43f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1555 microversion: 2.1 time: 0.173578 Jun 04 21:55:08.043111 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3332/6564] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:55:07 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:55:10.144648 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-44a7a19d-02dd-4359-9568-94364a732103 req-b880d0ee-db17-4d78-9798-92b49a10b5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:55:10.154266 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-44a7a19d-02dd-4359-9568-94364a732103 req-b880d0ee-db17-4d78-9798-92b49a10b5ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:55:10.154717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-44a7a19d-02dd-4359-9568-94364a732103 req-b880d0ee-db17-4d78-9798-92b49a10b5ef service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:55:10.169506 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-44a7a19d-02dd-4359-9568-94364a732103 req-b880d0ee-db17-4d78-9798-92b49a10b5ef service nova] Creating event network-changed:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch2-master-1 Jun 04 21:55:10.174636 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-44a7a19d-02dd-4359-9568-94364a732103 req-b880d0ee-db17-4d78-9798-92b49a10b5ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033752 Jun 04 21:55:10.175447 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3233/6565] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:57:04.393309 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [-] [255e1688-6b14-4faa-b370-fdeec054c97b] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 04 21:57:04.394287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:04.395139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=36 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:04.399931 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:57:04.400221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:04.407538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:04.407948 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:04.408731 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:04.409180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:04.433043 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lazy-loading 'flavor' on Instance uuid 87c54225-d2df-45b9-9f40-fa790e806da8 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:57:04.912654 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-81c56e92-25f1-4ad3-a962-8c779a14cd2f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8/action" status: 202 len: 0 microversion: 2.1 time: 0.521229 Jun 04 21:57:04.913268 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3333/6566] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:57:04 2022] POST /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:57:04.921762 ncdv-master-1 devstack@n-api.service[137229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4998025-16b0-4090-ba00-1f2f20c5992b] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 04 21:57:04.922692 ncdv-master-1 devstack@n-api.service[137229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e48c024-80e8-429d-8426-5feec1088ced] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 04 21:57:04.923487 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:04.924826 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=32 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:04.929703 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:04.930375 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:04.938414 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:04.938895 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:04.939696 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:04.940096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:05.139015 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:05.151775 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-902fc285-bd3e-4a87-9e22-2703db0ac966 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.233157 Jun 04 21:57:05.152389 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3234/6567] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:04 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:06.181595 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:06.182384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:06.191203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:06.191607 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:06.192399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:06.192871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:06.199490 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] [255e1688-6b14-4faa-b370-fdeec054c97b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51886. Jun 04 21:57:06.332102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:06.340587 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef5f06ed-6b9f-43b2-b131-ded45ee58b6e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.164628 Jun 04 21:57:06.341170 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3334/6568] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:06 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:07.363029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:07.364057 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:07.374736 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:07.375185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:07.375968 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:07.376431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:07.384229 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4998025-16b0-4090-ba00-1f2f20c5992b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51892. Jun 04 21:57:07.399434 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e48c024-80e8-429d-8426-5feec1088ced] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 51894. Jun 04 21:57:07.521723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:07.530199 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0d334492-40bc-4e6d-9231-aaeb5bdc22a0 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.173943 Jun 04 21:57:07.530775 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3235/6569] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:07 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:08.551896 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:08.552938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:08.563148 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:08.563653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:08.564446 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:08.564901 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:08.712930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:08.721488 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-119958ed-c604-438d-b085-9f068db58741 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.176249 Jun 04 21:57:08.722078 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3335/6570] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:08 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:09.744906 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:09.745970 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:09.757744 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:09.758528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:09.759967 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:09.760701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:09.900865 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:09.909223 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4d1729ef-e61e-41af-9b04-d14958531f87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.172478 Jun 04 21:57:09.909794 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3236/6571] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:09 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:10.926942 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:10.927579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:10.935304 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:10.935804 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:10.936587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:10.937033 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:11.090191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:11.098164 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ebb57ac4-aa3d-4dd5-9330-feb1d8f14ed9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.175263 Jun 04 21:57:11.098744 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3336/6572] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:10 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:12.120305 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:12.121218 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:12.133181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:12.133942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:12.135234 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:12.136035 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:12.288108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:12.296181 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-aac38b7a-0de7-4f4a-9b96-e34a96af1a3f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.182708 Jun 04 21:57:12.296763 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3237/6573] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:12 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:13.314938 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:13.315721 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:13.323589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:13.324044 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:13.324838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:13.325291 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:13.471484 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:13.482704 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-633b2b81-fcb5-45ad-a0a7-b08c546ef49a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.171847 Jun 04 21:57:13.483265 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3337/6574] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:13 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:57:14.501362 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:14.502051 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:14.509590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:14.510046 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:14.510842 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:14.511286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:14.649029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:14.658521 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3414a9d0-73d8-4dca-99e1-ab0d6d517879 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.161633 Jun 04 21:57:14.659108 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3238/6575] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:14 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:15.675945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:15.676589 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:15.684048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:15.684521 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:15.685389 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:15.685895 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:15.836274 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:15.849060 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-490779f0-19cf-49f4-a1e2-1cb170541a19 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1701 microversion: 2.1 time: 0.176843 Jun 04 21:57:15.849778 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3338/6576] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:15 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:16.871383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:16.872593 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:16.880259 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:16.880711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:16.881482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:16.881915 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:17.032898 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:17.041068 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c220755a-7798-4ab6-a209-ab6e9834e0bf tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1701 microversion: 2.1 time: 0.176197 Jun 04 21:57:17.041660 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3239/6577] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:16 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:18.059268 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:18.060115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:18.070458 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:18.075747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:18.076990 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:18.077702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:18.255246 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:18.263368 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-15fdecc7-2c59-4936-894d-beef978b52ba tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.208407 Jun 04 21:57:18.273861 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3339/6578] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:18 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:19.281427 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:19.282371 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:19.293067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:19.293794 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:19.295109 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:19.295735 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:19.453938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:19.462901 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-0223cfce-33cd-45f4-8887-27bdcacacacc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.185874 Jun 04 21:57:19.465876 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3240/6579] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:19 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:20.269309 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1e2bf56e-4cae-485e-a715-2cd63c9cf3b8 req-ad310a3d-bc51-4992-a3fa-93b6a717d667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "name": "network-vif-plugged", "status": "completed", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:57:20.278749 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1e2bf56e-4cae-485e-a715-2cd63c9cf3b8 req-ad310a3d-bc51-4992-a3fa-93b6a717d667 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:20.279216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1e2bf56e-4cae-485e-a715-2cd63c9cf3b8 req-ad310a3d-bc51-4992-a3fa-93b6a717d667 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:20.290841 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1e2bf56e-4cae-485e-a715-2cd63c9cf3b8 req-ad310a3d-bc51-4992-a3fa-93b6a717d667 service nova] Creating event network-vif-plugged:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch2-master-1 Jun 04 21:57:20.297279 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1e2bf56e-4cae-485e-a715-2cd63c9cf3b8 req-ad310a3d-bc51-4992-a3fa-93b6a717d667 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160460 Jun 04 21:57:20.298233 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3340/6580] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:57:20.484178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:20.485539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:20.492790 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:20.493574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:20.494573 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:20.495229 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:20.652609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:20.661943 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af134bd8-7d48-47bc-8c57-743a7fffea7a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.184541 Jun 04 21:57:20.662549 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3241/6581] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:20 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:21.681766 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:21.682487 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:21.689981 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:21.690719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:21.691837 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:21.692481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:21.851666 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:21.861905 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ef435665-6277-43be-adfd-d31c40f8232f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.185297 Jun 04 21:57:21.872932 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3341/6582] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:21 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:22.881156 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:22.881813 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:22.890460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:22.890908 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:22.891715 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:22.892144 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:23.035131 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:23.046234 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-294fb0e7-faaf-4f68-814d-cce907ffc37c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.169212 Jun 04 21:57:23.046818 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3242/6583] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:22 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:24.068195 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:24.068725 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:24.076273 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:24.076758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:24.077528 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:24.077974 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:24.248063 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:24.256585 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-fc774f1e-fb1d-46c8-bf7d-d193543fc63e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.192431 Jun 04 21:57:24.259345 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3342/6584] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:24 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:25.274740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:25.276216 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:25.283220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:25.283797 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:25.284773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:25.285282 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:25.438449 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:25.447983 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5621906e-5a68-4f0e-ac7f-f342a4f8b094 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.177583 Jun 04 21:57:25.448616 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3243/6585] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:25 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:26.466143 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:26.466888 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:26.474393 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:26.474853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:26.475747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:26.476190 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:26.621679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:26.630133 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-16d6e2c3-ebbc-4a16-ac16-f6daf1239f80 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1696 microversion: 2.1 time: 0.168370 Jun 04 21:57:26.630711 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3343/6586] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:26 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:27.652647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:27.653779 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:27.665562 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:27.666325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:27.667671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:27.668404 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:27.813302 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:27.825130 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-93ef67a5-cde0-40df-993f-47139c548e83 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1678 microversion: 2.1 time: 0.179613 Jun 04 21:57:27.825933 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3244/6587] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:27 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:28.846754 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:28.847946 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:28.856630 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:28.857236 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:28.858464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:28.859002 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:29.005793 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:29.014520 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9150d17f-a354-4005-8592-3b0e85e5a2bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1678 microversion: 2.1 time: 0.173079 Jun 04 21:57:29.015113 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3344/6588] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:28 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:30.032624 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:30.033221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:30.040765 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.041203 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.042000 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.042420 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.091875 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-ecac6ada-cd8b-4d54-b109-1c783f3b829f req-9ff00120-bda7-4cfa-91a3-66e1e554a155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "name": "network-vif-unplugged", "status": "completed", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:57:30.101504 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ecac6ada-cd8b-4d54-b109-1c783f3b829f req-9ff00120-bda7-4cfa-91a3-66e1e554a155 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.102464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-ecac6ada-cd8b-4d54-b109-1c783f3b829f req-9ff00120-bda7-4cfa-91a3-66e1e554a155 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.116219 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.compute.server_external_events [req-ecac6ada-cd8b-4d54-b109-1c783f3b829f req-9ff00120-bda7-4cfa-91a3-66e1e554a155 service nova] Unable to find a host for instance 87c54225-d2df-45b9-9f40-fa790e806da8. Dropping event network-vif-unplugged {{(pid=137228) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 21:57:30.117340 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-ecac6ada-cd8b-4d54-b109-1c783f3b829f req-9ff00120-bda7-4cfa-91a3-66e1e554a155 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030030 Jun 04 21:57:30.118010 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3345/6589] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 04 21:57:30.183996 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:30.191951 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a935288f-bb3d-4d4e-9225-ccadbf061852 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1621 microversion: 2.1 time: 0.163314 Jun 04 21:57:30.193139 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3245/6590] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:30 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1621 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:30.208985 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:57:30.209546 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:30.216048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.216688 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.217408 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.217861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.324898 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ebb7f84b-f8af-4f2e-8253-c343dc712c27 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8/action" status: 202 len: 0 microversion: 2.1 time: 0.119908 Jun 04 21:57:30.325500 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3346/6591] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 21:57:30 2022] POST /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:57:30.334079 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:30.334942 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:30.341880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.342831 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.343695 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:30.344157 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:30.492117 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:30.500675 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b6e93fee-1aad-4fd9-a1cd-9479de42dd0c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1629 microversion: 2.1 time: 0.170604 Jun 04 21:57:30.501270 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3246/6592] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:30 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1629 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:57:30.885501 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 21:57:30.885679 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 21:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 21:57:31.520311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:31.521376 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:31.528312 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:31.528788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:31.529555 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:31.530023 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:31.678139 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:31.681838 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:31.687382 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-8bdc2fc8-52b1-47e6-bc85-dc3bf238137f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.171924 Jun 04 21:57:31.688006 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3347/6593] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:31 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:32.705111 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:32.706475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:32.716330 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:32.717538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:32.718358 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:32.718491 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-0654b72b-b73b-4f2f-9ec3-24143b6359db req-2aaea5d6-d813-47ca-b18e-791eb95667a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:57:32.718960 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:32.727208 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0654b72b-b73b-4f2f-9ec3-24143b6359db req-2aaea5d6-d813-47ca-b18e-791eb95667a9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:32.727940 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-0654b72b-b73b-4f2f-9ec3-24143b6359db req-2aaea5d6-d813-47ca-b18e-791eb95667a9 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:32.741349 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-0654b72b-b73b-4f2f-9ec3-24143b6359db req-2aaea5d6-d813-47ca-b18e-791eb95667a9 service nova] Creating event network-changed:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch1-master-1 Jun 04 21:57:32.748135 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-0654b72b-b73b-4f2f-9ec3-24143b6359db req-2aaea5d6-d813-47ca-b18e-791eb95667a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133577 Jun 04 21:57:32.749058 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3247/6594] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:57:32.865398 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:32.873531 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-87b15e76-368f-4f43-af79-3ea75f91b895 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.172290 Jun 04 21:57:32.874064 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3348/6595] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:32 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 21:57:33.891632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:33.892466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:33.901160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:33.901708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:33.902547 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:33.902994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:34.045542 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:34.054018 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-c2fc45ce-5b73-4501-9d0c-51e3f4421d1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.167181 Jun 04 21:57:34.059694 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3248/6596] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:33 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:35.071281 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:35.071899 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:35.074781 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=35 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:35.080939 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:35.081599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:35.082401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:35.082852 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:35.230156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:35.238281 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e4b66fbd-ef71-4954-9361-60d84be2f0f6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.170966 Jun 04 21:57:35.238868 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3349/6597] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:35 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:36.256010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:36.257292 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:36.264596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=31 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:36.267163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:36.267846 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:36.268862 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:36.269267 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:36.273827 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=87 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:57:36.447367 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:36.457199 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-cf77ce80-c96b-446f-be68-83192a788db4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.205603 Jun 04 21:57:36.457965 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3249/6598] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:36 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:37.476893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:37.477977 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:37.485533 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:37.485959 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:37.486779 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:37.487216 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:37.637395 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:37.646092 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-cb158e61-4f64-4cc3-860e-da7c7bb6a7f1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.173875 Jun 04 21:57:37.646893 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3350/6599] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:37 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:38.664213 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:38.665679 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:38.672804 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:38.673343 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:38.674207 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:38.674651 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:38.829455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:38.838665 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bef9a1a4-cf2b-4dee-a51f-c750f8b6d401 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.178486 Jun 04 21:57:38.840509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3250/6600] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:38 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:39.857956 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:39.858648 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:39.866861 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:39.867313 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:39.868166 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:39.868597 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:40.010683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:40.019940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ba8e3657-5811-4c66-8fec-af252e0cd226 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.166085 Jun 04 21:57:40.020953 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3351/6601] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:39 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:41.038485 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:41.039162 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:41.046183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:41.046639 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:41.047561 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:41.048004 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:41.198038 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:41.207721 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a18c83b8-16f0-48b6-a8e4-e64bb98b62a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.172993 Jun 04 21:57:41.208490 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3251/6602] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:41 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:42.233905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:42.236163 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:42.248331 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:42.249101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:42.250401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:42.251142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:42.409774 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:42.421361 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce7dbe76-ba71-4c91-945c-009cf44c1f10 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.193968 Jun 04 21:57:42.422250 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3352/6603] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:42 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:43.443805 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:43.444728 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:43.456990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:43.457444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:43.458254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:43.458705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:43.603316 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:43.611349 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5bbdd0e4-aaf3-490b-9a7e-75211a8ccfc2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.174939 Jun 04 21:57:43.611967 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3252/6604] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:43 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:44.628860 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:44.629539 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:44.636994 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:44.637439 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:44.638229 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:44.642323 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:44.792117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:44.801122 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-48395930-3e05-4002-9175-f662ccd8bafb tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.176370 Jun 04 21:57:44.801716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3353/6605] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:44 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:45.823065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:45.824132 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:45.834227 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:45.834682 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:45.835465 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:45.835935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:45.981389 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:45.990324 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b5e67b30-34d7-4f31-b3e4-fa16a186f8a8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.173949 Jun 04 21:57:45.991071 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3253/6606] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:45 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:46.094853 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-3efdb310-be44-45b8-964b-f17fe71c1fc8 req-2ccc56e7-934c-44e1-9c68-fe5cfe6cfbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "name": "network-vif-plugged", "status": "completed", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:57:46.104809 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3efdb310-be44-45b8-964b-f17fe71c1fc8 req-2ccc56e7-934c-44e1-9c68-fe5cfe6cfbd3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:46.105270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-3efdb310-be44-45b8-964b-f17fe71c1fc8 req-2ccc56e7-934c-44e1-9c68-fe5cfe6cfbd3 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:46.118724 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-3efdb310-be44-45b8-964b-f17fe71c1fc8 req-2ccc56e7-934c-44e1-9c68-fe5cfe6cfbd3 service nova] Creating event network-vif-plugged:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch1-master-1 Jun 04 21:57:46.124300 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-3efdb310-be44-45b8-964b-f17fe71c1fc8 req-2ccc56e7-934c-44e1-9c68-fe5cfe6cfbd3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033471 Jun 04 21:57:46.124894 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3354/6607] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:57:47.012508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:47.013515 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:47.023236 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:47.023741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:47.024528 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:47.024973 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:47.166882 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:47.174898 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a18d1e66-429e-4e05-82ef-3b4df170bd71 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.169038 Jun 04 21:57:47.175481 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3254/6608] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:47 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:48.193787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:48.195083 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:48.203090 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:48.203568 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:48.204402 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:48.204882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:48.352254 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:48.366371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6a44d3a8-6648-4507-a6fc-0b20f1eb059c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1687 microversion: 2.1 time: 0.176682 Jun 04 21:57:48.367151 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3355/6609] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:48 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:57:49.385482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:57:49.386111 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:57:49.393912 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:49.394405 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:49.395196 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:57:49.396023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:57:49.538230 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:57:49.546647 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-79e0750a-31ee-49ba-8e28-259fc7217979 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1674 microversion: 2.1 time: 0.165278 Jun 04 21:57:49.547279 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3255/6610] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:57:49 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:05.831475 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=13 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:05.833373 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=44 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:05.835381 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=13 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:05.836246 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=41 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:05.838260 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:05.838771 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:05.840923 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b6299d35-e3c8-4937-9ae5-627a0c251820 req-31559692-5911-417e-96a7-a7ff5d59bf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:05.847008 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:05.847471 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:05.848370 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:05.848823 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:05.850587 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b6299d35-e3c8-4937-9ae5-627a0c251820 req-31559692-5911-417e-96a7-a7ff5d59bf1d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:05.851034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b6299d35-e3c8-4937-9ae5-627a0c251820 req-31559692-5911-417e-96a7-a7ff5d59bf1d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:05.862438 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b6299d35-e3c8-4937-9ae5-627a0c251820 req-31559692-5911-417e-96a7-a7ff5d59bf1d service nova] Creating event network-changed:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch1-master-1 Jun 04 21:59:05.868009 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b6299d35-e3c8-4937-9ae5-627a0c251820 req-31559692-5911-417e-96a7-a7ff5d59bf1d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034657 Jun 04 21:59:05.868825 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3256/6611] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:59:05.877392 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 21:59:05.978016 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-c31d6b05-d19c-4eae-8235-790bd5f42284 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "DELETE /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 204 len: 0 microversion: 2.1 time: 0.148293 Jun 04 21:59:05.982622 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3356/6612] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 21:59:05 2022] DELETE /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 21:59:05.992089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:05.994740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:06.003372 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:06.004155 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:06.006148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:06.007254 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:06.168364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:06.176781 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6685cde6-ff45-4d0d-b04c-98e66548645c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.192180 Jun 04 21:59:06.177371 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3257/6613] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:05 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:07.200384 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:07.201598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:07.212854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:07.213660 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:07.214935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:07.215743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:07.364753 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:07.372668 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-10984a34-1b44-47ba-9bc2-9a5014aeeb0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1680 microversion: 2.1 time: 0.179897 Jun 04 21:59:07.373418 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3357/6614] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:07 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:08.223594 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b46c1df6-3227-40bd-ba22-90f2161879ea req-60703847-4e1b-4228-a0ef-f4f31d554f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87c54225-d2df-45b9-9f40-fa790e806da8", "name": "network-vif-deleted", "tag": "e79e3d3a-a2f6-4890-95dd-8d81aaed981e"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:08.232002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b46c1df6-3227-40bd-ba22-90f2161879ea req-60703847-4e1b-4228-a0ef-f4f31d554f3c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:08.232443 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b46c1df6-3227-40bd-ba22-90f2161879ea req-60703847-4e1b-4228-a0ef-f4f31d554f3c service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:08.244640 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b46c1df6-3227-40bd-ba22-90f2161879ea req-60703847-4e1b-4228-a0ef-f4f31d554f3c service nova] Creating event network-vif-deleted:e79e3d3a-a2f6-4890-95dd-8d81aaed981e for instance 87c54225-d2df-45b9-9f40-fa790e806da8 on nch1-master-1 Jun 04 21:59:08.251185 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b46c1df6-3227-40bd-ba22-90f2161879ea req-60703847-4e1b-4228-a0ef-f4f31d554f3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088322 Jun 04 21:59:08.251893 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3258/6615] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:59:08.391065 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:08.391723 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:08.399839 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:08.400315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:08.401443 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:08.402207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:08.443156 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:08.443930 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:08.444394 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lazy-loading 'fault' on Instance uuid 87c54225-d2df-45b9-9f40-fa790e806da8 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 21:59:08.492093 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:08.500375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-40f8cc14-3a3c-414c-b7b4-2670e37c277e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 200 len: 1336 microversion: 2.1 time: 0.113467 Jun 04 21:59:08.500954 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3358/6616] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:08 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 1336 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:09.525369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:09.526619 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: 87c54225-d2df-45b9-9f40-fa790e806da8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:09.535054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:09.535502 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:09.536306 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:09.536737 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:09.550840 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] HTTP exception thrown: Instance 87c54225-d2df-45b9-9f40-fa790e806da8 could not be found. Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Request method failure captured: Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 HTTP/1.1 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9SpSCnEHLCkowT0xX27Icrnzc4MTNBZ_dbhxfARaiTsZN5uD_EPMkNwuCQY7DpeJZI-NpKzro0n3rOAej-eboDNLqbAyuaIDIrFB8Jw9bns3Fz4xOcjICA-QcIlyzvd7oswA58YyjITuIxhnqsvTi9luuRMWKipmJ_6kaIez53CSIU Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 179af47cc6864305ab601ac5edd826ee Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestShelveInstance-247392491 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_179af47cc6864305ab601ac5edd826ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/179af47cc6864305ab601ac5edd826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/179af47cc6864305ab601ac5edd826ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/179af47cc6864305ab601ac5edd826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestShelveInstance-247392491 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 179af47cc6864305ab601ac5edd826ee Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestShelveInstance-247392491 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestShelveInstance-247392491-project Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e94e127dc47a477d848d7ff172109538 Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestShelveInstance-247392491-project Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 87c54225-d2df-45b9-9f40-fa790e806da8 could not be found. Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '87c54225-d2df-45b9-9f40-fa790e806da8'} Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87c54225-d2df-45b9-9f40-fa790e806da8 could not be found. Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87c54225-d2df-45b9-9f40-fa790e806da8 could not be found. Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 21:59:09.552482 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87c54225-d2df-45b9-9f40-fa790e806da8 could not be found. Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Returning 404 to user: Instance 87c54225-d2df-45b9-9f40-fa790e806da8 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-2062be3b-7824-48b8-a42a-23aa5d8b383b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8" status: 404 len: 111 microversion: 2.1 time: 0.038173 Jun 04 21:59:09.556753 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3259/6617] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:09 2022] GET /compute/v2.1/servers/87c54225-d2df-45b9-9f40-fa790e806da8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 21:59:09.722311 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-89540552-d706-422a-b038-66499d8c6de9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '.version_select at 0x7f2d003b48b0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:09.743835 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-89540552-d706-422a-b038-66499d8c6de9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-686961193" status: 202 len: 0 microversion: 2.1 time: 0.024588 Jun 04 21:59:09.744441 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3359/6618] 10.222.0.18 () {58 vars in 1250 bytes} [Sat Jun 4 21:59:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-686961193 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 21:59:09.774139 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e7de8eff-8084-4cfa-bed6-3f1d32a0bb14 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'create', calling method: .version_select at 0x7f2d01619ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1314478343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKHyB1A7HwCGB3sZAge0rzAkolw4EtVgC8wcOLVdzkX1Hf7V+Bk0OKBxFyiZsNmJD4Ihk1tW3wRzy7hsxj1E7zVp9Vnv2zMtIAqxlPxmECD0NDvsqhIOih8w3g6FaAnfw=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:09.789602 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e7de8eff-8084-4cfa-bed6-3f1d32a0bb14 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for project 179af47cc6864305ab601ac5edd826ee. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:59:09.795916 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-e7de8eff-8084-4cfa-bed6-3f1d32a0bb14 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for user e94e127dc47a477d848d7ff172109538 and project 179af47cc6864305ab601ac5edd826ee. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:59:09.824010 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e7de8eff-8084-4cfa-bed6-3f1d32a0bb14 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053936 Jun 04 21:59:09.824702 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3260/6619] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 21:59:09 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:59:13.424530 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-714204640", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1314478343", "security_groups": [{"name": "tempest-secgroup-smoke-17025283"}], "networks": [{"uuid": "b4834023-fcbf-4561-9638-40faf5a5bff3"}], "block_device_mapping_v2": [{"uuid": "3d9187db-b18d-4cfa-908b-ff26cf626c2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:13.550492 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] validate_networks() for [('b4834023-fcbf-4561-9638-40faf5a5bff3', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 21:59:13.997454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 21:59:13.998200 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 21:59:13.999036 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 21:59:13.999780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 21:59:14.000478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 21:59:14.016744 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:14.017997 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:14.018831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:14.019286 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:14.037221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for project 179af47cc6864305ab601ac5edd826ee. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 21:59:14.042758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Getting quotas for user e94e127dc47a477d848d7ff172109538 and project 179af47cc6864305ab601ac5edd826ee. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 21:59:14.102477 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 21:59:14.104653 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d9187db-b18d-4cfa-908b-ff26cf626c2a',volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 21:59:14.242163 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e7f526ff-eaf4-44b3-b937-127f7f586e0f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.821785 Jun 04 21:59:14.242808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3360/6620] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 21:59:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 04 21:59:14.254376 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4acee4da-9bbd-4505-876b-3b7e31db322c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:14.255090 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4acee4da-9bbd-4505-876b-3b7e31db322c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:14.332903 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4acee4da-9bbd-4505-876b-3b7e31db322c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:14.339934 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4acee4da-9bbd-4505-876b-3b7e31db322c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1088 microversion: 2.1 time: 0.090760 Jun 04 21:59:14.340509 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3261/6621] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:14 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:15.356424 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:15.357387 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:15.366067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:15.366527 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:15.367335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:15.368004 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:15.443245 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:15.452056 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-64b7401f-fdff-4215-8644-ae0d5264b27d tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1204 microversion: 2.1 time: 0.099320 Jun 04 21:59:15.452563 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3361/6622] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:15 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:16.471165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:16.472345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:16.487537 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:16.488163 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:16.489265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:16.489717 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:16.708211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:16.716371 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1963436a-bb39-41f1-abe5-b5f1961992db tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.251295 Jun 04 21:59:16.716986 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3262/6623] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:16 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:17.045608 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-dbb1b24f-b0bc-4ce2-b311-942a3ea6827b req-7ca7bfb2-ac37-463f-bd54-c75447eeb7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:17.057646 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dbb1b24f-b0bc-4ce2-b311-942a3ea6827b req-7ca7bfb2-ac37-463f-bd54-c75447eeb7ff service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:17.058728 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dbb1b24f-b0bc-4ce2-b311-942a3ea6827b req-7ca7bfb2-ac37-463f-bd54-c75447eeb7ff service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:17.076743 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dbb1b24f-b0bc-4ce2-b311-942a3ea6827b req-7ca7bfb2-ac37-463f-bd54-c75447eeb7ff service nova] Creating event network-changed:efe3861f-5086-4455-9a54-2e1701ef41a8 for instance bbf4a611-a60f-431b-a5cc-bda172a976b8 on nch2-master-1 Jun 04 21:59:17.083383 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-dbb1b24f-b0bc-4ce2-b311-942a3ea6827b req-7ca7bfb2-ac37-463f-bd54-c75447eeb7ff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041535 Jun 04 21:59:17.084012 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3362/6624] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 21:59:17.738013 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:17.738974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:17.747077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:17.747592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:17.748497 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:17.748951 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:17.896221 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:17.904101 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a2f0e42d-97d7-4369-a2f8-d22e4ddeaec9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.172674 Jun 04 21:59:17.904700 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3263/6625] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:17 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:18.927416 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:18.928667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:18.940907 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:18.942302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:18.943125 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:18.943683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:19.099659 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:19.108060 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ec3bd4af-192b-49ac-ac6f-6d36d5766a2a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.188502 Jun 04 21:59:19.108748 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3363/6626] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:18 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:20.130077 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:20.130986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:20.143054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:20.143885 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:20.145237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:20.145990 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:20.286609 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:20.295028 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6b17290c-8177-46a1-90e6-64eed7795a34 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.171875 Jun 04 21:59:20.295684 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3264/6627] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:20 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:21.319003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:21.319768 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:21.327604 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:21.328096 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:21.328932 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:21.329386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:21.471436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:21.483329 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6408d16a-1016-4f43-a0bc-db7874ed192c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.169508 Jun 04 21:59:21.484284 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3364/6628] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:21 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:22.505909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:22.507089 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:22.521526 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:22.522357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:22.523863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:22.524668 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:22.663129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:22.672579 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-98afd0ad-c12c-4ad7-80ca-1a17946f31f7 req-c0b26207-dc46-465e-9036-b48571c61bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "name": "network-vif-plugged", "status": "completed", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:22.682945 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-98afd0ad-c12c-4ad7-80ca-1a17946f31f7 req-c0b26207-dc46-465e-9036-b48571c61bd2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:22.683543 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-98afd0ad-c12c-4ad7-80ca-1a17946f31f7 req-c0b26207-dc46-465e-9036-b48571c61bd2 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:22.694789 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-93bbb652-1489-4fc4-94d0-5ef8f1d0c15f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.187562 Jun 04 21:59:22.697685 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3265/6629] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:22 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:22.703150 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-98afd0ad-c12c-4ad7-80ca-1a17946f31f7 req-c0b26207-dc46-465e-9036-b48571c61bd2 service nova] Creating event network-vif-plugged:efe3861f-5086-4455-9a54-2e1701ef41a8 for instance bbf4a611-a60f-431b-a5cc-bda172a976b8 on nch2-master-1 Jun 04 21:59:22.712269 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-98afd0ad-c12c-4ad7-80ca-1a17946f31f7 req-c0b26207-dc46-465e-9036-b48571c61bd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041030 Jun 04 21:59:22.714072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3365/6630] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 21:59:23.714468 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:23.715115 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:23.722613 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:23.723040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:23.723837 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:23.724280 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:23.864714 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:23.872731 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-69ed3d7b-5e4b-4e00-874c-b69e91ccad1b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1258 microversion: 2.1 time: 0.162380 Jun 04 21:59:23.873317 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3266/6631] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:23 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:24.888058 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:24.888795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:24.893017 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:24.893732 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:24.901562 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:24.902027 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:24.902819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:24.903266 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:25.047583 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:25.059571 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e43f6fb0-7771-4d24-9995-370ea0b2e2c3 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1442 microversion: 2.1 time: 0.173120 Jun 04 21:59:25.060395 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3366/6632] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:24 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1442 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:25.077608 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 21:59:25.078223 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 21:59:25.080262 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 21:59:25.086628 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:25.087167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:25.088043 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:25.088478 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:25.227590 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 21:59:25.239247 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-670e1bc7-e9be-42a5-895b-5ec0b3c067b9 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1442 microversion: 2.1 time: 0.165616 Jun 04 21:59:25.239866 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3267/6633] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 21:59:25 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1442 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 21:59:26.992118 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-cbbf8955-ccae-45bf-9c1f-e59b1f58baa1 req-8d483205-6dba-4362-bc4a-2002bfe9722f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 21:59:27.001553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cbbf8955-ccae-45bf-9c1f-e59b1f58baa1 req-8d483205-6dba-4362-bc4a-2002bfe9722f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 21:59:27.002003 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-cbbf8955-ccae-45bf-9c1f-e59b1f58baa1 req-8d483205-6dba-4362-bc4a-2002bfe9722f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 21:59:27.016576 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-cbbf8955-ccae-45bf-9c1f-e59b1f58baa1 req-8d483205-6dba-4362-bc4a-2002bfe9722f service nova] Creating event network-changed:efe3861f-5086-4455-9a54-2e1701ef41a8 for instance bbf4a611-a60f-431b-a5cc-bda172a976b8 on nch2-master-1 Jun 04 21:59:27.022316 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-cbbf8955-ccae-45bf-9c1f-e59b1f58baa1 req-8d483205-6dba-4362-bc4a-2002bfe9722f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034819 Jun 04 21:59:27.022980 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3367/6634] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 21:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:00:50.895573 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:00:50.896281 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:01:25.614400 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:01:25.615020 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:01:33.922178 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:33.923480 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=48 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:33.980286 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:01:33.980840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:33.987034 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:33.987479 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:33.988278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:33.988716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:34.016008 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.objects.instance [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lazy-loading 'flavor' on Instance uuid bbf4a611-a60f-431b-a5cc-bda172a976b8 {{(pid=137229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 22:01:34.103332 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fbba862f-0eff-4437-a142-68272358e44b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8/action" status: 202 len: 0 microversion: 2.1 time: 0.184241 Jun 04 22:01:34.103890 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3268/6635] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 22:01:33 2022] POST /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 22:01:34.111205 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861201d-8b7d-4db4-b81d-9fdaf6c45049] AMQP server on 10.222.0.18:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 04 22:01:34.112055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:34.113117 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:01:34.117534 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:34.118264 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:34.126169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:34.126629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:34.127422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:34.127905 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:34.277538 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:34.287653 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-70464040-d7a8-40ff-9aa5-7bffc571d8bc tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.178899 Jun 04 22:01:34.288565 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3368/6636] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:34 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:35.314663 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:35.315723 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:35.326615 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:35.327364 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:35.328711 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:35.329455 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:35.467219 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:35.475422 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bcc6b88a-0288-4b41-8d5e-7c71e795ca36 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.169962 Jun 04 22:01:35.476036 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3269/6637] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:35 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:36.496434 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:36.497314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:36.510702 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:36.511454 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:36.512352 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:36.512810 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:36.518739 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861201d-8b7d-4db4-b81d-9fdaf6c45049] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52448. Jun 04 22:01:36.657314 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:36.665300 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f46b9c00-705f-4d1c-ba51-63ad464a5d7c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.175349 Jun 04 22:01:36.665858 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3369/6638] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:36 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:37.686993 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:37.687762 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:37.695211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:37.695840 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:37.696698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:37.697185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:37.845475 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:37.853837 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-04913d3f-0bdc-46f1-8633-b4ce60b40b0a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.173070 Jun 04 22:01:37.854421 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3270/6639] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:37 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:38.876292 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:38.877346 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:38.889251 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:38.889733 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:38.890517 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:38.890966 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:39.044282 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:39.052674 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-0faca903-205b-44eb-ab8b-c55f7d7f5430 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.183125 Jun 04 22:01:39.053251 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3370/6640] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:38 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:40.076925 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:40.077598 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:40.085198 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:40.085670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:40.086519 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:40.086965 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:40.232904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:40.241020 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-eb0e4ea9-0655-4b30-9daf-8a673c3237d5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.170808 Jun 04 22:01:40.241603 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3271/6641] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:40 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:41.260177 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:41.260817 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:41.271138 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:41.271736 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:41.272692 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:41.273383 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:41.416258 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:41.426204 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dafe8080-8e66-41e4-88ad-836dfcc65d74 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.170821 Jun 04 22:01:41.427087 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3371/6642] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:41 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:42.450926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:42.452610 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:42.460994 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:42.461444 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:42.462242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:42.462676 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:42.597574 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:42.605576 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-659d48f6-5ce0-4365-af31-477f045fbc2b tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.160402 Jun 04 22:01:42.606166 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3272/6643] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:42 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:43.624805 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:43.625447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:43.633650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:43.634049 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:43.634842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:43.635302 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:43.775427 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:43.785544 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-32e7d9dd-06b1-4ae5-b75b-d1880d85c1bd tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.166008 Jun 04 22:01:43.786091 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3372/6644] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:43 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:44.803245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:44.803869 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:44.811182 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:44.811690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:44.812454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:44.812894 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:44.961520 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:44.970644 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-6578206a-fbee-46bf-b907-2e97c4d6afad tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.171175 Jun 04 22:01:44.971380 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3273/6645] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:44 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:01:45.990459 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:45.991055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:45.998681 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:45.999155 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:45.999991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:46.000436 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:46.141613 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:46.152070 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-2af1ad40-8bc2-4119-81ae-7f2a7618a863 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.165880 Jun 04 22:01:46.152886 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3373/6646] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:45 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:47.172091 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:47.172810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:47.181859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:47.182396 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:47.183308 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:47.183874 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:47.326592 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:47.334918 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-adf4ae90-e8bc-4a47-abc9-84d751375e1f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1508 microversion: 2.1 time: 0.167585 Jun 04 22:01:47.335545 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3274/6647] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:47 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:47.352160 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:01:47.352713 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:47.360468 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:47.360927 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:47.361718 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:47.362174 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:47.448203 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [6858fe18-fc51-477a-8254-b11d68c2e1d2] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 22:01:48.457722 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [6858fe18-fc51-477a-8254-b11d68c2e1d2] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52490. Jun 04 22:01:48.461528 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-554028de-4a46-454f-96c8-0a21001b09e2 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "POST /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8/action" status: 202 len: 0 microversion: 2.1 time: 1.113926 Jun 04 22:01:48.462170 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3374/6648] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 22:01:47 2022] POST /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 22:01:48.470501 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:48.471108 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:48.478535 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:48.478999 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:48.479859 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:48.480322 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:48.636685 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:48.648894 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-909c6152-65c9-4fd2-b926-81b582de828a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1516 microversion: 2.1 time: 0.182066 Jun 04 22:01:48.649737 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3275/6649] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:48 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:49.225893 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-d5b4918d-72c5-428f-b2ec-c14d87a63804 req-e68ad881-190f-42e6-91c9-338fab2c863e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "name": "network-vif-unplugged", "status": "completed", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:01:49.235976 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d5b4918d-72c5-428f-b2ec-c14d87a63804 req-e68ad881-190f-42e6-91c9-338fab2c863e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:49.236428 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-d5b4918d-72c5-428f-b2ec-c14d87a63804 req-e68ad881-190f-42e6-91c9-338fab2c863e service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:49.248164 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.compute.server_external_events [req-d5b4918d-72c5-428f-b2ec-c14d87a63804 req-e68ad881-190f-42e6-91c9-338fab2c863e service nova] Unable to find a host for instance bbf4a611-a60f-431b-a5cc-bda172a976b8. Dropping event network-vif-unplugged {{(pid=137228) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 04 22:01:49.249086 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-d5b4918d-72c5-428f-b2ec-c14d87a63804 req-e68ad881-190f-42e6-91c9-338fab2c863e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027474 Jun 04 22:01:49.249688 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3375/6650] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 04 22:01:49.667185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:49.667828 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:49.675074 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:49.675390 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:49.676278 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:49.676727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:49.814214 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:49.822174 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-389609c7-6034-482a-9d8f-78c59db1c20f tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1516 microversion: 2.1 time: 0.158917 Jun 04 22:01:49.822734 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3276/6651] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:49 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:50.844180 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:50.845142 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:50.853980 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:50.854457 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:50.855247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:50.855748 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:51.001890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:51.010766 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-e91d2394-1aab-4467-8c6c-a6f2315fd4a7 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1516 microversion: 2.1 time: 0.173291 Jun 04 22:01:51.011357 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3376/6652] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:50 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:52.031670 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:52.032300 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:52.051674 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:52.052151 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:52.052995 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:52.053437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:52.196271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:52.204805 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a358a45d-d1b2-4d7e-9491-29433c311bc4 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1516 microversion: 2.1 time: 0.179296 Jun 04 22:01:52.205406 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3277/6653] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:52 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:53.222225 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:53.222858 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:53.230719 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:53.231193 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:53.232039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:53.232494 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:53.373046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:53.381207 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5cf9257d-946f-41b8-8776-5cbf2ada457e tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1518 microversion: 2.1 time: 0.162694 Jun 04 22:01:53.381804 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3377/6654] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:53 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:54.400394 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:54.401025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:54.409342 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:54.409803 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:54.411141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:54.411622 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:54.553997 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:54.566497 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-974614e0-2190-49ec-9929-349036bf6a67 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.170196 Jun 04 22:01:54.567271 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3278/6655] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:54 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:01:55.587071 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:55.587691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:55.595690 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:55.596126 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:55.596922 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:55.597401 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:55.739503 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:55.750490 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d17e2bd8-8a07-48ce-b980-e06659bd2775 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.167311 Jun 04 22:01:55.751260 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3378/6656] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:55 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:56.778408 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:56.779441 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:56.790437 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:56.790896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:56.791727 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:56.792165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:56.946508 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:56.954726 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-bde8204b-81c8-48ae-9840-3a5420154b18 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.183013 Jun 04 22:01:56.955349 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3279/6657] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:56 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:57.972191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:57.972863 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:57.980951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:57.981418 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:57.982203 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:57.982679 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:58.126026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:58.139339 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-387f186b-9d3f-49ae-a6a9-acf2134708b8 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.170455 Jun 04 22:01:58.140324 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3379/6658] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:57 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:01:59.162185 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:01:59.163166 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:01:59.171812 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:59.172270 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:59.173083 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:01:59.173530 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:01:59.318875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:01:59.329466 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-49a61aa2-968a-44a8-beb5-d7c2d24e2bb6 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.173819 Jun 04 22:01:59.330104 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3280/6659] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:01:59 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:02:00.352196 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:02:00.353070 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:02:00.364536 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:00.365299 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:00.366514 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:00.367423 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:00.513159 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:02:00.521940 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-5c6b4e57-9b9a-46b6-a1b4-a69b842adca1 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.176561 Jun 04 22:02:00.522508 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3380/6660] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:02:00 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:02:01.332788 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-988ebed3-d6e7-4aa6-90ea-c0ec7bc53cba req-c313df5e-66ba-4988-b7fc-6f36ab6867df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "name": "network-vif-plugged", "status": "completed", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:02:01.343245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-988ebed3-d6e7-4aa6-90ea-c0ec7bc53cba req-c313df5e-66ba-4988-b7fc-6f36ab6867df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:01.344616 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-988ebed3-d6e7-4aa6-90ea-c0ec7bc53cba req-c313df5e-66ba-4988-b7fc-6f36ab6867df service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:01.365498 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-988ebed3-d6e7-4aa6-90ea-c0ec7bc53cba req-c313df5e-66ba-4988-b7fc-6f36ab6867df service nova] Creating event network-vif-plugged:efe3861f-5086-4455-9a54-2e1701ef41a8 for instance bbf4a611-a60f-431b-a5cc-bda172a976b8 on nch2-master-1 Jun 04 22:02:01.375398 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-988ebed3-d6e7-4aa6-90ea-c0ec7bc53cba req-c313df5e-66ba-4988-b7fc-6f36ab6867df service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044558 Jun 04 22:02:01.375398 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3281/6661] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:02:01.540465 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:02:01.541144 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:02:01.548962 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:01.549551 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:01.550584 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:01.551060 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:01.696417 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:02:01.708170 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-d5e28b60-987b-4fcf-a03a-058ef4c48b04 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1574 microversion: 2.1 time: 0.171787 Jun 04 22:02:01.709032 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3381/6662] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:02:01 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:02:02.727706 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:02:02.728433 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:02:02.735290 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:02.735770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:02.736539 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:02:02.736974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:02:02.886719 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:02:02.895222 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-1b1cfc87-7ca5-4091-800a-be4efaed2e6c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1561 microversion: 2.1 time: 0.172685 Jun 04 22:02:02.895875 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3282/6663] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:02:02 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:02:27.395463 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:02:27.396144 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:03:27.128691 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=30 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:27.129569 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:27.134349 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:27.134870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:27.135192 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=30 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:27.136010 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:27.142906 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:27.143447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:27.145089 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:27.146039 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:27.177466 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 22:03:27.209675 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-878e70ca-e5d4-452b-9917-da8b7a0844a2 req-35b907ea-1883-41d7-a8a6-e05746e6ea5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:03:27.221422 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-878e70ca-e5d4-452b-9917-da8b7a0844a2 req-35b907ea-1883-41d7-a8a6-e05746e6ea5b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:27.222399 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-878e70ca-e5d4-452b-9917-da8b7a0844a2 req-35b907ea-1883-41d7-a8a6-e05746e6ea5b service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:27.237522 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-878e70ca-e5d4-452b-9917-da8b7a0844a2 req-35b907ea-1883-41d7-a8a6-e05746e6ea5b service nova] Creating event network-changed:efe3861f-5086-4455-9a54-2e1701ef41a8 for instance bbf4a611-a60f-431b-a5cc-bda172a976b8 on nch2-master-1 Jun 04 22:03:27.243202 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-878e70ca-e5d4-452b-9917-da8b7a0844a2 req-35b907ea-1883-41d7-a8a6-e05746e6ea5b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115425 Jun 04 22:03:27.244309 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3283/6664] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:03:27.272799 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-37b33425-25b9-4a70-af06-22fc1fe1a973 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "DELETE /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 204 len: 0 microversion: 2.1 time: 0.146732 Jun 04 22:03:27.273510 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3382/6665] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 22:03:27 2022] DELETE /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 22:03:27.283856 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:27.284926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:27.292625 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:27.293197 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:27.294167 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:27.294720 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:27.486498 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:27.494410 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-58885c27-3069-43b5-a1d7-bfb307fbd56c tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.215732 Jun 04 22:03:27.494994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3284/6666] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:27 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:03:28.512377 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:28.513271 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:28.521101 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:28.521556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:28.522372 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:28.522814 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:28.797683 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:28.807237 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-db1c0357-fa71-4af4-8006-730f8e45c62a tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1567 microversion: 2.1 time: 0.299160 Jun 04 22:03:28.807971 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3383/6667] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:28 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:29.259211 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-5ace1b08-022c-4734-a633-fe81aaeeeba7 req-8deb8233-74b7-47cd-a6cf-4b74f5b974da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf4a611-a60f-431b-a5cc-bda172a976b8", "name": "network-vif-deleted", "tag": "efe3861f-5086-4455-9a54-2e1701ef41a8"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:03:29.268832 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5ace1b08-022c-4734-a633-fe81aaeeeba7 req-8deb8233-74b7-47cd-a6cf-4b74f5b974da service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:29.269332 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-5ace1b08-022c-4734-a633-fe81aaeeeba7 req-8deb8233-74b7-47cd-a6cf-4b74f5b974da service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:29.282533 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-5ace1b08-022c-4734-a633-fe81aaeeeba7 req-8deb8233-74b7-47cd-a6cf-4b74f5b974da service nova] Creating event network-vif-deleted:efe3861f-5086-4455-9a54-2e1701ef41a8 for instance bbf4a611-a60f-431b-a5cc-bda172a976b8 on nch2-master-1 Jun 04 22:03:29.288075 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-5ace1b08-022c-4734-a633-fe81aaeeeba7 req-8deb8233-74b7-47cd-a6cf-4b74f5b974da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Jun 04 22:03:29.288715 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3285/6668] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:03:29.825775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:29.826421 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:29.835050 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:29.835788 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:29.836730 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:29.837191 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:29.874843 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:29.875317 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:29.875824 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lazy-loading 'fault' on Instance uuid bbf4a611-a60f-431b-a5cc-bda172a976b8 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 22:03:29.926265 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94e127dc47a477d848d7ff172109538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179af47cc6864305ab601ac5edd826ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:29.933477 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd040cef-78b7-42db-8076-e8c329ecb338 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 200 len: 1178 microversion: 2.1 time: 0.112051 Jun 04 22:03:29.934052 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3384/6669] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:29 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 1178 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:30.952456 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:30.953188 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] [instance: bbf4a611-a60f-431b-a5cc-bda172a976b8] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:30.959740 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:30.960186 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:30.960946 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:30.961378 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:30.974909 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] HTTP exception thrown: Instance bbf4a611-a60f-431b-a5cc-bda172a976b8 could not be found. Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Request method failure captured: Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 HTTP/1.1 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9SpSCnEHLCkowT0xX27Icrnzc4MTNBZ_dbhxfARaiTsZN5uD_EPMkNwuCQY7DpeJZI-NpKzro0n3rOAej-eboDNLqbAyuaIDIrFB8Jw9bns3Fz4xOcjICA-QcIlyzvd7oswA58YyjITuIxhnqsvTi9luuRMWKipmJ_6kaIez53CSIU Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 179af47cc6864305ab601ac5edd826ee Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestShelveInstance-247392491 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_179af47cc6864305ab601ac5edd826ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/179af47cc6864305ab601ac5edd826ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/179af47cc6864305ab601ac5edd826ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/179af47cc6864305ab601ac5edd826ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestShelveInstance-247392491 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 179af47cc6864305ab601ac5edd826ee Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestShelveInstance-247392491 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestShelveInstance-247392491-project Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: e94e127dc47a477d848d7ff172109538 Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestShelveInstance-247392491-project Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance bbf4a611-a60f-431b-a5cc-bda172a976b8 could not be found. Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': 'bbf4a611-a60f-431b-a5cc-bda172a976b8'} Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf4a611-a60f-431b-a5cc-bda172a976b8 could not be found. Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf4a611-a60f-431b-a5cc-bda172a976b8 could not be found. Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 22:03:30.976566 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf4a611-a60f-431b-a5cc-bda172a976b8 could not be found. Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Returning 404 to user: Instance bbf4a611-a60f-431b-a5cc-bda172a976b8 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-19c6cd93-517b-45c5-8d87-ef8cccd844a5 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8" status: 404 len: 111 microversion: 2.1 time: 0.031092 Jun 04 22:03:30.980933 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3286/6670] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:30 2022] GET /compute/v2.1/servers/bbf4a611-a60f-431b-a5cc-bda172a976b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 22:03:31.153189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-09aff10a-b2b8-4243-826d-6bbaa14bff87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] Calling method '.version_select at 0x7f2d00337af0>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:31.185014 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-09aff10a-b2b8-4243-826d-6bbaa14bff87 tempest-TestShelveInstance-247392491 tempest-TestShelveInstance-247392491-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1314478343" status: 202 len: 0 microversion: 2.1 time: 0.035714 Jun 04 22:03:31.185647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3385/6671] 10.222.0.18 () {58 vars in 1253 bytes} [Sat Jun 4 22:03:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1314478343 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 22:03:49.364655 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=8 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:49.366099 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=12 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:49.551279 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f16b14df-9b16-4166-84c0-d021cb6bbb92 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Action: 'create', calling method: .version_select at 0x7f2d016190d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1812429948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSdP3ufcN87dsLZkXdouhVCZbblyNTDxlueTHQ1yBnrVKngKiPVkIwHTE6MKsu8v3DePDyTSvQSZLfZf1OHDum+LHt2pQnnCq+ZfkSeknKYv3Ihl8IOvAM6SatOxZqU0w=="}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:03:49.566064 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f16b14df-9b16-4166-84c0-d021cb6bbb92 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Getting quotas for project 7eee26c390db416093331b3e47785088. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 22:03:49.571921 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-f16b14df-9b16-4166-84c0-d021cb6bbb92 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Getting quotas for user 71a2b3f1161b41f2b10b7367deeb7d5d and project 7eee26c390db416093331b3e47785088. Resources: {'key_pairs'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 22:03:49.604718 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f16b14df-9b16-4166-84c0-d021cb6bbb92 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.246093 Jun 04 22:03:49.610826 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3287/6672] 10.222.0.18 () {60 vars in 1158 bytes} [Sat Jun 4 22:03:49 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 22:03:50.676474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1712138748", "imageRef": "926a4015-c327-4be7-9086-5cce1a8e0ebf", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1812429948", "security_groups": [{"name": "tempest-secgroup-smoke-1626078905"}], "networks": [{"uuid": "5f8f0c40-66a8-4a88-bb7e-8dc7e88b7105"}]}} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:03:50.685102 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:50.685787 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:03:50.787871 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.network.neutron [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] validate_networks() for [('5f8f0c40-66a8-4a88-bb7e-8dc7e88b7105', None, None, None, None, None)] {{(pid=137228) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 22:03:51.187775 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Flavor limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 22:03:51.188467 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Image limits 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 22:03:51.188989 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Flavor pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 22:03:51.189463 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Image pref 0:0:0 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 22:03:51.189890 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.virt.hardware [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137228) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 22:03:51.199213 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:51.199734 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:51.200590 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:51.201046 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:51.222220 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Getting quotas for project 7eee26c390db416093331b3e47785088. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 22:03:51.227831 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.quota [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Getting quotas for user 71a2b3f1161b41f2b10b7367deeb7d5d and project 7eee26c390db416093331b3e47785088. Resources: {'instances', 'cores', 'ram'} {{(pid=137228) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 22:03:51.241879 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Going to run 1 instances... {{(pid=137228) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 22:03:51.244242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='926a4015-c327-4be7-9086-5cce1a8e0ebf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137228) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 22:03:51.294375 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-1812bbb0-5726-4a0c-8983-d9594a5a91d8 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.621793 Jun 04 22:03:51.300444 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3386/6673] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 22:03:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 22:03:51.306638 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b99f66d8-bf2d-4da2-bc2b-232511fbff50 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:51.307325 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b99f66d8-bf2d-4da2-bc2b-232511fbff50 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:51.368548 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b99f66d8-bf2d-4da2-bc2b-232511fbff50 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:51.376844 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b99f66d8-bf2d-4da2-bc2b-232511fbff50 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1249 microversion: 2.1 time: 0.074864 Jun 04 22:03:51.377495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3288/6674] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:51 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:52.395935 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:52.397820 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:52.405464 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:52.406064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:52.407499 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:52.408176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:52.506709 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:52.522772 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-77944349-b03f-47d8-a52d-fd94faa79f04 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1301 microversion: 2.1 time: 0.131772 Jun 04 22:03:52.534224 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3387/6675] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:52 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1301 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:03:53.540415 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:53.541652 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:53.550769 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:53.551428 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:53.552271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:53.552697 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:53.717440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:53.726344 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-98783075-068e-4e8f-8380-156052a33211 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1375 microversion: 2.1 time: 0.189970 Jun 04 22:03:53.726950 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3289/6676] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:53 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:54.391742 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-47d81207-8360-4a7c-9b94-e0a273b49f3a req-be667448-141c-4bc9-9bc7-d9ccedbe4c68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:03:54.413894 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-47d81207-8360-4a7c-9b94-e0a273b49f3a req-be667448-141c-4bc9-9bc7-d9ccedbe4c68 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:54.419891 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-47d81207-8360-4a7c-9b94-e0a273b49f3a req-be667448-141c-4bc9-9bc7-d9ccedbe4c68 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:54.448732 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-47d81207-8360-4a7c-9b94-e0a273b49f3a req-be667448-141c-4bc9-9bc7-d9ccedbe4c68 service nova] Creating event network-changed:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:03:54.454986 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-47d81207-8360-4a7c-9b94-e0a273b49f3a req-be667448-141c-4bc9-9bc7-d9ccedbe4c68 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070048 Jun 04 22:03:54.455868 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3388/6677] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:03:54.745418 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:54.746357 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:54.756471 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:54.757347 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:54.759252 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:54.760088 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:54.916212 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:54.924932 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af88e7b5-8b5e-4c50-a059-3ac24ece873b tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1375 microversion: 2.1 time: 0.184495 Jun 04 22:03:54.925534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3290/6678] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:54 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:55.943481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:55.944929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:55.954557 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:55.955255 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:55.956184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:55.956833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:56.098947 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:56.107035 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7f4debdc-b9d6-4d9b-9915-f773235b7b81 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1375 microversion: 2.1 time: 0.167993 Jun 04 22:03:56.107634 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3389/6679] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:55 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:57.124974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:57.125713 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:57.133220 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:57.133677 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:57.134440 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:57.134879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:57.288409 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:57.299102 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-941d3e97-5a1e-4c99-aec1-cc18e834c850 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1375 microversion: 2.1 time: 0.178205 Jun 04 22:03:57.299717 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3291/6680] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:57 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:03:57.940054 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c548f9cf-de15-4900-81d1-327f7fd427bd req-52f5aa85-3886-4040-9521-ce1d216f88a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "name": "network-vif-plugged", "status": "completed", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:03:57.948641 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c548f9cf-de15-4900-81d1-327f7fd427bd req-52f5aa85-3886-4040-9521-ce1d216f88a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:57.949103 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c548f9cf-de15-4900-81d1-327f7fd427bd req-52f5aa85-3886-4040-9521-ce1d216f88a4 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:57.960453 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c548f9cf-de15-4900-81d1-327f7fd427bd req-52f5aa85-3886-4040-9521-ce1d216f88a4 service nova] Creating event network-vif-plugged:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:03:57.965597 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c548f9cf-de15-4900-81d1-327f7fd427bd req-52f5aa85-3886-4040-9521-ce1d216f88a4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100609 Jun 04 22:03:57.966217 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3390/6681] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:03:58.317201 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:58.317863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:58.325383 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:58.325838 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:58.326612 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:58.327054 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:58.470816 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:58.479221 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-ef1683c8-09d4-4982-94fa-754c22045316 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1375 microversion: 2.1 time: 0.166666 Jun 04 22:03:58.479824 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3292/6682] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:58 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:59.504842 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:59.505556 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:59.512576 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:59.513091 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:59.513870 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:59.514326 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:59.658430 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:59.666570 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-62348cff-49a5-4a9c-bb47-bc4412efcaf7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1560 microversion: 2.1 time: 0.167593 Jun 04 22:03:59.667173 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3391/6683] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:59 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:03:59.684977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:03:59.685596 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:03:59.693445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:59.693900 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:59.694699 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:03:59.695146 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:03:59.836033 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:03:59.848555 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5463edec-323d-4147-9585-a60bcef6a953 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1560 microversion: 2.1 time: 0.167310 Jun 04 22:03:59.849208 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3293/6684] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:03:59 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:04:01.641169 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-a8508ef4-bc1a-4d99-8860-36ce821aa26d req-abd51be9-9537-4031-ab4a-719d7a4b1323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:04:01.646186 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:01.646881 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=6 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:04:01.653290 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a8508ef4-bc1a-4d99-8860-36ce821aa26d req-abd51be9-9537-4031-ab4a-719d7a4b1323 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:04:01.653743 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-a8508ef4-bc1a-4d99-8860-36ce821aa26d req-abd51be9-9537-4031-ab4a-719d7a4b1323 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:04:01.667017 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-a8508ef4-bc1a-4d99-8860-36ce821aa26d req-abd51be9-9537-4031-ab4a-719d7a4b1323 service nova] Creating event network-changed:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:04:01.672835 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-a8508ef4-bc1a-4d99-8860-36ce821aa26d req-abd51be9-9537-4031-ab4a-719d7a4b1323 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034981 Jun 04 22:04:01.673452 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3392/6685] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:04:10.905932 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:04:10.906907 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:05:56.807086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:05:56.808029 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:05:56.808681 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=30 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:05:56.813065 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-632154669"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:05:56.814171 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:05:56.823773 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:05:56.824271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:05:56.825195 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:05:56.825633 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:05:57.130948 ncdv-master-1 devstack@n-api.service[137229]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [98ee279c-48c9-4d3e-870a-0660b7e8e40b] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 22:05:58.142516 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [98ee279c-48c9-4d3e-870a-0660b7e8e40b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52926. Jun 04 22:05:58.154787 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9e888285-489d-4596-882f-33f2ea9b9f80 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "POST /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490/action" status: 202 len: 0 microversion: 2.1 time: 1.349536 Jun 04 22:05:58.155534 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3294/6686] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 22:05:56 2022] POST /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490/action => generated 0 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 22:06:04.538802 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861201d-8b7d-4db4-b81d-9fdaf6c45049] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 22:06:04.541018 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [-] [255e1688-6b14-4faa-b370-fdeec054c97b] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 04 22:06:04.542197 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:04.543486 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=26 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:04.549189 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "name": "network-vif-plugged", "status": "completed", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:06:04.562215 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:04.562833 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:04.576627 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] Creating event network-vif-plugged:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:06:04.581720 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] [d3b34972-39b5-47dd-8677-4d0b839bbfcd] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 22:06:05.554246 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861201d-8b7d-4db4-b81d-9fdaf6c45049] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52996. Jun 04 22:06:05.564688 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] [255e1688-6b14-4faa-b370-fdeec054c97b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 52998. Jun 04 22:06:05.593350 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] [d3b34972-39b5-47dd-8677-4d0b839bbfcd] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53000. Jun 04 22:06:05.597231 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-10aeca00-1527-4584-8736-22d19eb771a5 req-8f2ff149-2875-415e-a77b-d60580199892 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.061309 Jun 04 22:06:05.598644 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3393/6687] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:06:11.751770 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:11.752647 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:11.761129 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1268484295", "imageRef": "84209748-a0c9-4dfa-9c07-b4d89d819310", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1812429948", "security_groups": [{"name": "tempest-secgroup-smoke-1626078905"}], "networks": [{"uuid": "5f8f0c40-66a8-4a88-bb7e-8dc7e88b7105"}]}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:06:11.880829 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.network.neutron [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] validate_networks() for [('5f8f0c40-66a8-4a88-bb7e-8dc7e88b7105', None, None, None, None, None)] {{(pid=137229) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 04 22:06:12.362021 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Flavor limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 04 22:06:12.363184 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Image limits 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 04 22:06:12.363716 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Flavor pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 04 22:06:12.364135 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Image pref 0:0:0 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 04 22:06:12.364552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.virt.hardware [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 04 22:06:12.377120 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:12.377572 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:12.378445 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:12.378974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:12.397949 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Getting quotas for project 7eee26c390db416093331b3e47785088. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 04 22:06:12.403275 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.quota [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Getting quotas for user 71a2b3f1161b41f2b10b7367deeb7d5d and project 7eee26c390db416093331b3e47785088. Resources: {'instances', 'cores', 'ram'} {{(pid=137229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 04 22:06:12.415771 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Going to run 1 instances... {{(pid=137229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 04 22:06:12.418289 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84209748-a0c9-4dfa-9c07-b4d89d819310',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 04 22:06:12.472825 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-fdcc725c-ab84-4552-9b54-fc270a368229 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.723790 Jun 04 22:06:12.473459 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3295/6688] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Jun 4 22:06:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 04 22:06:12.485758 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9220e92b-11ff-4cdf-8409-443db3626d85 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:12.486578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9220e92b-11ff-4cdf-8409-443db3626d85 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:12.544226 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9220e92b-11ff-4cdf-8409-443db3626d85 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:12.552146 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9220e92b-11ff-4cdf-8409-443db3626d85 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1249 microversion: 2.1 time: 0.071553 Jun 04 22:06:12.552716 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3394/6689] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:12 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:06:13.571545 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:13.572237 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:13.580708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:13.581154 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:13.581930 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:13.582359 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:13.659694 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:13.670372 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9408d80e-caec-4da0-b626-6000be6507e4 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1309 microversion: 2.1 time: 0.104105 Jun 04 22:06:13.671293 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3296/6690] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:13 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:14.604247 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-280e4c23-ee46-4df1-9d3a-54c58abf3a97 req-aea39d2f-3286-41e5-b709-171ccf0032c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "name": "network-vif-unplugged", "status": "completed", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:06:14.608882 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:14.616324 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-280e4c23-ee46-4df1-9d3a-54c58abf3a97 req-aea39d2f-3286-41e5-b709-171ccf0032c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:14.616795 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-280e4c23-ee46-4df1-9d3a-54c58abf3a97 req-aea39d2f-3286-41e5-b709-171ccf0032c6 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:14.676965 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-280e4c23-ee46-4df1-9d3a-54c58abf3a97 req-aea39d2f-3286-41e5-b709-171ccf0032c6 service nova] Creating event network-vif-unplugged:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:06:14.689932 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:14.690584 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:14.691595 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-280e4c23-ee46-4df1-9d3a-54c58abf3a97 req-aea39d2f-3286-41e5-b709-171ccf0032c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088236 Jun 04 22:06:14.692825 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3395/6691] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:06:14.703789 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:14.704249 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:14.705067 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:14.705550 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:14.957245 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:14.968257 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-498a9a6b-27b9-42d5-a5ae-3912cbc6c1d5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.283237 Jun 04 22:06:14.969352 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3297/6692] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:14 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:15.987496 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:15.988435 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:15.996445 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:15.997553 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:15.998478 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:15.998933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:16.147832 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:16.156753 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7b9253eb-976b-4c92-9403-3746e42ebd77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.173552 Jun 04 22:06:16.157342 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3396/6693] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:15 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:17.175020 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:17.176307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:17.183880 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:17.184384 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:17.185148 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:17.185586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:17.338049 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:17.346873 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-952009a8-ed7a-4a81-b15f-2d9681945924 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.175803 Jun 04 22:06:17.347994 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3298/6694] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:17 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:18.368967 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:18.369578 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:18.377218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:18.377859 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:18.378510 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:18.378965 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:18.535783 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:18.543690 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-30d31cfd-24a0-45fe-96d8-7c079b7752b5 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.178970 Jun 04 22:06:18.544260 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3397/6695] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:18 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:19.561557 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:19.562926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:19.570348 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:19.570879 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:19.571808 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:19.572319 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:19.746671 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:19.757945 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-9ae0b826-337b-4517-ad98-90b7155ec10e tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.200382 Jun 04 22:06:19.758755 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3299/6696] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:19 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:20.774819 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:20.775474 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:20.783587 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:20.784098 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:20.785005 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:20.785447 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:20.931633 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:20.941745 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9a5e50ca-7438-45c8-9181-7b497dc415dc tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.170933 Jun 04 22:06:20.942647 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3398/6697] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:20 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:21.958938 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:21.959718 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:21.967063 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:21.967552 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:21.968431 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:21.968957 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:22.128096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:22.136235 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-a57e6735-e6cb-49a2-9e6b-71d872f62fff tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.181180 Jun 04 22:06:22.136835 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3300/6698] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:21 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:23.154780 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:23.156184 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:23.159991 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell0:SELECT=2 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:23.167064 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:23.167655 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:23.168695 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:23.169210 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:23.367867 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:23.376943 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-498aa433-544f-4886-ae12-d3aee15caf91 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.226243 Jun 04 22:06:23.378257 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3399/6699] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:23 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:23.448745 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:23.449911 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell0:SELECT=6 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:23.521698 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-b00451e4-2fab-4d3f-905b-503ca42599d2 req-042e70e4-4ffc-4452-9643-1f090d225c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476f610b-107a-4576-8c7e-d74539a62a77", "tag": "8bdc0303-b0d0-41f3-af0a-c398a5e59ebb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:06:23.531818 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b00451e4-2fab-4d3f-905b-503ca42599d2 req-042e70e4-4ffc-4452-9643-1f090d225c5d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:23.532265 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-b00451e4-2fab-4d3f-905b-503ca42599d2 req-042e70e4-4ffc-4452-9643-1f090d225c5d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:23.545689 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-b00451e4-2fab-4d3f-905b-503ca42599d2 req-042e70e4-4ffc-4452-9643-1f090d225c5d service nova] Creating event network-changed:8bdc0303-b0d0-41f3-af0a-c398a5e59ebb for instance 476f610b-107a-4576-8c7e-d74539a62a77 on nch1-master-1 Jun 04 22:06:23.551772 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-b00451e4-2fab-4d3f-905b-503ca42599d2 req-042e70e4-4ffc-4452-9643-1f090d225c5d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108917 Jun 04 22:06:23.552377 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3301/6700] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:06:24.398704 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:24.399336 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:24.408770 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:24.409270 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:24.410059 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:24.410518 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:24.545929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:24.553896 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-dd439280-d650-4079-bfb5-1c7793c0d5e2 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.161610 Jun 04 22:06:24.554471 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3400/6701] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:24 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:25.572183 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:25.573654 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:25.582935 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:25.583488 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:25.584358 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:25.585005 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:25.628035 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:06:25.628519 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:06:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 (ip 10.222.0.18) !!! Jun 04 22:06:25.808748 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:25.817191 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-205ac572-788f-4bd2-813d-646f81b41430 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.249510 Jun 04 22:06:25.817797 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3302/6702] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:25 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:26.837869 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:26.838481 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:26.847363 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:26.847866 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:26.848650 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:26.849130 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:27.002232 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:27.010540 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-ce4251e5-111a-46e8-b47d-f2c25a23074a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.179430 Jun 04 22:06:27.011101 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3401/6703] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:26 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:28.031119 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:28.031974 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:28.039544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:28.040025 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:28.040806 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:28.041215 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:28.185242 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:28.193563 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-5097bf8f-8aae-45a6-a5e3-18081d0d53fa tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.168645 Jun 04 22:06:28.194144 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3303/6704] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:28 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:29.214951 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:29.216208 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:29.229335 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:29.230114 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:29.231406 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:29.232242 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:29.373885 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:29.383163 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-17be94b3-c2a9-48a0-84ac-98f268a7eeea tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.174550 Jun 04 22:06:29.384061 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3402/6705] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:29 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:30.360002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-07db5135-c2c4-46d5-baa1-38f9880f0719 req-60bf0c64-c6f1-41cb-8538-fa0d694f88e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476f610b-107a-4576-8c7e-d74539a62a77", "name": "network-vif-plugged", "status": "completed", "tag": "8bdc0303-b0d0-41f3-af0a-c398a5e59ebb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:06:30.369454 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-07db5135-c2c4-46d5-baa1-38f9880f0719 req-60bf0c64-c6f1-41cb-8538-fa0d694f88e1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:30.369914 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-07db5135-c2c4-46d5-baa1-38f9880f0719 req-60bf0c64-c6f1-41cb-8538-fa0d694f88e1 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:30.383319 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-07db5135-c2c4-46d5-baa1-38f9880f0719 req-60bf0c64-c6f1-41cb-8538-fa0d694f88e1 service nova] Creating event network-vif-plugged:8bdc0303-b0d0-41f3-af0a-c398a5e59ebb for instance 476f610b-107a-4576-8c7e-d74539a62a77 on nch1-master-1 Jun 04 22:06:30.388634 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-07db5135-c2c4-46d5-baa1-38f9880f0719 req-60bf0c64-c6f1-41cb-8538-fa0d694f88e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032416 Jun 04 22:06:30.389452 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3304/6706] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:06:30.401399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:30.403136 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:30.410489 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:30.410957 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:30.411797 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:30.412411 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:30.597598 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:30.605678 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-426aaae9-c1ef-4492-902c-ab79cd10428a tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.208223 Jun 04 22:06:30.606275 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3403/6707] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:30 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:31.629235 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:31.630251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:31.641238 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:31.641690 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:31.642466 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:31.642904 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:31.784977 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:31.792909 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-af5c716f-e8f9-4d4a-bccd-c9f9548fd662 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1375 microversion: 2.1 time: 0.172472 Jun 04 22:06:31.793640 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3305/6708] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:31 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:32.813451 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:32.814067 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:32.821588 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:32.822055 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:32.822847 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:32.823287 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:32.960828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:32.968649 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-7a5adf8c-21d9-4bde-9a18-c9780afc31b3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1561 microversion: 2.1 time: 0.161116 Jun 04 22:06:32.969220 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3404/6709] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:32 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:32.986632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:06:32.987345 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:06:32.994701 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:32.995160 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:32.995986 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:32.996460 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:33.137126 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:06:33.145942 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-b25fb55f-19df-4047-b199-6f57ea948ec1 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1561 microversion: 2.1 time: 0.164178 Jun 04 22:06:33.146555 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3306/6710] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:06:32 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:06:35.166100 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-dc3e5991-4d23-4fc7-aff5-da3f84895f7d req-075cce03-fe27-44d7-a813-540befb2f07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476f610b-107a-4576-8c7e-d74539a62a77", "tag": "8bdc0303-b0d0-41f3-af0a-c398a5e59ebb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:06:35.172381 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=27 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:06:35.176887 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dc3e5991-4d23-4fc7-aff5-da3f84895f7d req-075cce03-fe27-44d7-a813-540befb2f07d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:06:35.177422 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-dc3e5991-4d23-4fc7-aff5-da3f84895f7d req-075cce03-fe27-44d7-a813-540befb2f07d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:06:35.189942 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-dc3e5991-4d23-4fc7-aff5-da3f84895f7d req-075cce03-fe27-44d7-a813-540befb2f07d service nova] Creating event network-changed:8bdc0303-b0d0-41f3-af0a-c398a5e59ebb for instance 476f610b-107a-4576-8c7e-d74539a62a77 on nch1-master-1 Jun 04 22:06:35.195312 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-dc3e5991-4d23-4fc7-aff5-da3f84895f7d req-075cce03-fe27-44d7-a813-540befb2f07d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Jun 04 22:06:35.196018 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3405/6711] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:08:01.997664 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:01.999141 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=60 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:02.007877 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-109865507"}} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:08:02.009848 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:02.019657 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:02.020181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:02.021323 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:02.021759 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:02.323501 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-f80ce8d8-b9b5-4830-a1ec-7d42bf88ca38 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "POST /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77/action" status: 202 len: 0 microversion: 2.1 time: 0.329301 Jun 04 22:08:02.324172 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3307/6712] 10.222.0.18 () {60 vars in 1277 bytes} [Sat Jun 4 22:08:01 2022] POST /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 04 22:08:06.863365 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861201d-8b7d-4db4-b81d-9fdaf6c45049] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 04 22:08:06.864760 ncdv-master-1 devstack@n-api.service[137228]: ERROR oslo.messaging._drivers.impl_rabbit [-] [255e1688-6b14-4faa-b370-fdeec054c97b] AMQP server on 10.222.0.18:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 04 22:08:06.865315 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_cell1:SELECT=58 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:06.866115 ncdv-master-1 devstack@n-api.service[137228]: DEBUG dbcounter [-] [137228] Writing DB stats nova_api:SELECT=1 {{(pid=137228) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:06.875399 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-c09cabdd-895c-4e48-b3bc-cb5434fc496c req-d58c86b9-49c6-4915-b564-c1fee6056e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476f610b-107a-4576-8c7e-d74539a62a77", "name": "network-vif-plugged", "status": "completed", "tag": "8bdc0303-b0d0-41f3-af0a-c398a5e59ebb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:08:06.885671 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c09cabdd-895c-4e48-b3bc-cb5434fc496c req-d58c86b9-49c6-4915-b564-c1fee6056e3f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:06.886493 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-c09cabdd-895c-4e48-b3bc-cb5434fc496c req-d58c86b9-49c6-4915-b564-c1fee6056e3f service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:06.900236 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-c09cabdd-895c-4e48-b3bc-cb5434fc496c req-d58c86b9-49c6-4915-b564-c1fee6056e3f service nova] Creating event network-vif-plugged:8bdc0303-b0d0-41f3-af0a-c398a5e59ebb for instance 476f610b-107a-4576-8c7e-d74539a62a77 on nch1-master-1 Jun 04 22:08:06.908006 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-c09cabdd-895c-4e48-b3bc-cb5434fc496c req-d58c86b9-49c6-4915-b564-c1fee6056e3f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046719 Jun 04 22:08:06.908684 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3406/6713] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:08:16.035809 ncdv-master-1 devstack@n-api.service[137229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4998025-16b0-4090-ba00-1f2f20c5992b] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 22:08:16.038469 ncdv-master-1 devstack@n-api.service[137229]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e48c024-80e8-429d-8426-5feec1088ced] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 04 22:08:16.039066 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_api:SELECT=2 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:16.040023 ncdv-master-1 devstack@n-api.service[137229]: DEBUG dbcounter [-] [137229] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 22:08:16.042257 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [req-1db45396-c3b9-4d5f-bec6-925e086679ca req-5921a255-9a12-4d75-af0a-531d810a8d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476f610b-107a-4576-8c7e-d74539a62a77", "tag": "8bdc0303-b0d0-41f3-af0a-c398a5e59ebb"}]} {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:08:16.044738 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:16.045339 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:16.054221 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1db45396-c3b9-4d5f-bec6-925e086679ca req-5921a255-9a12-4d75-af0a-531d810a8d7d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:16.054755 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [req-1db45396-c3b9-4d5f-bec6-925e086679ca req-5921a255-9a12-4d75-af0a-531d810a8d7d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:16.056040 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:16.056495 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:16.057271 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:16.057708 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:16.068094 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.compute.server_external_events [req-1db45396-c3b9-4d5f-bec6-925e086679ca req-5921a255-9a12-4d75-af0a-531d810a8d7d service nova] Creating event network-changed:8bdc0303-b0d0-41f3-af0a-c398a5e59ebb for instance 476f610b-107a-4576-8c7e-d74539a62a77 on nch1-master-1 Jun 04 22:08:16.073407 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [req-1db45396-c3b9-4d5f-bec6-925e086679ca req-5921a255-9a12-4d75-af0a-531d810a8d7d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035495 Jun 04 22:08:16.074462 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3407/6714] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:08:16.091073 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Going to try to terminate instance {{(pid=137229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 22:08:16.186145 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e8343fa0-5b92-4c9c-9638-6f14b74f8e16 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 204 len: 0 microversion: 2.1 time: 0.151693 Jun 04 22:08:16.187071 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3308/6715] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 22:08:16 2022] DELETE /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 22:08:16.197188 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:16.198343 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:16.206667 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:16.207482 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:16.209146 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:16.209813 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:16.217380 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] [255e1688-6b14-4faa-b370-fdeec054c97b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53390. Jun 04 22:08:16.218925 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861201d-8b7d-4db4-b81d-9fdaf6c45049] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53388. Jun 04 22:08:16.385564 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:08:16.394476 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6cdce220-ad58-4b79-9405-62c93b123eec tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1685 microversion: 2.1 time: 0.202395 Jun 04 22:08:16.395072 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3408/6716] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:16 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1685 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 04 22:08:17.415044 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:17.415793 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:17.425875 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:17.426307 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:17.427096 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:17.427544 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:17.432400 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4998025-16b0-4090-ba00-1f2f20c5992b] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53396. Jun 04 22:08:17.435545 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e48c024-80e8-429d-8426-5feec1088ced] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 53398. Jun 04 22:08:17.571796 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:08:17.579823 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-e43c397f-7758-4de1-9a19-c0faef12f839 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1685 microversion: 2.1 time: 0.169856 Jun 04 22:08:17.580409 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3309/6717] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:17 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:08:18.598828 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:18.599729 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:18.607086 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:18.607640 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:18.608385 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:18.608848 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:18.638202 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-bb4cc746-fa48-4f0a-92e9-267063709a6b req-896a445a-8fae-4bc3-b661-8f406cc20527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476f610b-107a-4576-8c7e-d74539a62a77", "name": "network-vif-deleted", "tag": "8bdc0303-b0d0-41f3-af0a-c398a5e59ebb"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:08:18.648632 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bb4cc746-fa48-4f0a-92e9-267063709a6b req-896a445a-8fae-4bc3-b661-8f406cc20527 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:18.649086 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-bb4cc746-fa48-4f0a-92e9-267063709a6b req-896a445a-8fae-4bc3-b661-8f406cc20527 service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:18.661704 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-bb4cc746-fa48-4f0a-92e9-267063709a6b req-896a445a-8fae-4bc3-b661-8f406cc20527 service nova] Creating event network-vif-deleted:8bdc0303-b0d0-41f3-af0a-c398a5e59ebb for instance 476f610b-107a-4576-8c7e-d74539a62a77 on nch1-master-1 Jun 04 22:08:18.667434 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-bb4cc746-fa48-4f0a-92e9-267063709a6b req-896a445a-8fae-4bc3-b661-8f406cc20527 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033025 Jun 04 22:08:18.672495 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3310/6718] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:08:18.979079 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:08:18.987553 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-bf7c19ca-100f-4010-ae77-e7b27b6120a6 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 200 len: 1499 microversion: 2.1 time: 0.392844 Jun 04 22:08:18.988520 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3409/6719] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:18 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 1499 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:08:20.010504 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:20.011705 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 476f610b-107a-4576-8c7e-d74539a62a77] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:20.022554 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:20.023002 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:20.023810 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:20.024251 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:20.038192 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] HTTP exception thrown: Instance 476f610b-107a-4576-8c7e-d74539a62a77 could not be found. Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Request method failure captured: Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 HTTP/1.1 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9a_JVureonYpfm1PqTif4VzXfe4kzEwkhZsksGb5dCQGtXV0DIw-GMV1e0NRphB6AKmW9KIZwhq7Ppfikg4SDSMppdJb-_Srzu_bWfMxJ8b_tSmnFSg7gP0LD0ESD5jdAoSdfXdcer7Xzw7gtFxy5CfcD8l0b-HXKIR0gqkhcViH1s Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 7eee26c390db416093331b3e47785088 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestSnapshotPattern-2061188378 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7eee26c390db416093331b3e47785088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7eee26c390db416093331b3e47785088"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7eee26c390db416093331b3e47785088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7eee26c390db416093331b3e47785088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestSnapshotPattern-2061188378 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 7eee26c390db416093331b3e47785088 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestSnapshotPattern-2061188378 Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestSnapshotPattern-2061188378-project Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 71a2b3f1161b41f2b10b7367deeb7d5d Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestSnapshotPattern-2061188378-project Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 476f610b-107a-4576-8c7e-d74539a62a77 could not be found. Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '476f610b-107a-4576-8c7e-d74539a62a77'} Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 476f610b-107a-4576-8c7e-d74539a62a77 could not be found. Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 476f610b-107a-4576-8c7e-d74539a62a77 could not be found. Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 22:08:20.039896 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 476f610b-107a-4576-8c7e-d74539a62a77 could not be found. Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Returning 404 to user: Instance 476f610b-107a-4576-8c7e-d74539a62a77 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4b3cfbdb-7af3-4c66-a488-63e627fb0994 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77" status: 404 len: 111 microversion: 2.1 time: 0.039342 Jun 04 22:08:20.044658 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3311/6720] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:20 2022] GET /compute/v2.1/servers/476f610b-107a-4576-8c7e-d74539a62a77 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 22:08:21.714026 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:21.715176 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:21.717436 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-e338eb5a-5b89-4254-a8fc-443e7cb81b8f req-ddfdd900-5ea5-4b33-bd51-1a679272b06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:08:21.724218 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:21.726051 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:21.727041 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:21.727917 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:21.731145 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e338eb5a-5b89-4254-a8fc-443e7cb81b8f req-ddfdd900-5ea5-4b33-bd51-1a679272b06d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:21.731741 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-e338eb5a-5b89-4254-a8fc-443e7cb81b8f req-ddfdd900-5ea5-4b33-bd51-1a679272b06d service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:21.745676 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-e338eb5a-5b89-4254-a8fc-443e7cb81b8f req-ddfdd900-5ea5-4b33-bd51-1a679272b06d service nova] Creating event network-changed:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:08:21.751692 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-e338eb5a-5b89-4254-a8fc-443e7cb81b8f req-ddfdd900-5ea5-4b33-bd51-1a679272b06d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037978 Jun 04 22:08:21.752957 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3312/6721] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 04 22:08:21.761915 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Going to try to terminate instance {{(pid=137228) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 04 22:08:21.866671 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-6b1b356b-7509-4934-bfc0-a558fe98f965 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 204 len: 0 microversion: 2.1 time: 0.157263 Jun 04 22:08:21.867975 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3410/6722] 10.222.0.18 () {58 vars in 1238 bytes} [Sat Jun 4 22:08:21 2022] DELETE /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 04 22:08:21.876863 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:21.877586 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:21.885181 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:21.885945 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:21.886724 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:21.887320 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:22.029369 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.policy [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:08:22.037304 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-4e4bb424-9fd4-42ec-bbba-46ae72e165d3 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1685 microversion: 2.1 time: 0.164742 Jun 04 22:08:22.037923 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3313/6723] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:21 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:08:23.060854 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:23.062048 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:23.072662 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:23.073133 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:23.073929 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:23.074386 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:23.218365 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:08:23.226514 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-f70d80a2-d6e5-4c4a-b936-79bb8c439e3d tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1685 microversion: 2.1 time: 0.173171 Jun 04 22:08:23.227062 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3411/6724] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:23 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:08:23.921121 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [req-8a74c8d1-6dad-4c69-bd1d-28be80a71b03 req-53a1b6a5-f15f-49a6-aa26-32c4c98d84ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f763d2a-a2f1-406e-a3d3-2d7be5c91490", "name": "network-vif-deleted", "tag": "2f5fecac-4e04-4c35-9127-5cdc2d7dfe45"}]} {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 04 22:08:23.932637 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8a74c8d1-6dad-4c69-bd1d-28be80a71b03 req-53a1b6a5-f15f-49a6-aa26-32c4c98d84ea service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:23.933095 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [req-8a74c8d1-6dad-4c69-bd1d-28be80a71b03 req-53a1b6a5-f15f-49a6-aa26-32c4c98d84ea service nova] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:23.949178 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.compute.server_external_events [req-8a74c8d1-6dad-4c69-bd1d-28be80a71b03 req-53a1b6a5-f15f-49a6-aa26-32c4c98d84ea service nova] Creating event network-vif-deleted:2f5fecac-4e04-4c35-9127-5cdc2d7dfe45 for instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 on nch2-master-1 Jun 04 22:08:23.955411 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [req-8a74c8d1-6dad-4c69-bd1d-28be80a71b03 req-53a1b6a5-f15f-49a6-aa26-32c4c98d84ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038350 Jun 04 22:08:23.956048 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3314/6725] 10.222.0.18 () {64 vars in 1317 bytes} [Sat Jun 4 22:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 04 22:08:24.245629 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:24.246280 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.compute.api [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137228) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:24.254263 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:24.254747 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:24.255599 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:24.256080 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:24.299757 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:24.300207 ncdv-master-1 devstack@n-api.service[137228]: DEBUG oslo_concurrency.lockutils [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137228) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:24.300686 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.objects.instance [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lazy-loading 'fault' on Instance uuid 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 {{(pid=137228) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 04 22:08:24.347999 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.policy [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71a2b3f1161b41f2b10b7367deeb7d5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eee26c390db416093331b3e47785088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137228) authorize /opt/stack/nova/nova/policy.py:199}} Jun 04 22:08:24.357890 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-9dbbef5f-7d00-4494-b6d1-4374bf79db77 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 200 len: 1503 microversion: 2.1 time: 0.116658 Jun 04 22:08:24.358808 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3412/6726] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:24 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 1503 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 04 22:08:25.381909 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '>' {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:25.382653 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.compute.api [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] [instance: 6f763d2a-a2f1-406e-a3d3-2d7be5c91490] Fetching instance by UUID {{(pid=137229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 04 22:08:25.390477 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:25.390926 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:25.391732 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 04 22:08:25.392165 ncdv-master-1 devstack@n-api.service[137229]: DEBUG oslo_concurrency.lockutils [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Lock "72b7e698-4334-4986-b8f6-aecb1ad8743a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 04 22:08:25.408960 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.wsgi [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] HTTP exception thrown: Instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 could not be found. Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Request method failure captured: Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: request: GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 HTTP/1.1 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Accept: application/json Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Accept-Encoding: identity Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Connection: close Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Content-Length: 0 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Content-Type: application/json Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Host: 10.222.0.18 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: Openstack-System-Scope: None Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: User-Agent: python-urllib3/1.26.9 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Auth-Token: gAAAAABim9a_JVureonYpfm1PqTif4VzXfe4kzEwkhZsksGb5dCQGtXV0DIw-GMV1e0NRphB6AKmW9KIZwhq7Ppfikg4SDSMppdJb-_Srzu_bWfMxJ8b_tSmnFSg7gP0LD0ESD5jdAoSdfXdcer7Xzw7gtFxy5CfcD8l0b-HXKIR0gqkhcViH1s Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Id: None Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Domain-Name: None Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Identity-Status: Confirmed Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Is-Admin-Project: True Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Id: default Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Domain-Name: Default Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Id: 7eee26c390db416093331b3e47785088 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Project-Name: tempest-TestSnapshotPattern-2061188378 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Role: member,reader Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Roles: member,reader Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7eee26c390db416093331b3e47785088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7eee26c390db416093331b3e47785088"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7eee26c390db416093331b3e47785088"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7eee26c390db416093331b3e47785088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}] Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant: tempest-TestSnapshotPattern-2061188378 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Id: 7eee26c390db416093331b3e47785088 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-Tenant-Name: tempest-TestSnapshotPattern-2061188378 Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-User: tempest-TestSnapshotPattern-2061188378-project Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Id: default Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Domain-Name: Default Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Id: 71a2b3f1161b41f2b10b7367deeb7d5d Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: X-User-Name: tempest-TestSnapshotPattern-2061188378-project Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: method: > Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: exception: Instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 could not be found. Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: action_args: {'id': '6f763d2a-a2f1-406e-a3d3-2d7be5c91490'} Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: {{(pid=137229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 could not be found. Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 could not be found. Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 04 22:08:25.410605 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 could not be found. Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: ERROR nova.api.openstack.wsgi Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: DEBUG nova.api.openstack.wsgi [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Returning 404 to user: Instance 6f763d2a-a2f1-406e-a3d3-2d7be5c91490 could not be found. {{(pid=137229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: INFO nova.api.openstack.requestlog [None req-3dab5add-7eea-4d45-b4ed-663f9ace8873 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490" status: 404 len: 111 microversion: 2.1 time: 0.037344 Jun 04 22:08:25.415981 ncdv-master-1 devstack@n-api.service[137229]: [pid: 137229|app: 0|req: 3315/6727] 10.222.0.18 () {58 vars in 1235 bytes} [Sat Jun 4 22:08:25 2022] GET /compute/v2.1/servers/6f763d2a-a2f1-406e-a3d3-2d7be5c91490 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 04 22:08:25.580933 ncdv-master-1 devstack@n-api.service[137228]: DEBUG nova.api.openstack.wsgi [None req-a9425c80-45ab-4653-8ea5-17a880127bc7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] Calling method '.version_select at 0x7f2d0034bc10>' {{(pid=137228) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 04 22:08:25.605371 ncdv-master-1 devstack@n-api.service[137228]: INFO nova.api.openstack.requestlog [None req-a9425c80-45ab-4653-8ea5-17a880127bc7 tempest-TestSnapshotPattern-2061188378 tempest-TestSnapshotPattern-2061188378-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1812429948" status: 202 len: 0 microversion: 2.1 time: 0.028328 Jun 04 22:08:25.605976 ncdv-master-1 devstack@n-api.service[137228]: [pid: 137228|app: 0|req: 3413/6728] 10.222.0.18 () {58 vars in 1256 bytes} [Sat Jun 4 22:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1812429948 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 04 22:09:07.508294 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:09:07.509456 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:09:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:09:45.658786 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:09:45.659723 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:09:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:10:47.410437 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:10:47.410977 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:10:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:11:09.502684 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:11:09.503485 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:11:24.381451 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:11:24.381991 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:11:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:12:27.524143 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:12:27.524933 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:12:30.926240 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:12:30.927167 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:12:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:13:05.675868 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:13:05.675868 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:14:07.420900 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:14:07.421399 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:14:29.514983 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:14:29.515691 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:14:44.391377 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:14:44.391885 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:15:47.533502 ncdv-master-1 devstack@n-api.service[137228]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:15:47.534700 ncdv-master-1 devstack@n-api.service[137228]: Sat Jun 4 22:15:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:15:50.939675 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:15:50.940620 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 04 22:16:25.685700 ncdv-master-1 devstack@n-api.service[137229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 04 22:16:25.686427 ncdv-master-1 devstack@n-api.service[137229]: Sat Jun 4 22:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!